00000001:00080000:2.0F:1787397364.899701:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378729 is committed 00000100:00100000:1.0F:1787397364.900046:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83280:x1874218700857856:12345-0@lo:1000:osp_up1-0.0 Request processed in 14470us (16582us total) trans 81604378729 rc 0/0 00000100:00100000:1.0:1787397364.900074:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000004:00080000:2.0:1787397364.900279:0:83280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 81604378729 committed transno 81604378729 00000100:00100000:2.0:1787397364.900286:0:83280:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378729 gen 2 00000100:00100000:2.0:1787397364.900326:0:83280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:83280:1874218700857856:0@lo:1000:osp_up1-0.0 00000400:00080000:2.0:1787397364.927737:0:83695:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1787397364.83297 00010000:02000000:0.0F:1787397364.927809:0:83297:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:04, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:1.0:1787397364.943131:0:83297:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe4869fe10 00100000:10000000:1.0:1787397364.943148:0:83297:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1787397364.944108:0:83283:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x682:0x0] 00000100:00100000:0.0:1787397364.944153:0:83283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83283:1874218700857984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0F:1787397364.944196:0:83285:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x45c:0x0] 00000100:00100000:0.0:1787397364.944218:0:83283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397364.944230:0:83285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83285:1874218700858112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787397364.944287:0:83283:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0e40 going to sleep for 20 seconds 00000100:00100000:3.0:1787397364.944302:0:83285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397364.944333:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700857984 00000100:00100000:3.0:1787397364.944337:0:83285:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 20 seconds 00000100:00100000:1.0:1787397364.944341:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700857984 00000100:00100000:1.0:1787397364.944408:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858112 00000100:00100000:1.0:1787397364.944412:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858112 00000100:00100000:0.0:1787397364.944442:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:0.0:1787397364.944452:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:83283:x1874218700857984:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1787397364.944459:0:26160:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1787397364.944484:0:26160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -31 00002000:02000040:0.0:1787397364.944488:0:26160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1667 to 0x280000401:1697) 00000100:00100000:1.0:1787397364.944639:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:1.0:1787397364.944649:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:83285:x1874218700858112:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1787397364.944654:0:26162:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1787397364.944666:0:26162:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -581 00002000:02000040:1.0:1787397364.944669:0:26162:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1117 to 0x2c0000401:1697) 00002000:00010000:0.0:1787397364.950471:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.950487:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950504:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.950509:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.950516:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950573:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950584:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950592:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950639:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.950764:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.950769:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950779:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.950782:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.950785:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950794:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950802:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950809:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950830:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397364.950871:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.950877:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950885:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.950895:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.950899:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950909:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950916:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950923:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.950940:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397364.950947:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397364.950957:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.950967:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.950974:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.950984:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.950986:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397364.951002:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951012:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.951016:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.951024:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.951035:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.951037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d18f096 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951055:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.951063:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951090:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.951101:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.951102:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951109:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.951117:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.951121:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951121:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951123:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.951165:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045dbc88d/0x274786fe0d18f09d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951170:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951193:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.951207:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.951210:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.951213:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.951217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.951237:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.951283:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.951289:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951297:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.951300:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.951304:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951313:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951321:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951327:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951342:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397364.951379:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.951385:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951399:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.951402:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.951406:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951415:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951422:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951428:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951443:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787397364.951453:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397364.951458:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951464:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.951467:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951475:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951498:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951506:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d18f0ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951564:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.951566:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951571:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951583:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.951585:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951588:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951600:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d18f0a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951604:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951624:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951637:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.951644:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951647:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d18f0b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951660:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.951665:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951672:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.951673:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951676:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.951685:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.951696:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d18f0b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951723:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.951725:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.951728:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397364.951741:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.951748:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951757:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.951760:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.951764:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951775:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951783:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951790:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951815:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.951854:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.951860:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951867:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.951870:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.951874:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951894:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951902:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951909:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951926:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.951952:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.951959:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.951965:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.951967:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.951974:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951975:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.951993:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.951995:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952004:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.952012:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952016:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952029:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952030:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d18f0c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952051:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952059:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.952063:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952085:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.952087:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952097:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952102:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.952111:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952123:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952131:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d18f0c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.952172:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952178:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952186:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952189:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.952193:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952202:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952210:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952216:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952224:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397364.952259:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952264:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952277:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952280:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.952283:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952291:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952299:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952306:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952314:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787397364.952351:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952357:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952364:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952367:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.952371:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952379:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952400:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952407:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397364.952407:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952414:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952420:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397364.952426:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.952430:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952438:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952448:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952454:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d18f0ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.952467:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952474:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952476:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397364.952485:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952488:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.952491:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952500:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952507:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952514:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952560:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397364.952571:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952580:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.952583:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952591:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952602:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952608:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f0d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.952617:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.952621:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397364.952638:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952646:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.952648:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952667:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952670:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952680:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952683:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.952691:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.952695:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f0dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952697:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952718:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952721:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.952727:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952730:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952744:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.952747:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952749:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952771:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952772:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.952786:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952794:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f0e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.952814:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952820:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952821:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.952828:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952835:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.952838:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.952842:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952848:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.952856:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952857:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952874:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952888:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952889:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952911:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f0ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952912:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.952936:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.952939:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.952943:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952950:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.952954:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952973:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.952977:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.952985:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.952986:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953004:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.953005:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f0f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953011:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953021:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953026:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.953030:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953032:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953049:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953050:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.953054:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953069:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953076:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953084:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953088:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.953096:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f0f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953123:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.953126:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.953132:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.953134:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.953142:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953150:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.953152:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953156:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953165:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953172:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953178:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953187:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.953220:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.953224:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953237:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.953240:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953243:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953251:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953257:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953264:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953271:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397364.953307:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.953311:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953318:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.953320:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953324:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953332:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953351:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953358:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953367:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787397364.953406:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.953412:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953420:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.953423:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953427:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953439:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953448:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953457:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953474:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953477:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397364.953481:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397364.953495:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953505:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953513:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953550:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d18f0ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.953559:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.953567:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953568:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397364.953576:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953591:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.953593:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.953600:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953604:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953637:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953641:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.953651:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953663:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953670:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953677:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953707:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953723:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953739:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f10d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953741:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397364.953779:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397364.953785:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953793:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00002000:00010000:0.0:1787397364.953794:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.953797:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953802:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953807:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953812:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953832:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.953841:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953843:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f106 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953845:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.953860:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953863:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f114 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953896:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953927:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953930:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.953937:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953939:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.953952:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.953960:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.953960:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.953972:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.953979:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.953990:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954000:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f11b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954001:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.954010:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.954023:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954031:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.954042:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954043:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.954049:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.954052:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.954055:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.954067:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954068:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954068:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954110:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954114:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954129:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954141:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954156:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954159:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954172:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d18f129 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954178:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.954197:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.954198:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f122 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954206:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954223:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.954228:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.954231:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.954237:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.954243:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954245:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.954247:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954251:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.954269:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.954273:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954274:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.954283:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954297:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d18f130 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954302:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954313:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954330:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954339:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.954358:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.954395:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.954401:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954416:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.954419:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.954423:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954433:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954441:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954449:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954458:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.954484:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.954489:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.954499:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.954502:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.954506:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954508:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954545:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954549:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:0.0:1787397364.954557:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.954563:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954566:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954578:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954579:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18f137 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954611:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954620:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.954621:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954641:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954647:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397364.954659:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.954664:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954672:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.954678:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954679:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.954693:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.954713:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954728:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.954731:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.954735:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954736:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954737:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.954754:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954772:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954775:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954807:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954814:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954820:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954824:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bdfdab2/0x274786fe0d18f13e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954830:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18f145 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954849:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.954852:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.954855:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.954887:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.954935:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787397364.954935:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.954942:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954944:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954960:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.954963:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.954966:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.954969:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.954970:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.954976:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.954986:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.954987:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.954997:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.955014:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955017:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955036:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955054:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955058:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18f14c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955082:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.955083:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397364.955087:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955095:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.955099:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955108:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955120:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955128:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18f153 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.955130:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.955142:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955152:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.955156:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.955159:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.955163:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.955163:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.955170:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955181:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955189:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955196:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955216:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.955245:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.955251:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397364.955260:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.955271:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.955271:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955278:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955287:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.955291:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955292:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.955301:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955310:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955314:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955325:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18f15a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955331:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955348:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955358:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397364.955397:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397364.955403:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.955411:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.955414:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.955417:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955419:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.955428:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955431:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.955437:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955444:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955448:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955466:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955486:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955494:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.955497:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.955506:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18f161 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955544:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.955549:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787397364.955555:0:26160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1666 00010000:00010000:3.0:1787397364.955556:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.955560:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955569:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955579:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955586:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18f168 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.955598:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.955599:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.955608:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397364.955671:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:83283:x1874218700857984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11217us (11450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397364.955689:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00100000:3.0:1787397364.955719:0:83283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83283:1874218700857984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787397364.955736:0:83283:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6a1:0x0] from OST, last_created [0x280000401:0x6a1:0x0]last_used is [0x280000401:0x682:0x0] 00010000:00010000:0.0:1787397364.955748:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.955755:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.955767:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397364.955805:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397364.955814:0:83283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83283:1874218700858368:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787397364.955855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397364.955860:0:83283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397364.955887:0:83283:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88000 going to sleep for 20 seconds 00000100:00100000:0.0:1787397364.955905:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858240 00000100:00100000:0.0:1787397364.955913:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858240 00000100:00100000:3.0:1787397364.955919:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858368 00000100:00100000:3.0:1787397364.955924:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858368 00000100:00100000:0.0:1787397364.955962:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1787397364.955967:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908 00000100:00100000:0.0:1787397364.955978:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700858240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397364.955982:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:83283:x1874218700858368:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1787397364.955986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000000:0.0:1787397364.955988:0:19690:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:3.0:1787397364.955990:0:15073:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397364.956020:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00002000:00080000:3.0:1787397364.956028:0:15073:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1698 00000100:00100000:0.0:1787397364.956069:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700858240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397364.956078:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:2.0:1787397364.956555:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397364.958125:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:83283:x1874218700858368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2143us (2261us total) trans 4294968723 rc 0/0 00000100:00100000:3.0:1787397364.958138:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908 00000100:00100000:0.0:1787397364.958261:0:83283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83283:1874218700858368:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397364.958277:0:83283:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6a1:0x0]-[0x280000401:0x6c1:0x0] 00002000:00010000:1.0:1787397364.960480:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.960495:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.960512:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.960516:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.960546:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.960563:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.960574:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.960601:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.960619:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.960716:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.960723:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.960734:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.960739:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.960748:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.960778:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.960786:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f16f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.960812:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.960814:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.960816:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.960914:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.961308:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961320:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.961323:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.961327:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961338:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961346:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961354:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961422:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.961473:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.961478:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961493:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.961496:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.961501:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961510:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961518:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.961544:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964420:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397364.964435:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964449:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.964455:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964467:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964507:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964515:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964563:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.964567:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964574:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.964577:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964585:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964594:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.964602:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.964603:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.964606:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.965366:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397364.965376:0:26162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f17d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.965563:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.965571:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965584:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.965589:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.965595:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965619:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965638:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965647:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965678:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.965724:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.965730:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965737:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.965740:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.965744:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965753:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965761:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965781:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.965804:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397364.966023:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397364.966031:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966041:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.966046:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966055:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966069:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966076:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f184 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966110:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.966113:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966119:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.966122:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966129:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966139:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966146:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f18b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966159:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.966161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.966162:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.966432:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.966439:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966449:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.966452:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.966457:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966467:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966476:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966483:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966503:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.966560:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787397364.966564:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.966566:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966572:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966576:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.966588:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966591:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.966600:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.966602:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966605:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966620:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966622:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966654:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966656:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966677:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966687:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.966692:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966694:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397364.966703:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.966707:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.966708:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966718:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966727:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966735:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f199 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.966752:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.966757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.966760:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.966760:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.966764:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.966772:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.966776:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.966781:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966789:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.966803:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.966804:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966813:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966836:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.966878:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.966883:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966890:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.966893:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.966897:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966906:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966914:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966921:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.966954:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397364.966989:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.966995:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.966997:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397364.967006:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967009:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.967016:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967026:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967027:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.967033:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967041:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967048:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967052:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967067:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967070:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967085:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f1a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967086:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397364.967106:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397364.967110:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967118:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.967122:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.967130:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.967145:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967153:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967156:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967173:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:2.0:1787397364.967175:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f1a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967187:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967193:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967194:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.967201:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967209:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967210:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.967216:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967225:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967228:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967246:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967251:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967258:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f1ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967273:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397364.967284:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.967290:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.967294:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.967297:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.967300:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.967302:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.967308:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967315:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967326:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967345:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5aa8f55/0x274786fe0d18f1b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967360:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.967362:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.967363:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.967404:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.967410:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967418:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.967421:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967426:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967435:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967443:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967450:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967470:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.967509:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.967515:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967541:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.967544:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967548:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967558:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967567:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967574:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967587:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397364.967593:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397364.967596:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967603:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.967606:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967636:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967648:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967656:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d18f1bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967670:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.967673:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967679:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.967682:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967689:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967698:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967706:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d18f1c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967730:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.967731:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.967733:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.967768:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.967777:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.967783:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967791:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.967794:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967798:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967807:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967816:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967823:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967844:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.967877:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.967883:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967904:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.967907:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.967911:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967920:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967928:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967935:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967947:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397364.967954:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397364.967958:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967966:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.967969:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967978:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.967999:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968007:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012c28ebe/0x274786fe0d18f1ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968020:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.968023:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968030:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.968033:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968040:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968048:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968054:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000078ce195/0x274786fe0d18f1d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968063:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968065:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968071:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.968109:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.968114:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968121:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.968124:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.968128:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968136:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968144:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968151:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968162:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397364.968168:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.968172:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968178:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052eee00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.968181:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968199:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968209:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968215:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bebe7cf/0x274786fe0d18f1d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968228:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968230:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968232:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.968270:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.968275:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968283:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.968286:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.968290:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968298:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968307:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968319:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968332:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397364.968339:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.968342:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968349:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.968352:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968360:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968371:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968378:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa5aa9c/0x274786fe0d18f1df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968392:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968394:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968396:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.968431:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.968440:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968448:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.968451:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.968455:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968464:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968472:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968479:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968491:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397364.968498:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.968501:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968508:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.968511:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968519:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968552:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968560:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18f1e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968574:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968575:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.968577:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.968619:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.968636:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968643:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.968646:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.968650:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968659:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968667:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968674:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968697:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397364.968703:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.968707:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968713:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.968716:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.968724:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.968735:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.970860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.970871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.976494:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976506:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18f1ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976571:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.976575:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.976578:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.976716:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.976723:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976735:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.976755:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.976762:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976775:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976785:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976792:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976815:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397364.976852:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787397364.976855:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.976860:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976863:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.976884:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.976885:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.976891:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397364.976892:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976898:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.976906:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976911:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976926:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.976927:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.976939:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004941a6d5/0x274786fe0d18f1f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976951:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.976965:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.976970:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.976971:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787397364.976993:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052eea00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.976997:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977004:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977015:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.977020:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.977023:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0ca2fb9/0x274786fe0d18f1fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977028:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977039:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.977042:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397364.977044:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.977046:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977048:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.977050:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.977060:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977067:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977074:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977099:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397364.977119:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.977125:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977133:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.977137:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.977138:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.977147:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977164:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977166:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977180:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d18f202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977187:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.977192:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.977197:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.977198:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.977201:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.977204:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.977212:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977220:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977227:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977390:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.977433:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.977439:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977454:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.977457:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.977461:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977470:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977490:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.977498:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.977643:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397364.977651:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977667:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.977668:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.977675:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977677:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.977694:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977695:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.977701:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977714:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.977716:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.977736:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d18f209 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977740:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.977753:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.977755:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.977757:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.977758:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.977760:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.977764:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.978719:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.979029:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397364.979039:0:26162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18f210 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.979151:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397364.979360:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.979367:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979379:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.979383:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.979457:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979472:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979490:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979902:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979920:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397364.979928:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.979936:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.979943:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052eec00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.979949:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.979958:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.979967:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397364.979972:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979973:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.979980:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700f1793/0x274786fe0d18f217 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979981:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.979984:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.979989:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.979997:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.980004:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.980005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980005:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.980007:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980012:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980031:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.980049:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.980054:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980072:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef000 already unused, calling callback (ffffffffc0e6de90) 00002000:00010000:1.0:1787397364.980072:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.980076:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980077:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980084:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980089:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.980091:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397364.980094:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980095:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980102:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18f21e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980104:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980112:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.980119:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980119:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980120:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980142:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.980184:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.980189:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980198:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.980201:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.980205:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980211:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.980213:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980218:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980225:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.980229:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980231:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980237:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980238:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980258:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397364.980258:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980265:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f225 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980280:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397364.980283:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980290:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397364.980293:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.980295:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.980300:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980301:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980308:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.980311:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397364.980311:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980315:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980318:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18f22c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980324:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980329:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980331:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397364.980331:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.980337:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980338:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980368:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397364.980369:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397364.980373:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.980380:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397364.980383:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.980405:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.980410:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980417:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.980420:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.980424:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980433:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980441:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980448:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980466:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.980467:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.980472:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980479:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397364.980493:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397364.980501:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397364.980506:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980514:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:3.0:1787397364.980516:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980548:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.980552:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980562:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980570:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980577:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980588:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397364.980622:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x682:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397364.980623:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980642:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980648:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18f23a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980650:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=3244s v=(0 0) 00010000:00010000:1.0:1787397364.980653:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397364.980657:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980662:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397364.980665:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980666:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980673:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.980675:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980676:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980683:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980688:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980693:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980701:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397364.980704:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18f241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980708:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397364.980711:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980715:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.980717:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980718:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397364.980721:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.980722:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.980727:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980729:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980739:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980747:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18f248 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397364.980760:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980761:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397364.980763:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397364.980976:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397364.981032:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.981049:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397364.981059:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18f233 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397364.981224:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.981227:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397364.981229:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787397364.983685:0:26162:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1116 00000100:00100000:0.0:1787397364.983790:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:83285:x1874218700858112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 39139us (39483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397364.983800:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000100:00100000:3.0:1787397364.983838:0:83285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83285:1874218700858112:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787397364.983852:0:83285:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6a1:0x0] from OST, last_created [0x2c0000401:0x6a1:0x0]last_used is [0x2c0000401:0x45c:0x0] 00000100:00100000:2.0:1787397364.983933:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397364.983964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397364.984001:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858496 00000100:00100000:0.0:1787397364.984009:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858496 00000100:00100000:3.0:1787397364.984036:0:83285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83285:1874218700858624:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787397364.984042:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1787397364.984050:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700858496:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1787397364.984057:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1787397364.984062:0:83285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397364.984078:0:83285:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 20 seconds 00002000:00000024:0.0:1787397364.984087:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397364.984091:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858624 00000100:00100000:3.0:1787397364.984094:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858624 00000100:00100000:3.0:1787397364.984188:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:3.0:1787397364.984195:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:83285:x1874218700858624:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1787397364.984200:0:25908:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1787397364.984222:0:25908:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1698 00000100:00100000:2.0:1787397364.984963:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397364.985024:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700858496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 670us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397364.985032:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1787397364.985590:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:83285:x1874218700858624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1393us (1524us total) trans 4294968721 rc 0/0 00000100:00100000:3.0:1787397364.985598:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00100000:2.0:1787397364.985664:0:83285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83285:1874218700858624:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397364.985694:0:83285:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6a1:0x0]-[0x2c0000401:0x6c1:0x0] 00010000:00010000:3.0:1787397365.543089:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787397365.732758:0:23942:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a83b521500 x1874218700856704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1787397374 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397365.732888:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700856704:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1014708us (1014975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397365.732898:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00080000:2.0:1787397365.733071:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1787397365.733080:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a83b522300 x1874218700856704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397394 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397365.733090:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a83b522300 x1874218700856704/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397394 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397365.733097:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397365.733113:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787397365.733118:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000681333b8): req@ffff89a83876df80 x1874218700773504/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397186 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397365.733140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700856704:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1787397365.733364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397365.734033:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700858752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397365.734117:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397365.734170:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700773504 00000100:00100000:1.0:1787397365.734182:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700773504 00000100:00100000:1.0:1787397365.734236:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858752 00000100:00100000:1.0:1787397365.734239:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858752 00000100:00100000:1.0:1787397365.734276:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:1.0:1787397365.734288:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218700773504:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1787397365.734296:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1787397365.734394:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445122048 avail 1298882560 00000100:00100000:3.0:1787397365.734444:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:3.0:1787397365.734465:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218700858752:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1787397365.734473:0:23942:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1787397365.734480:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218700773504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397365.734493:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000004:00000024:3.0:1787397365.734508:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445122048 avail 1298882560 00000100:00100000:1.0:1787397365.734626:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700773504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397365.734780:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700858752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397365.734868:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700858752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397365.734895:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00010000:00010000:3.0:1787397366.564924:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397367.589891:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397367.780946:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700858880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397367.781023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397367.781278:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700859008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397367.781372:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700858880 00000100:00100000:0.0:1787397367.781381:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700858880 00000100:00100000:0.0:1787397367.781435:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1787397367.781445:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700858880:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1787397367.781452:0:19690:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397367.781478:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787397367.781748:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397367.781779:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397367.781791:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700859136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397367.786959:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700858880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5504us (5925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397367.786976:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1787397367.787202:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700858880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397367.787551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397367.789381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397367.789501:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859008 00000100:00100000:0.0:1787397367.789511:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859008 00000100:00100000:0.0:1787397367.789594:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:0.0:1787397367.789604:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700859008:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1787397367.789627:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1787397367.789668:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397367.789744:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700859008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397367.789751:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:1.0:1787397367.789937:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700859008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397367.790630:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859136 00000100:00100000:2.0:1787397367.790638:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859136 00000100:00100000:2.0:1787397367.790702:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:2.0:1787397367.790712:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700859136:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787397367.790715:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:02000000:2.0:1787397367.790719:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1787397367.790743:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397367.790802:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700859136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397367.790809:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:1.0:1787397367.791263:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700859136:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787397368.612915:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397369.636715:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397369.828786:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397369.828813:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700859264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.828911:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.828912:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700859392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.828958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.828964:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700859648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.828984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700859904:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.828998:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.829025:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700860160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.829044:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700860416:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829058:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.829083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700860672:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.829107:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397369.829114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829117:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700859520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829143:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397369.829149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.829152:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700859776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.829174:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700860032:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.829208:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700860288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.829230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700860544:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397369.829265:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700860800:0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829294:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397369.829307:0:83275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859264 00000100:00100000:2.0:1787397369.829315:0:83275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859264 00000100:00100000:0.0:1787397369.829331:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860160 00000100:00100000:0.0:1787397369.829336:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860160 00000100:00100000:0.0:1787397369.829380:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860672 00000100:00100000:0.0:1787397369.829383:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860672 00000100:00100000:2.0:1787397369.829385:0:83275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787397369.829396:0:83275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a810b64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700859264:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.829403:0:83275:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.829429:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860032 00000100:00100000:0.0:1787397369.829434:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860032 00000100:00100000:0.0:1787397369.829459:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860544 00000100:00100000:2.0:1787397369.829460:0:83275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a810b64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700859264:12345-0@lo:400:kworker.0 Request processed in 65us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.829464:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860544 00000100:00100000:2.0:1787397369.829472:0:83275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787397369.829492:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1787397369.829502:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700860160:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1787397369.829508:0:26167:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.829510:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859392 00000100:00100000:2.0:1787397369.829515:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859392 00000100:00100000:2.0:1787397369.829579:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859648 00000100:00100000:2.0:1787397369.829583:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859648 00000100:00100000:0.0:1787397369.829588:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700860160:12345-0@lo:400:kworker.0 Request processed in 88us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.829598:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:2.0:1787397369.829599:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859520 00000100:00100000:2.0:1787397369.829603:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859520 00000100:00100000:0.0:1787397369.829620:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1787397369.829629:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700860672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.829631:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859776 00000020:02000000:0.0:1787397369.829635:0:26167:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.829637:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859776 00000100:00100000:2.0:1787397369.829653:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860288 00000100:00100000:2.0:1787397369.829655:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860288 00000100:00100000:2.0:1787397369.829665:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860800 00000100:00100000:2.0:1787397369.829668:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860800 00000100:00100000:2.0:1787397369.829686:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1787397369.829692:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700860672:12345-0@lo:400:kworker.0 Request processed in 64us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.829696:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700859392:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.829705:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.829705:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:0.0:1787397369.829725:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:0.0:1787397369.829734:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700860032:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1787397369.829738:0:26167:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.829750:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700859392:12345-0@lo:400:kworker.0 Request processed in 56us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.829758:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1787397369.829775:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1787397369.829775:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700860032:12345-0@lo:400:kworker.0 Request processed in 40us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.829790:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:2.0:1787397369.829791:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700859648:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.829798:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.829808:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1787397369.829817:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700860544:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1787397369.829821:0:26167:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.829832:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700859648:12345-0@lo:400:kworker.0 Request processed in 47us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.829840:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1787397369.829856:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1787397369.829860:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700860544:12345-0@lo:400:kworker.0 Request processed in 42us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.829867:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700859520:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.829872:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.829883:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:2.0:1787397369.829905:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700859520:12345-0@lo:400:kworker.0 Request processed in 40us (755us total) trans 0 rc 0/0 00000100:00080000:0.0:1787397369.829912:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397369.829913:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00080000:0.0:1787397369.829919:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397369.829924:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397369.829927:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397369.829931:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:2.0:1787397369.829939:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700859776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397369.829941:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700859904 00000020:02000000:2.0:1787397369.829945:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.829948:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700859904 00000100:00100000:0.0:1787397369.829975:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860416 00000100:00100000:2.0:1787397369.829977:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700859776:12345-0@lo:400:kworker.0 Request processed in 39us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.829980:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860416 00000100:00100000:2.0:1787397369.829992:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1787397369.829997:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:0.0:1787397369.830005:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700859904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830011:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000020:02000000:0.0:1787397369.830013:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.830021:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700860288:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.830026:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.830057:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700859904:12345-0@lo:400:kworker.0 Request processed in 52us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.830068:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:2.0:1787397369.830070:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700860288:12345-0@lo:400:kworker.0 Request processed in 49us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.830079:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1787397369.830086:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:2.0:1787397369.830096:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1787397369.830096:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700860416:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1787397369.830103:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1787397369.830108:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700860800:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1787397369.830114:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397369.830139:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700860416:12345-0@lo:400:kworker.0 Request processed in 46us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397369.830147:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:2.0:1787397369.830154:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700860800:12345-0@lo:400:kworker.0 Request processed in 47us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397369.830161:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1787397369.830261:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700859520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830277:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700860032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830291:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700860544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830305:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700859392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830320:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700859904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830333:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700860416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830426:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700859776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830439:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700860288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830456:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700860800:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830480:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700859648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830494:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700860160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830507:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700860672:0@lo:400:kworker.0 00000100:00100000:2.0:1787397369.830517:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700859264:0@lo:400:kworker.0 00000100:00100000:3.0:1787397370.117630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397370.117744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397370.117781:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397370.117833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397370.117886:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104384 00000100:00100000:0.0:1787397370.117896:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104384 00000100:00100000:0.0:1787397370.117958:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2280 00000100:00100000:0.0:1787397370.117969:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681104384:12345-192.168.204.60@tcp:400:kworker.0 00000020:02000000:0.0:1787397370.117977:0:26158:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397370.118049:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681104384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.118072:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2280 00000100:00080000:0.0:1787397370.118096:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397370.119513:0:83269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104000 00000100:00100000:1.0:1787397370.119563:0:83269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104000 00000100:00100000:1.0:1787397370.119633:0:83269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00100000:1.0:1787397370.119645:0:83269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a810b65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681104000:12345-192.168.204.60@tcp:400:kworker.0 00000020:02000000:1.0:1787397370.119653:0:83269:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1787397370.119703:0:83269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a810b65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681104000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 60us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397370.119712:0:83269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00100000:2.0:1787397370.129332:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104256 00000100:00100000:2.0:1787397370.129347:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104256 00000100:00100000:2.0:1787397370.129774:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104128 00000100:00100000:2.0:1787397370.129779:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104128 00000100:00100000:0.0:1787397370.129852:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 967 00000100:00100000:0.0:1787397370.129867:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681104256:12345-192.168.204.60@tcp:400:kworker.0 00000020:02000000:0.0:1787397370.129874:0:66176:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1787397370.129948:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681104256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 86us (12329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.129956:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 967 00000100:00100000:0.0:1787397370.129972:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 999 00000100:00100000:0.0:1787397370.129976:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681104128:12345-192.168.204.60@tcp:38:kworker.0 00000020:02000000:0.0:1787397370.129980:0:66176:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1787397370.130004:0:66176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t90194313217 exp 0000000000000000 cur 3249 last 0 00000020:00000080:0.0:1787397370.130052:0:66176:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18f24f 00000004:00100000:0.0:1787397370.130076:0:66176:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787397370.130174:0:66176:0:(import.c:65:import_set_state_nolock()) ffff89a8069d6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397370.130205:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681104128:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 227us (12372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.130214:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 999 00000100:00080000:3.0:1787397370.130377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397370.150979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397370.151568:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104512 00000100:00100000:2.0:1787397370.151592:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104512 00000100:00100000:2.0:1787397370.151658:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1000 00000100:00100000:2.0:1787397370.151668:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104512:12345-192.168.204.60@tcp:41:lfs.0 00000020:02000000:2.0:1787397370.151675:0:74374:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1787397370.151712:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397370.151788:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104512:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 121us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397370.151796:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1000 00000100:00100000:3.0:1787397370.165005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397370.165200:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104640 00000100:00100000:0.0:1787397370.165211:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104640 00000100:00100000:0.0:1787397370.165271:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1815 00000100:00100000:0.0:1787397370.165282:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104640:12345-192.168.204.60@tcp:13:lfs.0 00000020:02000000:0.0:1787397370.165290:0:19690:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397370.165337:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397370.165424:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104640:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 143us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.165432:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1815 00000100:00100000:0.0:1787397370.183337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397370.183444:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104768 00000100:00100000:2.0:1787397370.183454:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104768 00000100:00100000:2.0:1787397370.183506:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4910 00000100:00100000:2.0:1787397370.183514:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681104768:12345-192.168.204.60@tcp:8:lfs.0 00000020:02000000:2.0:1787397370.183572:0:26166:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:2.0:1787397370.183609:0:26166:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3249 last 0 00000020:00000080:2.0:1787397370.183645:0:26166:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18f256 00002000:00100000:2.0:1787397370.183658:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a81ab48000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787397370.183692:0:26166:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787397370.183779:0:26166:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787397370.183826:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397370.183894:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681104768:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 378us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397370.183902:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4910 00000100:00100000:1.0:1787397370.191188:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397370.191355:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681104896 00000100:00100000:0.0:1787397370.191373:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681104896 00000100:00100000:0.0:1787397370.191450:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1816 00000100:00100000:0.0:1787397370.191461:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104896:12345-192.168.204.60@tcp:13:lfs.0 00000020:02000000:0.0:1787397370.191469:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397370.191493:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397370.191642:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63965:x1874218681104896:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.191651:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1816 00000001:00100000:2.0:1787397370.198645:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:2.0:1787397370.198668:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968721 is committed 00000100:00100000:3.0:1787397370.343582:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397370.343610:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397370.343700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397370.343749:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700860928 00000100:00100000:2.0:1787397370.343766:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700860928 00000100:00100000:2.0:1787397370.344115:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1787397370.344127:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700860928:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1787397370.344139:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1787397370.344172:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397370.344423:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968721 gen 2 00000100:00100000:3.0:1787397370.344466:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397370.348305:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700860928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4163us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397370.348326:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1787397370.350427:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397370.350472:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700861056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397370.350605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397370.350699:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861056 00000100:00100000:0.0:1787397370.350713:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861056 00000100:00100000:0.0:1787397370.350806:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1787397370.350818:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700861056:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1787397370.350828:0:19690:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397370.350859:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397370.350959:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700861056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397370.350969:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1787397370.353732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700861056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787397370.660914:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397370.854141:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397370.854171:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700861184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397370.854269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397370.854817:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861184 00000100:00100000:2.0:1787397370.854836:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861184 00000100:00100000:2.0:1787397370.854910:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:2.0:1787397370.854927:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700861184:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1787397370.854938:0:8446:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1787397370.854991:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1787397370.855605:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700861184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 682us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397370.856137:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:3.0:1787397370.857016:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700861184:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787397370.866221:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968723 is committed 00010000:00010000:3.0:1787397371.685624:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397371.895790:0:83265:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000100:00100000:0.0:1787397372.237510:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397372.237696:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105024 00000100:00100000:1.0:1787397372.241705:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105024 00000100:00100000:1.0:1787397372.241845:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1001 00000100:00100000:1.0:1787397372.241859:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64056:x1874218681105024:12345-192.168.204.60@tcp:101:lfs.0 00000020:02000000:1.0:1787397372.241868:0:67264:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1787397372.241889:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397372.241914:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f25d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7de4 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397372.244759:0:67264:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2787us 00010000:00010000:2.0:1787397372.268759:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.268791:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.268808:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397372.268916:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397372.268921:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1787397372.268965:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.269017:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f25d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7de4 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.269057:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7de4 expref: 6 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.269067:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376b00) 00010000:00010000:2.0:1787397372.269070:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397372.269074:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00000100:00100000:2.0:1787397372.269516:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105024:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 27657us (32030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397372.269552:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1001 00000100:00100000:0.0:1787397372.298253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397372.298415:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105152 00000100:00100000:3.0:1787397372.298430:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105152 00000100:00100000:3.0:1787397372.298518:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1002 00000100:00100000:3.0:1787397372.298600:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105152:12345-192.168.204.60@tcp:41:lfs.0 00000020:02000000:3.0:1787397372.298611:0:66178:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1787397372.298663:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:3.0:1787397372.298774:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105152:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 179us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397372.298784:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1002 00000100:00100000:0.0:1787397372.301993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397372.302192:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105280 00000100:00100000:2.0:1787397372.302208:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105280 00000100:00100000:2.0:1787397372.302314:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1003 00000100:00100000:2.0:1787397372.302348:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105280:12345-192.168.204.60@tcp:41:lfs.0 00000020:02000000:2.0:1787397372.302357:0:74374:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1787397372.302415:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397372.302551:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105280:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 179us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397372.302561:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1003 00000100:00080000:3.0:1787397372.302711:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397372.317939:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397372.318516:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105408 00000100:00100000:2.0:1787397372.318580:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105408 00000100:00100000:2.0:1787397372.318674:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1819 00000100:00100000:2.0:1787397372.318688:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105408:12345-192.168.204.60@tcp:13:lfs.0 00000020:02000000:2.0:1787397372.318699:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1787397372.318743:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397372.318892:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64056:x1874218681105408:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 207us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397372.318900:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1819 00000100:00080000:3.0:1787397372.318976:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397372.338803:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397372.338919:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105536 00000100:00100000:3.0:1787397372.338935:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105536 00000100:00100000:3.0:1787397372.339011:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1820 00000100:00100000:3.0:1787397372.339022:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64056:x1874218681105536:12345-192.168.204.60@tcp:13:lfs.0 00000020:02000000:3.0:1787397372.339040:0:8438:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1787397372.339084:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397372.339343:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64056:x1874218681105536:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 322us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397372.339352:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1820 00000100:00100000:1.0:1787397372.408161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397372.408584:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105664 00000100:00100000:2.0:1787397372.408599:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105664 00000100:00100000:2.0:1787397372.408692:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1004 00000100:00100000:2.0:1787397372.408705:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:63580:x1874218681105664:12345-192.168.204.60@tcp:101:multiop.0 00000020:02000000:2.0:1787397372.408715:0:66177:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1787397372.408741:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397372.408770:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7deb expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.408866:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.408911:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.408925:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.413942:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.413968:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.413982:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416397:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416424:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416436:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397372.416492:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:2.0:1787397372.416496:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1787397372.416559:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416574:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416607:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416614:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416622:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416629:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416636:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397372.416641:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416648:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416663:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376b00) 00010000:00010000:2.0:1787397372.416667:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397372.416671:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416678:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416696:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416702:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416715:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416721:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397372.416724:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416731:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.416739:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff89a828809e00) 00010000:00010000:2.0:1787397372.416741:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397372.416744:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.418001:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.418082:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7deb expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.418100:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7deb expref: 7 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397372.418110:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff89a828809f00) 00010000:00010000:2.0:1787397372.418113:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397372.418117:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55c00, rc 0) 00000100:00100000:2.0:1787397372.418512:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:63580:x1874218681105664:12345-192.168.204.60@tcp:101:multiop.0 Request processed in 9807us (10363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397372.418561:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1004 00010000:00010000:1.0:1787397372.709356:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397372.901980:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397372.902018:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700861312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397372.902109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397372.902164:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861312 00000100:00100000:0.0:1787397372.902171:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861312 00000100:00100000:0.0:1787397372.902228:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1787397372.902238:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700861312:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1787397372.902245:0:19690:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1787397372.902266:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397372.902311:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700861312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397372.902318:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00080000:0.0:1787397372.902340:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397372.902378:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700861312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397372.907370:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700861568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397372.907444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397372.907517:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397372.907543:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700861440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397372.907570:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397372.907604:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861568 00000100:00100000:3.0:1787397372.907613:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861568 00000100:00100000:3.0:1787397372.907658:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:3.0:1787397372.907667:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700861568:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:3.0:1787397372.907685:0:23942:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1787397372.907718:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397372.907765:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700861568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397372.907773:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:3.0:1787397372.907798:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861440 00000100:00100000:3.0:1787397372.907802:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861440 00000100:00100000:3.0:1787397372.907833:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1787397372.907839:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700861440:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1787397372.907844:0:8439:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1787397372.907856:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397372.907886:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700861440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397372.907893:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1787397372.908020:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700861440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397372.908034:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700861568:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787397372.908551:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397373.732957:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397374.756724:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397374.950975:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700861952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951081:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700862464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951149:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700862976:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951218:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397374.951224:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700862080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951271:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700862592:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700863104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397374.951357:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862464 00000100:00100000:2.0:1787397374.951367:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862464 00000100:00100000:2.0:1787397374.951419:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862976 00000100:00100000:2.0:1787397374.951422:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862976 00000100:00100000:2.0:1787397374.951458:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862592 00000100:00100000:2.0:1787397374.951462:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862592 00000100:00100000:2.0:1787397374.951496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863104 00000100:00100000:2.0:1787397374.951499:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863104 00000100:00100000:2.0:1787397374.951551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1787397374.951560:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951618:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700862464:12345-0@lo:400:kworker.0 Request processed in 58us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951644:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1787397374.951663:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:2.0:1787397374.951669:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951702:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700862976:12345-0@lo:400:kworker.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951708:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:2.0:1787397374.951721:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:2.0:1787397374.951727:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951754:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700862592:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951760:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:2.0:1787397374.951770:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1787397374.951776:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951800:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700863104:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951806:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1787397374.951825:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861952 00000100:00100000:2.0:1787397374.951829:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861952 00000100:00100000:2.0:1787397374.951867:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862080 00000100:00100000:2.0:1787397374.951871:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862080 00000100:00100000:2.0:1787397374.951895:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1787397374.951901:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951931:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700861952:12345-0@lo:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951936:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1787397374.951953:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1787397374.951958:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700862080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.951986:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700862080:12345-0@lo:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397374.951992:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00080000:2.0:1787397374.952010:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397374.952014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397374.952016:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397374.952019:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397374.952054:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700862080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.952065:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700862592:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.952073:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700863104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.952081:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700861952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.952089:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700862464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397374.952097:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968723 gen 2 00000100:00100000:2.0:1787397374.952112:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700862976:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952292:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218700861824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952374:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700862336:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952417:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700862848:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952468:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787397374.952475:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952559:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700862208:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952596:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700862720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952633:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700863232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397374.952678:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861824 00000100:00100000:3.0:1787397374.952682:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861824 00000100:00100000:3.0:1787397374.952709:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862208 00000100:00100000:3.0:1787397374.952711:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862208 00000100:00100000:3.0:1787397374.952722:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862720 00000100:00100000:3.0:1787397374.952724:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862720 00000100:00100000:3.0:1787397374.952734:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863232 00000100:00100000:3.0:1787397374.952736:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863232 00000100:00100000:3.0:1787397374.952747:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1787397374.952752:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218700861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952787:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218700861824:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.952793:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1787397374.952805:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1787397374.952810:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700862208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952834:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700862208:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.952840:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1787397374.952852:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1787397374.952857:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700862720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952905:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700862720:12345-0@lo:400:kworker.0 Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.952911:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1787397374.952924:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1787397374.952931:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700863232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.952956:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700863232:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.952961:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1787397374.953000:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862336 00000100:00100000:3.0:1787397374.953003:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862336 00000100:00100000:3.0:1787397374.953025:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700862848 00000100:00100000:3.0:1787397374.953028:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700862848 00000100:00100000:3.0:1787397374.953040:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1787397374.953046:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700862336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953078:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700862336:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.953084:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:3.0:1787397374.953094:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1787397374.953099:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700862848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953144:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700862848:12345-0@lo:400:kworker.0 Request processed in 43us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.953150:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1787397374.953171:0:83275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700861696 00000100:00100000:3.0:1787397374.953174:0:83275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700861696 00000100:00100000:3.0:1787397374.953196:0:83275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787397374.953202:0:83275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700861696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953241:0:83275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700861696:12345-0@lo:400:kworker.0 Request processed in 38us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397374.953248:0:83275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1787397374.953277:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397374.953280:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397374.953306:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953319:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700862208:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953329:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700862720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953338:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700863232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953347:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218700861824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953356:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700862336:0@lo:400:kworker.0 00000100:00100000:3.0:1787397374.953364:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700862848:0@lo:400:kworker.0 00000100:00100000:0.0:1787397375.242832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397375.242878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397375.242906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397375.242929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397375.242954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397375.242979:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105920 00000100:00100000:0.0:1787397375.242989:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105920 00000100:00100000:0.0:1787397375.243044:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106048 00000100:00100000:0.0:1787397375.243047:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106048 00000100:00100000:0.0:1787397375.243083:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 974 00000100:00100000:0.0:1787397375.243094:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681105920:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397375.243166:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681105920:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397375.243188:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 974 00000100:00100000:0.0:1787397375.243207:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 975 00000100:00100000:0.0:1787397375.243213:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681106048:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397375.243239:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681106048:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397375.243246:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 975 00000100:00100000:0.0:1787397375.243267:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106304 00000100:00100000:0.0:1787397375.243271:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106304 00000100:00100000:0.0:1787397375.243291:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106176 00000100:00100000:0.0:1787397375.243294:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106176 00000100:00100000:0.0:1787397375.243313:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2285 00000100:00100000:0.0:1787397375.243320:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681106304:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397375.243345:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681106304:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397375.243351:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2285 00000100:00100000:0.0:1787397375.243362:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2286 00000100:00100000:0.0:1787397375.243367:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681106176:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397375.243388:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681106176:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397375.243393:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2286 00000100:00080000:0.0:1787397375.243410:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397375.243415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397375.243622:0:83271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681105792 00000100:00100000:1.0:1787397375.243626:0:83271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681105792 00000100:00100000:1.0:1787397375.243669:0:83271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 154 00000100:00100000:1.0:1787397375.243685:0:83271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681105792:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397375.243719:0:83271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681105792:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397375.243725:0:83271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 154 00000100:00100000:3.0:1787397375.464909:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397375.464932:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700863488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397375.465000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397375.465331:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700863360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397375.465364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397375.465415:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863488 00000100:00100000:2.0:1787397375.465429:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863488 00000100:00100000:2.0:1787397375.465473:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863360 00000100:00100000:2.0:1787397375.465476:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863360 00000100:00100000:2.0:1787397375.465492:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1787397375.465500:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700863488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397375.465547:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397375.465603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700863488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397375.465610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1787397375.465627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1787397375.465633:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700863360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397375.465648:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397375.465677:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700863360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397375.465683:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1787397375.465730:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700863488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397375.465761:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700863360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787397375.783003:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397375.888645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397375.888820:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106560 00000100:00100000:2.0:1787397375.888831:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106560 00000100:00100000:2.0:1787397375.888918:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1005 00000100:00100000:2.0:1787397375.888930:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:64176:x1874218681106560:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397375.888989:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787397375.889022:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d18f280 lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7deb expref: 7 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889046:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff89a828809f00) 00010000:00010000:2.0:1787397375.889120:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7de4 expref: 6 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889130:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376b00) 00010000:00010000:2.0:1787397375.889136:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397375.889179:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889192:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889202:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889216:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889223:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889230:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889319:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889342:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889350:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397375.889682:0:67264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].2, 64 off8320 00000004:00080000:2.0:1787397375.889694:0:67264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3255180171126ns, next at 3256180168379ns, rc = 0 00010000:00010000:2.0:1787397375.889761:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889771:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889787:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889795:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889802:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889808:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889832:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397375.889867:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397375.889871:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397375.889877:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889880:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889897:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397375.889898:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397375.889906:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889908:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397375.889916:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889927:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397375.889932:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.889938:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:2.0:1787397375.889943:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00080000:0.0:1787397375.889993:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787397375.890304:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890311:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d18f295 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890340:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890347:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890352:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890357:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890362:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397375.890364:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890370:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890377:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32e00) 00010000:00010000:2.0:1787397375.890379:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397375.890382:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890387:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d18f287 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397375.890399:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088312d66 reply state 00000000ef2690f9 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890428:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397375.890434:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff89a82df32400) 00010000:00010000:2.0:1787397375.890437:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397375.890439:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397375.890554:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:64176:x1874218681106560:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1624us (1920us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1787397375.890564:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1005 00010000:00010000:3.0:1787397375.895665:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:3.0:1787397375.895675:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397375.895682:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397375.895692:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d18f29c lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397375.895715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397375.895717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397375.895719:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397375.975282:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700863616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397375.975382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397375.975450:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863616 00000100:00100000:0.0:1787397375.975459:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863616 00000100:00100000:0.0:1787397375.975511:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1787397375.975543:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700863616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397375.975583:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:0.0:1787397375.975635:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700863616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397375.975643:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1787397375.975690:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700863616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397376.813153:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397377.833138:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397378.022661:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397378.022685:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700863744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397378.022798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397378.022931:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863744 00000100:00100000:3.0:1787397378.022939:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863744 00000100:00100000:2.0:1787397378.024338:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397378.024357:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700863872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397378.024428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397378.024483:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700864000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397378.024560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397378.024593:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700863872 00000100:00100000:2.0:1787397378.024599:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700863872 00000100:00100000:2.0:1787397378.024649:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864000 00000100:00100000:2.0:1787397378.024652:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864000 00000100:00100000:2.0:1787397378.024686:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1787397378.024696:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700863872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397378.024729:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397378.024770:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700863872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397378.024778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1787397378.024794:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:2.0:1787397378.024800:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700864000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397378.024836:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397378.024885:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700864000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397378.024892:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00080000:2.0:1787397378.024913:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397378.024917:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397378.024955:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700864000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397378.024987:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700863872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397378.037762:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:3.0:1787397378.037780:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700863744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397378.037839:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397378.037927:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700863744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (15127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397378.037934:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1787397378.038082:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700863744:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787397378.852750:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397379.881995:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397380.072339:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700864128:0@lo:400:kworker.0 00000100:00100000:2.0:1787397380.072438:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.072473:0:83275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864128 00000100:00100000:3.0:1787397380.072498:0:83275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864128 00000100:00100000:3.0:1787397380.072580:0:83275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787397380.072590:0:83275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700864128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.072650:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700864384:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.072687:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397380.072712:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397380.072719:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218700864256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.072740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397380.072772:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864384 00000100:00100000:1.0:1787397380.072776:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864384 00000100:00100000:1.0:1787397380.072811:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864256 00000100:00100000:1.0:1787397380.072814:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864256 00000100:00100000:1.0:1787397380.072835:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1787397380.072849:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700864384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.072886:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700864384:12345-0@lo:400:kworker.0 Request processed in 45us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.072893:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1787397380.072910:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1787397380.072917:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218700864256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.072957:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218700864256:12345-0@lo:400:kworker.0 Request processed in 40us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.072964:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00080000:1.0:1787397380.072984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397380.072988:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397380.073033:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218700864256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.073044:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700864384:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.073202:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700864512:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.073229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.076412:0:83275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700864128:12345-0@lo:400:kworker.0 Request processed in 3817us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.076427:0:83275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787397380.076487:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864512 00000100:00100000:3.0:1787397380.076496:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864512 00000100:00080000:0.0:1787397380.076585:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397380.076591:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:3.0:1787397380.076599:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700864512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076656:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700864768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.076663:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700864512:12345-0@lo:400:kworker.0 Request processed in 66us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.076669:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1787397380.076692:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.076716:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700865024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700865280:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076743:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.076744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.076762:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700865536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076765:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787397380.076769:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700864896:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.076781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397380.076809:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865024 00000100:00100000:1.0:1787397380.076812:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865024 00000100:00100000:3.0:1787397380.076816:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700864512:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076843:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865536 00000100:00100000:3.0:1787397380.076847:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787397380.076847:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865536 00000100:00100000:3.0:1787397380.076853:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700864640:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.076872:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1787397380.076879:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700865024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397380.076937:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864768 00000100:00100000:0.0:1787397380.076951:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864768 00000100:00100000:0.0:1787397380.076983:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865280 00000100:00100000:0.0:1787397380.076986:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865280 00000100:00100000:0.0:1787397380.077001:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:0.0:1787397380.077007:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700864768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077167:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700865024:12345-0@lo:400:kworker.0 Request processed in 287us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.077173:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1787397380.077188:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:1.0:1787397380.077195:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700865536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077223:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700865536:12345-0@lo:400:kworker.0 Request processed in 30us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.077229:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:1.0:1787397380.077253:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:1.0:1787397380.077275:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700865280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077307:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700865280:12345-0@lo:400:kworker.0 Request processed in 34us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.077312:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00080000:1.0:1787397380.077361:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397380.077386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397380.077405:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700865408:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397380.077451:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700865280:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077472:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864896 00000100:00100000:1.0:1787397380.077475:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864896 00000100:00100000:1.0:1787397380.077517:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865408 00000100:00100000:1.0:1787397380.077540:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865408 00000100:00100000:1.0:1787397380.077564:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1787397380.077571:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700864896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077605:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700864896:12345-0@lo:400:kworker.0 Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.077611:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1787397380.077622:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1787397380.077628:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700865408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077652:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700865408:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397380.077658:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00080000:1.0:1787397380.077671:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397380.077688:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700864896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.077698:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700865408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.079858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.080011:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700865152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.080078:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700865664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397380.080384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700865024:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080398:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700865536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080448:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700864640 00000100:00100000:3.0:1787397380.080455:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700864640 00000100:00100000:3.0:1787397380.080542:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865152 00000100:00100000:3.0:1787397380.080546:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865152 00000100:00100000:3.0:1787397380.080566:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865664 00000100:00100000:3.0:1787397380.080569:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865664 00000100:00100000:3.0:1787397380.080590:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1787397380.080597:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700864640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397380.080623:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700864768:12345-0@lo:400:kworker.0 Request processed in 3614us (3928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397380.080634:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1787397380.080645:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700864640:12345-0@lo:400:kworker.0 Request processed in 49us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.080651:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1787397380.080663:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1787397380.080668:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700865152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397380.080674:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700864768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080693:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700865152:12345-0@lo:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.080699:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1787397380.080709:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1787397380.080715:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700865664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080740:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700865664:12345-0@lo:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.080745:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:1.0:1787397380.080779:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397380.080788:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700864640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080798:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700865152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397380.080822:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700865664:0@lo:400:kworker.0 00000100:00100000:2.0:1787397380.082356:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700864128:0@lo:400:kworker.0 00000100:00100000:1.0:1787397380.360404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397380.360462:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397380.360505:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397380.360579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397380.360604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397380.360682:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106944 00000100:00100000:3.0:1787397380.360692:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106944 00000100:00100000:3.0:1787397380.360769:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106816 00000100:00100000:3.0:1787397380.360772:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106816 00000100:00100000:3.0:1787397380.360802:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 982 00000100:00100000:3.0:1787397380.360811:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681106944:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397380.360888:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681106944:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.360897:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 982 00000100:00100000:3.0:1787397380.360916:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 983 00000100:00100000:3.0:1787397380.360923:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681106816:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397380.360969:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681106816:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397380.360975:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 983 00000100:00100000:2.0:1787397380.361177:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107200 00000100:00100000:2.0:1787397380.361182:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107200 00000100:00100000:2.0:1787397380.361245:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107072 00000100:00100000:2.0:1787397380.361248:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107072 00000100:00100000:2.0:1787397380.361277:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2291 00000100:00100000:2.0:1787397380.361284:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681107200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397380.361314:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681107200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397380.361320:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2291 00000100:00100000:2.0:1787397380.361348:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2292 00000100:00100000:2.0:1787397380.361355:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681107072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397380.361378:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681107072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397380.361404:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2292 00000100:00100000:0.0:1787397380.361687:0:83271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681106688 00000100:00100000:0.0:1787397380.361693:0:83271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681106688 00000100:00100000:0.0:1787397380.361738:0:83271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 156 00000100:00100000:0.0:1787397380.361754:0:83271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681106688:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397380.361782:0:83271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681106688:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397380.361788:0:83271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 156 00000100:00080000:1.0:1787397380.362205:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397380.362210:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397380.362213:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397380.362215:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787397380.581475:0:83283:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3259871950138ns, next at 3260871947658ns, rc = 0 00000100:00100000:0.0:1787397380.581500:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397380.581519:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700865792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397380.581606:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397380.581696:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865792 00000100:00100000:2.0:1787397380.581705:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865792 00000100:00100000:2.0:1787397380.581764:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1787397380.581773:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700865792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397380.581802:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397380.581947:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700865792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397380.581955:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1787397380.582079:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700865792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397380.582215:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700865920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397380.582243:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397380.582295:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700865920 00000100:00100000:2.0:1787397380.582300:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700865920 00000100:00100000:2.0:1787397380.582338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1787397380.582345:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700865920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397380.582361:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397380.586800:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700865920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4443us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397380.586815:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1787397380.587301:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700865920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787397380.900798:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397381.093272:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700866048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397381.093371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397381.095404:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866048 00000100:00100000:0.0:1787397381.095428:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866048 00000100:00100000:0.0:1787397381.095507:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1787397381.095538:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700866048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397381.095578:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:0.0:1787397381.095658:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700866048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397381.095665:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:3.0:1787397381.095783:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700866048:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1787397381.637420:0:83265:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787397381.637455:0:83265:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:2.0:1787397381.637461:0:83265:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787397381.638198:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638212:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638234:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638241:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397381.638247:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638255:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638281:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff89a82df32400) 00010000:00010000:0.0:1787397381.638284:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397381.638290:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.638309:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d18f28e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397381.638392:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397381.638419:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700866176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397381.638493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397381.638997:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866176 00000100:00100000:0.0:1787397381.639005:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866176 00000100:00100000:0.0:1787397381.639183:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1787397381.639196:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700866176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397381.639233:0:25908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1666 count 1 00010000:00010000:0.0:1787397381.639265:0:25908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.639289:0:25908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 5 pid: 26169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.639328:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=216s v=(0 0) 00010000:00010000:0.0:1787397381.639333:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397381.639338:0:25908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.639374:0:25908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 5 pid: 26169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.639390:0:25908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 5 pid: 26169 timeout: 3360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397381.639403:0:25908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25908:1874218700866304:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397381.639494:0:25908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703e89d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397381.644840:0:25908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25908:1874218700866304:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397381.644875:0:25908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397381.653578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397381.653771:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107328 00000100:00100000:2.0:1787397381.653783:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107328 00010000:00010000:2.0:1787397381.653823:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 6 pid: 26169 timeout: 3360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397381.653865:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2579 00000100:00100000:2.0:1787397381.653874:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681107328:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397381.653899:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397381.653907:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 6 pid: 26169 timeout: 3360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654014:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 6 pid: 26169 timeout: 3360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654123:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18ee43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc1 expref: 6 pid: 26169 timeout: 3360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654145:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397381.654150:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397381.654156:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654166:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654201:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397381.654258:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838244850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681107328:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 383us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397381.654268:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2579 00010000:00010000:0.0:1787397381.654380:0:25908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.654390:0:25908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.654414:0:25908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.654422:0:25908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397381.654444:0:25908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397381.654746:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397381.654753:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654772:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397381.654776:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654787:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654802:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654809:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18f2a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397381.654830:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397381.654832:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397381.654833:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397381.655013:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700866176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15817us (16516us total) trans 4294968724 rc 0/0 00000100:00100000:0.0:1787397381.655023:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000004:00080000:2.0:1787397381.655188:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702618380/2, rc 0, transno 4294968724 00000100:00100000:2.0:1787397381.655195:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700866176:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787397381.925193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397382.949617:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397383.151574:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700866432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397383.151687:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397383.151737:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397383.151743:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700866560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397383.151772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397383.151829:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866560 00000100:00100000:3.0:1787397383.151838:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866560 00000100:00100000:3.0:1787397383.151893:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:3.0:1787397383.151902:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700866560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397383.151938:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397383.151986:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700866560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397383.151993:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:3.0:1787397383.152048:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700866560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397383.152294:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397383.152306:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700866688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397383.152339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397383.152495:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866432 00000100:00100000:2.0:1787397383.152501:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866432 00000100:00100000:2.0:1787397383.152564:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866688 00000100:00100000:2.0:1787397383.152568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866688 00000100:00100000:2.0:1787397383.152584:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1787397383.152592:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700866432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397383.152628:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397383.152673:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700866432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397383.152679:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1787397383.152692:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:2.0:1787397383.152698:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700866688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397383.152711:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397383.152736:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700866688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397383.152741:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00080000:0.0:1787397383.152882:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397383.152886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397383.152909:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700866688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397383.153105:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700866432:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787397383.975225:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397384.052633:0:83993:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 07:16:21 (1787397381) 00010000:00010000:3.0:1787397384.996701:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397385.192957:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700867200:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193081:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700867712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700868224:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193153:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787397385.193433:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700866816:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193501:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700867328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193569:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700867840:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193606:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700868352:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.193652:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700866944:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.193693:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194307:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700867456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.194340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194363:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700867968:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.194386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194409:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787397385.194416:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700867072:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.194479:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194499:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700867584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.194550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194572:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868096:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.194596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397385.194630:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867200 00000100:00100000:1.0:1787397385.194639:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867200 00000100:00100000:1.0:1787397385.194685:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867328 00000100:00100000:1.0:1787397385.194688:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867328 00000100:00100000:1.0:1787397385.194704:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867840 00000100:00100000:1.0:1787397385.194707:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867840 00000100:00100000:1.0:1787397385.194725:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868352 00000100:00100000:1.0:1787397385.194727:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868352 00000100:00100000:1.0:1787397385.194736:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866944 00000100:00100000:1.0:1787397385.194739:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866944 00000100:00100000:1.0:1787397385.194750:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867072 00000100:00100000:1.0:1787397385.194752:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867072 00000100:00100000:1.0:1787397385.194767:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1787397385.194775:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700867200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.195632:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1787397385.195651:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700867328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.196305:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700867200:12345-0@lo:400:kworker.0 Request processed in 1526us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.196336:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1787397385.196371:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1787397385.196383:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700867840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397385.199035:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867712 00000100:00100000:3.0:1787397385.199053:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867712 00000100:00100000:3.0:1787397385.199131:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868224 00000100:00100000:3.0:1787397385.199147:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868224 00000100:00100000:3.0:1787397385.199171:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867584 00000100:00100000:3.0:1787397385.199174:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867584 00000100:00100000:3.0:1787397385.199209:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868096 00000100:00100000:3.0:1787397385.199223:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868096 00000100:00100000:3.0:1787397385.199261:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1787397385.199271:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700867712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397385.200058:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1787397385.200072:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700868224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.200157:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1787397385.200165:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700867584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.200257:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700867584:12345-0@lo:400:kworker.0 Request processed in 92us (5705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.200265:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1787397385.200284:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1787397385.200290:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.200329:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700868096:12345-0@lo:400:kworker.0 Request processed in 39us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.200335:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:1.0:1787397385.201048:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700867840:12345-0@lo:400:kworker.0 Request processed in 4667us (7453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201059:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1787397385.201086:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1787397385.201103:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700868352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201149:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700868352:12345-0@lo:400:kworker.0 Request processed in 56us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201156:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1787397385.201171:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1787397385.201188:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700866944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201221:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700866944:12345-0@lo:400:kworker.0 Request processed in 44us (7527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201239:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1787397385.201253:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1787397385.201264:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201295:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700867072:12345-0@lo:400:kworker.0 Request processed in 34us (6816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201301:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1787397385.201343:0:83270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700866816 00000100:00100000:1.0:1787397385.201352:0:83270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700866816 00000100:00100000:1.0:1787397385.201398:0:83270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787397385.201406:0:83270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700866816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201458:0:83270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700866816:12345-0@lo:400:kworker.0 Request processed in 53us (7986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201464:0:83270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787397385.201539:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867456 00000100:00100000:1.0:1787397385.201544:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867456 00000100:00100000:1.0:1787397385.201573:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700867968 00000100:00100000:1.0:1787397385.201577:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700867968 00000100:00100000:1.0:1787397385.201593:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:1.0:1787397385.201600:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700867456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201636:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700867456:12345-0@lo:400:kworker.0 Request processed in 36us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201642:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:1.0:1787397385.201654:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:1.0:1787397385.201662:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700867968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.201690:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700867968:12345-0@lo:400:kworker.0 Request processed in 30us (7303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.201890:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:1.0:1787397385.201971:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700866816:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.202006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700867840:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.202020:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700868352:0@lo:400:kworker.0 00000100:00100000:1.0:1787397385.202034:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700867200:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202285:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700867072:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202298:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700867584:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202584:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202614:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700866944:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202625:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700867456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202636:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700867968:0@lo:400:kworker.0 00000100:00100000:2.0:1787397385.202718:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700867328:12345-0@lo:400:kworker.0 Request processed in 7075us (9166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.202727:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1787397385.203358:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700867328:0@lo:400:kworker.0 00000100:00080000:1.0:1787397385.203755:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397385.203761:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397385.203775:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397385.203778:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397385.204584:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700867712:12345-0@lo:400:kworker.0 Request processed in 5303us (11465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.204608:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:1.0:1787397385.205356:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700867712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397385.206502:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700868224:12345-0@lo:400:kworker.0 Request processed in 6427us (13339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397385.206517:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:1.0:1787397385.206817:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700868224:0@lo:400:kworker.0 00000001:00080000:3.0:1787397385.368516:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968724 is committed 00000100:00100000:0.0:1787397385.464665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397385.467633:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107456 00000100:00100000:0.0:1787397385.467654:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107456 00000100:00100000:0.0:1787397385.467764:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1006 00000100:00100000:0.0:1787397385.467778:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64763:x1874218681107456:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397385.467803:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397385.467835:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18f2aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7df2 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.467923:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.467940:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.467954:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397385.468007:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397385.468011:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1787397385.468033:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.468063:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18f2aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df2 expref: 7 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.468088:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df2 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397385.468098:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a83ac30600) 00010000:00010000:0.0:1787397385.468101:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397385.468105:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031c00, rc 0) 00000100:00100000:0.0:1787397385.469302:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64763:x1874218681107456:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1522us (4652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397385.469319:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1006 00000100:00080000:0.0:1787397385.469586:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397385.484116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.484442:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107584 00000100:00100000:3.0:1787397385.484455:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107584 00000100:00100000:3.0:1787397385.484554:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1007 00000100:00100000:3.0:1787397385.484566:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64763:x1874218681107584:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397385.484606:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:3.0:1787397385.484688:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64763:x1874218681107584:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 124us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.484698:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1007 00000100:00100000:1.0:1787397385.496263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397385.496315:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397385.496712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397385.496733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397385.496806:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397385.496910:0:83271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107712 00000100:00100000:2.0:1787397385.496925:0:83271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107712 00000100:00100000:2.0:1787397385.496993:0:83271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:2.0:1787397385.497011:0:83271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681107712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397385.497102:0:83271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681107712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 99us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.497114:0:83271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:1.0:1787397385.497366:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107968 00000100:00100000:1.0:1787397385.497372:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107968 00000100:00100000:2.0:1787397385.497385:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681107840 00000100:00100000:2.0:1787397385.497391:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681107840 00000100:00100000:1.0:1787397385.497437:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108096 00000100:00100000:1.0:1787397385.497442:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108096 00000100:00100000:2.0:1787397385.497444:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108224 00000100:00100000:2.0:1787397385.497449:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108224 00000100:00100000:1.0:1787397385.497482:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2297 00000100:00100000:2.0:1787397385.497488:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 990 00000100:00100000:1.0:1787397385.497497:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681107968:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397385.497506:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681107840:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397385.497577:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681107840:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.497577:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681107968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.497590:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 990 00000100:00100000:2.0:1787397385.497606:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1008 00000100:00100000:2.0:1787397385.497614:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64763:x1874218681108224:12345-192.168.204.60@tcp:41:lfs.0 00000100:00100000:1.0:1787397385.497621:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2297 00000100:00100000:1.0:1787397385.497642:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2298 00000100:00100000:1.0:1787397385.497653:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681108096:12345-192.168.204.60@tcp:400:kworker.0 00000004:00000024:2.0:1787397385.497655:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397385.497686:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681108096:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397385.497693:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2298 00000100:00100000:2.0:1787397385.497699:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64763:x1874218681108224:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 83us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.497709:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1008 00000100:00080000:1.0:1787397385.497722:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397385.497729:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397385.497739:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397385.503663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.503761:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108352 00000100:00100000:3.0:1787397385.503774:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108352 00000100:00100000:3.0:1787397385.503849:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1831 00000100:00100000:3.0:1787397385.503861:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64763:x1874218681108352:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397385.503906:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397385.504016:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64763:x1874218681108352:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 157us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.504025:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1831 00000100:00100000:1.0:1787397385.508567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.508742:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108480 00000100:00100000:3.0:1787397385.508753:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108480 00000100:00100000:3.0:1787397385.508831:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1832 00000100:00100000:3.0:1787397385.508843:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64763:x1874218681108480:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397385.508885:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397385.508965:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64763:x1874218681108480:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 125us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.508985:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1832 00000100:00100000:1.0:1787397385.594117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397385.596177:0:66196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108608 00000100:00100000:0.0:1787397385.596207:0:66196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108608 00000100:00100000:0.0:1787397385.596292:0:66196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787397385.596304:0:66196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64770:x1874218681108608:12345-192.168.204.60@tcp:700:mcreate.0 00000100:00100000:0.0:1787397385.596412:0:66196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64770:x1874218681108608:12345-192.168.204.60@tcp:700:mcreate.0 Request processed in 110us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397385.596420:0:66196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:1.0:1787397385.602227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.602787:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108864 00000100:00100000:3.0:1787397385.602800:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108864 00000100:00100000:3.0:1787397385.602873:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1009 00000100:00100000:3.0:1787397385.602884:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64770:x1874218681108864:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:3.0:1787397385.602970:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397385.603000:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f2b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df2 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603023:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a83ac30600) 00010000:00010000:3.0:1787397385.603035:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397385.603107:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603121:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603141:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603154:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603161:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.603167:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604440:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604483:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604490:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604497:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604503:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397385.604508:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604863:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604882:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:3.0:1787397385.604885:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397385.604890:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604898:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397385.604940:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f7ece0 reply state 000000008a146a67 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604955:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.604965:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82250c100) 00010000:00010000:3.0:1787397385.604973:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397385.604978:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397385.605140:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:64770:x1874218681108864:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 2247us (2920us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1787397385.605150:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1009 00000100:00100000:1.0:1787397385.632074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.632152:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108992 00000100:00100000:3.0:1787397385.632161:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108992 00000100:00100000:3.0:1787397385.632249:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1010 00000100:00100000:3.0:1787397385.632261:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:64773:x1874218681108992:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397385.632288:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397385.632309:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7df9 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632373:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632387:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632398:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397385.632447:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397385.632451:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1787397385.632473:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632497:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df9 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632513:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df9 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.632574:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:3.0:1787397385.632578:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397385.632582:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096ac00, rc 0) 00000100:00100000:3.0:1787397385.632647:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64773:x1874218681108992:12345-192.168.204.60@tcp:101:rm.0 Request processed in 389us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.632654:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1010 00000100:00100000:1.0:1787397385.638591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397385.638854:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109120 00000100:00100000:2.0:1787397385.638866:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109120 00000100:00100000:2.0:1787397385.638958:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1011 00000100:00100000:2.0:1787397385.638970:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64773:x1874218681109120:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397385.639014:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397385.639047:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f2d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e00 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639127:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639154:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639168:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639181:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639189:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639195:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639321:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639330:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639337:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397385.639396:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:2.0:1787397385.639399:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1787397385.639422:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639436:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639445:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639453:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639460:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639466:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397385.639472:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639480:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639499:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:2.0:1787397385.639502:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397385.639507:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639513:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639564:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639570:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639575:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639580:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397385.639583:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639589:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639596:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82250c100) 00010000:00010000:2.0:1787397385.639598:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397385.639601:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639606:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18f2e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639645:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d18f2d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e00 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639659:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e00 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.639666:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff89a834592200) 00010000:00010000:2.0:1787397385.639669:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397385.639671:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55a00, rc 0) 00000100:00100000:2.0:1787397385.639753:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:64773:x1874218681109120:12345-192.168.204.60@tcp:101:rm.0 Request processed in 785us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397385.639762:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1011 00000100:00100000:1.0:1787397385.644282:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397385.644408:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109376 00000100:00100000:3.0:1787397385.644419:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109376 00000100:00100000:3.0:1787397385.644516:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1012 00000100:00100000:3.0:1787397385.644547:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:64773:x1874218681109376:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397385.644606:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787397385.644634:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d18f2e9 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e00 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644654:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff89a834592200) 00010000:00010000:3.0:1787397385.644670:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f2cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7df9 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644679:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:3.0:1787397385.644685:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397385.644711:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644724:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644733:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644775:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644783:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644790:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644890:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644899:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.644906:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645447:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645457:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645465:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645473:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645481:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645496:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645519:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397385.645576:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645583:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645589:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645595:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397385.645600:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645609:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645620:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff89a82250cb00) 00010000:00010000:3.0:1787397385.645623:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397385.645628:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645634:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f2fe lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645656:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645661:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645675:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645682:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645686:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397385.645689:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645694:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645702:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250c700) 00010000:00010000:3.0:1787397385.645704:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397385.645707:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645713:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f2f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397385.645727:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005dffbacd reply state 00000000595997c9 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645739:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397385.645744:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82250c100) 00010000:00010000:3.0:1787397385.645747:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397385.645749:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397385.645812:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397385.645821:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.645829:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397385.645834:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.645842:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.645853:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff89a82250cb00) 00010000:00010000:2.0:1787397385.645856:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787397385.645859:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.645865:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ae00/0x274786fe0d18f305 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397385.645887:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397385.645890:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397385.645891:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397385.645915:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:64773:x1874218681109376:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1366us (1640us total) trans 94489280515 rc 0/0 00000100:00100000:3.0:1787397385.645931:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1012 00000100:00100000:2.0:1787397385.700860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397385.700962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397385.701010:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397385.701018:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397385.701042:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397385.701265:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868480 00000100:00100000:3.0:1787397385.701274:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868480 00000100:00100000:3.0:1787397385.701351:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868608 00000100:00100000:3.0:1787397385.701355:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868608 00000100:00100000:3.0:1787397385.701375:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:3.0:1787397385.701384:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700868480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397385.701413:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397385.701477:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700868480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.701485:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:3.0:1787397385.701504:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1787397385.701511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700868608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397385.701548:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397385.701579:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700868608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397385.701585:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:2.0:1787397385.705109:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397385.705140:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968724 gen 2 00000004:00080000:2.0:1787397385.705145:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702618380, transno 4294968724 00000100:00100000:2.0:1787397385.705176:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700868480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787397386.020736:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397386.216037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700868736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397386.216119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397386.216957:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868736 00000100:00100000:0.0:1787397386.216968:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868736 00000100:00100000:0.0:1787397386.217037:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1787397386.217048:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700868736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397386.217094:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:0.0:1787397386.232780:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700868736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15720us (16647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397386.233912:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:3.0:1787397386.234073:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700868736:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787397386.797934:0:84093:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd5eeeb480 00000020:00000080:3.0:1787397386.797953:0:84093:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1787397386.797961:0:84093:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:2.0:1787397387.046212:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397388.068910:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397388.260726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397388.260752:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700868864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397388.260824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397388.260872:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868864 00000100:00100000:0.0:1787397388.260880:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868864 00000100:00100000:0.0:1787397388.260942:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1787397388.260953:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700868864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397388.260982:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397388.261040:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700868864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397388.261049:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1787397388.261096:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700868864:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397388.261206:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397388.261386:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397388.261397:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700868992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397388.261430:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397388.261458:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700868992 00000100:00100000:1.0:1787397388.261462:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700868992 00000100:00100000:1.0:1787397388.261493:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1787397388.261500:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700868992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397388.261547:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397388.261584:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700868992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397388.261591:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1787397388.261626:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700868992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397388.261741:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700869120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397388.261770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397388.261833:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869120 00000100:00100000:0.0:1787397388.261838:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869120 00000100:00100000:0.0:1787397388.261878:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1787397388.261885:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700869120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397388.261901:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397388.261933:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700869120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397388.261940:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00080000:1.0:1787397388.262026:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397388.262048:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700869120:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397389.092896:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397390.118054:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397390.314626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700869376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.314745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.314790:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700869888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.314836:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.314859:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700870400:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.314883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.314915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787397390.314921:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700869248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.314953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.314983:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700869760:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.315005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.315023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700870272:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316291:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316337:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700870784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316410:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700869504:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316460:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700870016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316508:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700870528:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316547:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316575:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787397390.316582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700869632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316606:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316623:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700870144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316694:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700870656:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.316718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.316760:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869376 00000100:00100000:3.0:1787397390.316771:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869376 00000100:00100000:3.0:1787397390.317947:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869760 00000100:00100000:3.0:1787397390.317958:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869760 00000100:00100000:3.0:1787397390.317982:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870272 00000100:00100000:3.0:1787397390.317985:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870272 00000100:00100000:3.0:1787397390.317999:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870784 00000100:00100000:3.0:1787397390.318001:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870784 00000100:00100000:3.0:1787397390.318012:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869504 00000100:00100000:3.0:1787397390.318016:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869504 00000100:00100000:2.0:1787397390.318203:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870016 00000100:00100000:2.0:1787397390.318208:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870016 00000100:00100000:2.0:1787397390.318248:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870528 00000100:00100000:2.0:1787397390.318252:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870528 00000100:00100000:2.0:1787397390.318271:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870144 00000100:00100000:2.0:1787397390.318273:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870144 00000100:00100000:2.0:1787397390.318293:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870656 00000100:00100000:2.0:1787397390.318296:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870656 00000100:00100000:2.0:1787397390.318319:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:2.0:1787397390.318329:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700870016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318441:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700870016:12345-0@lo:400:kworker.0 Request processed in 112us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397390.318448:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:2.0:1787397390.318476:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:2.0:1787397390.318482:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700870528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318514:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700870528:12345-0@lo:400:kworker.0 Request processed in 32us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397390.318537:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:2.0:1787397390.318549:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:2.0:1787397390.318556:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700870144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318585:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700870144:12345-0@lo:400:kworker.0 Request processed in 30us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397390.318592:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:2.0:1787397390.318601:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1787397390.318608:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700870656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318635:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700870656:12345-0@lo:400:kworker.0 Request processed in 27us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397390.318641:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1787397390.318706:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700870144:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318719:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700870656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318731:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700870016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.318741:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700870528:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.319159:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869632 00000100:00100000:3.0:1787397390.319164:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869632 00000100:00100000:3.0:1787397390.319188:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1787397390.319197:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700869376:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397390.319218:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829b40700 x1874218700869376/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397390.319269:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700869376:12345-0@lo:400:kworker.0 Request processed in 74us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319276:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1787397390.319293:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1787397390.319301:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700869760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.319336:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700869760:12345-0@lo:400:kworker.0 Request processed in 36us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319342:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1787397390.319354:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1787397390.319367:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700870272:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397390.319380:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836691180 x1874218700870272/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397390.319411:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700870272:12345-0@lo:400:kworker.0 Request processed in 45us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319417:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1787397390.319430:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1787397390.319436:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700870784:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397390.319449:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836691500 x1874218700870784/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397390.319476:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700870784:12345-0@lo:400:kworker.0 Request processed in 40us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319482:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1787397390.319493:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1787397390.319500:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700869504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.319552:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700869504:12345-0@lo:400:kworker.0 Request processed in 52us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319559:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1787397390.319573:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1787397390.319580:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700869632:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397390.319592:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705230380 x1874218700869632/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397390.319619:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700869632:12345-0@lo:400:kworker.0 Request processed in 40us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319636:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1787397390.319661:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869888 00000100:00100000:3.0:1787397390.319666:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869888 00000100:00100000:3.0:1787397390.319699:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870400 00000100:00100000:3.0:1787397390.319703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870400 00000100:00100000:3.0:1787397390.319717:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1787397390.319723:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700869888:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397390.319740:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836691f80 x1874218700869888/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397390.319772:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700869888:12345-0@lo:400:kworker.0 Request processed in 49us (4935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.319778:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1787397390.319790:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1787397390.319796:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.320713:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700869632:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.320733:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700869504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.320785:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700869760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.321002:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700870272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.321017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700870784:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.321041:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700869376:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.321054:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700869888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.321361:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700870400:12345-0@lo:400:kworker.0 Request processed in 1562us (6473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.321374:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1787397390.321420:0:83270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700869248 00000100:00100000:3.0:1787397390.321427:0:83270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700869248 00000100:00100000:3.0:1787397390.321473:0:83270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787397390.321481:0:83270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700869248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397390.321562:0:83270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700869248:12345-0@lo:400:kworker.0 Request processed in 81us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.321569:0:83270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1787397390.321655:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397390.321663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397390.321675:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397390.321678:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397390.322944:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700869248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397390.322966:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700870400:0@lo:400:kworker.0 00000100:00100000:0.0:1787397390.597622:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397390.597667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397390.597713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397390.597739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397390.597769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397390.597793:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109888 00000100:00100000:0.0:1787397390.597793:0:83271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109504 00000100:00100000:2.0:1787397390.597807:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109888 00000100:00100000:0.0:1787397390.597808:0:83271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109504 00000100:00100000:2.0:1787397390.597883:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110016 00000100:00100000:2.0:1787397390.597887:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110016 00000100:00100000:2.0:1787397390.597917:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2303 00000100:00100000:2.0:1787397390.597928:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681109888:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397390.597997:0:83271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 160 00000100:00100000:0.0:1787397390.598004:0:83271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681109504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397390.598024:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681109888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397390.598032:0:83271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681109504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397390.598038:0:83271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 160 00000100:00100000:0.0:1787397390.598080:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109632 00000100:00100000:0.0:1787397390.598084:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109632 00000100:00100000:2.0:1787397390.598150:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2303 00000100:00100000:2.0:1787397390.598169:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2304 00000100:00100000:2.0:1787397390.598176:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681110016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397390.598217:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681110016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397390.598224:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2304 00000100:00100000:3.0:1787397390.598333:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109760 00000100:00100000:3.0:1787397390.598339:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109760 00000100:00100000:0.0:1787397390.598411:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 997 00000100:00100000:0.0:1787397390.598447:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2403:x1874218681109632:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787397390.598482:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a702618380 x1874218681109632/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:586/0 lens 224/224 e 0 to 0 dl 1787397401 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397390.598515:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2403:x1874218681109632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 70us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397390.598544:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 997 00000100:00100000:3.0:1787397390.600042:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 998 00000100:00100000:3.0:1787397390.600058:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681109760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397390.600286:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681109760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 230us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.600294:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 998 00000100:00080000:3.0:1787397390.600370:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397390.600376:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397390.600380:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397390.600384:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397390.826167:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397390.826206:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700870912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397390.826327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397390.826477:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700870912 00000100:00100000:1.0:1787397390.826487:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700870912 00000100:00100000:1.0:1787397390.826596:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:1.0:1787397390.826606:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700870912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397390.826647:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397390.826699:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700870912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397390.826706:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:1.0:1787397390.826759:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700870912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397390.828041:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700871040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397390.828129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397390.828197:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871040 00000100:00100000:3.0:1787397390.828204:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871040 00000100:00100000:3.0:1787397390.828254:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1787397390.828262:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700871040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397390.828290:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397390.828332:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700871040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397390.828339:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1787397390.828381:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700871040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787397391.141440:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397391.333757:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397391.333780:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700871168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397391.333868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397391.334024:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871168 00000100:00100000:1.0:1787397391.334035:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871168 00000100:00100000:1.0:1787397391.334098:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:1.0:1787397391.334117:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700871168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397391.334161:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00010000:00000080:1.0:1787397391.334182:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf8380 x1874218700871168/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:587/0 lens 224/368 e 0 to 0 dl 1787397402 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397391.334234:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700871168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397391.334244:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:3.0:1787397391.334629:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700871168:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397392.169624:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787397392.412503:0:83265:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280515 is committed 00010000:00010000:0.0:1787397392.412852:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412866:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412875:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412881:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096be00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397392.412886:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412894:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412911:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82250c100) 00010000:00010000:0.0:1787397392.412915:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397392.412927:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412934:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096be00/0x274786fe0d18f2bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412951:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412957:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412963:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412967:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397392.412970:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412976:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.412983:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82250c100) 00010000:00010000:0.0:1787397392.412995:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397392.412998:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397392.413004:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ba00/0x274786fe0d18f2f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397393.192354:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397393.384255:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700871296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397393.384330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397393.384628:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871296 00000100:00100000:0.0:1787397393.384636:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871296 00000100:00100000:0.0:1787397393.384681:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1787397393.384711:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700871296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397393.384743:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397393.384794:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700871296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397393.384802:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1787397393.384827:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700871424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397393.384856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397393.384887:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871424 00000100:00100000:0.0:1787397393.384890:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871424 00000100:00100000:0.0:1787397393.384924:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1787397393.384930:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700871424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397393.384948:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397393.384976:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700871424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397393.384982:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1787397393.385020:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700871424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397393.385139:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700871296:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787397393.385843:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397393.386132:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700871552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397393.386193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397393.387129:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871552 00000100:00100000:1.0:1787397393.387138:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871552 00000100:00100000:1.0:1787397393.387200:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:1.0:1787397393.387218:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700871552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397393.387245:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397393.387306:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700871552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397393.387331:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00080000:3.0:1787397393.387400:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397393.387441:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700871552:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787397393.576274:0:84389:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1787397393.697962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397393.698364:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110144 00000100:00100000:2.0:1787397393.698385:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110144 00000100:00100000:2.0:1787397393.698630:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1013 00000100:00100000:2.0:1787397393.698644:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:64842:x1874218681110144:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397393.698666:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397393.698748:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d18f30c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e07 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698818:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698832:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698847:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397393.698896:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397393.698899:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1787397393.698919:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698944:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d18f30c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e07 expref: 7 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698960:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e07 expref: 6 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397393.698968:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a834592c00) 00010000:00010000:2.0:1787397393.698971:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397393.698974:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54200, rc 0) 00010000:00000080:2.0:1787397393.698990:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876f100 x1874218681110144/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 576/688 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:0.0:1787397393.699295:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397393.702218:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64842:x1874218681110144:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3564us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397393.702233:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1013 00000100:00100000:1.0:1787397393.713648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397393.713772:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110272 00000100:00100000:0.0:1787397393.713784:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110272 00000100:00100000:0.0:1787397393.713856:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1014 00000100:00100000:0.0:1787397393.713867:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64842:x1874218681110272:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397393.713892:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397393.713914:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d18f31a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e0e expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714005:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714021:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714050:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714075:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714083:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714090:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714138:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714145:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714152:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714158:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397393.714162:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714180:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714193:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a834592c00) 00010000:00010000:0.0:1787397393.714196:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397393.714202:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714207:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18f321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714221:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714227:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714233:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714239:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397393.714241:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714247:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714254:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a82242ce00) 00010000:00010000:0.0:1787397393.714256:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397393.714259:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714274:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18f328 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714309:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d18f31a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e0e expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714320:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a834592c00) 00010000:00010000:0.0:1787397393.714322:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397393.714327:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d18f31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e0e expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.714337:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00010000:00000080:0.0:1787397393.714346:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70698f800 x1874218681110272/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 592/584 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397393.714410:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64842:x1874218681110272:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 545us (773us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397393.714419:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1014 00000100:00100000:3.0:1787397393.734972:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397393.735008:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110528 00000100:00100000:3.0:1787397393.735017:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110528 00000100:00100000:3.0:1787397393.736785:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1015 00000100:00100000:3.0:1787397393.736799:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:64842:x1874218681110528:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397393.736820:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397393.736823:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787397393.736850:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e07 expref: 6 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.736867:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a834592c00) 00010000:00010000:3.0:1787397393.736877:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397393.736893:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f32f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e15 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.736995:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.737007:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.738273:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.738304:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.738314:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.738324:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740641:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740666:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740678:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397393.740691:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787397393.740721:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740728:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740734:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740740:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740760:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397393.740765:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740773:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740785:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:3.0:1787397393.740788:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397393.740791:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740797:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f336 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397393.740817:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000140b0209 reply state 000000006da50cfa transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740829:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740835:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a82250c300) 00010000:00010000:3.0:1787397393.740837:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397393.740841:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397393.740877:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f32f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740901:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.740919:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff89a82250c900) 00010000:00010000:3.0:1787397393.740921:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397393.740924:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a800, rc 0) 00010000:00000080:3.0:1787397393.740933:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfb100 x1874218681110528/t94489280516(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 536/608 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397393.741011:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64842:x1874218681110528:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 4214us (6050us total) trans 94489280516 rc 0/0 00000100:00100000:3.0:1787397393.741021:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1015 00000100:00100000:1.0:1787397393.748320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397393.748592:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110784 00000100:00100000:3.0:1787397393.748603:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110784 00000100:00100000:3.0:1787397393.748666:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1016 00000100:00100000:3.0:1787397393.748676:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64842:x1874218681110784:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397393.748702:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397393.748723:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e1c expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.748836:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.748851:0:67264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.748859:0:67264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.748893:0:67264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.748925:0:67264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 9 pid: 66178 timeout: 3373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397393.748942:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67264:1874218700871680:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397393.749047:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397393.764040:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397393.765100:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110912 00000100:00100000:0.0:1787397393.765115:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110912 00010000:00010000:0.0:1787397393.765161:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 10 pid: 66178 timeout: 3373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397393.765211:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2580 00000100:00100000:0.0:1787397393.765221:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2404:x1874218681110912:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397393.765236:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397393.765243:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 10 pid: 66178 timeout: 3373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.765266:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 10 pid: 66178 timeout: 3373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.765294:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff89a82250c900) 00010000:00010000:0.0:1787397393.765300:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.765311:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.765318:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397393.765339:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397393.765391:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2404:x1874218681110912:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 172us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397393.765399:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2580 00010000:00010000:3.0:1787397393.770700:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a800/0x274786fe0d18f344 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 9 pid: 66178 timeout: 3373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397393.770731:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67264:1874218700871680:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397393.770756:0:67264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.770767:0:67264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.770774:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397393.770797:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787397393.771117:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771128:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771137:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771159:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397393.771164:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771174:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771264:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff89a82250c900) 00010000:00010000:3.0:1787397393.771269:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397393.771275:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771282:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b400/0x274786fe0d18f359 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771356:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f352 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e1c expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771367:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82250ce00) 00010000:00010000:3.0:1787397393.771370:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397393.771374:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096b800/0x274786fe0d18f352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e1c expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397393.771386:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b800, rc 0) 00010000:00000080:3.0:1787397393.771395:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70698e300 x1874218681110784/t94489280517(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 712/824 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397393.771578:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64842:x1874218681110784:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 22902us (23267us total) trans 94489280517 rc 301/301 00000100:00100000:3.0:1787397393.771598:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1016 00000100:00100000:1.0:1787397393.783043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397393.783205:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111168 00000100:00100000:2.0:1787397393.783217:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111168 00000100:00100000:2.0:1787397393.783277:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 210 00000100:00100000:2.0:1787397393.783288:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:64842:x1874218681111168:12345-192.168.204.60@tcp:35:lfs.0 00010000:00000080:2.0:1787397393.783482:0:66180:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70698c380 x1874218681111168/t94489280518(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 392/456 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397393.783588:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:64842:x1874218681111168:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 302us (571us total) trans 94489280518 rc 0/0 00000100:00100000:2.0:1787397393.783596:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 210 00000100:00100000:1.0:1787397393.790382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397393.790471:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111424 00000100:00100000:0.0:1787397393.790483:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111424 00000100:00100000:0.0:1787397393.790621:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 211 00000100:00100000:0.0:1787397393.790632:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:64842:x1874218681111424:12345-192.168.204.60@tcp:35:lfs.0 00010000:00000080:0.0:1787397393.790867:0:80567:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70939ea00 x1874218681111424/t94489280519(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:589/0 lens 392/456 e 0 to 0 dl 1787397404 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397393.790928:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:64842:x1874218681111424:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 298us (557us total) trans 94489280519 rc 0/0 00000100:00100000:0.0:1787397393.790936:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 211 00010000:00010000:3.0:1787397394.213409:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397395.238790:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397395.431098:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700871808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.431145:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700871936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.433130:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700872064:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.433276:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397395.433314:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700872448:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.433342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397395.433364:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700872960:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.433385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397395.433425:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872448 00000100:00100000:2.0:1787397395.433433:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872448 00000100:00100000:2.0:1787397395.433479:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872960 00000100:00100000:2.0:1787397395.433482:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872960 00000100:00100000:2.0:1787397395.433498:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:2.0:1787397395.433505:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700872448:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397395.433554:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70691ca80 x1874218700872448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397395.433593:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700872448:12345-0@lo:400:kworker.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397395.433601:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:2.0:1787397395.433618:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1787397395.433624:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700872960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.436023:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700872960:12345-0@lo:400:kworker.0 Request processed in 2393us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397395.436048:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1787397395.436135:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700872448:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.436149:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700872960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437207:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.437255:0:83270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871808 00000100:00100000:1.0:1787397395.437266:0:83270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871808 00000100:00100000:3.0:1787397395.437285:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700872320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.437335:0:83270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787397395.437347:0:83270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700871808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.437409:0:83270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700871808:12345-0@lo:400:kworker.0 Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397395.437412:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700872832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.437423:0:83270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787397395.437446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397395.437469:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700873344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.437472:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700871936 00000100:00100000:1.0:1787397395.437477:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700871936 00000100:00100000:3.0:1787397395.437494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.437549:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1787397395.437558:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700871936:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787397395.437574:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70691c700 x1874218700871936/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397395.437610:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700871936:12345-0@lo:400:kworker.0 Request processed in 54us (4336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.437617:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1787397395.437805:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700871808:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437826:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787397395.437832:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700872192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397395.437892:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700872704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437917:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397395.437936:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700873216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.437985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.438080:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872320 00000100:00100000:1.0:1787397395.438084:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872320 00000100:00100000:1.0:1787397395.438110:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872832 00000100:00100000:1.0:1787397395.438113:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872832 00000100:00100000:1.0:1787397395.438125:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873344 00000100:00100000:1.0:1787397395.438128:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873344 00000100:00100000:1.0:1787397395.438139:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872192 00000100:00100000:1.0:1787397395.438141:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872192 00000100:00100000:1.0:1787397395.438155:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1787397395.438162:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700872320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.438201:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1787397395.438210:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700872832:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397395.438226:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf9f80 x1874218700872832/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397395.438252:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700872320:12345-0@lo:400:kworker.0 Request processed in 89us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.438261:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1787397395.438268:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700872832:12345-0@lo:400:kworker.0 Request processed in 57us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.438278:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1787397395.438290:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700873344:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787397395.438304:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf9880 x1874218700873344/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397395.438330:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700873344:12345-0@lo:400:kworker.0 Request processed in 44us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.438404:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.438421:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700872576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.438445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.438462:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700873088:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.438481:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.438511:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872064 00000100:00100000:0.0:1787397395.438515:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872064 00000100:00100000:2.0:1787397395.438682:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700872320:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.438703:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700872832:0@lo:400:kworker.0 00000100:00100000:2.0:1787397395.438714:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700873344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.439146:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1787397395.443454:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1787397395.443515:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1787397395.443554:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700872192:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787397395.443583:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350ad80 x1874218700872192/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397395.443706:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700872192:12345-0@lo:400:kworker.0 Request processed in 182us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.443717:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1787397395.445450:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700871936:0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.445512:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700872192:0@lo:400:kworker.0 00000100:00080000:1.0:1787397395.447984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397395.447996:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397395.449215:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1787397395.449255:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872704 00000100:00100000:0.0:1787397395.449267:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872704 00000100:00100000:0.0:1787397395.449340:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873216 00000100:00100000:0.0:1787397395.449343:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873216 00000100:00100000:0.0:1787397395.449366:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700872576 00000100:00100000:3.0:1787397395.449370:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700872064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.449370:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700872576 00000100:00100000:0.0:1787397395.449405:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873088 00000100:00100000:0.0:1787397395.449410:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873088 00000100:00100000:0.0:1787397395.449437:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:0.0:1787397395.449446:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700872704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.449573:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:1.0:1787397395.449585:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700873216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.450557:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700872704:12345-0@lo:400:kworker.0 Request processed in 1111us (12637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.450569:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00100000:0.0:1787397395.450599:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:0.0:1787397395.450608:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80353b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700872576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.450650:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700872064:12345-0@lo:400:kworker.0 Request processed in 1227us (12109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397395.450662:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1787397395.450699:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:3.0:1787397395.450708:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80353a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700873088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397395.450748:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80353a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700873088:12345-0@lo:400:kworker.0 Request processed in 43us (12266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397395.450755:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1787397395.450835:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80353b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700872576:12345-0@lo:400:kworker.0 Request processed in 228us (12387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.450841:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:0.0:1787397395.450899:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700872064:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.450925:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700872576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.450950:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700873088:0@lo:400:kworker.0 00000100:00100000:0.0:1787397395.451003:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700872704:0@lo:400:kworker.0 00000100:00080000:0.0:1787397395.456078:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397395.456090:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397395.456591:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700873216:12345-0@lo:400:kworker.0 Request processed in 7004us (18598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.456605:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1787397395.461858:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700873216:0@lo:400:kworker.0 00000100:00100000:1.0:1787397395.721145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397395.721196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397395.721222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397395.721244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397395.721325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397395.721358:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111680 00000100:00100000:1.0:1787397395.721369:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111680 00000100:00100000:1.0:1787397395.721438:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111808 00000100:00100000:1.0:1787397395.721442:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111808 00000100:00100000:1.0:1787397395.721470:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1005 00000100:00100000:1.0:1787397395.721480:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681111680:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787397395.721514:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70939e680 x1874218681111680/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397395.721596:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681111680:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 119us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.721604:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1005 00000100:00100000:1.0:1787397395.721625:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1006 00000100:00100000:1.0:1787397395.721633:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681111808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397395.721672:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681111808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.721678:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1006 00000100:00100000:1.0:1787397395.721703:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111936 00000100:00100000:1.0:1787397395.721708:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111936 00000100:00100000:1.0:1787397395.721738:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112064 00000100:00100000:1.0:1787397395.721741:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112064 00000100:00100000:1.0:1787397395.721764:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2309 00000100:00100000:1.0:1787397395.721771:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681111936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397395.721796:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681111936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.721803:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2309 00000100:00100000:1.0:1787397395.721815:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2310 00000100:00100000:1.0:1787397395.721822:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681112064:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397395.721844:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681112064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397395.721849:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2310 00000100:00080000:0.0:1787397395.722056:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397395.722062:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397395.722066:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397395.722068:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397395.726625:0:83271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111552 00000100:00100000:3.0:1787397395.726711:0:83271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111552 00000100:00100000:3.0:1787397395.726775:0:83271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:3.0:1787397395.726783:0:83271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681111552:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397395.727060:0:83271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705d62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681111552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 277us (5926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397395.727069:0:83271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 162 00000020:01000004:1.0:1787397395.849677:0:84486:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787397395.849735:0:84486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.849750:0:84486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.849758:0:84486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.849780:0:84486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.849811:0:84486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787397395.849816:0:84486:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787397395.849847:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397395.849851:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397395.849857:0:84486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397395.849882:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a828783800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787397395.850452:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700873472:0@lo:39:umount.0 00000100:00100000:2.0:1787397395.850552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.854797:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873472 00000100:00100000:1.0:1787397395.854813:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873472 00000100:00100000:1.0:1787397395.854880:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1787397395.854896:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700873472:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787397395.855048:0:67264:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f081 00000100:00080000:1.0:1787397395.855059:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a810dbf000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787397395.855086:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00000080:1.0:1787397395.855094:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8288c2d80 x1874218700873472/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:591/0 lens 224/224 e 0 to 0 dl 1787397406 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397395.855095:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.855106:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397395.855110:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.855119:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397395.855126:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397395.855132:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397395.855134:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397395.855138:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1787397395.855169:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218700873472:12345-0@lo:39:umount.0 Request processed in 281us (4616us total) trans 0 rc 0/0 00010000:00010000:0.0:1787397395.855171:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397395.855176:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00010000:00010000:0.0:1787397395.855188:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1787397395.855189:0:67264:0:(genops.c:906:class_export_put()) final put ffff89a827b39000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787397395.855209:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.855216:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18ef62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef69 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.855229:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.855231:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.855232:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397395.855243:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b39000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787397395.855313:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a810dbf000 for lustre-MDT0000 00000100:00100000:0.0:1787397395.855331:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700873600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397395.855371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397395.856667:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828783800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787397395.856684:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700873472:0@lo:39:umount.0 00010000:00010000:3.0:1787397395.857277:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397395.862348:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397395.862358:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787397395.862367:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787397395.862517:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873600 00000100:00100000:2.0:1787397395.862552:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873600 00000100:00100000:2.0:1787397395.862729:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1787397395.862740:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700873600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397395.862769:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397395.862861:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab600/0x274786fe0d18ef69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ef62 expref: 24 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.862879:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397395.863095:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803539880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218700873600:12345-0@lo:103:ldlm_bl.0 Request processed in 356us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397395.863103:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1787397395.863149:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700873600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397395.866166:0:84486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866325:0:84486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866400:0:84486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866406:0:84486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866433:0:84486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397395.866440:0:84486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866447:0:84486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866452:0:84486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866459:0:84486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866518:0:84486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397395.866551:0:84486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866558:0:84486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866575:0:84486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.866582:0:84486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.866665:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397395.866673:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.866681:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397395.866685:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.866700:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397395.866707:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397395.866712:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787397395.866715:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787397395.866750:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.866757:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397395.866803:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397395.866810:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397395.866814:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700873728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397395.866817:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397395.866819:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866826:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397395.866832:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397395.866845:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397395.866847:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787397395.866849:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787397395.866867:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866872:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397395.866874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397395.866887:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866894:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d18ef85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866905:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397395.866908:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866913:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397395.866916:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.866923:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397395.866929:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397395.866935:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787397395.866937:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787397395.866948:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.867032:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397395.867040:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.867048:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.867050:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.867052:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397395.867064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80353b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700873856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397395.867092:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.867114:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397395.867120:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80353bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700873984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397395.867124:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.867131:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f0600/0x274786fe0d18ee90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee97 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397395.867141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397395.867142:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397395.867143:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397395.867145:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397395.867173:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873728 00000100:00100000:0.0:1787397395.867180:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873728 00010000:00010000:1.0:1787397395.867211:0:84486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397395.867216:0:84486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d18ef54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ef5b expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397395.867222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873856 00000100:00100000:0.0:1787397395.867225:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873856 10000000:01000000:1.0:1787397395.867226:0:84486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787397395.867234:0:84486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.867241:0:84486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397395.867243:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700873984 00000100:00100000:0.0:1787397395.867245:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700873984 00010000:00010000:1.0:1787397395.867248:0:84486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397395.867255:0:84486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397395.867263:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1787397395.867271:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+25:3649:x1874218700873728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397395.867284:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397395.867300:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63e00/0x274786fe0d18ee97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ee90 expref: 25 pid: 83271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397395.867303:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1787397395.867310:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700873856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397395.867312:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397395.867318:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397395.867338:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62e00/0x274786fe0d18ef8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ef85 expref: 24 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397395.867345:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700873728:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (470us total) trans 0 rc 0/0 00010000:00010000:2.0:1787397395.867349:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397395.867352:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1787397395.867375:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218700873856:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.867375:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1787397395.867381:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1787397395.867381:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218700873984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397395.867388:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397395.867398:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720aa00/0x274786fe0d18ef5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ef54 expref: 21 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.867406:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397395.867421:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80353b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700873856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397395.867424:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+20:3650:x1874218700873984:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.867429:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1787397395.867438:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80353bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700873984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397395.867453:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700873728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397395.867572:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397395.867578:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.867584:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397395.867588:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.867595:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397395.867607:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397395.867612:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787397395.867614:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1787397395.867682:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.867690:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397395.867728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700874112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397395.867760:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397395.867813:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397395.867821:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397395.867823:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397395.867825:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397395.868002:0:84486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397395.868008:0:84486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d18ee7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ee89 expref: -99 pid: 83264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397395.868027:0:84486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1787397395.868031:0:84486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787397395.868040:0:84486:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787397395.868074:0:84486:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787397395.868079:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1787397395.868084:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787397395.868090:0:84486:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1787397395.868368:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874112 00000100:00100000:0.0:1787397395.868375:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874112 00000100:00100000:0.0:1787397395.868411:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1787397395.868419:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218700874112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397395.868430:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397395.868431:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.868442:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720ae00/0x274786fe0d18ee89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ee7b expref: 20 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.868453:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397395.869156:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218700874112:12345-0@lo:103:ldlm_bl.0 Request processed in 734us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.869166:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1787397395.869177:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700874112:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1787397395.871720:0:84486:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1787397395.872461:0:83265:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00000020:00000080:1.0:1787397395.873153:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1787397395.873167:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a838262000 e90f04db-6a63-4f01-92c7-7bf813f9f081 192.168.204.60@tcp 5 (0 0 0) 0 0 0 1: ffff89a817b33000 94489280519 stale:0 00000020:00080000:1.0:1787397395.873174:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a83879f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.873179:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a827b3c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.873183:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a817ef9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.873187:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a828786800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.873191:0:84486:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a703c8b380) has exports, disconnecting them 00000020:00080000:1.0:1787397395.873197:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a838262000), last request at 1787397395 00000020:00000080:1.0:1787397395.873204:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f24f 00000100:00080000:1.0:1787397395.873214:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a8069d6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397395.873244:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a838262000): rc 0 00000020:00080000:1.0:1787397395.873247:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a83879f800), last request at 1787397183 00000020:00000080:1.0:1787397395.873250:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f07a 00000100:00080000:1.0:1787397395.873253:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a83879e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397395.873268:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83879f800): rc 0 00000020:00000080:1.0:1787397395.873270:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a83879f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787397395.873283:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a827b3c000), last request at 1787397395 00000020:00000080:1.0:1787397395.873286:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f073 00000100:00080000:1.0:1787397395.873289:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a827b38800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787397395.873306:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83879f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397395.873368:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879e800 for lustre-MDT0000 00000020:00080000:1.0:1787397395.873392:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a827b3c000): rc 0 00000020:00000080:1.0:1787397395.873395:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a827b3c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787397395.873402:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a817ef9000), last request at 1787397395 00000020:00000080:1.0:1787397395.873406:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f06c 00000100:00080000:1.0:1787397395.873416:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a827b3c800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787397395.873432:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b3c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397395.873455:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a827b38800 for lustre-MDT0000 00010000:00010000:1.0:1787397395.873484:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787397395.873491:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817ef9000): rc 0 00000020:00000080:1.0:1787397395.873493:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a817ef9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787397395.873501:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a828786800), last request at 1787397178 00000020:00000080:1.0:1787397395.873504:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eed6 00000100:00080000:1.0:1787397395.873514:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a83879d800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787397395.873553:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ef9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397395.873576:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a827b3c800 for lustre-MDT0000 00010000:00010000:1.0:1787397395.873585:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787397395.873592:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a828786800): rc 0 00000020:00000080:1.0:1787397395.873594:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a828786800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1787397395.873606:0:84486:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe40e2bae0 00000020:00000080:1.0:1787397395.873617:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828786800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397395.873653:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879d800 for lustre-MDT0000 00000100:00080000:1.0:1787397395.873674:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397395.873678:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378729 gen 3 00010000:00010000:3.0:1787397395.874896:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397395.874909:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397395.875081:0:84486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787397395.875112:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a806901000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787397395.875219:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875233:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875241:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875262:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397395.875267:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875275:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875297:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a82250c300) 00010000:00010000:0.0:1787397395.875300:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397395.875304:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397395.875310:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096ac00/0x274786fe0d18f33d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787397395.875342:0:3635:0:(genops.c:906:class_export_put()) final put ffff89a838262000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00010000:00010000:0.0:1787397395.875374:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397395.875383:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838262000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0000 00000020:00000080:0.0:1787397395.875425:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8069d6800 for lustre-MDT0000 00000100:00100000:3.0:1787397395.875506:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874240:0@lo:39:umount.0 00000100:00100000:3.0:1787397395.875616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397395.875888:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874240 00000100:00100000:1.0:1787397395.875897:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874240 00000100:00100000:1.0:1787397395.876039:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:1.0:1787397395.876051:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700874240:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787397395.876086:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef15 00000100:00080000:1.0:1787397395.876095:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a817eca000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397395.876120:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378729 00000100:00100000:1.0:1787397395.876274:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218700874240:12345-0@lo:39:umount.0 Request processed in 225us (657us total) trans 81604378730 rc 0/0 00000100:00100000:1.0:1787397395.876282:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00080000:1.0:1787397395.876327:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806901000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787397395.876334:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874240:0@lo:39:umount.0 00010000:00010000:0.0:1787397395.876407:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397395.877469:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397395.877475:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968724 gen 3 00000004:00080000:1.0:1787397395.877492:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787397395.877610:0:84486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787397395.878129:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80353bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1874218700874368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787397395.878199:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a838799000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787397395.878221:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397395.878224:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968721 gen 3 00000004:00080000:1.0:1787397395.878238:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787397395.878328:0:84486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787397395.878337:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a706ff5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787397395.878380:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c8b380) has no exports 00000100:00100000:0.0:1787397395.878486:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397395.878503:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1874218700874624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397395.878549:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874496:0@lo:9:umount.0 00000100:00100000:0.0:1787397395.878613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.878655:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874752:0@lo:9:umount.0 00000100:00100000:0.0:1787397395.878678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397395.878713:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874496 00000100:00100000:0.0:1787397395.878734:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874496 00000100:00100000:0.0:1787397395.878777:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874752 00000100:00100000:0.0:1787397395.878780:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874752 00000100:00100000:0.0:1787397395.878959:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:0.0:1787397395.878967:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80353b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700874496:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787397395.878992:0:26169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef23 00000100:00080000:0.0:1787397395.879000:0:26169:0:(import.c:65:import_set_state_nolock()) ffff89a817ecd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397395.879055:0:26169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968724 00000100:00100000:0.0:1787397395.879208:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80353b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700874496:12345-0@lo:9:umount.0 Request processed in 240us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.879216:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:0.0:1787397395.879233:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1787397395.879239:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700874752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787397395.879252:0:26169:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef3f 00000100:00080000:0.0:1787397395.879258:0:26169:0:(import.c:65:import_set_state_nolock()) ffff89a836715800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397395.879282:0:26169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968721 00000100:00100000:0.0:1787397395.879361:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80353bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700874752:12345-0@lo:9:umount.0 Request processed in 122us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397395.879368:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00010000:00010000:0.0:1787397395.879393:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397395.879399:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397395.879423:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a838799000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397395.879433:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397395.879434:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.879437:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874496:0@lo:9:umount.0 00000100:00080000:0.0:1787397395.879448:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a706ff5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397395.879455:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397395.879456:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.879459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700874752:0@lo:9:umount.0 00000020:00080000:1.0:1787397395.880238:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c8b380) has no exports 00000020:00000080:1.0:1787397395.923688:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eeeb 00000020:00000080:1.0:1787397395.923704:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787397395.923718:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787397395.924024:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787397395.924085:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397395.924099:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787397395.924104:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a82e4f99c0) has no exports 00000020:00000080:0.0:1787397395.924452:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eee4 00000020:00000080:0.0:1787397395.924458:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a7037c2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397395.924514:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397395.924819:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787397395.924823:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a7037c4800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787397395.924826:0:84486:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787397395.924831:0:84486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397395.925141:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787397395.925340:0:84486:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7057149c0 - data ffff89a8188395e8/ffff89a807057c00 00000020:01000000:0.0:1787397395.925490:0:84486:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a705714d80 - data ffff89a701c33a20/ffff89a828827400 00000100:00080000:0.0:1787397395.978029:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787397395.978038:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378729 gen 4 00000100:00100000:0.0:1787397395.978054:0:84486:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a70939fb80 x1874218700874240/t81604378730(81604378730) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397405 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397395.978077:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787397395.979796:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787397395.979802:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968724 gen 4 00000004:00080000:0.0:1787397395.979815:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.979817:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787397395.980427:0:83282:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787397395.980433:0:83282:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 2 count 1 00000040:00080000:1.0:1787397395.980443:0:83282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:0.0:1787397395.981249:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787397395.981253:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968721 gen 4 00000004:00080000:0.0:1787397395.981272:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.981274:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787397395.981753:0:83284:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787397395.981758:0:83284:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 1 count 1 00000040:00080000:1.0:1787397395.981779:0:83284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:0.0:1787397395.982903:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eea5 00000020:00000080:0.0:1787397395.982915:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a8037da800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397395.983740:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397395.984356:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eeba 00000020:00000080:0.0:1787397395.984364:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a837bb5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787397395.984372:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787397395.984387:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397395.984399:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397395.984403:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a7033a3380) has no exports 00000004:01000000:0.0:1787397395.984602:0:84486:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787397395.984610:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef38 00000020:00000080:0.0:1787397395.984615:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a836715000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787397395.984619:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787397395.984623:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397395.984767:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787397395.984774:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836715000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787397395.985228:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397395.985233:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a8387819c0) has no exports 00000020:00000080:0.0:1787397395.985241:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef31 00000020:00000080:0.0:1787397395.985247:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a706ff3000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787397395.985710:0:84486:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787397395.985716:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787397395.985720:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968721 gen 5 00000004:00080000:0.0:1787397395.985727:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.985729:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397395.986362:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397395.986467:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397395.986479:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397395.986487:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef1c 00000020:00000080:0.0:1787397395.986494:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a7025d4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787397395.986498:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787397395.986502:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397395.986507:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787397395.986510:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a703c8cd40) has no exports 00000020:00000080:0.0:1787397395.986515:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef0e 00000020:00000080:0.0:1787397395.986518:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a8037dc800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787397395.987159:0:84486:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787397395.987165:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787397395.987167:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968724 gen 5 00000004:00080000:0.0:1787397395.987171:0:84486:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397395.987173:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397395.987216:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397395.987223:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787397395.987237:0:84486:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787397395.987244:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef00 00000020:00000080:0.0:1787397395.987250:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a83ae92000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787397395.987254:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787397395.987258:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397395.987262:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787397395.987265:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a828c1cd40) has no exports 00000020:00000080:0.0:1787397395.987271:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eef9 00000020:00000080:0.0:1787397395.987274:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a806907800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397395.987608:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706ff5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787397395.987615:0:8:0:(genops.c:906:class_export_put()) final put ffff89a7025d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397395.987618:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787397395.987623:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397395.987864:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397395.987871:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397395.987876:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a838799000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397395.987880:0:8:0:(genops.c:906:class_export_put()) final put ffff89a83ae91800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397395.987883:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae91800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787397395.987886:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397395.987919:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae92000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397395.987997:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a806907800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787397395.990652:0:84486:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787397395.990662:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397395.990668:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378729 gen 5 00000100:00100000:1.0:1787397395.990677:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397395.990766:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397395.990780:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397395.990818:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397395.990822:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397395.990827:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a803902000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397395.990832:0:84486:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803902000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787397395.990849:0:84486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397395.991125:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eec1 00000020:00000080:1.0:1787397395.991132:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a837bb2800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787397395.991380:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a806901000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787397395.991389:0:8:0:(genops.c:906:class_export_put()) final put ffff89a8037df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397395.991392:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787397395.991401:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397395.991730:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787397395.991736:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397395.991743:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787397395.991747:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a703c899c0) has no exports 00000020:00000080:1.0:1787397395.991772:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397395.991775:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787397395.991792:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18eec8 00000020:00000080:1.0:1787397395.991797:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a837bb0000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787397395.991804:0:84486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7090fa000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787397395.991808:0:84486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7090fa000 3 00000020:01000004:1.0:1787397395.991811:0:84486:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a7090fa000 from lustre-MDT0000 00000020:00000080:1.0:1787397395.991831:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397395.991835:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787397395.991838:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a8037d8000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787397395.991841:0:84486:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037d8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787397395.991848:0:84486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787397395.991885:0:84486:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787397395.991889:0:84486:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787397395.991892:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787397395.991895:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397395.991898:0:84486:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787397395.991908:0:84486:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a83879b000 367372d5-1a70-4e8f-8f10-c0f943f3662d 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.991914:0:84486:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a803e9f800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.991918:0:84486:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a828c18000) has exports, disconnecting them 00000020:00000080:2.0:1787397395.992069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787397395.992074:0:8:0:(genops.c:906:class_export_put()) final put ffff89a703c33000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787397395.992076:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c33000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787397395.992079:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787397395.992114:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1787397395.992141:0:84486:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a83879b000), last request at 1787397181 00000020:00000080:1.0:1787397395.992166:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f049 00000020:00010000:1.0:1787397395.992172:0:84486:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83879b000: total 0 00000100:00080000:1.0:1787397395.992176:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a838798800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397395.992215:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a83879b000): rc 0 00000020:00080000:1.0:1787397395.992219:0:84486:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a803e9f800), last request at 1787397178 00000020:00000080:1.0:1787397395.992277:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ee66 00000020:00010000:1.0:1787397395.992282:0:84486:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a803e9f800: total 0 00000100:00080000:1.0:1787397395.992285:0:84486:0:(import.c:65:import_set_state_nolock()) ffff89a803e9d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397395.992297:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a803e9f800): rc 0 00000020:00080000:1.0:1787397395.992302:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a828c18000) has no exports 00000100:00100000:1.0:1787397395.992374:0:83270:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a83b2d5a00:83270] 1 exiting: rc = 0 00000100:00100000:1.0:1787397395.992500:0:83275:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a838732e00:83275] 3 exiting: rc = 0 00000020:00010000:2.0:1787397395.992622:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83879b000: total 0 00010000:00010000:2.0:1787397395.992669:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83879b000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1787397395.992702:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d18f065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ddd expref: 5 pid: 83271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992717:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63800/0x274786fe0d18f050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dc8 expref: 4 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992729:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63600/0x274786fe0d18f05e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dd6 expref: 3 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992741:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa000/0x274786fe0d18f057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7dcf expref: 2 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992749:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83879b000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1787397395.992766:0:6510:0:(genops.c:906:class_export_put()) final put ffff89a83879b000/367372d5-1a70-4e8f-8f10-c0f943f3662d 00000020:00010000:2.0:1787397395.992798:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a803e9f800: total 1 00010000:00010000:2.0:1787397395.992820:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a803e9f800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787397395.992836:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63200/0x274786fe0d18f00a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f003 expref: 14 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992849:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63400/0x274786fe0d18ef9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ef93 expref: 13 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992860:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0400/0x274786fe0d18f018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f011 expref: 12 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992870:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0800/0x274786fe0d18efa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efa1 expref: 11 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992884:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a800/0x274786fe0d18f026 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f01f expref: 10 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992893:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0200/0x274786fe0d18efb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efaf expref: 9 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992903:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62800/0x274786fe0d18f034 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f02d expref: 8 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992915:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1e00/0x274786fe0d18efc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efbd expref: 7 pid: 83271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992937:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aba00/0x274786fe0d18efd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efcb expref: 6 pid: 83270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992948:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1c00/0x274786fe0d18efe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efd9 expref: 5 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992971:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720bc00/0x274786fe0d18f042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f03b expref: 4 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992980:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b600/0x274786fe0d18effc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18eff5 expref: 3 pid: 83275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.992991:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62400/0x274786fe0d18efee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18efe7 expref: 2 pid: 83269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397395.993001:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a803e9f800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787397395.993013:0:6510:0:(genops.c:906:class_export_put()) final put ffff89a803e9f800/99b57a74-e5dc-42df-b087-b10fad741506 00010000:00010000:2.0:1787397395.993029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397395.993031:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397395.993033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397395.993062:0:83269:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a83b98c000:83269] 0 exiting: rc = 1 00000020:00000080:1.0:1787397395.993316:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83879b000/367372d5-1a70-4e8f-8f10-c0f943f3662d for MGS 00000020:00000080:1.0:1787397395.993356:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9f800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:1.0:1787397395.993368:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a838798800 for MGS 00000020:00000080:1.0:1787397395.993373:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a803e9d800 for MGS 00000100:00100000:3.0:1787397395.993470:0:83271:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a83b98d400:83271] 2 exiting: rc = 0 00000100:00100000:1.0:1787397395.993727:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993735:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993740:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993746:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993751:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993757:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993763:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993769:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993775:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993789:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993798:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993805:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993811:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993817:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993823:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993828:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993833:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993839:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993845:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993861:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993867:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993872:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993878:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993883:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993888:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993893:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993898:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993903:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993909:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993915:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993920:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993935:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993941:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993947:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993953:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993959:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993965:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993970:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993974:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993979:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993984:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993989:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993994:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.993998:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994003:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994008:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994026:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994031:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994037:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994042:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994048:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994052:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994058:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994063:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994076:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994081:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994086:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994092:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994097:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994102:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994108:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994113:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994118:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397395.994124:0:84486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787397395.995000:0:84486:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14ae0 - data ffff89a701d04e58/ffff89a828515000 00000020:01000000:1.0:1787397395.995138:0:84486:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a704b880c0 - data ffff89a83fc19798/ffff89a83878c000 00000020:00000080:1.0:1787397395.995602:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ee5f 00000020:00000080:1.0:1787397395.995611:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a83ae93800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397395.996008:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1787397395.996034:0:84486:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7090fa000 from MGS, refs=2 00000020:01000004:1.0:1787397395.996038:0:84486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7090fa000 2 00000020:01000004:1.0:1787397395.996041:0:84486:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a7090fa000 from MGS 00000020:00000080:1.0:1787397395.996066:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397395.996076:0:84486:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787397395.996079:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a83ae97800/MGS 00000020:00000080:1.0:1787397395.996081:0:84486:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae97800/MGS for MGS 00000020:01000000:1.0:1787397395.996088:0:84486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787397395.996162:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787397395.996166:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397395.996176:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787397395.996183:0:84486:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a7025d0000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397395.996189:0:84486:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a706920000) has exports, disconnecting them 00000020:00080000:1.0:1787397395.996195:0:84486:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a7025d0000), last request at 1787397178 00000020:00000080:1.0:1787397395.996199:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ef77 00000020:00080000:1.0:1787397395.996209:0:84486:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7025d0000): rc 0 00000020:00000080:1.0:1787397395.996214:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a7025d0000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397395.996252:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d0000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:2.0:1787397395.998701:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1787397396.022613:0:84486:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787397396.022624:0:84486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397396.022698:0:84486:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397396.022708:0:84486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397396.022912:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397396.022937:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787397396.022945:0:84486:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7090fa000 1 00000020:00000080:0.0:1787397396.022951:0:84486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ee51 00000020:00000080:0.0:1787397396.022959:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a83ae97000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787397396.023302:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828783800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787397396.023311:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a836712800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787397396.023314:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836712800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787397396.023329:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787397396.023462:0:84486:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787397396.023468:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397396.023474:0:84486:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397396.023478:0:84486:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a838780000) has no exports 00000020:00000080:2.0:1787397396.023731:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae97000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397396.076831:0:84486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397396.076845:0:84486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787397396.076851:0:84486:0:(genops.c:906:class_export_put()) final put ffff89a7090fe000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787397396.076855:0:84486:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787397396.076868:0:84486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787397396.077137:0:84486:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a7090ff000 00000020:02000400:2.0:1787397396.077217:0:84486:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787397396.266549:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397396.453020:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397396.453044:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700874880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397396.453120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397396.453265:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874880 00000100:00100000:1.0:1787397396.453274:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874880 00000100:00100000:1.0:1787397396.453356:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:1.0:1787397396.453364:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218700874880:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787397396.453373:0:23942:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397396.453426:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218700874880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (305us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397396.453433:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:02020000:3.0:1787397396.453497:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787397396.453503:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397396.453508:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397396.453558:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397396.453564:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397396.453568:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3243 00000100:00080000:3.0:1787397396.453574:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397396.453598:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705985f80 x1874218700875008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397396.458172:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700875008:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787397396.458285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397396.463547:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875008 00000100:00100000:2.0:1787397396.463563:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875008 00000100:00100000:3.0:1787397396.470183:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:3.0:1787397396.470197:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700875008:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1787397396.470226:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397396.470340:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700875008:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 144us (12054us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397396.470348:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00080000:2.0:1787397396.470434:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397396.470440:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397396.470444:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700875008:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1787397397.288145:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397398.308833:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397398.503061:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700875136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397398.503139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397398.503182:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397398.503189:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700875264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397398.503213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397398.504596:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875136 00000100:00100000:1.0:1787397398.505796:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875136 00000100:00100000:1.0:1787397398.505876:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875264 00000100:00100000:1.0:1787397398.505880:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875264 00000100:00100000:1.0:1787397398.505903:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:1.0:1787397398.505923:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700875136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397398.505956:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397398.506049:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700875136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397398.506058:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:1.0:1787397398.506078:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:1.0:1787397398.506085:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700875264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397398.506100:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397398.506124:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700875264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397398.506130:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:1.0:1787397398.506186:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700875264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397398.506203:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700875136:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397398.506455:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397398.506460:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397399.334083:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397400.361210:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397400.549070:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397400.549077:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397400.549081:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397400.549089:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3275 00000100:00080000:2.0:1787397400.549095:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397400.549102:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397400.549127:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a803416a00 x1874218700876032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397400.549174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700876032:0@lo:38:kworker.0 00000100:00100000:2.0:1787397400.549242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397400.549342:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876032 00000100:00100000:3.0:1787397400.549350:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876032 00000100:00100000:3.0:1787397400.549392:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:3.0:1787397400.549400:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700876032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397400.549420:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397400.549466:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700876032:12345-0@lo:38:kworker.0 Request processed in 66us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397400.549473:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00080000:3.0:1787397400.549511:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397400.549515:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397400.549519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700876032:0@lo:38:kworker.0 00000100:00100000:3.0:1787397400.549569:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700875648:0@lo:400:kworker.0 00000100:00100000:3.0:1787397400.549614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397400.549632:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700876288:0@lo:400:kworker.0 00000100:00100000:3.0:1787397400.549656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397400.549689:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397400.549696:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700875776:0@lo:400:kworker.0 00000100:00100000:3.0:1787397400.549718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397400.549733:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700876416:0@lo:400:kworker.0 00000100:00100000:3.0:1787397400.549752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397400.549778:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876288 00000100:00100000:3.0:1787397400.549781:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876288 00000100:00100000:3.0:1787397400.549826:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1787397400.549832:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700876288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397400.549873:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f658c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700876288:12345-0@lo:400:kworker.0 Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397400.549879:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00080000:3.0:1787397400.550057:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397400.550083:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700876288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.550567:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700875392:0@lo:400:kworker.0 00000400:00000100:0.0:1787397400.550608:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700875392 offset 0 length 224: 4 00000100:00100000:0.0:1787397400.550633:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700875904:0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.550657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397400.550700:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397400.550707:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700875520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.550729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397400.550755:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700876160:0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.550777:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397400.550818:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876160 00000100:00100000:0.0:1787397400.550823:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876160 00000100:00100000:0.0:1787397400.550864:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:0.0:1787397400.550871:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700876160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.550910:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700876160:12345-0@lo:400:kworker.0 Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397400.550916:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00080000:0.0:1787397400.550953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397400.550972:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700876160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.551099:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875648 00000100:00100000:2.0:1787397400.551111:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875648 00000100:00100000:2.0:1787397400.551154:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875776 00000100:00100000:2.0:1787397400.551157:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875776 00000100:00100000:2.0:1787397400.551168:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876416 00000100:00100000:2.0:1787397400.551171:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876416 00000100:00100000:2.0:1787397400.551179:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875904 00000100:00100000:2.0:1787397400.551181:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875904 00000100:00100000:2.0:1787397400.551193:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700875520 00000100:00100000:2.0:1787397400.551196:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700875520 00000100:00100000:2.0:1787397400.551204:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1787397400.551210:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.551249:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700875648:12345-0@lo:400:kworker.0 Request processed in 40us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397400.551256:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1787397400.551269:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1787397400.551274:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700875904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.551301:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700875904:12345-0@lo:400:kworker.0 Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397400.551306:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1787397400.551316:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1787397400.551320:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218700875776:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397400.551326:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397400.551347:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218700875776:12345-0@lo:400:kworker.0 Request processed in 25us (1629us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397400.551351:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1787397400.551360:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1787397400.551364:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218700876416:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397400.551368:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397400.551399:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218700876416:12345-0@lo:400:kworker.0 Request processed in 33us (1646us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397400.551405:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1787397400.551416:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1787397400.551420:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874218700875520:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397400.551424:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397400.551443:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874218700875520:12345-0@lo:400:kworker.0 Request processed in 22us (713us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397400.551448:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00080000:2.0:1787397400.551493:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397400.551499:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397400.551503:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397400.551508:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397400.551512:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3062 00000100:00080000:2.0:1787397400.551517:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397400.551571:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5c00 x1874218700876544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397400.551594:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700875776:0@lo:400:kworker.0 00000100:00080000:2.0:1787397400.551607:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397400.551610:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397400.551614:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397400.551617:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397400.551620:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3062 00000100:00080000:2.0:1787397400.551624:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397400.551642:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd6300 x1874218700876672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397400.551654:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700876416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.551669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700875648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.551707:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700876544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397400.551737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397400.551755:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700876672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397400.551776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397400.551801:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876544 00000100:00100000:2.0:1787397400.551805:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876544 00000100:00100000:2.0:1787397400.551818:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876672 00000100:00100000:2.0:1787397400.551821:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876672 00000100:00100000:2.0:1787397400.551829:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1787397400.551833:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876544:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787397400.551852:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397400.551882:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876544:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 48us (145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397400.551889:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1787397400.551899:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1787397400.551903:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787397400.551912:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397400.551946:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 42us (170us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397400.551953:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00080000:2.0:1787397400.551985:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397400.551990:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397400.551993:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700876544:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787397400.552002:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397400.552004:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397400.552007:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700876672:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787397400.555791:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397400.555852:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787397400.555858:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787397400.555865:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787397400.555870:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397400.555875:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3062 00000100:00080000:0.0:1787397400.555885:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397400.555923:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee6300 x1874218700876800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397400.555982:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700875520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397400.556004:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700875904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397400.556226:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700876800:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397400.556293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397400.556390:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876800 00000100:00100000:0.0:1787397400.556398:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876800 00000100:00100000:0.0:1787397400.556439:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1787397400.556446:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876800:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787397400.556478:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397400.556559:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700876800:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 112us (265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397400.556567:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:1.0:1787397400.556659:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397400.556664:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397400.556667:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700876800:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397400.837354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397400.837404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397400.837433:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681112192 offset 0 length 224: 4 00000100:00100000:1.0:1787397400.837448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397400.837475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397400.837504:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112576 00000100:00100000:1.0:1787397400.837513:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112576 00000100:00100000:1.0:1787397400.837617:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112704 00000100:00100000:1.0:1787397400.837620:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112704 00000100:00100000:1.0:1787397400.837648:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2313 00000100:00100000:1.0:1787397400.837658:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681112576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397400.837743:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681112576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397400.837752:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2313 00000100:00100000:1.0:1787397400.837772:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2314 00000100:00100000:1.0:1787397400.837779:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681112704:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397400.837802:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681112704:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397400.837808:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2314 00000100:00100000:1.0:1787397400.837941:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112320 00000100:00100000:1.0:1787397400.837954:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112320 00000100:00100000:1.0:1787397400.837978:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112448 00000100:00100000:1.0:1787397400.837995:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112448 00000100:00100000:1.0:1787397400.838027:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1009 00000100:00100000:1.0:1787397400.838033:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681112448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397400.838069:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681112448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397400.838076:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1009 00000100:00100000:1.0:1787397400.838089:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1024 00000100:00100000:1.0:1787397400.838094:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1874218681112320:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:1.0:1787397400.838100:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397400.838121:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1874218681112320:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (781us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397400.838126:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1024 00000100:00080000:0.0:1787397400.838649:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397400.838655:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397400.838657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397400.843625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397400.844568:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681112832 00000100:00100000:0.0:1787397400.844590:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681112832 00000100:00100000:0.0:1787397400.844669:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1025 00000100:00100000:0.0:1787397400.844678:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681112832:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787397400.844705:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397400.844799:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681112832:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 Request processed in 119us (1190us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397400.844806:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1025 00010000:00010000:0.0:1787397401.393322:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787397401.576742:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397401.576760:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a817ecf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397401.577121:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787397401.577190:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecd000 for lustre-OST0000 00000001:00100000:0.0:1787397401.581352:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397401.581370:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378730 is committed 00000020:00000080:0.0:1787397401.581392:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a817eca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397401.581479:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817eca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:2.0:1787397401.581704:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397401.581718:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a836716000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397401.586053:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817eca000 for lustre-MDT0001 00000020:00000080:1.0:1787397401.586077:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836716000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787397401.586283:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836715800 for lustre-OST0001 00010000:00010000:0.0:1787397402.404990:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397403.428866:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397403.620924:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700876928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397403.621010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397403.621168:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397403.621174:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700877056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397403.621196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397403.621515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700876928 00000100:00100000:1.0:1787397403.621543:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700876928 00000100:00080000:2.0:1787397403.621743:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397403.621841:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877056 00000100:00100000:1.0:1787397403.621845:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877056 00000100:00100000:1.0:1787397403.621921:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:1.0:1787397403.621937:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700876928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397403.621966:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397403.622017:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700876928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397403.622024:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:1.0:1787397403.622060:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1787397403.622068:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700877056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397403.622086:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397403.622114:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700877056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397403.622119:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1787397403.622164:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700877056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397403.622180:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700876928:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397403.622466:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397404.454908:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397405.478401:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397405.669928:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397405.669935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397405.669938:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397405.669946:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3279 00000100:00080000:1.0:1787397405.669952:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397405.669959:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397405.669983:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939c380 x1874218700877312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397405.670019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397405.670023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397405.670024:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397405.670028:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3279 00000100:00080000:1.0:1787397405.670030:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397405.670034:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397405.670045:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939d180 x1874218700877568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397405.670092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397405.670096:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397405.670097:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397405.670101:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3279 00000100:00080000:1.0:1787397405.670103:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397405.670107:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397405.670119:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939fb80 x1874218700877824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397405.670141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397405.670144:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397405.670145:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397405.670149:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3279 00000100:00080000:1.0:1787397405.670151:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397405.670155:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397405.670164:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939d880 x1874218700878208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397405.670195:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700877696:0@lo:400:kworker.0 00000100:00100000:1.0:1787397405.670309:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397405.670353:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397405.670360:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700877952:0@lo:400:kworker.0 00000100:00100000:1.0:1787397405.670392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397405.670410:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700877312:0@lo:38:kworker.0 00000100:00100000:1.0:1787397405.670427:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877696 00000100:00100000:1.0:1787397405.670435:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877696 00000100:00100000:3.0:1787397405.670464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397405.670493:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700877568:0@lo:38:kworker.0 00000100:00100000:1.0:1787397405.670510:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877312 00000100:00100000:1.0:1787397405.670544:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877312 00000100:00100000:3.0:1787397405.670568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397405.670626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700877440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397405.671465:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700877184:0@lo:400:kworker.0 00000400:00000100:2.0:1787397405.671510:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700877184 offset 0 length 224: 4 00000100:00100000:0.0:1787397405.675033:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877952 00000100:00100000:0.0:1787397405.675055:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877952 00000100:00100000:0.0:1787397405.675153:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:0.0:1787397405.675169:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700877952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397405.675286:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700877952:12345-0@lo:400:kworker.0 Request processed in 125us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397405.675295:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:1.0:1787397405.675380:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877568 00000100:00100000:1.0:1787397405.675385:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877568 00000100:00100000:1.0:1787397405.675405:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1787397405.675415:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70939ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700877696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397405.675454:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70939ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700877696:12345-0@lo:400:kworker.0 Request processed in 41us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397405.675459:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1787397405.675488:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1787397405.675493:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700877312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397405.675512:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397405.675556:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700877312:12345-0@lo:38:kworker.0 Request processed in 62us (5092us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397405.675571:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1787397405.675779:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1787397405.675784:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700877824:0@lo:38:kworker.0 00000100:00100000:2.0:1787397405.675788:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700877568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397405.675799:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397405.675858:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700877568:12345-0@lo:38:kworker.0 Request processed in 69us (5289us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397405.675863:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1787397405.675889:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397405.675926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397405.675991:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397405.675996:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397405.676018:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397405.676069:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700877952:0@lo:400:kworker.0 00000100:00100000:3.0:1787397405.676081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397405.676084:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700877696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397405.676112:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700878208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397405.676137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397405.676168:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397405.676173:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397405.676178:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700877312:0@lo:38:kworker.0 00000100:00080000:3.0:1787397405.676189:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397405.676192:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397405.676197:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700877568:0@lo:38:kworker.0 00000100:00100000:2.0:1787397405.676199:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877824 00000100:00100000:2.0:1787397405.676204:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877824 00000100:00100000:3.0:1787397405.676225:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700877440 00000100:00100000:3.0:1787397405.676230:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700877440 00000100:00100000:2.0:1787397405.676230:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1787397405.676237:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700877824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397405.676248:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397405.676270:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878208 00000100:00100000:3.0:1787397405.676274:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878208 00000100:00100000:3.0:1787397405.676290:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1787397405.676298:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700877440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397405.676337:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700877440:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397405.676344:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1787397405.676499:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878080 00000100:00100000:1.0:1787397405.676503:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878080 00000100:00100000:1.0:1787397405.676552:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:1.0:1787397405.676559:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397405.676605:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878080:12345-0@lo:400:kworker.0 Request processed in 48us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397405.676611:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:1.0:1787397405.676632:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1787397405.676636:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700878208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397405.676646:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397405.676677:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700877440:0@lo:400:kworker.0 00000100:00080000:3.0:1787397405.676694:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397405.676697:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397405.676787:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878080:0@lo:400:kworker.0 00000100:00100000:1.0:1787397405.676794:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700878208:12345-0@lo:38:kworker.0 Request processed in 154us (653us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397405.676812:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:3.0:1787397405.676834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397405.676839:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397405.676842:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700878208:0@lo:38:kworker.0 00000100:00100000:2.0:1787397405.677111:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700877824:12345-0@lo:38:kworker.0 Request processed in 874us (1032us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397405.677118:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00080000:3.0:1787397405.685182:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397405.685194:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397405.685200:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700877824:0@lo:38:kworker.0 00000100:00100000:1.0:1787397405.958812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397405.958857:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681112960 offset 0 length 224: 4 00000100:00100000:1.0:1787397405.958876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397405.958914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397405.958957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397405.958999:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113344 00000100:00100000:1.0:1787397405.959011:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113344 00000100:00100000:1.0:1787397405.959078:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113472 00000100:00100000:1.0:1787397405.959081:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113472 00000100:00100000:1.0:1787397405.959110:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4914 00000100:00100000:1.0:1787397405.959122:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681113344:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:1.0:1787397405.959159:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18edbe 00000100:00080000:1.0:1787397405.959168:0:8435:0:(import.c:65:import_set_state_nolock()) ffff89a7090f8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397405.959230:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968724 00000100:00100000:1.0:1787397405.959390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681113344:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 271us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397405.959397:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4914 00000100:00100000:1.0:1787397405.959415:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4915 00000100:00100000:1.0:1787397405.959422:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681113472:12345-192.168.204.60@tcp:9:kworker.0 00000100:00080000:3.0:1787397405.959557:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397405.959562:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397405.959574:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113216 00000100:00100000:3.0:1787397405.959578:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113216 00000100:00100000:3.0:1787397405.959623:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113088 00000100:00100000:3.0:1787397405.959627:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113088 00000100:00100000:3.0:1787397405.959646:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1012 00000100:00100000:3.0:1787397405.959653:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681113216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397405.959687:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681113216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397405.959694:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1012 00000100:00100000:3.0:1787397405.959707:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1029 00000100:00100000:3.0:1787397405.959712:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681113088:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397405.959731:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397405.959756:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681113088:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 42us (879us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397405.959762:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1029 00000100:00080000:3.0:1787397405.959778:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1787397405.960390:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f256 00000100:00080000:1.0:1787397405.960399:0:8435:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787397405.960545:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397405.960599:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787397405.960728:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968721 00000100:00100000:1.0:1787397405.960867:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681113472:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 1443us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397405.960876:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4915 00010000:00010000:0.0:1787397406.500881:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397407.525235:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397408.551283:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397408.740762:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397408.740794:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397408.740899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397408.740941:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397408.740966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397408.741075:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878336 00000100:00100000:2.0:1787397408.741084:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878336 00000100:00100000:2.0:1787397408.741165:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878464 00000100:00100000:2.0:1787397408.741169:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878464 00000100:00100000:2.0:1787397408.741200:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:2.0:1787397408.741209:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397408.741255:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397408.741634:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397408.741639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397408.741742:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 534us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397408.741750:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:2.0:1787397408.741785:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:2.0:1787397408.741792:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397408.741810:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397408.741837:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700878464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397408.741842:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1787397408.741917:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397408.741930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700878464:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787397409.573944:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397410.601462:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397410.789136:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397410.789143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397410.789148:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397410.789156:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3284 00000100:00080000:2.0:1787397410.789162:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397410.789170:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397410.789209:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939d880 x1874218700878720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397410.789238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397410.789242:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397410.789244:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397410.789252:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3284 00000100:00080000:2.0:1787397410.789256:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397410.789261:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397410.789293:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939d500 x1874218700878976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397410.789322:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397410.789325:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397410.789327:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397410.789330:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3284 00000100:00080000:2.0:1787397410.789333:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787397410.789349:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397410.789363:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70939c380 x1874218700879232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397410.789384:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397410.789387:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397410.789389:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397410.789392:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3284 00000100:00080000:2.0:1787397410.789394:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397410.789397:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397410.789411:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70691f800 x1874218700879616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397410.789438:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700878848:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.789503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789558:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787397410.789566:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700878592:0@lo:400:kworker.0 00000400:00000100:2.0:1787397410.789586:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700878592 offset 0 length 224: 4 00000100:00100000:2.0:1787397410.789607:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700879488:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.789657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700878720:0@lo:38:kworker.0 00000100:00100000:2.0:1787397410.789711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700878976:0@lo:38:kworker.0 00000100:00100000:2.0:1787397410.789759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789776:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700879232:0@lo:38:kworker.0 00000100:00100000:2.0:1787397410.789799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789815:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700879616:0@lo:38:kworker.0 00000100:00100000:2.0:1787397410.789832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789861:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700879104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.789883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789900:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397410.789905:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70939f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700879360:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.789925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397410.789956:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878848 00000100:00100000:2.0:1787397410.789963:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878848 00000100:00100000:2.0:1787397410.790013:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878720 00000100:00100000:2.0:1787397410.790016:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878720 00000100:00100000:2.0:1787397410.790025:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700878976 00000100:00100000:2.0:1787397410.790027:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700878976 00000100:00100000:2.0:1787397410.790033:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879616 00000100:00100000:2.0:1787397410.790035:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879616 00000100:00100000:2.0:1787397410.790042:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879104 00000100:00100000:2.0:1787397410.790044:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879104 00000100:00100000:2.0:1787397410.790061:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1787397410.790068:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790123:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700878848:12345-0@lo:400:kworker.0 Request processed in 55us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397410.790143:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1787397410.790160:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1787397410.790166:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700879104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790196:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700879104:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397410.790202:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1787397410.790213:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1787397410.790217:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700878720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397410.790233:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397410.790261:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700878720:12345-0@lo:38:kworker.0 Request processed in 42us (549us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397410.790267:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1787397410.790277:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1787397410.790281:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700878976:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397410.790290:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397410.790312:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700878976:12345-0@lo:38:kworker.0 Request processed in 29us (552us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397410.790318:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1787397410.790327:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1787397410.790331:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700879616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397410.790339:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397410.790359:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700879616:12345-0@lo:38:kworker.0 Request processed in 26us (526us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397410.790364:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1787397410.790391:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879488 00000100:00100000:2.0:1787397410.790395:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879488 00000100:00100000:2.0:1787397410.790419:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879360 00000100:00100000:2.0:1787397410.790422:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879360 00000100:00100000:2.0:1787397410.790439:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1787397410.790445:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700879488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790475:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700879488:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397410.790481:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1787397410.790492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1787397410.790497:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700879360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790545:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700879360:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397410.790551:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:2.0:1787397410.790575:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879232 00000100:00100000:2.0:1787397410.790578:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879232 00000100:00100000:2.0:1787397410.790604:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1787397410.790609:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700879232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397410.790618:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397410.790644:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700879232:12345-0@lo:38:kworker.0 Request processed in 33us (844us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397410.790649:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00080000:2.0:1787397410.790676:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397410.790680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397410.790682:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397410.790721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700879360:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790748:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700879104:0@lo:400:kworker.0 00000100:00080000:2.0:1787397410.790797:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397410.790803:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397410.790806:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700878720:0@lo:38:kworker.0 00000100:00080000:2.0:1787397410.790813:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397410.790816:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397410.790818:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700878976:0@lo:38:kworker.0 00000100:00080000:2.0:1787397410.790826:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397410.790829:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397410.790831:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700879232:0@lo:38:kworker.0 00000100:00080000:2.0:1787397410.790838:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397410.790840:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397410.790843:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700879616:0@lo:38:kworker.0 00000100:00100000:2.0:1787397410.790878:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700879488:0@lo:400:kworker.0 00000100:00100000:2.0:1787397410.790891:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700878848:0@lo:400:kworker.0 00000400:00000100:1.0:1787397411.080136:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681113600 offset 0 length 224: 4 00000100:00100000:1.0:1787397411.081611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397411.081739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397411.081958:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113856 00000100:00100000:0.0:1787397411.081969:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113856 00000100:00100000:0.0:1787397411.082050:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681113728 00000100:00100000:0.0:1787397411.082054:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681113728 00000100:00100000:0.0:1787397411.082085:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1015 00000100:00100000:0.0:1787397411.082098:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681113856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397411.082195:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681113856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 85us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397411.082204:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1015 00000100:00100000:0.0:1787397411.082225:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1033 00000100:00100000:0.0:1787397411.082231:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681113728:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397411.082251:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397411.082277:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681113728:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 46us (538us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397411.082284:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1033 00000100:00080000:1.0:1787397411.083978:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397411.628060:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397411.827095:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:2.0:1787397411.827107:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a81ab48000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:1.0:1787397411.827187:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a81ab48000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0001 00000020:00000080:1.0:1787397411.827243:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a807dfe000 for lustre-OST0001 00000001:00100000:3.0:1787397411.830580:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:3.0:1787397411.830591:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a827b3b800/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:2.0:1787397411.830819:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b3b800/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0000 00000020:00000080:2.0:1787397411.830872:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7090f8800 for lustre-OST0000 00010000:00010000:2.0:1787397412.646496:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397413.669982:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397413.863374:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397413.863391:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700879744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397413.863463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397413.863576:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879744 00000100:00100000:1.0:1787397413.863583:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879744 00000100:00100000:1.0:1787397413.863634:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1787397413.863643:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700879744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397413.863681:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397413.863727:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700879744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397413.863734:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00080000:1.0:1787397413.863756:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397413.863791:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700879744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397413.864338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397413.864350:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700879872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397413.864391:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397413.864589:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700879872 00000100:00100000:2.0:1787397413.864595:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700879872 00000100:00100000:2.0:1787397413.864655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1787397413.864672:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700879872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397413.864702:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397413.864738:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700879872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397413.864744:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00080000:1.0:1787397413.864817:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397413.864845:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700879872:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787397414.693476:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397415.729356:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397415.911246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397415.911255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397415.911267:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397415.911277:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3290 00000100:00080000:3.0:1787397415.911285:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397415.911292:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397415.911323:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705985180 x1874218700880128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397415.911481:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700880000:0@lo:400:kworker.0 00000100:00080000:3.0:1787397415.911506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397415.911509:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397415.911511:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397415.911515:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3290 00000100:00080000:3.0:1787397415.911517:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397415.911537:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397415.911550:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705986d80 x1874218700880384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397415.911567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397415.911570:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:1.0:1787397415.911570:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700880000 offset 0 length 224: 4 00000100:00080000:3.0:1787397415.911572:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397415.911575:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3290 00000100:00080000:3.0:1787397415.911577:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397415.911581:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397415.911591:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705987480 x1874218700880640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397415.911613:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397415.911617:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397415.911637:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397415.911642:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3290 00000100:00080000:3.0:1787397415.911645:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397415.911649:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397415.911651:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700880896:0@lo:400:kworker.0 00000100:00100000:3.0:1787397415.911662:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705984a80 x1874218700881024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397415.911691:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700880128:0@lo:38:kworker.0 00000100:00100000:1.0:1787397415.911692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397415.911718:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397415.911724:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700880768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397415.911725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397415.911749:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700880384:0@lo:38:kworker.0 00000100:00100000:1.0:1787397415.911749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397415.911768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397415.911783:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880896 00000100:00100000:3.0:1787397415.911784:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700880640:0@lo:38:kworker.0 00000100:00100000:1.0:1787397415.911791:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880896 00000100:00100000:1.0:1787397415.911853:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880768 00000100:00100000:1.0:1787397415.911856:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880768 00000100:00100000:1.0:1787397415.911880:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:1.0:1787397415.911888:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700880896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.911950:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700880896:12345-0@lo:400:kworker.0 Request processed in 61us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397415.911957:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1787397415.911977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397415.911986:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:1.0:1787397415.911997:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700880768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.914245:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700880768:12345-0@lo:400:kworker.0 Request processed in 2239us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397415.914263:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00080000:1.0:1787397415.914319:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397415.914326:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397415.914361:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700880256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.914421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397415.914464:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397415.914481:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700880512:0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.914509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397415.914570:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880128 00000100:00100000:1.0:1787397415.914586:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880128 00000100:00100000:1.0:1787397415.914618:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880384 00000100:00100000:1.0:1787397415.914621:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880384 00000100:00100000:1.0:1787397415.914652:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880256 00000100:00100000:1.0:1787397415.914655:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880256 00000100:00100000:1.0:1787397415.914687:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880512 00000100:00100000:1.0:1787397415.914689:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880512 00000100:00100000:1.0:1787397415.914706:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1787397415.914714:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700880256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.914766:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700880256:12345-0@lo:400:kworker.0 Request processed in 52us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397415.914772:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1787397415.914784:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1787397415.914789:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700880512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.914816:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700880512:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397415.914822:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1787397415.914833:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1787397415.914838:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700880128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397415.914860:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397415.914892:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700880128:12345-0@lo:38:kworker.0 Request processed in 52us (3165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397415.914898:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1787397415.914909:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1787397415.914912:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700880384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397415.914921:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397415.914943:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700880384:12345-0@lo:38:kworker.0 Request processed in 29us (3174us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397415.914954:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:1.0:1787397415.914975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397415.915008:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700880512:0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.915017:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700880256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.915048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700880768:0@lo:400:kworker.0 00000100:00100000:1.0:1787397415.915060:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700880896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397415.917602:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700880640 00000100:00100000:2.0:1787397415.917632:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700880640 00000100:00100000:2.0:1787397415.917700:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:2.0:1787397415.917710:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700880640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397415.917741:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397415.917854:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700880640:12345-0@lo:38:kworker.0 Request processed in 144us (5885us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397415.917864:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00080000:3.0:1787397415.917937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397415.917952:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397415.917958:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700880640:0@lo:38:kworker.0 00000100:00100000:3.0:1787397415.917972:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700881024:0@lo:38:kworker.0 00000100:00100000:3.0:1787397415.918051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397415.918175:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397415.918181:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397415.918184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700880128:0@lo:38:kworker.0 00000100:00080000:3.0:1787397415.918196:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397415.918200:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397415.918203:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700880384:0@lo:38:kworker.0 00000100:00100000:2.0:1787397415.919909:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881024 00000100:00100000:2.0:1787397415.919925:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881024 00000100:00100000:2.0:1787397415.919985:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1787397415.919996:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700881024:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397415.920024:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397415.920113:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700881024:12345-0@lo:38:kworker.0 Request processed in 119us (2062us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397415.920121:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:3.0:1787397415.921286:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397415.921322:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397415.921327:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700881024:0@lo:38:kworker.0 00000100:00100000:1.0:1787397416.203826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397416.203941:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114112 00000100:00100000:2.0:1787397416.203957:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114112 00000100:00100000:2.0:1787397416.204163:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1037 00000100:00100000:2.0:1787397416.204179:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703646850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681114112:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397416.204208:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397416.204416:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703646850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681114112:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 237us (601us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397416.204425:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1037 00000100:00100000:0.0:1787397416.218578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397416.218709:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114240 00000100:00100000:2.0:1787397416.218726:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114240 00000100:00100000:2.0:1787397416.218829:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1018 00000100:00100000:2.0:1787397416.218847:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681114240:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397416.218964:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681114240:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 123us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397416.218973:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1018 00000100:00080000:3.0:1787397416.219233:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:0.0:1787397416.219863:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681114368 offset 0 length 520: 4 00010000:00010000:1.0:1787397416.742028:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787397416.935573:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397400/real 1787397400] req@ffff89a827b79500 x1874218700875392/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397416.935614:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a827b79500 x1874218700875392/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397416.935624:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787397416.935628:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787397416.935631:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787397416.935634:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787397416.935638:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a827b79500 x1874218700875392/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397416.935648:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a70939f100 x1874218700877184/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397416.935666:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a70939fb80 x1874218700878592/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397426 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397416.935681:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a705986300 x1874218700880000/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787397416.935708:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787397416.935711:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787397416.935712:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787397416.935715:0:3650:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1787397416.935732:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700878592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.935751:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700875392:0@lo:400:kworker.0 00000100:00080000:2.0:1787397416.935764:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397416.935769:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787397416.935773:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397416.935778:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3057 00000100:00080000:2.0:1787397416.935788:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397416.935816:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178dd180 x1874218700881152/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397416.935838:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397416.935842:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397416.935843:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397416.935847:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3295 00000100:00080000:2.0:1787397416.935849:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397416.935853:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397416.935878:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178ded80 x1874218700881280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397416.935902:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397416.935906:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397416.935908:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397416.935911:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3295 00000100:00080000:2.0:1787397416.935914:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397416.935919:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397416.935931:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178de680 x1874218700881536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397416.935950:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397416.935953:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397416.935955:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397416.935959:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3295 00000100:00080000:2.0:1787397416.935962:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397416.935967:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397416.935993:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178ddf80 x1874218700881792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397416.936020:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397416.936023:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397416.936025:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397416.936028:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3295 00000100:00080000:2.0:1787397416.936030:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397416.936033:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397416.936054:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178df800 x1874218700882176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397416.936090:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700881664:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.936169:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397416.936185:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70939f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700877184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.936201:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397416.936206:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700881920:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.936212:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700881408:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.936251:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397416.936257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397416.936297:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881664 00000100:00100000:1.0:1787397416.936307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397416.936314:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700882048:0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.936338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397416.936367:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881920 00000100:00100000:1.0:1787397416.936387:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881920 00000100:00100000:1.0:1787397416.936428:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882048 00000100:00100000:1.0:1787397416.936431:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882048 00000100:00100000:1.0:1787397416.936451:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:1.0:1787397416.936459:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700881920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.936510:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700881920:12345-0@lo:400:kworker.0 Request processed in 51us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397416.936518:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:1.0:1787397416.936553:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:1.0:1787397416.936559:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700882048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.936589:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700882048:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397416.936595:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:1.0:1787397416.936639:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700880000:0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.936699:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700882048:0@lo:400:kworker.0 00000100:00100000:1.0:1787397416.936709:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700881920:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.937583:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881664 00000100:00100000:2.0:1787397416.937720:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881408 00000100:00100000:2.0:1787397416.937725:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881408 00000100:00100000:2.0:1787397416.937759:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1787397416.937767:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700881664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.937831:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700881664:12345-0@lo:400:kworker.0 Request processed in 64us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397416.937838:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1787397416.937853:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1787397416.937859:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700881408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.937890:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700881408:12345-0@lo:400:kworker.0 Request processed in 31us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397416.937897:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1787397416.937941:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700881408:0@lo:400:kworker.0 00000100:00100000:2.0:1787397416.937954:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700881664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397416.938677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700881152:0@lo:250:kworker.0 00000400:00000100:3.0:1787397416.938720:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700881152 offset 0 length 520: 4 00000100:00100000:3.0:1787397416.938762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700881280:0@lo:38:kworker.0 00000100:00100000:3.0:1787397416.938800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397416.938825:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700881536:0@lo:38:kworker.0 00000100:00100000:3.0:1787397416.938846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397416.938860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700881792:0@lo:38:kworker.0 00000100:00100000:3.0:1787397416.938882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397416.938897:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700882176:0@lo:38:kworker.0 00000100:00100000:3.0:1787397416.938915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397416.938949:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881280 00000100:00100000:3.0:1787397416.938955:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881280 00000100:00100000:3.0:1787397416.938978:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881536 00000100:00100000:3.0:1787397416.938981:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881536 00000100:00100000:3.0:1787397416.938991:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882176 00000100:00100000:3.0:1787397416.938993:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882176 00000100:00100000:3.0:1787397416.939007:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1787397416.939013:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700881280:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397416.939032:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397416.939070:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700881280:12345-0@lo:38:kworker.0 Request processed in 54us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397416.939077:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1787397416.939104:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1787397416.939122:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700881536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397416.939132:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397416.939158:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700881536:12345-0@lo:38:kworker.0 Request processed in 34us (311us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397416.939163:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1787397416.939174:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1787397416.939178:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700882176:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397416.939186:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397416.939208:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700882176:12345-0@lo:38:kworker.0 Request processed in 28us (292us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397416.939214:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00080000:3.0:1787397416.939249:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397416.939255:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397416.939258:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700881280:0@lo:38:kworker.0 00000100:00080000:3.0:1787397416.939266:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397416.939270:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397416.939272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700881536:0@lo:38:kworker.0 00000100:00080000:3.0:1787397416.939280:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397416.939283:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397416.939285:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700882176:0@lo:38:kworker.0 00000100:00100000:2.0:1787397416.941168:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700881792 00000100:00100000:2.0:1787397416.941180:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700881792 00000100:00100000:2.0:1787397416.941234:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1787397416.941242:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700881792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397416.941263:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397416.941328:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700881792:12345-0@lo:38:kworker.0 Request processed in 85us (2444us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397416.941335:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00080000:3.0:1787397416.941644:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397416.941649:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397416.941653:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700881792:0@lo:38:kworker.0 00010000:00010000:2.0:1787397417.765385:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397418.790389:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397418.980674:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397418.980699:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700882304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397418.980775:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397418.980822:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882304 00000100:00100000:1.0:1787397418.980829:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882304 00000100:00100000:1.0:1787397418.980878:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1787397418.980885:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700882304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397418.980915:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397418.980957:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700882304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397418.980964:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1787397418.981012:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700882304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397418.981128:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397418.981136:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700882432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397418.981164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397418.981202:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397418.981213:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882432 00000100:00100000:3.0:1787397418.981216:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882432 00000100:00100000:3.0:1787397418.981242:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1787397418.981248:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700882432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397418.981262:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397418.981289:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700882432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397418.981294:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00080000:3.0:1787397418.981308:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397418.981325:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700882432:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1787397419.535701:0:85105:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787397419.535708:0:85105:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787397419.535710:0:85105:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787397419.535827:0:85105:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a706d34800 00000020:01000004:2.0:1787397419.535847:0:85105:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787397419.535865:0:85105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787397419.535881:0:85105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a828c1cd40) 00000020:00000080:2.0:1787397419.535903:0:85105:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787397419.673271:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397419.674444:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787397419.692045:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787397419.692325:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787397419.693462:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787397419.693864:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787397419.694077:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787397419.696963:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787397419.697612:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787397419.697846:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787397419.698047:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787397419.698313:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787397419.698514:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787397419.698828:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787397419.703071:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787397419.708127:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.708480:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.708802:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.709002:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.709265:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.709648:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.709836:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.710040:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.710359:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.711442:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.711761:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.711979:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.712415:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.713409:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.713669:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.713870:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.714068:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.715358:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.716357:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.717243:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.720402:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.723886:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.724331:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.730484:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.731069:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.731744:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.732011:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.732324:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787397419.732605:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.732949:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.733485:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787397419.733792:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787397419.734912:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397419.735563:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787397419.736300:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397419.737137:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787397419.740080:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787397419.740654:0:85105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787397419.741240:0:85105:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787397419.741463:0:85105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787397419.741473:0:85105:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787397419.741485:0:85105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f36e 00000020:01000004:3.0:1787397419.741490:0:85105:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787397419.741502:0:85105:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787397419.741507:0:85105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a706d34800 from MGS 00000020:01000004:3.0:1787397419.742055:0:85105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787397419.742071:0:85105:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a838780000) 00000020:00000080:3.0:1787397419.742087:0:85105:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1787397419.742218:0:85105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a706d34800 from MGS, refs=2 00080000:01000000:3.0:1787397419.742225:0:85105:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787397419.742231:0:85105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f37c 00010000:00010000:3.0:1787397419.742375:0:85105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1787397419.747016:0:85105:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787397419.750393:0:85109:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787397419.750465:0:85105:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787397419.750596:0:85105:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397419.752291:0:85105:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787397419.752600:0:85105:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397419.752768:0:85105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787397419.752775:0:85105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787397419.756026:0:85105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787397419.756041:0:85105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787397419.756861:0:85105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787397419.756870:0:85105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787397419.757411:0:85105:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787397419.757435:0:85105:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1787397419.757437:0:85105:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1787397419.757440:0:85105:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1787397419.757446:0:85105:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 57, was 0): CONNECTING 00000100:00100000:2.0:1787397419.757452:0:85105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:2.0:1787397419.812786:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397420.836960:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397421.326752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397421.326876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397421.335230:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114496 00000100:00100000:3.0:1787397421.335247:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114496 00000100:00100000:3.0:1787397421.335425:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114624 00000100:00100000:3.0:1787397421.335430:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114624 00000100:00080000:0.0:1787397421.336014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397421.336098:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1021 00000100:00100000:2.0:1787397421.336112:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681114624:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397421.336745:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1041 00000100:00100000:1.0:1787397421.336755:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681114496:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397421.336783:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397421.336871:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681114496:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 115us (10131us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397421.336880:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1041 00000100:00100000:2.0:1787397421.338040:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681114624:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1925us (11156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397421.338051:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1021 00010000:00010000:1.0:1787397421.860950:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397422.052676:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397422.052687:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397422.052690:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397422.052693:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397422.052697:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397422.052705:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3296 00000100:00080000:3.0:1787397422.052710:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397422.052718:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397422.052761:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750000 x1874218700882560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397422.052813:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397422.052816:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397422.052832:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397422.052836:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3296 00000100:00080000:3.0:1787397422.052838:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397422.052842:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397422.052856:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835752680 x1874218700882816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397422.052873:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397422.052877:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397422.052879:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397422.052882:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3296 00000100:00080000:3.0:1787397422.052885:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397422.052889:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397422.052902:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750a80 x1874218700883072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397422.052932:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397422.052935:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397422.052936:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397422.052939:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3296 00000100:00080000:3.0:1787397422.052942:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397422.052945:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397422.052955:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835751500 x1874218700883456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397422.052982:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700883328:0@lo:400:kworker.0 00000100:00100000:3.0:1787397422.053047:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397422.053088:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397422.053095:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700883200:0@lo:400:kworker.0 00000100:00100000:3.0:1787397422.053140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397422.053336:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700882560:0@lo:38:kworker.0 00000100:00100000:2.0:1787397422.053371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397422.053402:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700882816:0@lo:38:kworker.0 00000100:00100000:2.0:1787397422.053437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397422.053462:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700883072:0@lo:38:kworker.0 00000100:00100000:2.0:1787397422.053487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397422.053516:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700883456:0@lo:38:kworker.0 00000100:00100000:2.0:1787397422.053561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397422.053595:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883072 00000100:00100000:2.0:1787397422.053603:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883072 00000100:00100000:2.0:1787397422.053646:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1787397422.053654:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700883072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397422.053676:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397422.053717:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700883072:12345-0@lo:38:kworker.0 Request processed in 63us (229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397422.053725:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00080000:2.0:1787397422.053769:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397422.053774:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397422.053778:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700883072:0@lo:38:kworker.0 00000100:00100000:0.0:1787397422.053848:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882560 00000100:00100000:0.0:1787397422.053858:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882560 00000100:00100000:0.0:1787397422.053885:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882816 00000100:00100000:0.0:1787397422.053888:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882816 00000100:00100000:0.0:1787397422.053903:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883456 00000100:00100000:0.0:1787397422.053906:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883456 00000100:00100000:0.0:1787397422.053920:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1787397422.053925:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700882560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397422.053936:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397422.053966:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700882560:12345-0@lo:38:kworker.0 Request processed in 39us (593us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397422.053972:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1787397422.053984:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1787397422.053988:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700882816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397422.053997:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397422.054021:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700882816:12345-0@lo:38:kworker.0 Request processed in 31us (583us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397422.054026:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1787397422.054037:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1787397422.054040:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700883456:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397422.054048:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397422.054078:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700883456:12345-0@lo:38:kworker.0 Request processed in 36us (516us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397422.054084:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1787397422.054254:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700882688:0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397422.054307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397422.054313:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700882944:0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397422.054366:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883328 00000100:00100000:1.0:1787397422.054371:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883328 00000100:00100000:1.0:1787397422.054408:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883200 00000100:00100000:1.0:1787397422.054411:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883200 00000100:00100000:1.0:1787397422.054433:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:1.0:1787397422.054440:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700883328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054485:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700883328:12345-0@lo:400:kworker.0 Request processed in 46us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397422.054491:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:1.0:1787397422.054537:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1787397422.054546:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700883200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054575:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700883200:12345-0@lo:400:kworker.0 Request processed in 31us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397422.054580:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1787397422.054622:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700883200:0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054634:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700883328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054654:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882688 00000100:00100000:1.0:1787397422.054657:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882688 00000100:00100000:1.0:1787397422.054679:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700882944 00000100:00100000:1.0:1787397422.054682:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700882944 00000100:00100000:1.0:1787397422.054696:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1787397422.054702:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700882688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054750:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700882688:12345-0@lo:400:kworker.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397422.054756:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1787397422.054768:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1787397422.054774:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700882944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054802:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700882944:12345-0@lo:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397422.054807:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1787397422.054831:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700882944:0@lo:400:kworker.0 00000100:00100000:1.0:1787397422.054840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700882688:0@lo:400:kworker.0 00000100:00080000:0.0:1787397422.054995:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397422.055001:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397422.055002:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397422.055439:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397422.055445:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397422.055448:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700882560:0@lo:38:kworker.0 00000100:00080000:2.0:1787397422.055458:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397422.055461:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397422.055464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700882816:0@lo:38:kworker.0 00000100:00080000:2.0:1787397422.055472:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397422.055475:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397422.055477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700883456:0@lo:38:kworker.0 00010000:00010000:2.0:1787397422.884838:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397423.908829:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397424.100839:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700883584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397424.100944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397424.101229:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883584 00000100:00100000:1.0:1787397424.101238:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883584 00000100:00100000:1.0:1787397424.101299:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1787397424.101308:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700883584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397424.101340:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397424.101922:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397424.102170:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397424.102185:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700883712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397424.102246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397424.103230:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700883584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1920us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397424.103243:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1787397424.103271:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883712 00000100:00100000:1.0:1787397424.103277:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883712 00000100:00100000:1.0:1787397424.103326:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1787397424.103334:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700883712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397424.104764:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397424.104865:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700883712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1529us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397424.104876:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1787397424.106708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700883712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397424.106745:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700883584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787397424.106917:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397424.933045:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397425.956774:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397426.148750:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397416/real 1787397416] req@ffff89a8178dd180 x1874218700881152/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397426.148796:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a8178dd180 x1874218700881152/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397426.148821:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.148844:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787397426.148855:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700881152:0@lo:250:kworker.0 10000000:01000000:2.0:1787397426.149122:0:85105:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1787397426.149144:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d18f02d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f034 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149156:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d18f02d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f034 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149188:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1787397426.149208:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149221:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d18f02d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f034 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149254:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18ef93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18ef9a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149262:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18ef93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18ef9a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149267:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149271:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149275:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18ef93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18ef9a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149284:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d18efaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149292:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d18efaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149297:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149301:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149304:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d18efaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efb6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149312:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d18efd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efe0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149329:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d18efd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efe0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149335:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149338:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149343:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d18efd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efe0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149351:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d18efe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149357:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d18efe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149363:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149366:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149369:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d18efe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149378:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a600/0x274786fe0d18f003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f00a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149383:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a600/0x274786fe0d18f003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f00a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149389:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149392:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149395:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a600/0x274786fe0d18f003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f00a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149414:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62200/0x274786fe0d18f011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f018 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149438:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62200/0x274786fe0d18f011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f018 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149443:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149447:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149452:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62200/0x274786fe0d18f011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f018 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149460:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d18f03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f042 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149467:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d18f03b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f042 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149471:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149474:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149478:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d18f03b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f042 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149489:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d18efa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efa8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149495:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d18efa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efa8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149500:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149511:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149514:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d18efa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efa8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149570:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d18efbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efc4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149577:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d18efbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efc4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149583:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397426.149586:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149589:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d18efbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efc4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149603:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d18efcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18efd2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149609:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d18efcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18efd2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149614:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397426.149617:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149621:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d18efcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18efd2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149629:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d18eff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18effc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149636:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d18eff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18effc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149651:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397426.149654:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149658:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d18eff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18effc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.149667:0:85105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d18f01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f026 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397426.149673:0:85105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d18f01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f026 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397426.149678:0:85105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397426.149681:0:85105:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397426.149684:0:85105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d18f01f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f026 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397426.149700:0:85105:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 57, was 0): DISCONN 00000100:00080000:2.0:1787397426.149705:0:85105:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397426.149711:0:85105:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3296 00000100:00080000:2.0:1787397426.149717:0:85105:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397426.149723:0:85105:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397426.149754:0:85105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8178df800 x1874218700883840/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397426.149772:0:85105:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1787397426.150091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700883840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787397426.150183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397426.150432:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397426.150438:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397426.150441:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397426.150444:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397426.150448:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397426.150452:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3301 00000100:00080000:3.0:1787397426.150455:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397426.150460:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.150481:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835752d80 x1874218700883968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397426.150514:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397426.150517:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397426.150519:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397426.150544:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3301 00000100:00080000:3.0:1787397426.150547:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397426.150551:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.150563:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835751500 x1874218700884224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397426.150578:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397426.150581:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397426.150583:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397426.150585:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3301 00000100:00080000:3.0:1787397426.150596:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397426.150600:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.150612:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750000 x1874218700884480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397426.150641:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397426.150644:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397426.150646:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397426.150649:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3301 00000100:00080000:3.0:1787397426.150651:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397426.150654:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.150663:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835753b80 x1874218700884864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397426.150687:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700884736:0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.150726:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.150754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397426.150760:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700884608:0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.150781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.150813:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884736 00000100:00100000:3.0:1787397426.150822:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884736 00000100:00100000:3.0:1787397426.150875:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884608 00000100:00100000:3.0:1787397426.150878:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884608 00000100:00100000:3.0:1787397426.151021:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:3.0:1787397426.151031:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700884736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.151082:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700884736:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.151089:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:3.0:1787397426.151127:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:3.0:1787397426.151134:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700884608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.151163:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700884608:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.151169:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00080000:3.0:1787397426.151190:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397426.151194:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397426.151222:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700884608:0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.151366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700884736:0@lo:400:kworker.0 00000100:00100000:3.0:1787397426.151393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700883968:0@lo:38:kworker.0 00000100:00100000:3.0:1787397426.151476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.151498:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700884224:0@lo:38:kworker.0 00000100:00100000:3.0:1787397426.151542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.151560:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700884480:0@lo:38:kworker.0 00000100:00100000:3.0:1787397426.151583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.151600:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700884864:0@lo:38:kworker.0 00000100:00100000:3.0:1787397426.151620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.151649:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883968 00000100:00100000:3.0:1787397426.151654:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883968 00000100:00100000:3.0:1787397426.151676:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884224 00000100:00100000:3.0:1787397426.151679:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884224 00000100:00100000:3.0:1787397426.151692:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884864 00000100:00100000:3.0:1787397426.151695:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884864 00000100:00100000:3.0:1787397426.151711:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1787397426.151717:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700883968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397426.151737:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397426.151780:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700883968:12345-0@lo:38:kworker.0 Request processed in 62us (303us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397426.151786:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1787397426.151799:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1787397426.151803:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700884224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397426.151813:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397426.151836:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700884224:12345-0@lo:38:kworker.0 Request processed in 31us (314us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397426.151841:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1787397426.151851:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1787397426.151854:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700884864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397426.151862:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397426.152012:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700884096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397426.152046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397426.152063:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397426.152069:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700884352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397426.152089:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397426.152147:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884096 00000100:00100000:0.0:1787397426.152151:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884096 00000100:00100000:0.0:1787397426.152184:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884352 00000100:00100000:0.0:1787397426.152188:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884352 00000100:00100000:0.0:1787397426.152214:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1787397426.152219:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397426.152271:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700884096:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.152277:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1787397426.152290:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1787397426.152295:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700884352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397426.152319:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700884352:12345-0@lo:400:kworker.0 Request processed in 24us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.152324:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1787397426.152345:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884480 00000100:00100000:0.0:1787397426.152348:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884480 00000100:00100000:0.0:1787397426.152362:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1787397426.152366:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700884480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397426.152376:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397426.152398:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700884480:12345-0@lo:38:kworker.0 Request processed in 31us (815us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397426.152403:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00080000:0.0:1787397426.152617:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397426.152645:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700884352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397426.152655:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700884096:0@lo:400:kworker.0 00000100:00080000:0.0:1787397426.152724:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.152729:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397426.152732:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700883968:0@lo:38:kworker.0 00000100:00080000:0.0:1787397426.152741:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.152752:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397426.152755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700884224:0@lo:38:kworker.0 00000100:00080000:0.0:1787397426.152766:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.152769:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397426.152771:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700884480:0@lo:38:kworker.0 00000100:00080000:0.0:1787397426.152779:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.152782:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397426.152784:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700884864:0@lo:38:kworker.0 00000100:00100000:3.0:1787397426.153652:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700884864:12345-0@lo:38:kworker.0 Request processed in 27us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397426.153664:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1787397426.153766:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700883840 00000100:00100000:2.0:1787397426.153773:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700883840 00000100:00100000:2.0:1787397426.153809:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397426.153815:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1874218700883840:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787397426.153851:0:85111:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3305 last 0 00000020:00000080:2.0:1787397426.153898:0:85111:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d18f383 00000100:00080000:2.0:1787397426.154026:0:85111:0:(import.c:65:import_set_state_nolock()) ffff89a7090fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397426.154100:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218700883840:12345-0@lo:250:mount.lustre.0 Request processed in 284us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.154117:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787397426.154481:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 23 00000100:00080000:0.0:1787397426.154492:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:0.0:1787397426.154501:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787397426.154506:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787397426.154509:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787397426.154512:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787397426.154558:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787397426.154568:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700883840:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1787397426.155442:0:85105:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1787397426.155459:0:85105:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787397426.155505:0:85105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787397426.155511:0:85105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397426.155668:0:85105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397426.155709:0:85105:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787397426.155714:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397426.155716:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397426.155717:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.155718:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.155719:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.155721:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.155722:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397426.155723:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397426.155725:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.155727:0:85105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397426.155730:0:85105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787397426.155732:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397426.155733:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397426.155734:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.155735:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.155736:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.155737:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.155738:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397426.155739:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397426.155740:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.155741:0:85105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397426.155765:0:85105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787397426.155793:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700884992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397426.155869:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787397426.156387:0:65702:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:3.0:1787397426.156402:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1787397426.156404:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787397426.156406:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787397426.156407:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397426.156408:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397426.156409:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397426.156410:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397426.156412:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397426.156413:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397426.156414:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1787397426.156458:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1787397426.156465:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1787397426.156468:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787397426.156477:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787397426.156478:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397426.156479:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397426.156480:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397426.156481:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397426.156482:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397426.156483:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397426.156484:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1787397426.156502:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1787397426.156506:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1787397426.156508:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787397426.156509:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787397426.156510:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397426.156511:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397426.156512:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397426.156513:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397426.156514:0:65702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397426.156515:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397426.156516:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1787397426.156567:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1787397426.156607:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700885376:0@lo:253:kworker.0 00000100:00100000:3.0:1787397426.156646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.156824:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.156864:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700885120:0@lo:253:kworker.0 00000100:00100000:2.0:1787397426.156910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.164291:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700884992 00000100:00100000:3.0:1787397426.164306:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700884992 00000100:00100000:3.0:1787397426.164350:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885376 00000100:00100000:3.0:1787397426.164354:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885376 00000100:00100000:3.0:1787397426.164372:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787397426.164380:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+6:85105:x1874218700884992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787397426.164435:0:85111:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397426.164439:0:85111:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787397426.164442:0:85111:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1787397426.164489:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700885248:0@lo:253:kworker.0 00000100:00100000:3.0:1787397426.164576:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787397426.164720:0:85115:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787397426.164863:0:85111:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 100 00000100:00100000:1.0:1787397426.166817:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885248 00000100:00100000:1.0:1787397426.166832:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885248 00000100:00100000:1.0:1787397426.166895:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787397426.166907:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:3648:x1874218700885376:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787397426.166946:0:85112:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787397426.170712:0:85116:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787397426.170721:0:85116:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787397426.170724:0:85116:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787397426.170727:0:85116:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787397426.170985:0:85116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1787397426.171208:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885120 00000100:00100000:0.0:1787397426.171219:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885120 20000000:01000000:1.0:1787397426.175463:0:85111:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787397426.175495:0:85111:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787397426.176806:0:85112:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787397426.176837:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:85105:x1874218700884992:12345-0@lo:253:mount.lustre.0 Request processed in 12451us (20960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.176850:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787397426.176899:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787397426.176910:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3651:x1874218700885248:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1787397426.176942:0:85111:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1787397426.177059:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700884992:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397426.177075:0:85105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787397426.177080:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397426.177081:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397426.177083:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.177084:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.177085:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.177087:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.177088:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397426.177090:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397426.177092:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.177093:0:85105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397426.177118:0:85105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a706d34800 from lustre-MDT0000 10000000:01000000:2.0:1787397426.177154:0:85105:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787397426.177157:0:85105:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397426.177168:0:85105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a706d34800 10000000:01000000:2.0:1787397426.177174:0:85105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787397426.177180:0:85105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a706d34800 10000000:01000000:2.0:1787397426.177183:0:85105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787397426.177187:0:85105:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a706d34800 from 1 10000000:01000000:2.0:1787397426.177191:0:85105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397426.177232:0:85105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.177244:0:85105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.177274:0:85105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397426.177297:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397426.177357:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.177394:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397426.177456:0:85113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787397426.177465:0:85113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1787397426.188647:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885504 00000100:00100000:2.0:1787397426.188663:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885504 00000100:00100000:0.0:1787397426.188814:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787397426.188829:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218700885120:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397426.188875:0:85117:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397426.191630:0:85112:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397426.191656:0:85112:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787397426.191792:0:85115:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397426.191798:0:85115:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397426.191826:0:85115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191857:0:85115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397426.191867:0:85115:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070523s 00010000:00010000:0.0:1787397426.191873:0:85115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191892:0:85115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191901:0:85115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191907:0:85115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191913:0:85115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397426.191917:0:85115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191925:0:85115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191937:0:85115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191944:0:85115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397426.191950:0:85115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031200/0x274786fe0d18f391 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397426.192323:0:85111:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787397426.192510:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218700885376:12345-0@lo:253:kworker.0 Request processed in 25601us (35858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.192553:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1787397426.192610:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787397426.192614:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787397426.192616:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397426.192618:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397426.192619:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397426.192621:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397426.192623:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397426.192625:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397426.192627:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787397426.192631:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700885376:0@lo:253:kworker.0 20000000:01000000:3.0:1787397426.196663:0:85111:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397426.196685:0:85111:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787397426.196804:0:85117:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787397426.196961:0:85115:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787397426.196966:0:85115:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787397426.196992:0:85115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197008:0:85115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397426.197017:0:85115:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070523s 00010000:00010000:2.0:1787397426.197022:0:85115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197029:0:85115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197042:0:85115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197050:0:85115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197056:0:85115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397426.197076:0:85115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197086:0:85115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197099:0:85115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197107:0:85115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.197114:0:85115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f398 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397426.203023:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787397426.203067:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3651:x1874218700885248:12345-0@lo:253:kworker.0 Request processed in 26157us (38487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.203080:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787397426.203299:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:85105:x1874218700885504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397426.203317:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397426.203342:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74a00/0x274786fe0d18f39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f38a expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.203370:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74a00/0x274786fe0d18f39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f38a expref: 7 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.203381:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74a00/0x274786fe0d18f39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f38a expref: 7 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.203391:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74a00, rc 0) 00000100:00100000:1.0:1787397426.203455:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:85105:x1874218700885504:12345-0@lo:101:mount.lustre.0 Request processed in 418us (26097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.203478:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1787397426.203612:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787397426.203615:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787397426.203617:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.203618:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.203619:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.203621:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.203622:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397426.203624:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.203626:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787397426.203629:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700885248:0@lo:253:kworker.0 20000000:01000000:1.0:1787397426.205672:0:85117:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397426.205693:0:85117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787397426.205846:0:85115:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787397426.205851:0:85115:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787397426.205875:0:85115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205892:0:85115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397426.205903:0:85115:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070523s 00010000:00010000:2.0:1787397426.205936:0:85115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205944:0:85115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205955:0:85115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205962:0:85115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205968:0:85115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397426.205973:0:85115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.205980:0:85115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.206003:0:85115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.206010:0:85115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.206016:0:85115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f3a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397426.206336:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+6:3650:x1874218700885120:12345-0@lo:253:kworker.0 Request processed in 17508us (49421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.206347:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787397426.206588:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397426.206609:0:85105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397426.206628:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787397426.206632:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00010000:3.0:1787397426.206633:0:85105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397426.206633:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.206636:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.206638:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.206650:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.206651:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397426.206652:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.206654:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787397426.206657:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700885120:0@lo:253:kworker.0 10000000:01000000:3.0:1787397426.206663:0:85105:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787397426.206672:0:85105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.206679:0:85105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397426.206687:0:85105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787397426.206691:0:85105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397426.206697:0:85105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a706d34800 10000000:01000000:3.0:1787397426.206706:0:85105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787397426.206710:0:85105:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787397426.206712:0:85105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397426.206739:0:85105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.206746:0:85105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.206755:0:85105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.206775:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397426.206811:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.206848:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.206876:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885632 00000100:00100000:1.0:1787397426.206883:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885632 00000100:00100000:1.0:1787397426.206930:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397426.206938:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+6:85105:x1874218700885632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397426.206951:0:85113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397426.206964:0:85113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74400/0x274786fe0d18f3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f3ad expref: -99 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.206980:0:85113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74400/0x274786fe0d18f3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f3ad expref: 7 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.206990:0:85113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74400/0x274786fe0d18f3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f3ad expref: 7 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.206997:0:85113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:1.0:1787397426.207025:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:85105:x1874218700885632:12345-0@lo:101:mount.lustre.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.207031:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787397426.208015:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397426.208035:0:85105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.208175:0:85105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.208321:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.208368:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.208405:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.211359:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885760 00000100:00100000:1.0:1787397426.211375:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885760 00000100:00100000:1.0:1787397426.211917:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787397426.211930:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:85105:x1874218700885760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397426.212361:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:85105:x1874218700885760:12345-0@lo:501:mount.lustre.0 Request processed in 433us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.212371:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397426.212556:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.212615:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397426.212669:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.214856:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700885888 00000100:00100000:2.0:1787397426.214873:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700885888 00000100:00100000:3.0:1787397426.214909:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.214937:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787397426.214947:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:85105:x1874218700885888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397426.216712:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:85105:x1874218700885888:12345-0@lo:503:mount.lustre.0 Request processed in 1755us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.216728:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787397426.216815:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700885888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397426.218300:0:85118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85118:1874218700886016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397426.218581:0:85118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.218619:0:85118:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.218908:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886016 00000100:00100000:2.0:1787397426.218916:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886016 00000100:00100000:2.0:1787397426.218968:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787397426.218979:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:85118:x1874218700886016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397426.219910:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:85118:x1874218700886016:12345-0@lo:502:llog_process_th.0 Request processed in 930us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.219921:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397426.220477:0:85118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85118:1874218700886016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397426.220514:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397426.220629:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.220632:0:85118:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787397426.220638:0:85118:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787397426.220642:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397426.220655:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a8387819c0) 00000020:00000080:3.0:1787397426.220679:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1787397426.220691:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787397426.220771:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787397426.220780:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f3c2 00000020:00000080:3.0:1787397426.221274:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787397426.221281:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397426.221434:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.221437:0:85118:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787397426.221442:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397426.221446:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.221448:0:85118:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787397426.221452:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397426.221460:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a838784d40) 00000020:00000080:3.0:1787397426.221474:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1787397426.221479:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787397426.221481:0:85118:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787397426.221484:0:85118:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787397426.221490:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787397426.221663:0:85118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a706d34800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787397426.221676:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a838783380) 00000020:00000080:3.0:1787397426.221687:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1787397426.221742:0:85118:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787397426.221747:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f3d7 00000020:00000080:3.0:1787397426.222164:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787397426.222246:0:85118:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787397426.222252:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d18f3de 00080000:01000000:3.0:1787397426.222259:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787397426.222262:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f3e5 00010000:00010000:2.0:1787397426.315179:0:85118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787397426.315326:0:85118:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: e90f04db-6a63-4f01-92c7-7bf813f9f081 idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:2.0:1787397426.315368:0:85118:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:2.0:1787397426.315392:0:85118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:2.0:1787397426.315502:0:85118:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787397426.320223:0:85118:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a801377780: xid 1874218681106560, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:3.0:1787397426.321098:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a702478000) 00000020:00000080:3.0:1787397426.321124:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1787397426.321196:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787397426.321202:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f401 00000020:00000080:3.0:1787397426.321992:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397426.328033:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d18f408 00000020:00000080:2.0:1787397426.338620:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787397426.338636:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397426.338660:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397426.338663:0:85118:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787397426.338667:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787397426.338670:0:85118:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787397426.338672:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397426.338674:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397426.338676:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787397426.338679:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397426.338680:0:85118:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787397426.338684:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397426.338689:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397426.338691:0:85118:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787397426.338696:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787397426.338759:0:85118:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787397426.338776:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397426.338780:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397426.338781:0:85118:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787397426.338796:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397426.338800:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397426.338801:0:85118:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787397426.338803:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787397426.338809:0:85118:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:2.0:1787397426.338834:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397426.338851:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a828c199c0) 00000020:00000080:2.0:1787397426.338872:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787397426.338878:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787397426.338946:0:85118:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787397426.338953:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787397426.338960:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f416 00010000:00080000:2.0:1787397426.338993:0:85118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a819128000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397426.342486:0:85118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787397426.352121:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397426.352137:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787397426.352178:0:85118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787397426.352202:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f41d 00000100:00080000:0.0:1787397426.352213:0:85118:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397426.352219:0:85118:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819128000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397426.352258:0:85118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee5c00 x1874218700886144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397426.352289:0:85118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787397426.352370:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397426.352455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.352557:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886144 00000100:00100000:3.0:1787397426.352565:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886144 00000100:00100000:3.0:1787397426.352597:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:3.0:1787397426.352604:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700886144:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787397426.352625:0:23942:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3305 last 0 00000020:00000080:3.0:1787397426.352656:0:23942:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f424 00000004:00100000:3.0:1787397426.352673:0:23942:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397426.352767:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a7025d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397426.352833:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700886144:12345-0@lo:38:llog_process_th.0 Request processed in 228us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.352841:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:3.0:1787397426.352884:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397426.352892:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1787397426.352899:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787397426.352903:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787397426.352905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819128000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:0.0:1787397426.352986:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397426.352991:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.352993:0:85118:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787397426.352996:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397426.352999:0:85118:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787397426.353000:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397426.353002:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397426.353003:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397426.353005:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.353007:0:85118:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397426.353009:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397426.353014:0:85118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787397426.353018:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.353019:0:85118:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787397426.353021:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397426.353025:0:85118:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787397426.353045:0:85118:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787397426.353047:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397426.353061:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a703c88000) 00000020:00000080:0.0:1787397426.353079:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787397426.353099:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397426.353164:0:85118:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787397426.353170:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787397426.353176:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f432 00010000:00080000:0.0:1787397426.353204:0:85118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a83670c000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397426.353414:0:85118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1787397426.356843:0:85118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787397426.356883:0:85118:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787397426.357741:0:85118:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000100:00100000:3.0:1787397426.360734:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397426.361109:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700886272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397426.361184:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.361319:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886272 00000100:00100000:2.0:1787397426.361328:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886272 00000100:00100000:2.0:1787397426.361379:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1787397426.361401:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700886272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397426.361448:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397426.361645:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700886272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397426.361755:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700886272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 354us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.361763:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000040:00080000:1.0:1787397426.363403:0:85118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397426.363456:0:85118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:1.0:1787397426.365710:0:85118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000040:00080000:3.0:1787397426.369226:0:85124:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:3.0:1787397426.369239:0:85124:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787397426.370685:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397426.370698:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397426.370743:0:85118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787397426.370774:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f439 00000100:00080000:3.0:1787397426.370861:0:85118:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397426.370870:0:85118:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a83670c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.370909:0:85118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829b40a80 x1874218700886400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397426.370932:0:85118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787397426.371055:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397426.371060:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.371062:0:85118:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787397426.371065:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397426.371067:0:85118:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787397426.371069:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397426.371070:0:85118:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397426.371072:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397426.371074:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.371076:0:85118:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397426.371078:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397426.371081:0:85118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397426.371085:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.371086:0:85118:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787397426.371088:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397426.371094:0:85118:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:3.0:1787397426.371120:0:85118:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397426.371123:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397426.371135:0:85118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a829b919c0) 00000020:00000080:3.0:1787397426.371150:0:85118:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787397426.371156:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787397426.371220:0:85118:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787397426.371226:0:85118:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787397426.371233:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f447 00010000:00080000:3.0:1787397426.371266:0:85118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a835593000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397426.371476:0:85118:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1787397426.371572:0:85118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787397426.371587:0:85118:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787397426.372260:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886400:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397426.372333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.372695:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886400 00000100:00100000:3.0:1787397426.372703:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886400 00000100:00100000:3.0:1787397426.372740:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916 00000100:00100000:3.0:1787397426.372746:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1874218700886400:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787397426.372775:0:25908:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3305 last 0 00000020:00000080:3.0:1787397426.372943:0:25908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f44e 00002000:00100000:3.0:1787397426.372957:0:25908:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a835590800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787397426.372961:0:25908:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787397426.372964:0:25908:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787397426.373045:0:25908:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397426.373067:0:25908:0:(import.c:65:import_set_state_nolock()) ffff89a835594000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397426.373176:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700886400:12345-0@lo:8:llog_process_th.0 Request processed in 428us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.373184:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916 00000040:00080000:0.0:1787397426.373378:0:85118:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000040:00080000:0.0:1787397426.374449:0:85118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397426.374477:0:85118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:0.0:1787397426.374624:0:85118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000040:00080000:0.0:1787397426.377020:0:85126:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1787397426.377324:0:85126:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1787397426.377766:0:85126:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1787397426.377907:0:85126:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1787397426.378269:0:85126:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1787397426.378273:0:85126:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787397426.379416:0:85118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397426.379442:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397426.379490:0:85118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787397426.379560:0:85118:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f455 00000100:00080000:3.0:1787397426.379571:0:85118:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397426.379578:0:85118:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a835593000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397426.379615:0:85118:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829b43100 x1874218700886528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397426.379633:0:85118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787397426.379690:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397426.379701:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.379704:0:85118:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787397426.379707:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397426.379711:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.379712:0:85118:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787397426.379714:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787397426.379716:0:85118:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787397426.379718:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397426.379719:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.379720:0:85118:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787397426.379722:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397426.379724:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.379726:0:85118:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787397426.379729:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787397426.379761:0:85118:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85118:1874218700886656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397426.380115:0:85118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.380238:0:85118:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.380357:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397426.380367:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787397426.380375:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787397426.380379:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787397426.380382:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787397426.380402:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787397426.380409:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886400:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397426.380609:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886528:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397426.380652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.380726:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886528 00000100:00100000:2.0:1787397426.380732:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886528 00000100:00100000:2.0:1787397426.380775:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917 00000100:00100000:2.0:1787397426.380791:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218700886528:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787397426.380820:0:26164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3305 last 0 00000020:00000080:2.0:1787397426.380849:0:26164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f45c 00002000:00100000:2.0:1787397426.380864:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a819129800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787397426.380869:0:26164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787397426.380872:0:26164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397426.380943:0:26164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787397426.380965:0:26164:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397426.381010:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700886528:12345-0@lo:8:llog_process_th.0 Request processed in 227us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.381018:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917 00000100:00100000:0.0:1787397426.381232:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397426.381239:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397426.381245:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787397426.381248:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787397426.381256:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835593000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787397426.381268:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397426.381272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700886528:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787397426.381292:0:85126:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787397426.381342:0:85126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3305671819337ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787397426.381348:0:85126:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:3.0:1787397426.381590:0:85124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 3 count 2 00000040:00080000:3.0:1787397426.381615:0:85124:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:3.0:1787397426.381620:0:85124:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000004:00080000:3.0:1787397426.381640:0:85124:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787397426.381669:0:85124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3305672146367ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787397426.381673:0:85124:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787397426.381797:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700887040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397426.381838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.382260:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700886784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397426.382297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.382329:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397426.382335:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700886912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397426.382354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.382792:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886784 00000100:00100000:3.0:1787397426.382799:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886784 00000100:00100000:3.0:1787397426.382851:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886912 00000100:00100000:3.0:1787397426.382854:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886912 00000100:00100000:3.0:1787397426.382874:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1787397426.382883:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700886784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397426.382909:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397426.382955:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700886784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.382974:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1787397426.382992:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1787397426.382998:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700886912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397426.383014:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397426.383052:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700886912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.383058:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00080000:0.0:1787397426.383247:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397426.383252:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397426.383449:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700886912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397426.383466:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700886784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397426.383959:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887040 00000100:00100000:0.0:1787397426.383966:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887040 00000100:00100000:0.0:1787397426.384013:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1787397426.384021:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700887040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397426.384055:0:26165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1666 count 1 00000100:00100000:0.0:1787397426.384149:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700887040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (2310us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397426.384156:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00000004:00080000:0.0:1787397426.384186:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a829b43480, transno 0 00000004:00080000:0.0:1787397426.384190:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a829b43480/1, rc -2, transno 0 00000100:00100000:0.0:1787397426.384200:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700887040:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1787397426.385478:0:85124:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:3.0:1787397426.385504:0:85124:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1787397426.392005:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700886656 00000100:00100000:1.0:1787397426.392023:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700886656 00000100:00100000:1.0:1787397426.392092:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787397426.392102:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:85118:x1874218700886656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.392318:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:85118:x1874218700886656:12345-0@lo:502:llog_process_th.0 Request processed in 216us (12201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.392339:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787397426.393000:0:85118:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85118:1874218700886656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397426.393055:0:85118:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397426.393064:0:85118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397426.393067:0:85118:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787397426.393072:0:85118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:0.0:1787397426.393388:0:85106:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787397426.393413:0:85106:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:1.0:1787397426.394475:0:85105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787397426.394570:0:85105:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787397426.394591:0:85105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.394604:0:85105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397426.394613:0:85105:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a706d34800 from 1 10000000:01000000:1.0:1787397426.394615:0:85105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397426.394662:0:85105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.394669:0:85105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.394696:0:85105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397426.394721:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397426.394804:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.394846:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80153aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.394986:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887168 00000100:00100000:2.0:1787397426.394994:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887168 00000100:00100000:2.0:1787397426.395052:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397426.395061:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:85105:x1874218700887168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397426.395075:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397426.395089:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f463 expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.395113:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f463 expref: 9 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.395123:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f463 expref: 9 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.395134:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54600, rc 0) 00000100:00100000:2.0:1787397426.395174:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:85105:x1874218700887168:12345-0@lo:101:mount.lustre.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.395181:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787397426.395427:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397426.395442:0:85105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.395452:0:85105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397426.396312:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887296:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787397426.396368:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.396406:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80153aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397426.396629:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887296 00000100:00100000:0.0:1787397426.396636:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887296 00000100:00100000:0.0:1787397426.396683:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397426.396692:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:85105:x1874218700887296:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787397426.396709:0:85112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787397426.396731:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787397426.396735:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787397426.396738:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787397426.396741:0:85112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:0.0:1787397426.396846:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:85105:x1874218700887296:12345-0@lo:256:mount.lustre.0 Request processed in 155us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.396854:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397426.397057:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887296:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787397426.397736:0:85105:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397426.397763:0:85105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.397774:0:85105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397426.398415:0:85105:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a706d34800 from 1 10000000:01000000:3.0:1787397426.398429:0:85105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397426.398479:0:85105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.398711:0:85105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.398722:0:85105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.398745:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397426.399170:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.399247:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.403994:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887424 00000100:00100000:2.0:1787397426.404012:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887424 00000100:00100000:2.0:1787397426.404159:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787397426.404169:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:85105:x1874218700887424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397426.404185:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397426.404205:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f471 expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.404232:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f471 expref: 10 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.404242:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f471 expref: 10 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.404250:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55000, rc 0) 00000100:00100000:2.0:1787397426.404428:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700887424:12345-0@lo:101:mount.lustre.0 Request processed in 252us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.404435:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397426.405226:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397426.405249:0:85105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.405260:0:85105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.405339:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.405383:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.405473:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397426.405721:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887552 00000100:00100000:0.0:1787397426.405728:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887552 00000100:00100000:0.0:1787397426.405894:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397426.405903:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700887552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397426.406060:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700887552:12345-0@lo:501:mount.lustre.0 Request processed in 157us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.406067:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787397426.406133:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.406165:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397426.406213:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.406349:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.406429:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887680 00000100:00100000:2.0:1787397426.406434:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887680 00000100:00100000:2.0:1787397426.406518:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397426.406560:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700887680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397426.406644:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700887680:12345-0@lo:503:mount.lustre.0 Request processed in 85us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.406651:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397426.407015:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700887680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397426.408109:0:85128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85128:1874218700887808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397426.408179:0:85128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397426.408316:0:85128:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.408350:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887808 00000100:00100000:3.0:1787397426.408356:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887808 00000100:00100000:3.0:1787397426.408448:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397426.408464:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:85128:x1874218700887808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397426.409198:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:85128:x1874218700887808:12345-0@lo:502:llog_process_th.0 Request processed in 732us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.409208:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397426.409322:0:85128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85128:1874218700887808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397426.409355:0:85128:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397426.409366:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.409368:0:85128:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787397426.409374:0:85128:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a706d34800 00000020:00000080:0.0:1787397426.409377:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397426.409385:0:85128:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397426.409387:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.409388:0:85128:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787397426.409391:0:85128:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397426.409393:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397426.409395:0:85128:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787397426.409405:0:85128:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a706d34800 00000020:00000080:0.0:1787397426.409407:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787397426.409518:0:85128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85128:1874218700887936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397426.409578:0:85128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.416778:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700887936 00000100:00100000:2.0:1787397426.416807:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700887936 00000100:00100000:2.0:1787397426.416878:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787397426.416889:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:85128:x1874218700887936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397426.417472:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:85128:x1874218700887936:12345-0@lo:502:llog_process_th.0 Request processed in 583us (7891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.417496:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787397426.418679:0:85128:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8346a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.418721:0:85128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85128:1874218700887936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397426.418767:0:85128:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397426.418776:0:85128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397426.418778:0:85128:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787397426.418792:0:85128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787397426.419632:0:85105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1787397426.419663:0:85105:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397426.419687:0:85105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.419699:0:85105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397426.419765:0:85105:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787397426.419796:0:85105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a706d34800 10000000:01000000:3.0:1787397426.419799:0:85105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a706d34800 10000000:01000000:3.0:1787397426.419803:0:85105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397426.419809:0:85105:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a706d34800 from 1 10000000:01000000:3.0:1787397426.419811:0:85105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397426.419847:0:85105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.419856:0:85105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.419865:0:85105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.419887:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397426.419947:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.419985:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.420005:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888064 00000100:00100000:3.0:1787397426.420010:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888064 00000100:00100000:3.0:1787397426.420180:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397426.420189:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:85105:x1874218700888064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397426.420201:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397426.420215:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b600/0x274786fe0d18f486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f47f expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.420236:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b600/0x274786fe0d18f486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f47f expref: 11 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.420246:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b600/0x274786fe0d18f486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f47f expref: 11 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.420254:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b600, rc 0) 00000100:00100000:3.0:1787397426.420291:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888064:12345-0@lo:101:mount.lustre.0 Request processed in 103us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.420297:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397426.420333:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397426.420348:0:85105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397426.420356:0:85105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397426.420406:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.420442:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.420460:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.420478:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888192 00000100:00100000:3.0:1787397426.420481:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888192 00000100:00100000:3.0:1787397426.420497:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787397426.420503:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.420716:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888192:12345-0@lo:501:mount.lustre.0 Request processed in 212us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.420724:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787397426.420754:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397426.421614:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397426.421677:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.421710:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.421735:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888320 00000100:00100000:3.0:1787397426.421740:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888320 00000100:00100000:3.0:1787397426.421771:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397426.421778:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397426.422260:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397426.422545:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.422596:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.422616:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.422731:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703662850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888320:12345-0@lo:503:mount.lustre.0 Request processed in 250us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.422743:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397426.422781:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888448 00000100:00100000:3.0:1787397426.422856:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888448 00000100:00100000:3.0:1787397426.422879:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397426.422885:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397426.422971:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703661850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888448:12345-0@lo:502:llog_process_th.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.422978:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787397426.424357:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888448:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787397426.424436:0:85131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787397426.424450:0:85131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a706924d40) 00000020:00000080:1.0:1787397426.424473:0:85131:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787397426.426322:0:85131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a706d34800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787397426.426331:0:85131:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a706d34800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787397426.426334:0:85131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a706d34800 4 00010000:00080000:1.0:1787397426.426371:0:85131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a83fa41000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397426.433879:0:85131:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1787397426.436833:0:85131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787397426.436929:0:85131:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787397426.436943:0:85131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d18f494 00000100:00080000:1.0:1787397426.436955:0:85131:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397426.436962:0:85131:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a83fa41000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397426.437011:0:85131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82e4f5c00 x1874218700888576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397426.437035:0:85131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787397426.438006:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.438106:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.438148:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888704 00000100:00100000:1.0:1787397426.438155:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888704 00000100:00100000:1.0:1787397426.438205:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787397426.438214:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.438345:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888704:12345-0@lo:502:llog_process_th.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.438353:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787397426.438426:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836022900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.438454:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.438496:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.438559:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.438581:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888832 00000100:00100000:1.0:1787397426.438585:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888832 00000100:00100000:1.0:1787397426.438609:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397426.438616:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397426.438675:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:85131:x1874218700888832:12345-0@lo:502:llog_process_th.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.438682:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397426.438714:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.438728:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:85131:1874218700888832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787397426.438746:0:85131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1787397426.439805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700888576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397426.439867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.440636:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888576 00000100:00100000:1.0:1787397426.440645:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888576 00000100:00100000:1.0:1787397426.440683:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1787397426.440691:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700888576:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397426.440754:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700888576:12345-0@lo:38:llog_process_th.0 Request processed in 62us (885us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397426.440761:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000020:01000000:2.0:1787397426.440893:0:85105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787397426.440923:0:85105:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397426.440938:0:85105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.440950:0:85105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397426.441002:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787397426.441004:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397426.441005:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.441007:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.441008:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.441009:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.441010:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397426.441012:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397426.441013:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.441014:0:85105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397426.441018:0:85105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787397426.441021:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397426.441022:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397426.441023:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397426.441024:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397426.441026:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397426.441027:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397426.441028:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397426.441039:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397426.441041:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397426.441047:0:85105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397426.441067:0:85105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787397426.441083:0:85105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397426.441122:0:85105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397426.441148:0:85105:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397426.441174:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700888960 00000100:00100000:2.0:1787397426.441178:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700888960 00000100:00100000:0.0:1787397426.442673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397426.442716:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115008 00000100:00100000:0.0:1787397426.442723:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115008 00000100:00100000:0.0:1787397426.442777:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1026 00000100:00100000:0.0:1787397426.442801:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681115008:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397426.442879:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681115008:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.442887:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1026 00000100:00080000:0.0:1787397426.442911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397426.444618:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397426.444633:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83fa41000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397426.444640:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787397426.444645:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700888576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397426.445594:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787397426.445609:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787397426.445641:0:85117:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787397426.445656:0:85117:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787397426.450400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397426.450469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397426.454999:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114752 00000100:00100000:1.0:1787397426.455014:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114752 00000100:00100000:1.0:1787397426.455123:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:1.0:1787397426.455132:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874218681114752:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:1.0:1787397426.455165:0:85113:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 367372d5-1a70-4e8f-8f10-c0f943f3662d@192.168.204.60@tcp t0 exp 0000000000000000 cur 3305 last 0 00000020:00000080:1.0:1787397426.455203:0:85113:0:(genops.c:1406:class_connect()) connect: client 367372d5-1a70-4e8f-8f10-c0f943f3662d, cookie 0x274786fe0d18f49b 00000100:00080000:1.0:1787397426.455443:0:85113:0:(import.c:65:import_set_state_nolock()) ffff89a836714000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397426.455607:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703660050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:2401:x1874218681114752:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 473us (5217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.455616:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:1.0:1787397426.455666:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681114880 00000100:00100000:1.0:1787397426.455670:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681114880 00000100:00100000:1.0:1787397426.455696:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1049 00000100:00100000:1.0:1787397426.455701:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681114880:12345-192.168.204.60@tcp:38:kworker.0 00000100:00100000:1.0:1787397426.455735:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681114880:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 33us (5267us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397426.455742:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1049 20000000:01000000:0.0:1787397426.456667:0:85117:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397426.456687:0:85117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787397426.457046:0:85115:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397426.457051:0:85115:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397426.457074:0:85115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457092:0:85115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457100:0:85115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457134:0:85115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457147:0:85115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397426.457161:0:85115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85115:1874218700889088:0@lo:104: 00000100:00100000:1.0:1787397426.457226:0:85115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397426.457258:0:85115:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397426.457282:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889088 00000100:00100000:1.0:1787397426.457288:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889088 00000100:00100000:1.0:1787397426.457398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787397426.457409:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:85115:x1874218700889088:12345-0@lo:104: 00010000:00010000:1.0:1787397426.457442:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457506:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397426.457667:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:85115:x1874218700889088:12345-0@lo:104: Request processed in 260us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397426.457674:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:1.0:1787397426.457696:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397426.457702:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457709:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397426.457713:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457721:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397426.457728:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397426.457733:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397426.457761:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.457777:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787397426.457933:0:85115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85115:1874218700889088:0@lo:104: 00010000:00010000:0.0:1787397426.457955:0:85115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397426.458023:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:85105:x1874218700888960:12345-0@lo:253:mount.lustre.0 Request processed in 12418us (16899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397426.458042:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787397426.458173:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700889216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397426.458214:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397426.458263:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.458271:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a75000/0x274786fe0d18f463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18f46a expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.458287:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397426.458288:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397426.458290:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397426.458688:0:85105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:85105:1874218700888960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787397426.458700:0:85105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787397426.458703:0:85105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787397426.458705:0:85105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397426.458707:0:85105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397426.458708:0:85105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397426.458710:0:85105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397426.458711:0:85105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397426.458712:0:85105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397426.458714:0:85105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397426.458715:0:85105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397426.458717:0:85105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787397426.458732:0:85105:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787397426.462257:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889216 00000100:00100000:2.0:1787397426.462271:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889216 00010000:00010000:2.0:1787397426.462311:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397426.462349:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1787397426.462359:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+11:3649:x1874218700889216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397426.462375:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397426.462380:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462392:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462409:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54600/0x274786fe0d18f46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d18f463 expref: 11 pid: 85111 timeout: 3405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462434:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462457:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397426.462474:0:19654:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005422790s 00010000:00010000:2.0:1787397426.462478:0:19654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462484:0:19654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462491:0:19654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462498:0:19654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462504:0:19654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397426.462518:0:19654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462554:0:19654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462574:0:19654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397426.462585:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397426.462690:0:85115:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.462699:0:85115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397426.462706:0:85115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75200/0x274786fe0d18f4a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397426.462996:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+10:3649:x1874218700889216:12345-0@lo:103:ldlm_bl.0 Request processed in 638us (4780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397426.463004:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1787397426.470449:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700889216:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787397426.481270:0:85105:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:2.0:1787397426.482043:0:85105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787397426.482359:0:85137:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787397426.482408:0:85137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787397426.482933:0:85105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787397426.483554:0:85138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.483621:0:85138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.483664:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889344 00000100:00100000:3.0:1787397426.483671:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889344 00000100:00100000:3.0:1787397426.483716:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:3.0:1787397426.483724:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.483804:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.483812:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:3.0:1787397426.483835:0:85138:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.483856:0:85138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889344:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787397426.483881:0:85138:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787397426.483902:0:85138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.483936:0:85138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.483954:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889472 00000100:00100000:3.0:1787397426.483957:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889472 00000100:00100000:3.0:1787397426.483975:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1787397426.483980:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.484072:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.484078:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1787397426.484092:0:85138:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.484103:0:85138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.484143:0:85138:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.484161:0:85138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397426.484175:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889600 00000100:00100000:3.0:1787397426.484178:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889600 00000100:00100000:3.0:1787397426.484193:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1787397426.484198:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397426.484232:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85138:x1874218700889600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 34us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397426.484237:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1787397426.484250:0:85138:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397426.484259:0:85138:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85138:1874218700889600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787397426.484308:0:85138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397426.486093:0:85138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787397426.486179:0:85138:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1787397426.487194:0:85105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787397426.487239:0:85105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787397426.487703:0:85105:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787397426.487712:0:85105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787397426.487750:0:85105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397426.488717:0:85105:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787397426.489173:0:85105:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787397426.489205:0:85105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787397426.489320:0:85105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787397426.498028:0:85105:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00000020:00080000:0.0:1787397426.499672:0:85136:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:0.0:1787397426.499681:0:85136:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:00080000:2.0:1787397426.500082:0:85137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787397426.500160:0:85137:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787397426.500164:0:85137:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1787397426.502117:0:85105:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:1.0:1787397426.503156:0:85139:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85139 00010000:02000000:1.0:1787397426.503243:0:85139:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1787397426.503248:0:85139:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787397426.503252:0:85139:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1787397426.503947:0:85105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787397426.503977:0:85105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787397426.504016:0:85105:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787397426.504046:0:85105:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787397426.505413:0:85105:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397426.506090:0:85105:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397426.982461:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397428.005302:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397428.040048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397428.040433:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115136 00000100:00100000:1.0:1787397428.040445:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115136 00000100:00100000:1.0:1787397428.040594:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:1.0:1787397428.040605:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:42362:x1874218681115136:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.040621:0:85113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397428.040640:0:85113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75800/0x274786fe0d18f4a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e23 expref: -99 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.040684:0:85113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75800/0x274786fe0d18f4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e23 expref: 6 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.040696:0:85113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75800/0x274786fe0d18f4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e23 expref: 6 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.040706:0:85113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00000100:00100000:1.0:1787397428.040765:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703662050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681115136:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 162us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.040773:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:3.0:1787397428.051127:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397428.051288:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115264 00000100:00100000:2.0:1787397428.051298:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115264 00000100:00100000:2.0:1787397428.051379:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:2.0:1787397428.051398:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681115264:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397428.051426:0:85112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787397428.051469:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397428.051474:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1787397428.051477:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1787397428.051479:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1787397428.051481:0:85112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:2.0:1787397428.054721:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703663c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681115264:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 3320us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.054739:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:2.0:1787397428.061953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397428.062137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397428.062184:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115392 00000100:00100000:2.0:1787397428.062197:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115392 00000100:00100000:2.0:1787397428.062256:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1050 00000100:00100000:2.0:1787397428.062267:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681115392:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1787397428.062309:0:77740:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e90f04db-6a63-4f01-92c7-7bf813f9f081' at ffff89a7090fd800, cookie 0x274786fe0d18f3ec 00010000:00080000:2.0:1787397428.062315:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp recovering/t94489280514 exp ffff89a7090fd800 cur 3307 last 1787397426 00010000:02000400:2.0:1787397428.062334:0:77740:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1787397428.062341:0:77740:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1787397428.062376:0:77740:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787397428.062665:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115520 00000100:00100000:3.0:1787397428.062671:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115520 00000100:00100000:3.0:1787397428.062707:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:3.0:1787397428.062714:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681115520:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.062727:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.062746:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096a000/0x274786fe0d18f4b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e2a expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.062772:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a000/0x274786fe0d18f4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e2a expref: 7 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.062784:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096a000/0x274786fe0d18f4b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e2a expref: 7 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.062794:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a000, rc 0) 00000100:00100000:3.0:1787397428.062849:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703660450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681115520:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 134us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.062855:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00080000:2.0:1787397428.063182:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a706ff5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397428.063646:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681115392:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 Request processed in 1376us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.063656:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1050 10000000:01000000:1.0:1787397428.068756:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787397428.068766:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a706d34800 from 104 10000000:01000000:1.0:1787397428.068773:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397428.068851:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.068865:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.068896:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.068926:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.069043:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397428.069082:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889728 00000100:00100000:2.0:1787397428.069089:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889728 00000100:00100000:1.0:1787397428.069091:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d479c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.069164:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787397428.069173:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8347eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218700889728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397428.069199:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397428.069215:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55400/0x274786fe0d18f4be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f4b7 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.069240:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55400/0x274786fe0d18f4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f4b7 expref: 11 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.069250:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55400/0x274786fe0d18f4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f4b7 expref: 11 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.069260:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55400, rc 0) 00000100:00100000:2.0:1787397428.069302:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8347eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700889728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.069309:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787397428.070898:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.070925:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.070937:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.071015:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.071075:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.071129:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d479c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397428.071151:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889856 00000100:00100000:1.0:1787397428.071156:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889856 00000100:00100000:1.0:1787397428.071200:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397428.071208:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8347e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700889856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397428.071228:0:85113:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397428.071243:0:85113:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397428.071245:0:85113:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:1.0:1787397428.071339:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8347e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700889856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.071347:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397428.071401:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787397428.071447:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787397428.071455:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.071464:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397428.071474:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397428.071477:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:1.0:1787397428.071479:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397428.071504:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.071548:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.071558:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.071573:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.071602:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.071624:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.072021:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700889984 00000100:00100000:3.0:1787397428.072027:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700889984 00000100:00100000:3.0:1787397428.072080:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397428.072089:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8347ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700889984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.072110:0:85117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.072126:0:85117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096aa00/0x274786fe0d18f4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f4c5 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.072146:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096aa00/0x274786fe0d18f4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f4c5 expref: 12 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.072156:0:85117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18f4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f4c5 expref: 12 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.072165:0:85117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096aa00, rc 0) 00000100:00100000:3.0:1787397428.072203:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8347ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700889984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.072210:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787397428.072963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397428.073037:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115648 00000100:00100000:0.0:1787397428.073045:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115648 00000100:00100000:0.0:1787397428.073084:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:0.0:1787397428.073093:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8347e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681115648:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.073313:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8347e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681115648:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 219us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.073334:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:1.0:1787397428.077584:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700889984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.077629:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.077646:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.077791:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.077883:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.077922:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.078779:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890112 00000100:00100000:3.0:1787397428.078791:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890112 00000100:00100000:3.0:1787397428.078870:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787397428.078881:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8347eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700890112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.079182:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8347eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700890112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.079192:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787397428.079557:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.079615:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.079688:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.079722:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d479c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.079774:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890240 00000100:00100000:3.0:1787397428.079780:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890240 00000100:00100000:3.0:1787397428.079825:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397428.079833:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700890240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.079934:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700890240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.079951:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787397428.080211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397428.080349:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681108864 00000100:00100000:0.0:1787397428.080355:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681108864 00000100:00100000:0.0:1787397428.080440:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1051 00000100:00100000:0.0:1787397428.080452:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681108864:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:0.0:1787397428.080468:0:66178:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:0.0:1787397428.080488:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681108864:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 40us (278us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397428.080495:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1051 00010000:00080000:3.0:1787397428.081651:0:85139:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1787397428.081912:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.083679:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397428.084181:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115776 00000100:00100000:1.0:1787397428.084195:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115776 00000040:00080000:0.0:1787397428.084242:0:85206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000100:00100000:1.0:1787397428.084250:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:1.0:1787397428.084261:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681115776:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.084465:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681115776:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 205us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.084474:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000020:01000000:3.0:1787397428.084489:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787397428.084515:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397428.084558:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.084572:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397428.084581:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787397428.084584:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 101 10000000:01000000:3.0:1787397428.084587:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397428.084623:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.084631:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.084640:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.084664:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.084710:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.084755:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.084829:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890368 00000100:00100000:2.0:1787397428.084841:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890368 00000100:00100000:2.0:1787397428.084878:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787397428.084887:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700890368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397428.084895:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397428.084906:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55600/0x274786fe0d18f4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f4d3 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.084925:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55600/0x274786fe0d18f4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f4d3 expref: 13 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.084936:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55600/0x274786fe0d18f4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f4d3 expref: 13 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.084945:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55600, rc 0) 00000100:00100000:2.0:1787397428.084978:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700890368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.084985:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787397428.085187:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.085202:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.085218:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.085272:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.085306:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.085328:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.085382:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890496 00000100:00100000:0.0:1787397428.085396:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890496 00000100:00100000:2.0:1787397428.085518:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787397428.085554:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700890496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397428.085570:0:85112:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787397428.085586:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397428.085590:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1787397428.085593:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1787397428.085595:0:85112:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1787397428.085597:0:85112:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:2.0:1787397428.085723:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700890496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.085731:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787397428.090828:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787397428.090942:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397428.091869:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.091884:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397428.091895:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787397428.091898:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1787397428.091901:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397428.091940:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092021:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092032:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.092059:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.092135:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.092251:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80292ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.092280:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890624 00000100:00100000:3.0:1787397428.092286:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890624 00000100:00100000:3.0:1787397428.092327:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397428.092406:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700890624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.092420:0:85113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.092580:0:85113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b200/0x274786fe0d18f4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f4e1 expref: -99 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092608:0:85113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b200/0x274786fe0d18f4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f4e1 expref: 14 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092621:0:85113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b200/0x274786fe0d18f4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f4e1 expref: 14 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092631:0:85113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b200, rc 0) 00000100:00100000:3.0:1787397428.092674:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700890624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 338us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.092681:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397428.092735:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.092753:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.092763:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.092899:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.092942:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.093246:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80292ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.093265:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890752 00000100:00100000:3.0:1787397428.093270:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890752 00000100:00100000:3.0:1787397428.093291:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397428.093298:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700890752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.093637:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700890752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.093645:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397428.093683:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.093714:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.093762:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.093775:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80292ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.093787:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700890880 00000100:00100000:3.0:1787397428.093851:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700890880 00000100:00100000:3.0:1787397428.093871:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397428.093877:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700890880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.095667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397428.095754:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681115904 00000100:00100000:1.0:1787397428.095767:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681115904 00000100:00100000:1.0:1787397428.095824:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:1.0:1787397428.095833:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681115904:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.095849:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397428.095869:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75400/0x274786fe0d18f4ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e31 expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.095915:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75400/0x274786fe0d18f4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e31 expref: 9 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.095926:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75400/0x274786fe0d18f4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e31 expref: 9 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.095935:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75400, rc 0) 00000100:00100000:1.0:1787397428.096002:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681115904:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.096010:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:0.0:1787397428.100226:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700890880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6332us (6448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.100252:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700890880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.100260:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:3.0:1787397428.103125:0:85207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1787397428.103352:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1787397428.103392:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787397428.103407:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.103420:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397428.103432:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1787397428.103435:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:1.0:1787397428.103438:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787397428.103479:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.103488:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.103500:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.103574:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.103646:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.103694:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.104107:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891008 00000100:00100000:3.0:1787397428.104118:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891008 00000100:00100000:3.0:1787397428.104165:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397428.104175:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700891008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.104284:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.104438:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096ba00/0x274786fe0d18f4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f4f6 expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.104475:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096ba00/0x274786fe0d18f4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f4f6 expref: 15 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.104488:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096ba00/0x274786fe0d18f4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f4f6 expref: 15 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.104498:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096ba00, rc 0) 00000100:00100000:3.0:1787397428.104783:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700891008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 607us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.104792:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787397428.107170:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397428.107450:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.107465:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397428.107487:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787397428.107492:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.107499:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397428.107507:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787397428.107638:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:2.0:1787397428.107642:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397428.107755:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.107763:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.107772:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397428.107795:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.108147:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397428.109967:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.110184:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891136 00000100:00100000:3.0:1787397428.110195:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891136 00000100:00100000:3.0:1787397428.110261:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397428.110272:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700891136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.110289:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.110762:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096be00/0x274786fe0d18f50b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f504 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.110794:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096be00/0x274786fe0d18f50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f504 expref: 16 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.110806:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096be00/0x274786fe0d18f50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f504 expref: 16 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.110815:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096be00, rc 0) 00000100:00100000:3.0:1787397428.112410:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1736us (3858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.112435:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397428.112632:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.112721:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.112733:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.112814:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.112919:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.112952:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.113233:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891264 00000100:00100000:2.0:1787397428.113239:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891264 00000100:00100000:2.0:1787397428.113282:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787397428.113292:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.113454:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.113460:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787397428.114251:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.114307:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.114617:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.114747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397428.117976:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.118393:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891392 00000100:00100000:2.0:1787397428.118403:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891392 00000100:00100000:3.0:1787397428.118480:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116032 00000100:00100000:3.0:1787397428.118485:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116032 00000100:00100000:0.0:1787397428.118507:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397428.118625:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:3.0:1787397428.118634:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681116032:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.119439:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681116032:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 802us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.119450:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787397428.121472:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.121750:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3231us (7131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.121761:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397428.121799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397428.121813:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116160 00000100:00100000:1.0:1787397428.121821:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116160 00000100:00100000:1.0:1787397428.121862:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:1.0:1787397428.121870:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681116160:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.121932:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.121943:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681116160:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.121953:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000040:00080000:0.0:1787397428.125986:0:85209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787397428.126200:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787397428.126225:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787397428.126237:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.126250:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397428.126259:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397428.126262:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:1.0:1787397428.126265:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397428.126305:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.126326:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.126348:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.126377:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.126461:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.126506:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.126809:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891520 00000100:00100000:0.0:1787397428.126817:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891520 00000100:00100000:0.0:1787397428.126865:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787397428.126874:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700891520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.126887:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397428.126900:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031000/0x274786fe0d18f519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f512 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.126923:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031000/0x274786fe0d18f519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f512 expref: 17 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.126934:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031000/0x274786fe0d18f519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f512 expref: 17 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.126943:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00000100:00100000:0.0:1787397428.126980:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.126987:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397428.127924:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.127950:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.127963:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.128039:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.128079:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.128121:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.128170:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891648 00000100:00100000:0.0:1787397428.128176:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891648 00000100:00100000:0.0:1787397428.128213:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397428.128221:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.128494:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.128502:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787397428.128688:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.128724:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.128767:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.128798:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.129424:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891776 00000100:00100000:0.0:1787397428.129431:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891776 00000100:00100000:0.0:1787397428.129475:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787397428.129485:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.129628:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.129635:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397428.130491:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.131844:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397428.131916:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116288 00000100:00100000:3.0:1787397428.131926:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116288 00000100:00100000:3.0:1787397428.131981:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:3.0:1787397428.131992:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681116288:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.132084:0:85117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.132107:0:85117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096ac00/0x274786fe0d18f520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e38 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.132139:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096ac00/0x274786fe0d18f520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e38 expref: 10 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.132153:0:85117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096ac00/0x274786fe0d18f520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e38 expref: 10 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.132164:0:85117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096ac00, rc 0) 00000100:00100000:3.0:1787397428.132753:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681116288:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 761us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.132762:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000040:00080000:1.0:1787397428.133066:0:85210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1787397428.133914:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1787397428.133948:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397428.133960:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.133973:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397428.133985:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787397428.133988:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1787397428.133992:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787397428.134036:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.134045:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.134057:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.134097:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.134153:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.134199:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397428.136492:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700891904 00000100:00100000:1.0:1787397428.136510:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700891904 00000100:00100000:1.0:1787397428.136590:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397428.136600:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700891904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.136617:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397428.136636:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75c00/0x274786fe0d18f52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f527 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.136665:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75c00/0x274786fe0d18f52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f527 expref: 18 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.136677:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75c00/0x274786fe0d18f52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f527 expref: 18 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.136685:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:1.0:1787397428.136763:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700891904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.136771:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397428.137794:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700891904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.137818:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.137829:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.137908:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.137961:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397428.137984:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892032 00000100:00100000:2.0:1787397428.137992:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892032 00000100:00100000:0.0:1787397428.137997:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.138050:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397428.138060:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700892032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.139502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397428.139766:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700892032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1704us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.139779:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397428.139898:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116416 00000100:00100000:2.0:1787397428.139908:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116416 00000100:00100000:1.0:1787397428.139993:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.140070:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.140129:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.143206:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.143669:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892160 00000100:00100000:2.0:1787397428.143679:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892160 00000100:00100000:2.0:1787397428.143738:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:2.0:1787397428.143747:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681116416:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.143890:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681116416:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 143us (4396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397428.143898:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:2.0:1787397428.143931:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787397428.143937:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700892160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.154931:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700892160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10983us (14791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.154961:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397428.155151:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397428.157969:0:85211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1787397428.158231:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787397428.158258:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787397428.158289:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.158302:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397428.158312:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787397428.158314:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:1.0:1787397428.158328:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787397428.158367:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.158375:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.158396:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.158429:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.158503:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.158576:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d476c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.158980:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892288 00000100:00100000:3.0:1787397428.158990:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892288 00000100:00100000:3.0:1787397428.159054:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787397428.159065:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700892288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.159080:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397428.159096:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b000/0x274786fe0d18f53c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f535 expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.159123:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b000/0x274786fe0d18f53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f535 expref: 19 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.159147:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b000/0x274786fe0d18f53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f535 expref: 19 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.159156:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b000, rc 0) 00000100:00100000:3.0:1787397428.159217:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.159224:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787397428.159643:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.159808:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.159818:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.159895:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.159942:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.159975:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.160543:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892416 00000100:00100000:0.0:1787397428.160552:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892416 00000100:00100000:0.0:1787397428.160598:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787397428.160609:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.160751:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.160758:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397428.161009:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.161046:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.161095:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.161129:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d476c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.161985:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892544 00000100:00100000:0.0:1787397428.162007:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892544 00000100:00100000:0.0:1787397428.162061:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787397428.162071:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.162219:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.162235:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787397428.162250:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397428.163483:0:85212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397428.163815:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397428.163840:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397428.163852:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.163866:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397428.163876:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397428.163879:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:0.0:1787397428.163882:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397428.163919:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.163928:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.163939:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.163963:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.164027:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.164075:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397428.164240:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892672 00000100:00100000:1.0:1787397428.164248:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892672 00000100:00100000:1.0:1787397428.164316:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397428.164329:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700892672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.164350:0:85117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397428.164369:0:85117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74c00/0x274786fe0d18f54a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f543 expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.164410:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74c00/0x274786fe0d18f54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f543 expref: 20 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.164423:0:85117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74c00/0x274786fe0d18f54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f543 expref: 20 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.164433:0:85117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74c00, rc 0) 00000100:00100000:1.0:1787397428.164485:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700892672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397428.164493:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397428.164639:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.164654:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.164664:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.164729:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.164757:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.164785:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.164823:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892800 00000100:00100000:3.0:1787397428.164829:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892800 00000100:00100000:3.0:1787397428.164868:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397428.164877:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700892800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.165178:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700892800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.165187:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787397428.165307:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.165339:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.165462:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.165483:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397428.165553:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700892928 00000100:00100000:3.0:1787397428.165559:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700892928 00000100:00100000:3.0:1787397428.165591:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787397428.165599:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700892928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.165714:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700892928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397428.165721:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787397428.165934:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700892928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397428.167240:0:85213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787397428.167445:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787397428.167472:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397428.167484:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.167493:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397428.167503:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787397428.167506:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1787397428.167509:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397428.167569:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.167577:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.167587:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.167609:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.167667:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.167705:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47480 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.167748:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893056 00000100:00100000:0.0:1787397428.167755:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893056 00000100:00100000:0.0:1787397428.167835:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787397428.167845:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700893056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.167858:0:85112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397428.167872:0:85112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030600/0x274786fe0d18f558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f551 expref: -99 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.167896:0:85112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030600/0x274786fe0d18f558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f551 expref: 21 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.167906:0:85112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030600/0x274786fe0d18f558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f551 expref: 21 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.167915:0:85112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030600, rc 0) 00000100:00100000:0.0:1787397428.167968:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.168000:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787397428.168076:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397428.168090:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397428.168099:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397428.168165:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397428.168191:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397428.168221:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d47480 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.168223:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893184 00000100:00100000:0.0:1787397428.168229:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893184 00000100:00100000:0.0:1787397428.168265:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787397428.168273:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.169190:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 913us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.169203:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787397428.169281:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.169422:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.169470:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.169630:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.169749:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893312 00000100:00100000:0.0:1787397428.169755:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893312 00000100:00100000:0.0:1787397428.169843:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787397428.169856:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.171462:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1595us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.171477:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787397428.171704:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397428.190149:0:85215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1787397428.191401:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787397428.191729:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787397428.191748:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397428.191766:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397428.191869:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397428.191874:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:3.0:1787397428.191877:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397428.191924:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.191934:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.191946:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.191979:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.192186:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.192247:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.192352:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893440 00000100:00100000:0.0:1787397428.192361:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893440 00000100:00100000:0.0:1787397428.192432:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787397428.192442:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700893440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.192458:0:85117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397428.192475:0:85117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030200/0x274786fe0d18f566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f55f expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.192505:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030200/0x274786fe0d18f566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f55f expref: 22 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.192516:0:85117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030200/0x274786fe0d18f566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f55f expref: 22 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.192572:0:85117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:0.0:1787397428.192619:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.192626:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787397428.192749:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397428.192764:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397428.192773:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397428.192829:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.192857:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.192874:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.192919:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893568 00000100:00100000:2.0:1787397428.192923:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893568 00000100:00100000:2.0:1787397428.192959:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787397428.192966:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.193102:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.193110:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787397428.193227:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.193258:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397428.193302:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397428.193318:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397428.193428:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893696 00000100:00100000:2.0:1787397428.193434:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893696 00000100:00100000:2.0:1787397428.193472:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787397428.193479:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397428.193612:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397428.193618:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787397428.193715:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397428.194955:0:85216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397428.199275:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397428.199471:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397428.199484:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199496:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397428.199506:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1787397428.199509:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:0.0:1787397428.199512:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787397428.199583:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199593:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199605:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.199633:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.199704:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.199762:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.199788:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893824 00000100:00100000:0.0:1787397428.199797:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893824 00000100:00100000:0.0:1787397428.199845:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787397428.199854:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700893824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.199867:0:85111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397428.199882:0:85111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031400/0x274786fe0d18f574 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f56d expref: -99 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199906:0:85111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031400/0x274786fe0d18f574 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f56d expref: 23 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199918:0:85111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031400/0x274786fe0d18f574 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f56d expref: 23 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.199927:0:85111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031400, rc 0) 00000100:00100000:0.0:1787397428.199971:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700893824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.199979:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787397428.200028:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.200043:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200051:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397428.200072:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787397428.200076:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200094:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397428.200101:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787397428.200103:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:0.0:1787397428.200105:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787397428.200119:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200126:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200133:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.200145:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.200171:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.200184:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.200197:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700893952 00000100:00100000:0.0:1787397428.200201:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700893952 00000100:00100000:0.0:1787397428.200229:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787397428.200236:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700893952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.200242:0:85117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397428.200251:0:85117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031200/0x274786fe0d18f582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f57b expref: -99 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200265:0:85117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031200/0x274786fe0d18f582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f57b expref: 24 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200286:0:85117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031200/0x274786fe0d18f582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f57b expref: 24 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.200293:0:85117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031200, rc 0) 00000100:00100000:0.0:1787397428.201731:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700893952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397428.201747:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787397428.201871:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700893952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397428.201888:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.201899:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397428.201974:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700894080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.202022:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397428.202051:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397428.202071:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894080 00000100:00100000:0.0:1787397428.202076:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894080 00000100:00100000:0.0:1787397428.202109:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787397428.202118:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700894080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397428.202217:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700894080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397428.202225:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787397428.202270:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700894080:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787397428.202326:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787397428.202333:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397428.202350:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397429.028907:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397429.220782:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700894208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397429.220862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397429.222638:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894208 00000100:00100000:3.0:1787397429.222649:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894208 00000100:00100000:3.0:1787397429.222711:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1787397429.222722:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700894208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397429.222753:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397429.222822:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700894208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397429.222830:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1787397429.222885:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700894208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397429.222902:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397429.222911:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700894336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397429.222943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397429.222975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397429.222987:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894336 00000100:00100000:3.0:1787397429.222991:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894336 00000100:00100000:3.0:1787397429.223019:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1787397429.223025:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700894336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397429.223043:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397429.223078:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700894336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397429.223084:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00080000:3.0:1787397429.223100:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397429.223131:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700894336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787397430.052713:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397430.885179:0:85390:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787397431.079657:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397431.559178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397431.559293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397431.559428:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116544 00000100:00100000:2.0:1787397431.559439:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116544 00000100:00100000:2.0:1787397431.559518:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:2.0:1787397431.559567:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681116544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397431.559660:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681116544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397431.559669:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:1.0:1787397431.560424:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116672 00000100:00100000:1.0:1787397431.560432:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116672 00000100:00100000:1.0:1787397431.560556:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1027 00000100:00100000:1.0:1787397431.560567:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681116672:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397431.560619:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681116672:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 55us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397431.560626:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1027 00000100:00080000:3.0:1787397431.561058:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1787397431.783576:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1787397431.783848:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397431.783853:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397431.783858:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397431.783867:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3305 00000100:00080000:0.0:1787397431.783872:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397431.783878:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397431.783905:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee4380 x1874218700894592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397431.783928:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397431.783931:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397431.783933:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397431.783936:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3305 00000100:00080000:0.0:1787397431.783939:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397431.783942:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397431.783959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750000 x1874218700894848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397431.785934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397431.785945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397431.785948:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397431.785956:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3305 00000100:00080000:0.0:1787397431.785960:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397431.785967:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397431.786000:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835752d80 x1874218700895104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397431.786031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397431.786034:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397431.786036:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397431.786040:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3305 00000100:00080000:0.0:1787397431.786042:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397431.786046:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397431.786058:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b79500 x1874218700895488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397431.786085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787397431.786088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397431.786090:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83fa41000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397431.786096:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a83fa41000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397431.786106:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b79180 x1874218700896000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397431.786163:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700894464:0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786267:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700895360:0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786331:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397431.786338:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700894720:0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786383:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700895616:0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700894592:0@lo:38:kworker.0 00000100:00100000:0.0:1787397431.786504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786537:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700894848:0@lo:38:kworker.0 00000100:00100000:0.0:1787397431.786579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700895104:0@lo:38:kworker.0 00000100:00100000:0.0:1787397431.786620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786636:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700895488:0@lo:38:kworker.0 00000100:00100000:0.0:1787397431.786652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786668:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700896000:0@lo:38:kworker.0 00000100:00100000:0.0:1787397431.786685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397431.786722:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894464 00000100:00100000:0.0:1787397431.786730:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894464 00000100:00100000:0.0:1787397431.786778:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787397431.786786:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786853:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700894464:12345-0@lo:400:kworker.0 Request processed in 66us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.786860:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787397431.786896:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895360 00000100:00100000:0.0:1787397431.786900:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895360 00000100:00100000:0.0:1787397431.786951:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1787397431.786958:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.786991:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700895360:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.786997:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:0.0:1787397431.787017:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894720 00000100:00100000:0.0:1787397431.787020:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894720 00000100:00100000:0.0:1787397431.787045:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894592 00000100:00100000:0.0:1787397431.787047:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894592 00000100:00100000:0.0:1787397431.787058:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894848 00000100:00100000:0.0:1787397431.787061:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894848 00000100:00100000:0.0:1787397431.787067:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895488 00000100:00100000:0.0:1787397431.787069:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895488 00000100:00100000:0.0:1787397431.787076:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896000 00000100:00100000:0.0:1787397431.787078:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896000 00000100:00100000:0.0:1787397431.787087:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1787397431.787093:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700894720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397431.787122:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700894720:12345-0@lo:400:kworker.0 Request processed in 29us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.787128:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1787397431.787141:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1787397431.787145:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700894592:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.787168:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3311 last 0 00000020:00000080:0.0:1787397431.787214:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d18f589 00000004:00100000:0.0:1787397431.787231:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397431.787376:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a829b1b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397431.787415:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218700894592:12345-0@lo:38:kworker.0 Request processed in 269us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.787421:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1787397431.787433:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1787397431.787437:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700894848:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.787448:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3311 last 0 00000020:00000080:0.0:1787397431.787469:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d18f590 00000004:00100000:0.0:1787397431.787475:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397431.787490:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a829b19800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397431.787515:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218700894848:12345-0@lo:38:kworker.0 Request processed in 76us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.787537:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1787397431.787548:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1787397431.787552:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700895488:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.787564:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3311 last 0 00000020:00000080:0.0:1787397431.787585:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d18f597 00000004:00100000:0.0:1787397431.787590:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397431.787611:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a829b1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397431.787636:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218700895488:12345-0@lo:38:kworker.0 Request processed in 82us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.787642:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1787397431.787654:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1787397431.787663:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700896000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.787676:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3311 last 0 00000020:00000080:0.0:1787397431.787696:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d18f59e 00000004:00100000:0.0:1787397431.787702:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397431.787715:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397431.787741:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700896000:12345-0@lo:38:kworker.0 Request processed in 77us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397431.787747:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00010000:00080000:0.0:1787397431.787893:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a704ee4380 x1874218700894592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.787909:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00000100:00100000:1.0:1787397431.789904:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700894720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.789922:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700894464:0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.789935:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700895360:0@lo:400:kworker.0 00000100:00080000:0.0:1787397431.792699:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a704ee4380 x1874218700894592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.792717:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397431.792725:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397431.792729:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000001:00100000:1.0:1787397431.794848:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787397431.796386:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700894976:0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.797977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397431.798026:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700895744:0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.798056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397431.798138:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397431.798146:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700895232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.798172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:2.0:1787397431.801029:0:85442:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:3.0:1787397431.803075:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700895872:0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.803153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:2.0:1787397431.803486:0:85442:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1787397431.807042:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397431.807053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397431.807074:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895616 00000100:00100000:2.0:1787397431.807085:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895616 00000100:00100000:2.0:1787397431.807146:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895104 00000100:00100000:2.0:1787397431.807149:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895104 00000100:00100000:2.0:1787397431.807167:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:2.0:1787397431.807182:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397431.807320:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700895616:12345-0@lo:400:kworker.0 Request processed in 132us (20864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397431.807328:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:2.0:1787397431.807344:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:2.0:1787397431.807349:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700895104:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787397431.807381:0:8445:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a7090fa000, cookie 0x274786fe0d18f3f3 00010000:00080000:2.0:1787397431.807387:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff89a7090fa000 cur 3311 last 1787397426 00000004:00100000:2.0:1787397431.807411:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397431.807450:0:8445:0:(import.c:65:import_set_state_nolock()) ffff89a706ff6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397431.807497:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700895104:12345-0@lo:38:kworker.0 Request processed in 146us (20876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397431.807504:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00010000:00080000:2.0:1787397431.807629:0:85139:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787397431.807635:0:85139:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:2.0:1787397431.807640:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.807644:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:2.0:1787397431.807648:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280514) 00000020:00080000:2.0:1787397431.807651:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.807663:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681108864 t94489280514 from 192.168.204.60@tcp req@ffff89a8178df800 x1874218681108864/t0(94489280514) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:624/0 lens 528/0 e 0 to 0 dl 1787397439 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397431.808334:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895744 00000100:00100000:1.0:1787397431.808343:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895744 00000100:00100000:1.0:1787397431.808398:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700895616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.808437:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895232 00000100:00100000:1.0:1787397431.808442:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895232 00000100:00100000:1.0:1787397431.808500:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1787397431.808509:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700895232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.808595:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700895232:12345-0@lo:400:kworker.0 Request processed in 87us (10422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397431.808615:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00080000:2.0:1787397431.810029:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397431.810587:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700895232:0@lo:400:kworker.0 00000100:00100000:2.0:1787397431.810782:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700895872 00000100:00100000:2.0:1787397431.810789:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700895872 00000100:00100000:0.0:1787397431.810864:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700894592:0@lo:38:kworker.0 00000100:00100000:2.0:1787397431.810925:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1787397431.810935:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700895872:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787397431.810935:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835750000 x1874218700894848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.810952:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000100:00100000:2.0:1787397431.811010:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700895872:12345-0@lo:400:kworker.0 Request processed in 77us (7857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397431.811018:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1787397431.811323:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700895872:0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.811924:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700896128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397431.811981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397431.812030:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896128 00000100:00100000:1.0:1787397431.812035:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896128 00000100:00100000:1.0:1787397431.812068:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1787397431.812075:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700896128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397431.812104:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397431.812146:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700896128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397431.812152:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1787397431.812189:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700896128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397431.812241:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1787397431.812248:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700895744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397431.812284:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700895744:12345-0@lo:400:kworker.0 Request processed in 37us (14228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397431.812291:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1787397431.812335:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700895744:0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.812562:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700894976 00000100:00100000:3.0:1787397431.812568:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700894976 00000100:00100000:3.0:1787397431.812607:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1787397431.812613:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397431.812651:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700894976:12345-0@lo:400:kworker.0 Request processed in 38us (14676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397431.812657:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1787397431.815075:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700894976:0@lo:400:kworker.0 00000100:00080000:0.0:1787397431.818386:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a835750000 x1874218700894848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.818401:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397431.818407:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397431.818425:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397431.818431:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700894848:0@lo:38:kworker.0 00000100:00080000:2.0:1787397431.818495:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397431.818502:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397431.818505:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787397431.818517:0:85139:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10483us 00000100:00080000:0.0:1787397431.818616:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:0.0:1787397431.818631:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787397431.818635:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1787397431.818638:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:0.0:1787397431.818642:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:0.0:1787397431.818645:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787397431.819652:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700895104:0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.819686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a827b79500 x1874218700895488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.819702:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00080000:0.0:1787397431.820583:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a827b79500 x1874218700895488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397456 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.820595:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397431.820600:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397431.820604:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397431.820609:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700895488:0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.820633:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a827b79180 x1874218700896000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397431.820644:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:0.0:1787397431.820652:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787397431.820656:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397431.820658:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83fa41000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397431.820670:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700896000:0@lo:38:kworker.0 00010000:00080000:0.0:1787397431.820727:0:85445:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1787397431.820731:0:85445:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1787397431.820736:0:85445:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1787397431.821220:0:85445:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000001:00100000:0.0:1787397431.821253:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787397431.821324:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700896256:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397431.821410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397431.823237:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896256 00000100:00100000:3.0:1787397431.823253:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896256 00000100:00100000:3.0:1787397431.823331:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1787397431.823342:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700896256:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787397431.823383:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a827b79500 x1874218700896256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:627/0 lens 224/0 e 0 to 0 dl 1787397442 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397431.823396:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700896256:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 56us (1986us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397431.823403:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00010000:00010000:2.0:1787397431.848804:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849087:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849108:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849131:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849139:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849145:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849631:0:85139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849640:0:85139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849647:0:85139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849654:0:85139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397431.849659:0:85139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849667:0:85139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849904:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a828809100) 00010000:00010000:2.0:1787397431.849910:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397431.849917:0:85139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849924:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397431.849955:0:85139:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f7ece0 reply state 00000000ca285742 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849966:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.849974:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a828809600) 00010000:00010000:2.0:1787397431.849976:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397431.849980:0:85139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787397431.850138:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397431.850163:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.850167:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:2.0:1787397431.850170:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.850172:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000001:00080000:0.0:1787397431.853965:0:85106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280514 is committed 00010000:00010000:3.0:1787397431.855817:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855848:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855857:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855863:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397431.855869:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855877:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855902:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a828809600) 00010000:00010000:3.0:1787397431.855906:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397431.855911:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397431.855917:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f5ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397431.865405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397431.865566:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681109376 00000100:00100000:1.0:1787397431.865579:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681109376 00000100:00100000:1.0:1787397431.865667:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1056 00000100:00100000:1.0:1787397431.865691:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681109376:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:1.0:1787397431.865716:0:66178:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:1.0:1787397431.865743:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681109376:12345-192.168.204.60@tcp:36:rm.0 Request processed in 65us (349us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397431.865753:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1056 00000020:00080000:1.0:1787397431.865776:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.865781:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:1.0:1787397431.865787:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:1.0:1787397431.865790:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.865799:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681109376 t94489280515 from 192.168.204.60@tcp req@ffff89a829b41180 x1874218681109376/t0(94489280515) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 512/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397431.865917:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.865945:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.865960:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.865973:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.865979:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.865985:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866089:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866097:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866113:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866367:0:85139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866376:0:85139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866383:0:85139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866389:0:85139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397431.866392:0:85139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866399:0:85139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866411:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff89a809376400) 00010000:00010000:1.0:1787397431.866414:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787397431.866418:0:85139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866424:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d18f5c1 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866446:0:85139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866452:0:85139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866464:0:85139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866469:0:85139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397431.866472:0:85139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866478:0:85139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866487:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376e00) 00010000:00010000:1.0:1787397431.866489:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397431.866492:0:85139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866498:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d18f5b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397431.866512:0:85139:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001bd33bce reply state 0000000050aba516 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866558:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.866565:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a809376900) 00010000:00010000:1.0:1787397431.866568:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397431.866570:0:85139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1787397431.866653:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1787397431.866669:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.866671:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:1.0:1787397431.866680:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.866682:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00100000:2.0:1787397431.873173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397431.873287:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110528 00000100:00100000:3.0:1787397431.873297:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110528 00000100:00100000:3.0:1787397431.873366:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1057 00000100:00100000:3.0:1787397431.873376:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681110528:12345-192.168.204.60@tcp:101:lfs.0 00010000:00080000:3.0:1787397431.873398:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:3.0:1787397431.873925:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681110528:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 443us (653us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397431.873936:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1057 00000020:00080000:1.0:1787397431.873984:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.873988:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:1.0:1787397431.873992:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:1.0:1787397431.873995:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.874005:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681110528 t94489280516 from 192.168.204.60@tcp req@ffff89a8178dd180 x1874218681110528/t0(94489280516) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 536/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787397431.874029:0:85139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397431.874058:0:85139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d18f5c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e15 expref: -99 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874306:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874332:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874343:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874357:0:85139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874364:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.874369:0:85139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397431.875135:0:85139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:1.0:1787397431.875160:0:85139:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x274786fe0d18f34b 00000004:00080000:1.0:1787397431.875162:0:85139:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x274786fe0d18f34b in new mfd 00010000:00010000:1.0:1787397431.875173:0:85139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875182:0:85139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875329:0:85139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875337:0:85139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052eec00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397431.875342:0:85139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875349:0:85139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875365:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376b00) 00010000:00010000:1.0:1787397431.875367:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397431.875372:0:85139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875377:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f5cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397431.875389:0:85139:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039088b76 reply state 00000000851396ec transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875400:0:85139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875416:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a809376000) 00010000:00010000:1.0:1787397431.875418:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397431.875421:0:85139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397431.875452:0:85139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d18f5c8 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 10 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875462:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809376b00) 00010000:00010000:1.0:1787397431.875465:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397431.875469:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d18f5c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e15 expref: 10 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397431.875486:0:85139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75200, rc 0) 00010000:00080000:1.0:1787397431.875789:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1787397431.875817:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.875830:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:1.0:1787397431.875837:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.875839:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:1.0:1787397431.945941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397431.946075:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681110784 00000100:00100000:3.0:1787397431.946089:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681110784 00000100:00100000:3.0:1787397431.946158:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1058 00000100:00100000:3.0:1787397431.946170:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681110784:12345-192.168.204.60@tcp:101:lfs.0 00010000:00080000:3.0:1787397431.946196:0:77740:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:3.0:1787397431.946264:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681110784:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 96us (330us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397431.946271:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1058 00000020:00080000:2.0:1787397431.947886:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.947895:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:2.0:1787397431.947900:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:2.0:1787397431.947903:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.947915:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681110784 t94489280517 from 192.168.204.60@tcp req@ffff89a82e4f4700 x1874218681110784/t0(94489280517) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 736/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787397431.947947:0:85139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397431.947972:0:85139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e1c expref: -99 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397431.948079:0:85139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:2.0:1787397431.949387:0:85139:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x274786fe0d18f360 00000004:00080000:2.0:1787397431.949401:0:85139:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x274786fe0d18f360 in new mfd 00010000:00010000:2.0:1787397431.949451:0:85139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e1c expref: 12 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.949468:0:85139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a828809100) 00010000:00010000:2.0:1787397431.949471:0:85139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397431.949476:0:85139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d18f5e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e1c expref: 12 pid: 85139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397431.949495:0:85139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54200, rc 0) 00010000:00080000:2.0:1787397431.950013:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397431.950036:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.950039:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:2.0:1787397431.950043:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397431.950046:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:2.0:1787397431.955730:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397431.955937:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111168 00000100:00100000:3.0:1787397431.955949:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111168 00000100:00100000:3.0:1787397431.956005:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 212 00000100:00100000:3.0:1787397431.956015:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681111168:12345-192.168.204.60@tcp:35:lfs.0 00010000:00080000:3.0:1787397431.956033:0:80567:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:3.0:1787397431.956049:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681111168:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 37us (329us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397431.956056:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 212 00000020:00080000:3.0:1787397431.956074:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.956077:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:3.0:1787397431.956089:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:3.0:1787397431.956092:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.956101:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681111168 t94489280518 from 192.168.204.60@tcp req@ffff89a8178ded80 x1874218681111168/t0(94489280518) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 392/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397431.956373:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397431.956389:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.956392:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:3.0:1787397431.956395:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.956397:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:1.0:1787397431.966132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397431.966625:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681111424 00000100:00100000:3.0:1787397431.966639:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681111424 00000100:00100000:3.0:1787397431.966705:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 213 00000100:00100000:3.0:1787397431.966716:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681111424:12345-192.168.204.60@tcp:35:lfs.0 00010000:00080000:3.0:1787397431.966738:0:66179:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:3.0:1787397431.966752:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681111424:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 41us (631us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397431.966759:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 213 00000020:00080000:3.0:1787397431.966776:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.966780:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:3.0:1787397431.966784:0:85139:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:3.0:1787397431.966787:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.966795:0:85139:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681111424 t94489280519 from 192.168.204.60@tcp req@ffff89a82e4f7100 x1874218681111424/t0(94489280519) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 392/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397431.967054:0:85139:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397431.967069:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.967081:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:3.0:1787397431.967084:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397431.967086:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:1.0:1787397431.992284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397431.992338:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116800 00000100:00100000:1.0:1787397431.992347:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116800 00000100:00100000:1.0:1787397431.992415:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1030 00000100:00100000:1.0:1787397431.992426:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681116800:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787397431.992453:0:66178:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a82e4f6d80 x1874218681116800/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 224/0 e 0 to 0 dl 1787397442 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397431.992489:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681116800:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 65us (214us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397431.992497:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1030 00000020:00080000:1.0:1787397431.992538:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.992543:0:85139:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:1.0:1787397431.992546:0:85139:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1787397431.992549:0:85139:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397431.992556:0:85139:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397431.992559:0:85139:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787397431.992664:0:85139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000001:00100000:1.0:1787397431.996773:0:85106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:1.0:1787397431.996786:0:85106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787397431.996803:0:85106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:0.0:1787397431.997939:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.997954:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.997961:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.997968:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397431.997972:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.997979:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.997999:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998006:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d18f5ba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998044:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998050:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998054:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998059:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397431.998062:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998067:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998075:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397431.998080:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18f5d6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397431.998504:0:85139:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1787397431.998746:0:85139:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1787397431.998762:0:85139:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a827b79500 x1874218700896256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:627/0 lens 224/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787397432.000101:0:85139:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a82e4f6d80 x1874218681116800/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:627/0 lens 224/0 e 0 to 0 dl 1787397442 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1787397432.001980:0:85139:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1787397432.002519:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787397432.002559:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a827b79180 x1874218700896256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397447 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397432.002570:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a827b79180 x1874218700896256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397447 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397432.002577:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397432.002598:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1787397432.002604:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000005bf6646): req@ffff89a705985c00 x1874218700874880/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397412 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397432.002621:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700896256:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397432.005986:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700896384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397432.006068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397432.006618:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397432.007090:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896384 00000100:00100000:1.0:1787397432.007101:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896384 00000100:00100000:1.0:1787397432.007144:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700874880 00000100:00100000:1.0:1787397432.007146:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700874880 00000100:00100000:1.0:1787397432.007161:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1787397432.007169:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218700896384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397432.007208:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:1.0:1787397432.007257:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218700896384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397432.007265:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1787397432.007284:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:1.0:1787397432.007290:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700874880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397432.007300:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:1.0:1787397432.007353:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700874880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397432.007359:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:0.0:1787397432.009091:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700896384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397432.010593:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700874880:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1787397432.052142:0:85139:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe47a5be10 00100000:10000000:2.0:1787397432.052156:0:85139:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1787397432.065495:0:85127:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x45c:0x0] 00000100:00100000:2.0:1787397432.065572:0:85127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85127:1874218700896512:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787397432.065658:0:85127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397432.065687:0:85127:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa000 going to sleep for 11 seconds 00000004:00080000:3.0:1787397432.066098:0:85125:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x682:0x0] 00000100:00100000:3.0:1787397432.066124:0:85125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85125:1874218700896640:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787397432.066155:0:85125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397432.066185:0:85125:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397432.066206:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896512 00000100:00100000:3.0:1787397432.066214:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896512 00000100:00100000:3.0:1787397432.066263:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896640 00000100:00100000:3.0:1787397432.066266:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896640 00000100:00100000:3.0:1787397432.066291:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:3.0:1787397432.066301:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:85127:x1874218700896512:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787397432.066320:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:2.0:1787397432.066331:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85125:x1874218700896640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787397432.066343:0:26161:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -613 00002000:02000040:3.0:1787397432.066348:0:26161:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1117 to 0x2c0000401:1729) 00002000:00080000:2.0:1787397432.066350:0:26160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -63 00002000:02000040:2.0:1787397432.066355:0:26160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1667 to 0x280000401:1729) 00002000:00010000:3.0:1787397432.084824:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.084843:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.084865:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.084870:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.084877:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.084899:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.084931:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.084939:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.084965:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.084978:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.084992:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.085008:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.085013:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.085026:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.085054:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.085075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087887654/0x274786fe0d18f5f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.085103:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.085105:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.085107:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397432.085129:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.085136:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.095300:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.095331:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.095345:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.095795:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.095815:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.096041:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.096099:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397432.096362:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.096370:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097005:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.097011:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.097019:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097038:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097049:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097058:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097092:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397432.097191:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.097199:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097288:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.097303:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.097318:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097330:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097339:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097347:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.097382:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787397432.098355:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397432.098370:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.098448:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.098459:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.098743:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.098750:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.098757:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.098773:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.098784:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.098806:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.098926:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397432.099017:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.099023:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099031:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.099034:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.099038:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099048:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099056:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099063:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099080:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787397432.099119:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.099125:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099139:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.099142:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.099146:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099155:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099162:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099169:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099178:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787397432.099298:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.099303:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099322:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.099325:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.099329:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099337:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099360:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099444:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099456:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787397432.099498:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.099503:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099609:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.099612:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.099616:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099627:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099636:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099645:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099752:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787397432.099801:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.099806:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.099815:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.099819:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.100083:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100094:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100102:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100109:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100119:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1787397432.100169:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.100173:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100182:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.100192:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.100197:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100281:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100291:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100297:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100317:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1787397432.100440:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.100449:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100457:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.100460:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.100465:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100475:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100484:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100500:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100600:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1787397432.100649:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.100656:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100744:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.100748:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.100752:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100762:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100771:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100778:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.100787:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1787397432.101057:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.101064:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101082:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.101085:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.101090:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101100:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101107:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101114:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101122:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1787397432.101177:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.101182:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101190:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.101193:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.101198:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101283:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101314:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101322:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101332:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1787397432.101462:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.101467:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101475:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.101477:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.101481:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101489:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101498:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101505:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.101629:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1787397432.103921:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.103937:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.103956:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.103960:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.103967:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.103983:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.103994:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104002:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104015:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1787397432.104138:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104144:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104152:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104155:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104161:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104185:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104193:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104200:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104209:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1787397432.104255:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104260:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104268:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104270:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104274:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104282:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104288:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104316:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104326:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1787397432.104399:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104404:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104411:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104413:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104417:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104425:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104431:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104438:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104446:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1787397432.104484:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104489:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104503:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104506:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104510:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104543:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104553:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104561:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104570:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1787397432.104616:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104621:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104628:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104631:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104634:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104642:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104662:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104669:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104678:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1787397432.104718:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.104724:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104731:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.104734:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.104738:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104747:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.104755:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105321:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105334:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105349:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105368:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105375:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e96d0b/0x274786fe0d18f5f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105394:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1787397432.105409:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105426:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105429:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105437:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105449:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105456:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c1548e9/0x274786fe0d18f600 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105470:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1787397432.105474:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105479:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105483:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105490:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105501:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105513:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a727b07a/0x274786fe0d18f607 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105541:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1787397432.105545:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105553:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105556:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105564:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105575:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105581:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f41820b/0x274786fe0d18f60e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105594:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1787397432.105598:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105605:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105616:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105623:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105634:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105641:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263c852b/0x274786fe0d18f615 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105656:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1787397432.105659:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105665:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105669:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105688:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105699:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105705:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2760fa0/0x274786fe0d18f61c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105724:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1787397432.105728:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105734:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105737:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105745:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105755:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105763:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005de836a/0x274786fe0d18f623 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105774:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1787397432.105778:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105783:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.105786:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105804:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.105814:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106027:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa14e5df/0x274786fe0d18f62a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106041:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1787397432.106045:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106051:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106054:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106458:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106473:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106481:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c7b113/0x274786fe0d18f631 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106512:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1787397432.106516:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106545:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106548:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106557:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106567:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106574:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a9ccdb3/0x274786fe0d18f638 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106588:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1787397432.106591:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106598:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106601:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106619:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106630:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106636:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e838c6/0x274786fe0d18f63f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106650:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1787397432.106653:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106659:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106662:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106737:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106751:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106759:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b043607/0x274786fe0d18f646 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106785:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787397432.106789:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106796:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106799:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106806:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106889:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106898:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe8cdfb0/0x274786fe0d18f64d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106911:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787397432.106915:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106922:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106926:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106944:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106954:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106960:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7df7f16/0x274786fe0d18f654 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106974:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787397432.106978:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106984:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.106987:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.106995:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107004:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107012:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374568cf/0x274786fe0d18f65b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107038:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787397432.107042:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107048:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107051:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107058:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107067:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107074:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d18f662 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107086:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787397432.107089:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107094:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107097:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107115:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107125:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107132:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d18f669 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107144:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787397432.107148:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107154:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107157:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107164:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107173:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107180:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d18f670 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107206:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397432.107210:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107216:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107219:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107227:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107237:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107243:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d18f677 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107254:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397432.107257:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107263:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107267:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107285:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107296:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107314:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d18f67e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107328:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.107331:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107337:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.107340:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107347:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107357:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107364:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d18f685 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.107387:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.107388:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.107390:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.109637:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.109648:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.109769:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.109821:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.109912:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.109922:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.109932:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.109938:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.109951:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.109976:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.109977:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1787397432.109997:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397432.110000:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d18f68c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.110003:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110025:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110031:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.110034:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:0.0:1787397432.110035:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110039:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.110043:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.110048:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.110052:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.110061:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110065:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.110115:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110117:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.110164:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110167:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110209:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110231:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.110267:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1787397432.110276:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397432.110280:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110283:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110300:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.110303:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:0.0:1787397432.110314:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110326:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110327:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.110337:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110344:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110349:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110355:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d18f69a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110362:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110373:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110374:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110377:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110380:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.110394:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.110410:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.110416:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110424:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.110427:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397432.110436:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.110445:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110451:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110455:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.110464:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.110469:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110470:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110490:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d18f6a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110492:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110510:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110514:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110516:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110519:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.110553:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110575:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.110808:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.110813:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110830:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.110834:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397432.110837:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.110848:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110849:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110869:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.110874:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397432.110875:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110879:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110891:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110909:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d18f6a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.110911:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110927:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.110931:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.110933:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.110934:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.110960:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.111018:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.111024:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111031:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.111034:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111042:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111052:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111059:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d18f6af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111074:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.111076:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.111081:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397432.111084:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.111089:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111106:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.111109:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.111113:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111121:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111129:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111136:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111157:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397432.111201:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.111206:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111214:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.111217:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.111220:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111228:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111246:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.111247:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111253:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111259:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111268:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.111275:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111283:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111291:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.111297:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111315:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d18f6b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111331:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.111334:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111341:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.111345:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397432.111348:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.111354:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111360:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111365:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.111372:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.111382:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111388:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111394:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111405:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111411:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111438:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.111446:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.111450:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111459:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.111463:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111472:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111485:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.111499:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d18f6c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.111502:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.111517:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.111543:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.111546:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.111548:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.111574:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f6bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.111594:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.111595:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.111597:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.111775:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397432.111807:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397432.111878:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.111890:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397432.111894:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.111899:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397432.111906:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.111909:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.111944:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:1.0:1787397432.111949:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.111960:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d18f693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.111975:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.111985:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.111994:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397432.111998:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.112000:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.112001:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.112016:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112024:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112047:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.112073:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.112080:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112089:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.112094:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.112104:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397432.112104:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112119:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112131:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112133:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.112147:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.112159:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112162:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d18f6cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112191:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112219:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112234:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.112237:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112238:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.112243:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.112261:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.112271:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.112278:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112287:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.112291:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112300:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.112322:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397432.112323:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.112338:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112342:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad953d5a/0x274786fe0d18f6d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.112378:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.112379:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.112380:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.112602:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.112607:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.112876:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.112883:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.112894:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.112905:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.112910:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.112980:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.112989:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.112997:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113081:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397432.113155:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.113160:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113168:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.113171:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.113175:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113182:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113189:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113203:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113217:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397432.113257:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.113261:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113269:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.113272:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.113276:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113285:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113292:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113299:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113323:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787397432.113359:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.113364:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113378:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.113381:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.113385:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113394:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113401:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113407:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113422:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787397432.113432:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787397432.113437:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113444:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.113447:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113456:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113482:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113489:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d18f6e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113504:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397432.113508:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113516:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.113519:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113547:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113556:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113562:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d18f6e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.113574:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397432.113577:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114034:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397432.114040:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114055:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397432.114059:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114066:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114077:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114084:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d18f6f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397432.114101:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397432.114103:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397432.114105:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.114730:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.114738:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.114747:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114764:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114774:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114781:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114802:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397432.114945:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.114953:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114976:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.114979:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.114984:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.114994:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115002:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115010:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115035:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397432.115088:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.115093:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115102:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.115105:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.115109:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115118:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115138:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115145:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115153:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397432.115193:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.115198:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115205:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.115207:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.115211:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115221:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115229:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115236:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115257:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787397432.115299:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.115314:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115323:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.115325:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.115329:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115337:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115344:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115352:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115360:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787397432.115397:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.115402:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115410:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.115418:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.115423:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115431:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115439:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115446:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.115455:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787397432.115494:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.115500:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116272:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.116279:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116289:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116320:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116326:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fcc8452/0x274786fe0d18f6ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116358:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787397432.116363:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116369:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.116372:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116379:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116389:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116411:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027e39819/0x274786fe0d18f6d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116433:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787397432.116437:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116443:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.116445:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787397432.116447:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116459:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116462:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116476:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116476:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.116482:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116489:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d18f6fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116497:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116506:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397432.116511:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116512:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116541:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f3930a/0x274786fe0d18f703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.116553:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.116559:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397432.116564:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116565:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116584:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.116587:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116593:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116615:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116621:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d18f711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116634:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.116637:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116643:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.116646:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116654:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116663:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116777:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d18f718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.116793:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.116796:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.116805:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.116888:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.116894:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.117792:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.117811:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.117817:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d18f70a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.117835:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.117837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.117839:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.119404:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.119417:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.119484:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.119603:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.119620:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.119644:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.120070:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.120077:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.120094:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397432.120380:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.120392:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120407:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.120412:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.120418:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120432:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120460:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120466:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120489:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397432.120503:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397432.120510:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120518:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.120561:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120569:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120593:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120601:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bbf4257/0x274786fe0d18f71f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120632:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787397432.120639:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.120649:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.120653:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120663:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.120667:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120675:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120689:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120694:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d18f726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120709:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.120711:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.120712:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.120722:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.120742:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.120747:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.120754:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.120768:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.120779:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397432.120780:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.120802:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.120805:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120828:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.120832:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.120836:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120863:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120872:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120880:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120894:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.120903:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.120907:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120914:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.120917:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120925:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120935:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120943:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c39213e7/0x274786fe0d18f734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.120963:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.120965:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.120966:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.121227:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.121233:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121240:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.121244:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.121247:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121257:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121264:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121271:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121289:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397432.121344:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.121349:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121368:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.121371:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.121375:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121383:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121390:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121396:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121408:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397432.121444:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.121449:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121456:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.121458:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.121462:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121471:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121490:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121498:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121511:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787397432.121519:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397432.121547:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121554:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.121556:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121564:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121575:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121595:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d18f73b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121612:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397432.121623:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121650:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.121656:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121665:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121676:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121683:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d18f742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121695:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.121698:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121703:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.121707:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121714:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121740:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.121741:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.121748:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121763:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.121769:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.121771:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.121774:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.121800:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.121807:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.121814:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121823:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.121826:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121834:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121844:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121851:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d18f72d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121883:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.121884:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.121886:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.121925:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.121930:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121938:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.121941:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.121945:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121955:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121962:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121969:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.121984:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.121991:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.121995:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397432.122184:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.122192:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122217:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.122222:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.122227:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122238:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122247:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122254:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122272:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397432.122281:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397432.122286:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122295:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397432.122299:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122334:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122350:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122358:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189a3be6/0x274786fe0d18f757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122391:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.122393:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.122394:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397432.122459:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.122465:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122473:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.122476:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.122480:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122488:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.122496:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123329:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123357:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397432.123441:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.123447:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123457:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.123460:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.123465:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123476:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123484:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.123491:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124067:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.124074:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124085:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124106:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124113:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124144:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397432.124148:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124154:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.124157:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124163:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124173:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124186:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d18f75e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124205:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.124208:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124214:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.124218:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124224:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124235:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124242:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.124243:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.124246:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.124291:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397432.124301:0:26161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d18f765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.124375:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.124382:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.124385:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.124392:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124405:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.124417:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.124423:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124435:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124443:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124450:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124475:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.124486:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.124490:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124497:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.124500:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124507:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124516:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124556:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f76c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.124574:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.124576:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.124577:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397432.125191:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.125212:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125227:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.125231:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.125236:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125248:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125258:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125266:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125287:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397432.125301:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397432.125317:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125326:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397432.125342:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125353:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125380:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125389:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d18f773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.125412:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.125414:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.125416:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397432.127861:0:26161:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.127879:0:26161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.127899:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.127903:0:26161:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.127911:0:26161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.128160:0:26161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.128192:0:26161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.128212:0:26161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.129354:0:26161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397432.135256:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397432.135281:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.135300:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397432.135318:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.135334:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.135365:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.135375:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d18f77a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.135402:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.135407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.135410:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787397432.150259:0:26161:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1116 00000100:00100000:3.0:1787397432.151122:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:85127:x1874218700896512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 84807us (85449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397432.151144:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:2.0:1787397432.152414:0:85127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85127:1874218700896512:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397432.152435:0:85127:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x45c:0x0] 00000100:00100000:2.0:1787397432.152548:0:85127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85127:1874218700896896:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397432.152681:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700896768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397432.152727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397432.152775:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896768 00000100:00100000:3.0:1787397432.152789:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896768 00000100:00100000:2.0:1787397432.152816:0:85127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397432.152848:0:85127:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa000 going to sleep for 11 seconds 00000100:00100000:3.0:1787397432.152873:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:3.0:1787397432.152886:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700896768:12345-0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1787397432.153095:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.153105:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153122:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.153126:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.153133:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153147:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153157:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153176:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153194:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.153204:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.153208:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153216:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.153221:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153230:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153245:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153252:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d18f781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153270:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.153272:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.153274:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.153323:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.153333:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153342:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.153345:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.153349:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153358:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153366:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153374:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153388:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.153395:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.153400:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153406:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.153409:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153417:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153432:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153439:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d61fea7/0x274786fe0d18f788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153452:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.153453:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.153455:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397432.153489:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.153493:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153501:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.153504:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.153508:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.153516:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1787397432.154055:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397432.154172:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700896768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1286us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397432.154183:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:3.0:1787397432.154268:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700896768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397432.155117:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700896896 00000100:00100000:0.0:1787397432.155131:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700896896 00000100:00100000:0.0:1787397432.155188:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:0.0:1787397432.155198:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85127:x1874218700896896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787397432.155243:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:0.0:1787397432.156931:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:85127:x1874218700896896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1727us (4108us total) trans 4294968722 rc 0/0 00000100:00100000:0.0:1787397432.156944:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00010000:00010000:2.0:1787397432.157461:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157472:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397432.157603:0:85127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85127:1874218700896896:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397432.157619:0:85127:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00010000:00010000:2.0:1787397432.157655:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397432.157748:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.157755:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157767:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.157771:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.157777:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157789:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157796:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157803:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157815:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397432.157856:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.157861:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157878:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.157881:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.157884:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157893:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157900:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157906:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157918:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787397432.157955:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397432.157960:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157967:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:2.0:1787397432.157970:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397432.157975:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.157983:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158403:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397432.158418:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158442:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397432.158464:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158485:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158512:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158538:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d18f78f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158570:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397432.158574:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158582:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397432.158585:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158593:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158605:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158612:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d18f796 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158638:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397432.158641:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158648:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397432.158652:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158674:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158687:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158704:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d18f79d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.158717:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.158719:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.158721:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.160570:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.161485:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397432.162793:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397432.162830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397432.163126:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.163158:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.163171:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.163195:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.163201:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.163213:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.163238:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.163247:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d18f7a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.163275:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.163278:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.163295:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397432.163348:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397432.163360:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.163379:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=3311s v=(0 0) 00010000:00010000:3.0:1787397432.163397:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397432.163405:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.163421:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.163783:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.163792:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397432.163822:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397432.164789:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397432.164801:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.164813:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397432.164819:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.164831:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.164854:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.164862:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18f7ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397432.164890:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.164892:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397432.164895:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787397432.166132:0:26160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1666 00000100:00100000:3.0:1787397432.166886:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85125:x1874218700896640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100548us (100721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397432.166904:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00000100:00100000:2.0:1787397432.167096:0:85125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85125:1874218700896640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787397432.167122:0:85125:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x682:0x0] 00000100:00100000:2.0:1787397432.167380:0:85125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85125:1874218700897152:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397432.167441:0:85125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397432.167475:0:85125:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397432.167511:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897152 00000100:00100000:2.0:1787397432.167551:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897152 00000100:00100000:0.0:1787397432.167823:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700897024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397432.168016:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:2.0:1787397432.168028:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:85125:x1874218700897152:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787397432.168081:0:26163:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00000100:00100000:0.0:1787397432.168273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397432.168614:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897024 00000100:00100000:1.0:1787397432.168624:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897024 00000100:00100000:1.0:1787397432.168678:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1787397432.168686:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700897024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397432.168712:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397432.168771:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700897024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397432.168794:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1787397432.168820:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700897024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397432.173729:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:85125:x1874218700897152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5619us (6203us total) trans 4294968725 rc 0/0 00000100:00100000:2.0:1787397432.173746:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:3.0:1787397432.173978:0:85125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85125:1874218700897152:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787397432.174013:0:85125:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00000020:00000004:0.0:1787397432.833416:0:85495:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787397432.833882:0:85495:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787397433.124712:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397433.605048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397433.605113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397433.605154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397433.605340:0:85117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681116928 00000100:00100000:0.0:1787397433.605350:0:85117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681116928 00000100:00100000:1.0:1787397433.605403:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117056 00000100:00100000:1.0:1787397433.605408:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117056 00000100:00100000:0.0:1787397433.605418:0:85117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787397433.605426:0:85117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681116928:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397433.605444:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117184 00000100:00100000:1.0:1787397433.605447:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117184 00000100:00100000:1.0:1787397433.605468:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1031 00000100:00100000:1.0:1787397433.605476:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681117056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397433.605513:0:85117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681116928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 87us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397433.605558:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1032 00000100:00100000:3.0:1787397433.605567:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681117184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397433.605567:0:85117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00080000:2.0:1787397433.605778:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397433.605783:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397433.607872:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681117056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2375us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397433.607890:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1031 00000100:00100000:3.0:1787397433.608147:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681117184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2579us (2990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397433.608155:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1032 00010000:00010000:0.0:1787397434.148851:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397434.343781:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700897408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397434.343860:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397434.343914:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397434.343922:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700897280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397434.343946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397434.344050:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897408 00000100:00100000:0.0:1787397434.344059:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897408 00000100:00100000:0.0:1787397434.344127:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897280 00000100:00100000:0.0:1787397434.344131:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897280 00000100:00100000:0.0:1787397434.344151:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1787397434.344163:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700897408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397434.344195:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397434.344247:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700897408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397434.344287:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1787397434.344304:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:0.0:1787397434.344311:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700897280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397434.344327:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397434.344358:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700897280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397434.344364:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:0.0:1787397434.344418:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700897280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397434.344434:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700897408:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787397434.344619:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397434.344624:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397434.679420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397434.679592:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117312 00000100:00100000:1.0:1787397434.679605:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117312 00000100:00100000:1.0:1787397434.679681:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1059 00000100:00100000:1.0:1787397434.679693:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681117312:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397434.679723:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397434.679753:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18f7b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e3f expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.679840:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.679858:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.679874:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397434.679952:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397434.679985:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397434.680018:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.680047:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18f7b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e3f expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.680067:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e3f expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397434.680077:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:1.0:1787397434.680080:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397434.680084:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ee800, rc 0) 00000100:00100000:1.0:1787397434.680161:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65166:x1874218681117312:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 469us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397434.680168:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1059 00000100:00100000:0.0:1787397434.685711:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397434.685819:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117440 00000100:00100000:2.0:1787397434.685830:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117440 00000100:00100000:2.0:1787397434.685900:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1060 00000100:00100000:2.0:1787397434.685924:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65166:x1874218681117440:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397434.685965:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1787397434.686045:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65166:x1874218681117440:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397434.686054:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1060 00000100:00100000:2.0:1787397434.688365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397434.696669:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117568 00000100:00100000:1.0:1787397434.696688:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117568 00000100:00100000:1.0:1787397434.696840:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1061 00000100:00100000:1.0:1787397434.696853:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681117568:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787397434.696909:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397434.697156:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681117568:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 305us (8798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397434.697164:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1061 00000100:00100000:3.0:1787397434.700632:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397434.700830:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117696 00000100:00100000:0.0:1787397434.700841:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117696 00000100:00100000:0.0:1787397434.700954:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4923 00000100:00100000:0.0:1787397434.700964:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2401:x1874218681117696:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:0.0:1787397434.701119:0:26157:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3313 last 0 00000020:00000080:0.0:1787397434.701155:0:26157:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18f7c0 00002000:00100000:0.0:1787397434.701242:0:26157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a829b1a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397434.701265:0:26157:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787397434.701338:0:26157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787397434.701373:0:26157:0:(import.c:65:import_set_state_nolock()) ffff89a831149800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397434.701771:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681117696:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 806us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397434.703271:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4923 00000100:00100000:0.0:1787397434.705188:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397434.705313:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117824 00000100:00100000:3.0:1787397434.705324:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117824 00000100:00100000:3.0:1787397434.705395:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1861 00000100:00080000:2.0:1787397434.705400:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397434.705406:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681117824:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397434.705433:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397434.705507:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681117824:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397434.705515:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1861 00000100:00100000:2.0:1787397434.709619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397434.709727:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681117952 00000100:00100000:1.0:1787397434.709737:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681117952 00000100:00100000:1.0:1787397434.709783:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4924 00000100:00100000:1.0:1787397434.709793:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2401:x1874218681117952:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:1.0:1787397434.709856:0:26168:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3313 last 0 00000020:00000080:1.0:1787397434.709892:0:26168:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18f7c7 00002000:00100000:1.0:1787397434.709906:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a817eca000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787397434.709918:0:26168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787397434.709985:0:26168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787397434.710033:0:26168:0:(import.c:65:import_set_state_nolock()) ffff89a817ecc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397434.710685:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681117952:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 889us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397434.710695:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4924 00000100:00100000:1.0:1787397434.714492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397434.715030:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118080 00000100:00100000:3.0:1787397434.715041:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118080 00000100:00100000:3.0:1787397434.715269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1862 00000100:00100000:3.0:1787397434.715285:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681118080:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397434.715315:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397434.715396:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65166:x1874218681118080:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 117us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397434.715404:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1862 00000100:00080000:2.0:1787397434.716036:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397435.174398:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397436.197504:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397436.906070:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700897536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906379:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700898048:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906430:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700898560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906471:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700899072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906492:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906517:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787397436.906553:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700897664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906594:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700898176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.906617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.906767:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700898688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907058:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907100:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700897792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907238:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700898304:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907341:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700898816:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397436.907384:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700897920:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907445:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700898432:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907482:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700898944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397436.907555:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897536 00000100:00100000:0.0:1787397436.907563:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897536 00000100:00100000:0.0:1787397436.907608:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787397436.907616:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700897536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.907720:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700897536:12345-0@lo:400:kworker.0 Request processed in 104us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.907728:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787397436.907765:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898048 00000100:00100000:0.0:1787397436.907770:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898048 00000100:00100000:0.0:1787397436.907804:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898560 00000100:00100000:0.0:1787397436.907808:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898560 00000100:00100000:0.0:1787397436.907822:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899072 00000100:00100000:0.0:1787397436.907825:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899072 00000100:00100000:0.0:1787397436.907836:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897664 00000100:00100000:0.0:1787397436.907839:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897664 00000100:00100000:0.0:1787397436.907852:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897792 00000100:00100000:0.0:1787397436.907855:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897792 00000100:00100000:0.0:1787397436.907869:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700897920 00000100:00100000:0.0:1787397436.907871:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700897920 00000100:00100000:0.0:1787397436.907887:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1787397436.907893:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700898048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908335:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700898048:12345-0@lo:400:kworker.0 Request processed in 369us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908355:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1787397436.908376:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1787397436.908384:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700898560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908423:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700898560:12345-0@lo:400:kworker.0 Request processed in 40us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908431:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1787397436.908445:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1787397436.908451:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908477:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700899072:12345-0@lo:400:kworker.0 Request processed in 26us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908482:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1787397436.908492:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1787397436.908497:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700897664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908716:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700897664:12345-0@lo:400:kworker.0 Request processed in 24us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908723:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1787397436.908738:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1787397436.908745:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700897792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908788:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700897792:12345-0@lo:400:kworker.0 Request processed in 43us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908794:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1787397436.908808:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:0.0:1787397436.908814:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700897920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908841:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700897920:12345-0@lo:400:kworker.0 Request processed in 28us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908853:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:0.0:1787397436.908888:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898176 00000100:00100000:0.0:1787397436.908894:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898176 00000100:00100000:0.0:1787397436.908921:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898688 00000100:00100000:0.0:1787397436.908925:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898688 00000100:00100000:0.0:1787397436.908952:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1787397436.908959:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700898176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.908993:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700898176:12345-0@lo:400:kworker.0 Request processed in 35us (2374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.908998:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1787397436.909011:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1787397436.909017:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700898688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.909044:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700898688:12345-0@lo:400:kworker.0 Request processed in 28us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.909050:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1787397436.909078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898304 00000100:00100000:0.0:1787397436.909082:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898304 00000100:00100000:0.0:1787397436.909374:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898816 00000100:00100000:0.0:1787397436.909379:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898816 00000100:00100000:3.0:1787397436.909412:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700897920:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.909416:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898432 00000100:00100000:0.0:1787397436.909420:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898432 00000100:00100000:3.0:1787397436.909430:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700897792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.909446:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700898944 00000100:00100000:0.0:1787397436.909451:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700898944 00000100:00100000:0.0:1787397436.909488:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:0.0:1787397436.909497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700898304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397436.909501:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:3.0:1787397436.909514:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.909586:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700898304:12345-0@lo:400:kworker.0 Request processed in 89us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397436.909593:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700898816:12345-0@lo:400:kworker.0 Request processed in 80us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397436.909599:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:3.0:1787397436.909612:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1787397436.909682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1787397436.909692:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700898432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.909725:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700898432:12345-0@lo:400:kworker.0 Request processed in 36us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397436.916441:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1787397436.916465:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700898944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397436.916585:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700898944:12345-0@lo:400:kworker.0 Request processed in 129us (9081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397436.916594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1787397436.916697:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700899200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397436.916705:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:3.0:1787397436.916744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397436.916766:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397436.916773:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397436.916776:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397436.916781:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397436.916797:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899200 00000100:00100000:3.0:1787397436.916807:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899200 00000100:00100000:3.0:1787397436.917910:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1787397436.917923:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700899200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397436.917958:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397436.918017:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700899200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397436.918024:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1787397436.918083:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700899200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397436.918178:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700898432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397436.918192:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700898944:0@lo:400:kworker.0 00000100:00100000:3.0:1787397436.918205:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700898304:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919421:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700897664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919440:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700898176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919450:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700898688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919460:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700897536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919471:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700898048:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700898560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397436.919495:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700899072:0@lo:400:kworker.0 00000100:00100000:3.0:1787397436.922433:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700898816:0@lo:400:kworker.0 00010000:00010000:2.0:1787397437.221939:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397437.413776:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397437.413799:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700899328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397437.413869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397437.413942:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899328 00000100:00100000:2.0:1787397437.413950:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899328 00000100:00100000:2.0:1787397437.414001:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1787397437.414009:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700899328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397437.414035:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397437.414077:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700899328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397437.414084:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1787397437.414124:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700899328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397437.414858:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397437.414870:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700899456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397437.414909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397437.414943:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899456 00000100:00100000:2.0:1787397437.414949:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899456 00000100:00100000:2.0:1787397437.414976:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1787397437.414983:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700899456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397437.415002:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397437.415034:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700899456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397437.415041:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1787397437.415095:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700899456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397437.416098:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397437.416113:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700899584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397437.416156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397437.416213:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899584 00000100:00100000:1.0:1787397437.416218:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899584 00000100:00100000:1.0:1787397437.416257:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1787397437.416264:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700899584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397437.416290:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:1.0:1787397437.416326:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700899584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397437.416331:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1787397437.416372:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700899584:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1787397437.417858:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:2.0:1787397437.417874:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968722 is committed 00000001:00100000:3.0:1787397437.417955:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:3.0:1787397437.417965:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968725 is committed 00010000:00010000:3.0:1787397438.245612:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397438.731736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397438.731779:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397438.731823:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397438.731843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397438.731866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397438.731896:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118464 00000100:00100000:1.0:1787397438.731907:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118464 00000100:00100000:1.0:1787397438.731979:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118336 00000100:00100000:1.0:1787397438.731983:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118336 00000100:00100000:3.0:1787397438.731999:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118208 00000100:00100000:3.0:1787397438.732004:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118208 00000100:00100000:1.0:1787397438.732009:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1039 00000100:00100000:1.0:1787397438.732018:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681118464:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397438.732030:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:3.0:1787397438.732037:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681118208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:2.0:1787397438.732104:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397438.732108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397438.732122:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118720 00000100:00100000:0.0:1787397438.732126:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118720 00000100:00100000:2.0:1787397438.732132:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118592 00000100:00100000:2.0:1787397438.732135:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118592 00000100:00100000:0.0:1787397438.732160:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2335 00000100:00100000:0.0:1787397438.732167:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681118720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397438.732204:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681118464:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397438.732213:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1039 00000100:00100000:1.0:1787397438.732232:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1040 00000100:00100000:1.0:1787397438.732239:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681118336:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397438.732586:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681118208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 548us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397438.732594:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00080000:3.0:1787397438.732672:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397438.732675:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397438.732746:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681118720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 579us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397438.732754:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2335 00000100:00100000:0.0:1787397438.732786:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2336 00000100:00100000:0.0:1787397438.732793:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681118592:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397438.732820:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681118592:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397438.732826:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2336 00000100:00100000:1.0:1787397438.736426:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681118336:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 4175us (4569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397438.736443:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1040 00010000:00010000:0.0:1787397439.269676:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397439.464671:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397439.464695:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700899712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397439.464765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397439.464909:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899712 00000100:00100000:2.0:1787397439.464918:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899712 00000100:00100000:2.0:1787397439.464978:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1787397439.464988:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700899712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397439.465016:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397439.465062:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700899712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397439.465079:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1787397439.465130:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700899712:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397439.465249:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397439.465453:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700899840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397439.465488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397439.465605:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899840 00000100:00100000:3.0:1787397439.465610:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899840 00000100:00100000:3.0:1787397439.465651:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:3.0:1787397439.465659:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700899840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397439.465677:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397439.465725:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397439.465937:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700899840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397439.465944:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1787397439.465997:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700899840:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1787397439.730068:0:85688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1787397440.293970:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397441.170958:0:85736:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1787397441.316661:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397442.020854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700900224:0@lo:400:kworker.0 00000100:00100000:1.0:1787397442.020869:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700900096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.020945:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700899968:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.021059:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700900352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.023481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.023562:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700900736:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.023605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.023628:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901248:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.023650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.023677:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787397442.023684:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700900608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.023706:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.023869:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.023898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.023945:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900224 00000100:00100000:0.0:1787397442.023954:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900224 00000100:00100000:0.0:1787397442.024100:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1787397442.024121:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700900224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024181:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700900224:12345-0@lo:400:kworker.0 Request processed in 71us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.024204:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1787397442.024233:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900608 00000100:00100000:0.0:1787397442.024238:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900608 00000100:00100000:0.0:1787397442.024263:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901120 00000100:00100000:0.0:1787397442.024266:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901120 00000100:00100000:0.0:1787397442.024281:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1787397442.024287:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700900608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024322:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700900608:12345-0@lo:400:kworker.0 Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.024328:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1787397442.024340:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1787397442.024346:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024372:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901120:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.024378:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00080000:0.0:1787397442.024396:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397442.024434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700900608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024444:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024455:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700900224:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024509:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900736 00000100:00100000:0.0:1787397442.024513:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900736 00000100:00100000:0.0:1787397442.024670:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:0.0:1787397442.024677:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024714:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700900736:12345-0@lo:400:kworker.0 Request processed in 37us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.024744:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:0.0:1787397442.024755:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901248 00000100:00100000:0.0:1787397442.024758:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901248 00000100:00100000:0.0:1787397442.024788:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1787397442.024794:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024826:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901248:12345-0@lo:400:kworker.0 Request processed in 32us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.024832:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00080000:0.0:1787397442.024877:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397442.024897:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700900736:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024906:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968725 gen 2 00000100:00100000:0.0:1787397442.024915:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901248:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.024926:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397442.024932:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397442.024963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.025135:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901632 00000100:00100000:0.0:1787397442.025139:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901632 00000100:00100000:0.0:1787397442.025164:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:0.0:1787397442.025170:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397442.025195:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397442.025231:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.025236:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:0.0:1787397442.025268:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397442.027882:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.028003:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900096 00000100:00100000:0.0:1787397442.028026:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900096 00000100:00100000:0.0:1787397442.028091:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1787397442.028100:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700900096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.028177:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700900096:12345-0@lo:400:kworker.0 Request processed in 79us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.028184:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:1.0:1787397442.028330:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397442.028367:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700900096:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.032686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397442.032755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700900864:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.032808:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397442.032841:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700901376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.032863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397442.032903:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900864 00000100:00100000:3.0:1787397442.032911:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900864 00000100:00100000:3.0:1787397442.032987:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901376 00000100:00100000:3.0:1787397442.032990:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901376 00000100:00100000:3.0:1787397442.033018:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1787397442.033027:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700900864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.033077:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700900864:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397442.033083:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1787397442.033101:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:3.0:1787397442.033107:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700901376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.033146:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700901376:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397442.033151:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00080000:3.0:1787397442.033174:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397442.033200:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968722 gen 2 00000100:00100000:3.0:1787397442.033220:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700901376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.033241:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700900864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.033602:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900352 00000100:00100000:0.0:1787397442.033608:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900352 00000100:00100000:0.0:1787397442.033654:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1787397442.033660:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700900352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.033701:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218700900352:12345-0@lo:400:kworker.0 Request processed in 42us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.033709:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:3.0:1787397442.034058:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397442.034088:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700900352:0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.037980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397442.038062:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700900480:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.038106:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700899968 00000100:00100000:2.0:1787397442.038108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.038125:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700899968 00000100:00100000:2.0:1787397442.038166:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700900992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397442.038183:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787397442.038190:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397442.038192:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700899968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.038214:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900480 00000100:00100000:2.0:1787397442.038218:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900480 00000100:00100000:0.0:1787397442.038247:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700899968:12345-0@lo:400:kworker.0 Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.038256:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787397442.038271:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700900992 00000100:00100000:2.0:1787397442.038274:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700900992 00000100:00100000:2.0:1787397442.038293:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1787397442.038299:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700900480:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787397442.038322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397442.038335:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1787397442.038342:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700900992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.038343:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700900480:12345-0@lo:400:kworker.0 Request processed in 43us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.038348:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1787397442.038369:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700900992:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.038375:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1787397442.038393:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700900992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.038402:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700901504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.038426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397442.038472:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700899968:0@lo:400:kworker.0 00000100:00100000:2.0:1787397442.038483:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700900480:0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.038601:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901504 00000100:00100000:3.0:1787397442.038606:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901504 00000100:00100000:3.0:1787397442.038642:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1787397442.038649:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700901504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397442.038684:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700901504:12345-0@lo:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397442.038689:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1787397442.038837:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700901504:0@lo:400:kworker.0 00010000:00010000:2.0:1787397442.340863:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397442.533919:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397442.533997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397442.534052:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901760 00000100:00100000:2.0:1787397442.534060:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901760 00000100:00100000:2.0:1787397442.534112:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1787397442.534120:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397442.534152:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397442.534286:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700901760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.534296:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1787397442.534370:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397442.534984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700901888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397442.535034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397442.535062:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700901888 00000100:00100000:2.0:1787397442.535067:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700901888 00000100:00100000:2.0:1787397442.535111:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1787397442.535120:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700901888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397442.535140:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397442.536774:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700901888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1649us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.536789:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1787397442.536824:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700902016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397442.536937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397442.536966:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902016 00000100:00100000:2.0:1787397442.536972:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902016 00000100:00100000:2.0:1787397442.537008:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1787397442.537015:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700902016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397442.537042:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1787397442.537072:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700902016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.537078:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1787397442.537126:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700902016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397442.537559:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700901888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397442.920870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397442.921086:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118848 00000100:00100000:2.0:1787397442.921107:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118848 00000100:00100000:2.0:1787397442.921205:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1062 00000100:00100000:2.0:1787397442.921217:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65636:x1874218681118848:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397442.921263:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:2.0:1787397442.921338:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65636:x1874218681118848:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 123us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.921347:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1062 00000100:00080000:0.0:1787397442.921465:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397442.924785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397442.924958:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681118976 00000100:00100000:0.0:1787397442.924969:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681118976 00000100:00100000:0.0:1787397442.925058:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1063 00000100:00100000:0.0:1787397442.925069:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65636:x1874218681118976:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397442.925118:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397442.925189:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:65636:x1874218681118976:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 121us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.925197:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1063 00000100:00080000:3.0:1787397442.925264:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397442.928128:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397442.928227:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119104 00000100:00100000:2.0:1787397442.928236:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119104 00000100:00100000:2.0:1787397442.928311:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1869 00000100:00100000:2.0:1787397442.928321:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:65636:x1874218681119104:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397442.928345:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397442.928411:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:65636:x1874218681119104:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.928419:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1869 00000100:00080000:3.0:1787397442.930135:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397442.933175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397442.933390:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119232 00000100:00100000:0.0:1787397442.933403:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119232 00000100:00100000:0.0:1787397442.933543:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1870 00000100:00100000:0.0:1787397442.933555:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:65636:x1874218681119232:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397442.933583:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397442.933665:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:65636:x1874218681119232:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 113us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397442.933675:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1870 00000100:00080000:3.0:1787397442.937675:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397442.968628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397442.968746:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119488 00000100:00100000:2.0:1787397442.968757:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119488 00000100:00100000:2.0:1787397442.968810:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1064 00000100:00100000:2.0:1787397442.968821:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65652:x1874218681119488:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397442.968842:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397442.968863:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e46 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.968936:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.968962:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.968976:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.968993:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969013:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969021:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969117:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969125:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969132:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969139:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969144:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397442.969148:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969155:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969174:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:2.0:1787397442.969177:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397442.969181:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969188:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969202:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969209:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969214:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969219:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397442.969222:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969228:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969235:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a80aa31200) 00010000:00010000:2.0:1787397442.969237:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397442.969240:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969246:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969291:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e46 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969301:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:2.0:1787397442.969303:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397442.969308:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e46 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.969317:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:2.0:1787397442.969384:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65652:x1874218681119488:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 564us (767us total) trans 0 rc 301/301 00000100:00100000:2.0:1787397442.969391:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1064 00000100:00100000:1.0:1787397442.982087:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397442.982198:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119616 00000100:00100000:2.0:1787397442.982209:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119616 00000100:00100000:2.0:1787397442.982270:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1065 00000100:00100000:2.0:1787397442.982282:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65652:x1874218681119616:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:2.0:1787397442.982364:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982382:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982396:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982413:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982442:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982450:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982563:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982572:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982580:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397442.982623:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397442.982635:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982650:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982657:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982664:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982671:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982677:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397442.982687:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982696:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982720:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:2.0:1787397442.982724:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397442.982729:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982736:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d18f7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982749:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982756:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982762:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982767:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397442.982770:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982775:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982782:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff89a80aa31200) 00010000:00010000:2.0:1787397442.982784:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397442.982793:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982800:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d18f7ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982815:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982821:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982826:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982831:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397442.982834:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982841:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982849:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff89a80aa31700) 00010000:00010000:2.0:1787397442.982851:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397442.982853:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397442.982859:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f7f1 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397442.982941:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:65652:x1874218681119616:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 660us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397442.982950:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1065 00010000:00010000:3.0:1787397443.364746:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397443.860628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397443.860663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397443.860691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397443.860742:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120000 00000100:00100000:3.0:1787397443.860753:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119744 00000100:00100000:0.0:1787397443.860754:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120000 00000100:00100000:3.0:1787397443.860761:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119744 00000100:00100000:2.0:1787397443.860876:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1047 00000100:00100000:2.0:1787397443.860889:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681120000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397443.860979:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681120000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397443.861200:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:3.0:1787397443.861210:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681119744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397443.861244:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681119744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397443.861251:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:3.0:1787397443.863119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397443.864221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397443.866830:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1047 00000100:00100000:2.0:1787397443.866873:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681119872 00000100:00100000:2.0:1787397443.866882:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681119872 00000100:00100000:2.0:1787397443.866931:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1048 00000100:00100000:2.0:1787397443.866940:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681119872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397443.868056:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120256 00000100:00100000:0.0:1787397443.868065:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120256 00000100:00100000:0.0:1787397443.868126:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120128 00000100:00100000:0.0:1787397443.868131:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120128 00000100:00100000:0.0:1787397443.868162:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2341 00000100:00100000:0.0:1787397443.868171:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681120256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397443.868240:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681120256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 69us (7547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397443.868247:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2341 00000100:00100000:0.0:1787397443.868271:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2342 00000100:00100000:0.0:1787397443.868278:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681120128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397443.868306:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681120128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (4092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397443.868312:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2342 00000100:00100000:2.0:1787397443.868553:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681119872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1612us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397443.868564:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1048 00010000:00010000:0.0:1787397444.389985:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397444.581362:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397444.581389:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700902144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397444.581469:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397444.581585:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902144 00000100:00100000:3.0:1787397444.581593:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902144 00000100:00080000:1.0:1787397444.581622:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397444.581653:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1787397444.581664:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700902144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397444.581701:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397444.581713:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397444.581724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700902272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397444.581744:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700902144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397444.581751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397444.581761:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1787397444.581777:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902272 00000100:00100000:3.0:1787397444.581781:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902272 00000100:00100000:3.0:1787397444.581808:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1787397444.581814:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700902272:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397444.581826:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787397444.581830:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397444.581894:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700902272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397444.581901:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1787397444.581950:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700902272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397444.582021:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700902144:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787397445.415851:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397446.436922:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397447.140754:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700902400:0@lo:400:kworker.0 00000100:00100000:3.0:1787397447.140860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397447.140927:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700902528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397447.140959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397447.141082:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902400 00000100:00100000:0.0:1787397447.141094:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902400 00000100:00100000:0.0:1787397447.141164:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397447.141176:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700902400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.149428:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700902656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.149552:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.149590:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700903168:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.149619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.149789:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700903680:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.149834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.149941:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787397447.149948:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700903040:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150083:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700903552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150107:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150144:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700902784:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150190:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700903296:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150213:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150233:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700903808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150277:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397447.150285:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700902912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150328:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700903424:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150349:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150434:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700903936:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.150458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.150500:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902656 00000100:00100000:2.0:1787397447.150510:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902656 00000100:00100000:2.0:1787397447.150604:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903040 00000100:00100000:2.0:1787397447.150608:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903040 00000100:00100000:2.0:1787397447.150624:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903552 00000100:00100000:2.0:1787397447.150626:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903552 00000100:00100000:0.0:1787397447.151942:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700902400:12345-0@lo:400:kworker.0 Request processed in 10753us (11066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.151961:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397447.152040:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903680 00000100:00100000:0.0:1787397447.152048:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903680 00000100:00100000:0.0:1787397447.152103:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903296 00000100:00100000:0.0:1787397447.152106:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903296 00000100:00100000:0.0:1787397447.152135:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903808 00000100:00100000:0.0:1787397447.152139:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903808 00000100:00100000:0.0:1787397447.152159:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903424 00000100:00100000:0.0:1787397447.152180:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903424 00000100:00100000:0.0:1787397447.152212:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:0.0:1787397447.152223:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700903680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397447.152320:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700903680:12345-0@lo:400:kworker.0 Request processed in 99us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.152328:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:2.0:1787397447.152340:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902784 00000100:00100000:0.0:1787397447.152340:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1787397447.152346:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700903296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.152350:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902784 00000100:00100000:0.0:1787397447.152381:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700903296:12345-0@lo:400:kworker.0 Request processed in 35us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.152387:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1787397447.152399:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1787397447.152405:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700903808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397447.152435:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700903808:12345-0@lo:400:kworker.0 Request processed in 30us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.152438:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902912 00000100:00100000:2.0:1787397447.152441:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902912 00000100:00100000:0.0:1787397447.152441:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1787397447.152451:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346 00000100:00100000:2.0:1787397447.152456:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903936 00000100:00100000:0.0:1787397447.152457:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.152459:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903936 00000100:00100000:2.0:1787397447.152473:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1787397447.152480:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.152537:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700902656:12345-0@lo:400:kworker.0 Request processed in 42us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.152544:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1787397447.152560:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1787397447.152567:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700903040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.152599:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700903040:12345-0@lo:400:kworker.0 Request processed in 33us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.152606:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1787397447.152621:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1787397447.152627:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700903552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397447.152678:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700903424:12345-0@lo:400:kworker.0 Request processed in 221us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.152685:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346 00000100:00100000:0.0:1787397447.152714:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700902528 00000100:00100000:0.0:1787397447.152719:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700902528 00000100:00100000:0.0:1787397447.152748:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700903168 00000100:00100000:0.0:1787397447.152752:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700903168 00000100:00100000:0.0:1787397447.152765:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:0.0:1787397447.152771:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700902528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397447.152816:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397447.152854:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700902528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (11893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.152860:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:0.0:1787397447.152871:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:0.0:1787397447.152877:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700903168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397447.152905:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700903168:12345-0@lo:400:kworker.0 Request processed in 29us (3285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397447.152912:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1787397447.154193:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700903552:12345-0@lo:400:kworker.0 Request processed in 1562us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.154209:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1787397447.154245:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1787397447.154257:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700902784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154287:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700902784:12345-0@lo:400:kworker.0 Request processed in 34us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.154293:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1787397447.154304:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1787397447.154310:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700902912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154345:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700902912:12345-0@lo:400:kworker.0 Request processed in 36us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.154351:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1787397447.154362:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1787397447.154368:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700903936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154394:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700903936:12345-0@lo:400:kworker.0 Request processed in 26us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.154399:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1787397447.154471:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397447.154479:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397447.154482:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397447.154485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397447.154560:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700902912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154579:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700903424:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154593:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700903936:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154606:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700902784:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154618:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700903296:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154632:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700903808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154698:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700903040:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154712:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700903552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154726:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700902656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154741:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700903168:0@lo:400:kworker.0 00000100:00100000:2.0:1787397447.154767:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700903680:0@lo:400:kworker.0 00000100:00100000:3.0:1787397447.155183:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700902400:0@lo:400:kworker.0 00000100:00100000:3.0:1787397447.155268:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700902528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397447.461745:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397447.654355:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397447.654390:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700904064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397447.654489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.654584:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904064 00000100:00100000:2.0:1787397447.654594:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904064 00000100:00100000:2.0:1787397447.654670:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:2.0:1787397447.654681:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700904064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397447.654726:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397447.654776:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700904064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.654784:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:2.0:1787397447.654841:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700904064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397447.655384:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397447.655397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700904192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397447.655443:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397447.655486:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904192 00000100:00100000:3.0:1787397447.655492:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904192 00000100:00100000:3.0:1787397447.655545:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1787397447.655553:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700904192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397447.655586:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445122048 avail 1298882560 00000100:00100000:3.0:1787397447.655641:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700904192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397447.655670:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:3.0:1787397447.655710:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700904192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397447.656051:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397447.656065:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700904320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397447.656106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397447.656223:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904320 00000100:00100000:2.0:1787397447.656229:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904320 00000100:00100000:2.0:1787397447.656270:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:2.0:1787397447.656278:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700904320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397447.656300:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397447.656349:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700904320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397447.656357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1787397447.656436:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700904320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787397448.484896:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397448.964646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397448.965239:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120384 00000100:00100000:3.0:1787397448.965255:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120384 00000100:00100000:3.0:1787397448.965342:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397448.965353:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681120384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397448.965716:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681120384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 363us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397448.965726:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397448.966962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397448.967074:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120512 00000100:00100000:0.0:1787397448.967085:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120512 00000100:00100000:0.0:1787397448.967182:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1055 00000100:00100000:0.0:1787397448.967193:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681120512:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397448.967275:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681120512:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397448.967284:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1055 00000100:00080000:3.0:1787397448.971412:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397448.971760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397448.971810:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397448.971885:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397448.971912:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120640 00000100:00100000:2.0:1787397448.971926:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120640 00000100:00100000:2.0:1787397448.972031:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1056 00000100:00100000:2.0:1787397448.972045:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681120640:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397448.972162:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681120640:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397448.972171:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1056 00000100:00080000:1.0:1787397448.972420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397448.972638:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120768 00000100:00100000:3.0:1787397448.972643:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120768 00000100:00100000:3.0:1787397448.972708:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681120896 00000100:00100000:3.0:1787397448.972712:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681120896 00000100:00100000:3.0:1787397448.972741:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2347 00000100:00100000:3.0:1787397448.972749:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681120768:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397448.972790:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681120768:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397448.972798:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2347 00000100:00100000:3.0:1787397448.972813:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2348 00000100:00100000:3.0:1787397448.972819:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681120896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397448.972854:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681120896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397448.972873:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2348 00000100:00080000:1.0:1787397448.973151:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397448.973155:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787397449.513373:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397449.702171:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700904576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397449.702294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397449.702407:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904576 00000100:00100000:3.0:1787397449.702418:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904576 00000100:00100000:2.0:1787397449.702562:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700904448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397449.702594:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:2.0:1787397449.702604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397449.702643:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904448 00000100:00100000:2.0:1787397449.702648:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904448 00000100:00100000:3.0:1787397449.702675:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700904576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397449.702676:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1787397449.702687:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700904448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397449.702731:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787397449.702731:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397449.702807:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700904448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397449.702812:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700904576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 205us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397449.702822:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1787397449.702896:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700904448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397449.702986:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00080000:1.0:1787397449.703600:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397449.703608:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397449.703810:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700904576:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1787397450.001088:0:85933:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 07:17:27 (1787397447) 00000100:00100000:2.0:1787397450.117748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397450.118087:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681121024 00000100:00100000:3.0:1787397450.118098:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681121024 00000100:00100000:3.0:1787397450.118181:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1066 00000100:00100000:3.0:1787397450.118192:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66242:x1874218681121024:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397450.118214:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397450.118232:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e4d expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118294:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118309:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118323:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118338:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118357:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118364:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118408:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118414:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118419:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118425:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118429:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397450.118433:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118440:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118452:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397450.118454:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.118459:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118464:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f7ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118480:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118486:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118491:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118496:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397450.118499:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118504:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118511:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a82ebb1600) 00010000:00010000:3.0:1787397450.118513:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.118515:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118544:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f806 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118585:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f7f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e4d expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118595:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397450.118598:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.118608:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e4d expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.118619:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63e00, rc 0) 00000100:00100000:3.0:1787397450.118677:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66242:x1874218681121024:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 487us (939us total) trans 0 rc 301/301 00000100:00100000:3.0:1787397450.118684:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1066 00000100:00080000:1.0:1787397450.118903:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397450.126106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397450.126343:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681121280 00000100:00100000:1.0:1787397450.126355:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681121280 00000100:00100000:1.0:1787397450.126424:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1067 00000100:00100000:1.0:1787397450.126435:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66242:x1874218681121280:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:1.0:1787397450.126498:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397450.126551:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee800/0x274786fe0d18f7b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e3f expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126580:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432100) 00010000:00010000:1.0:1787397450.126595:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397450.126670:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126694:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126703:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126716:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126723:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397450.126728:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136213:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136235:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136247:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397450.136264:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e9d4138 reply state 00000000e63a1526 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136287:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136294:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397450.136297:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397450.136301:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787397450.136307:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787397450.136317:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136324:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136341:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136348:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136354:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397450.136359:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136368:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136381:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817be7800) 00010000:00010000:3.0:1787397450.136383:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.136388:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136393:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee400/0x274786fe0d18f80d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397450.136413:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e9d4138 reply state 00000000e63a1526 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136572:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.136578:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a817be7600) 00010000:00010000:3.0:1787397450.136581:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397450.136583:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787397450.136680:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66242:x1874218681121280:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 10242us (10581us total) trans 98784247809 rc 0/0 00000100:00100000:3.0:1787397450.136696:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1067 00000100:00100000:1.0:1787397450.163054:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397450.167554:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681121408 00000100:00100000:3.0:1787397450.167577:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681121408 00000100:00100000:3.0:1787397450.167636:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1068 00000100:00100000:3.0:1787397450.167647:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66243:x1874218681121408:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397450.167670:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397450.167693:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e54 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167755:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167768:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167778:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397450.167828:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397450.167831:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397450.167849:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167883:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e54 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167898:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e54 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.167921:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1600) 00010000:00010000:3.0:1787397450.167924:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397450.167928:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63a00, rc 0) 00000100:00100000:3.0:1787397450.168012:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:66243:x1874218681121408:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 366us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397450.168020:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1068 00000100:00100000:2.0:1787397450.172189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397450.172256:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681121536 00000100:00100000:3.0:1787397450.172265:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681121536 00000100:00100000:3.0:1787397450.172321:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1069 00000100:00100000:3.0:1787397450.172331:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:66243:x1874218681121536:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397450.172354:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397450.172377:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e5b expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172441:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172454:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172465:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172476:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172482:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172506:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172617:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172625:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172632:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397450.172667:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787397450.172670:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397450.172689:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172701:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172707:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172714:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172719:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172725:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397450.172729:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172743:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172756:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1600) 00010000:00010000:3.0:1787397450.172758:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.172763:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.172768:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173085:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173095:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173101:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173105:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397450.173108:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173114:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173123:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a817be7600) 00010000:00010000:3.0:1787397450.173126:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397450.173130:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173146:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f83e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173174:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e5b expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173187:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e5b expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397450.173194:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397450.173197:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397450.173199:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63400, rc 0) 00000100:00100000:3.0:1787397450.173306:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:66243:x1874218681121536:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 975us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397450.173313:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1069 00000100:00100000:1.0:1787397450.187793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397450.187877:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681121792 00000100:00100000:2.0:1787397450.187889:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681121792 00000100:00100000:2.0:1787397450.187964:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1070 00000100:00100000:2.0:1787397450.187975:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:66243:x1874218681121792:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397450.187997:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397450.188018:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e62 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397450.188134:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787397450.188236:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f84c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e62 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397450.188252:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1600) 00010000:00010000:2.0:1787397450.188255:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397450.188259:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d18f84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e62 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397450.188270:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:2.0:1787397450.188333:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:66243:x1874218681121792:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 361us (561us total) trans 98784247810 rc 301/301 00000100:00100000:2.0:1787397450.188340:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1070 00000100:00100000:2.0:1787397450.196041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397450.196271:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122048 00000100:00100000:0.0:1787397450.196281:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122048 00000100:00100000:0.0:1787397450.196337:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1071 00000100:00100000:0.0:1787397450.196346:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:66243:x1874218681122048:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:0.0:1787397450.196402:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397450.196428:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d18f845 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e5b expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397450.196458:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:0.0:1787397450.196464:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397450.196488:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397450.196500:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397450.196510:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397450.197038:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000059045e6 reply state 0000000063b2983e transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397450.197056:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397450.197063:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:0.0:1787397450.197066:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1787397450.197069:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787397450.197077:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1787397450.197228:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:66243:x1874218681122048:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 880us (1195us total) trans 98784247811 rc 0/0 00000100:00100000:0.0:1787397450.197236:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1071 00000100:00100000:1.0:1787397450.202870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397450.203056:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122304 00000100:00100000:3.0:1787397450.203067:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122304 00000100:00100000:3.0:1787397450.203132:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 214 00000100:00100000:3.0:1787397450.203143:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:66243:x1874218681122304:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397450.203380:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:66243:x1874218681122304:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 239us (527us total) trans 98784247812 rc 0/0 00000100:00100000:3.0:1787397450.203387:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 214 00010000:00010000:1.0:1787397450.532799:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787397451.120858:0:85106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:3.0:1787397451.120976:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.120990:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121012:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121019:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052eee00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397451.121024:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121032:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121053:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a817be7600) 00010000:00010000:3.0:1787397451.121056:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397451.121061:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121066:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f814 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121088:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121093:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121099:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121104:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397451.121106:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121122:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121130:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397451.121133:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397451.121136:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121141:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f81b lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121157:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121162:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121167:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121172:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397451.121175:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121181:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121188:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397451.121190:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787397451.121192:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.121208:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d18f85a lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397451.194002:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397451.194078:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122432 00000100:00100000:0.0:1787397451.194088:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122432 00000100:00100000:0.0:1787397451.194599:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1072 00000100:00100000:0.0:1787397451.194611:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66252:x1874218681122432:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397451.194652:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:0.0:1787397451.194727:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66252:x1874218681122432:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 119us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397451.194734:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1072 00000100:00100000:2.0:1787397451.197227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397451.197268:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122560 00000100:00100000:2.0:1787397451.197278:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122560 00000100:00100000:2.0:1787397451.197342:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1073 00000100:00100000:2.0:1787397451.197351:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66252:x1874218681122560:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397451.197389:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397451.197452:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66252:x1874218681122560:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397451.197460:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1073 00000100:00080000:2.0:1787397451.197480:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397451.200445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397451.200501:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122688 00000100:00100000:3.0:1787397451.200511:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122688 00000100:00100000:3.0:1787397451.200593:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1877 00000100:00100000:3.0:1787397451.200604:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:66252:x1874218681122688:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397451.200634:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397451.200702:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:66252:x1874218681122688:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397451.200710:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1877 00000100:00080000:1.0:1787397451.200976:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397451.204890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397451.204969:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681122816 00000100:00100000:3.0:1787397451.204980:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681122816 00000100:00100000:3.0:1787397451.205063:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1878 00000100:00100000:3.0:1787397451.205073:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:66252:x1874218681122816:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397451.205108:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397451.205181:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:66252:x1874218681122816:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397451.205189:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1878 00000100:00080000:1.0:1787397451.205190:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397451.268554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397451.268653:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123072 00000100:00100000:2.0:1787397451.268663:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123072 00000100:00100000:2.0:1787397451.268722:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1074 00000100:00100000:2.0:1787397451.268734:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66259:x1874218681123072:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:2.0:1787397451.268788:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397451.268815:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d18f829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e54 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268832:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1600) 00010000:00010000:2.0:1787397451.268844:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397451.268906:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268918:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268944:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268962:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268970:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.268976:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269712:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269724:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269741:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269748:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269754:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397451.269758:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269766:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269776:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787397451.269779:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397451.269783:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269788:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d18f861 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397451.269801:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000226ab0a9 reply state 00000000f06adbcb transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269812:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.269819:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32e00) 00010000:00010000:2.0:1787397451.269821:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397451.269824:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397451.269938:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66259:x1874218681123072:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 1195us (1406us total) trans 98784247813 rc 0/0 00000100:00100000:2.0:1787397451.269954:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1074 00000100:00100000:3.0:1787397451.318475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397451.318578:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123200 00000100:00100000:1.0:1787397451.318590:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123200 00000100:00100000:1.0:1787397451.318648:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1075 00000100:00100000:1.0:1787397451.318659:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66262:x1874218681123200:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787397451.318686:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397451.318724:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e69 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318792:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318809:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318821:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397451.318876:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397451.318880:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397451.318902:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318939:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eec00/0x274786fe0d18f86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e69 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318957:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e69 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397451.318965:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835734a00) 00010000:00010000:1.0:1787397451.318968:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397451.318972:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052eee00, rc 0) 00000100:00100000:1.0:1787397451.319031:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:66262:x1874218681123200:12345-192.168.204.60@tcp:101:rm.0 Request processed in 374us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397451.319039:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1075 00000100:00100000:0.0:1787397451.325828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397451.325913:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123328 00000100:00100000:2.0:1787397451.325925:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123328 00000100:00100000:2.0:1787397451.326004:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1076 00000100:00100000:2.0:1787397451.326015:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:66262:x1874218681123328:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397451.326037:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397451.326058:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e70 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326125:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326140:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326153:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326165:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326173:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326180:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326270:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326299:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326307:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397451.326353:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787397451.326358:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397451.326380:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326391:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326399:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326405:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326412:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326418:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397451.326423:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326431:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326443:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835734a00) 00010000:00010000:2.0:1787397451.326453:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397451.326459:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326466:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d18f884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326480:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326485:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326491:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326496:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397451.326499:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326505:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326514:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32e00) 00010000:00010000:2.0:1787397451.326516:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397451.326620:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326629:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d18f88b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326664:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18f87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e70 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326691:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e70 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.326698:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787397451.326700:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397451.326702:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab400, rc 0) 00000100:00100000:2.0:1787397451.326769:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:66262:x1874218681123328:12345-192.168.204.60@tcp:101:rm.0 Request processed in 756us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397451.326777:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1076 00000100:00100000:3.0:1787397451.330332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397451.330686:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123584 00000100:00100000:0.0:1787397451.330697:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123584 00000100:00100000:0.0:1787397451.330764:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1077 00000100:00100000:0.0:1787397451.330775:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:66262:x1874218681123584:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397451.330838:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787397451.330870:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18f892 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e70 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.330889:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:0.0:1787397451.330905:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052eee00/0x274786fe0d18f876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e69 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.330914:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835734a00) 00010000:00010000:0.0:1787397451.330922:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397451.331164:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331180:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331268:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331281:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331302:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331309:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331409:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331417:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397451.331424:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.331987:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.331999:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332008:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332015:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332021:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332028:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332083:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397451.332106:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332122:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332128:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332134:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397451.332139:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332147:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332158:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff89a8191cd600) 00010000:00010000:2.0:1787397451.332162:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397451.332167:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332173:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18f8a7 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332201:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332207:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332213:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332218:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332230:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397451.332233:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332239:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332247:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cd000) 00010000:00010000:2.0:1787397451.332250:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397451.332253:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332258:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f899 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397451.332273:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfca68c0 reply state 00000000d8c02097 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332284:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397451.332290:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32e00) 00010000:00010000:2.0:1787397451.332292:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397451.332295:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397451.332382:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:66262:x1874218681123584:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1606us (2059us total) trans 98784247814 rc 0/0 00000100:00100000:2.0:1787397451.332391:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1077 00010000:00010000:3.0:1787397451.333321:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397451.333331:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.333339:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397451.333354:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.333362:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.333378:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff89a8191cd600) 00010000:00010000:3.0:1787397451.333380:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397451.333383:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.333388:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18f8ae lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397451.333406:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397451.333409:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397451.333411:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397451.559831:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397452.084978:0:86032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff20cc0570 00000020:00000080:1.0:1787397452.084998:0:86032:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1787397452.085007:0:86032:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00000100:00100000:3.0:1787397452.262260:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700904704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262394:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700905216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262442:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700905728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262486:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700906240:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262584:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787397452.262590:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700905088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700905600:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262687:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700906112:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262749:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700904832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262808:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700905344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262853:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700905856:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262894:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787397452.262901:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700904960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262956:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700905472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.262975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.262995:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700905984:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.263020:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.263065:0:85113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904704 00000100:00100000:3.0:1787397452.263072:0:85113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904704 00000100:00100000:3.0:1787397452.263125:0:85113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787397452.263133:0:85113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700904704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.263196:0:85113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700904704:12345-0@lo:400:kworker.0 Request processed in 62us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.263203:0:85113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787397452.263248:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700904704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397452.263609:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905600 00000100:00100000:0.0:1787397452.263615:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905600 00000100:00100000:0.0:1787397452.263663:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906112 00000100:00100000:0.0:1787397452.263666:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906112 00000100:00100000:0.0:1787397452.263685:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905472 00000100:00100000:0.0:1787397452.263688:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905472 00000100:00100000:0.0:1787397452.263707:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905984 00000100:00100000:0.0:1787397452.263711:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905984 00000100:00100000:0.0:1787397452.263732:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:0.0:1787397452.263739:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700905600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.264195:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:3.0:1787397452.264216:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700906112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.264277:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700906112:12345-0@lo:400:kworker.0 Request processed in 63us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.264285:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:3.0:1787397452.264321:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:3.0:1787397452.264337:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.264380:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700905472:12345-0@lo:400:kworker.0 Request processed in 52us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.264388:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:3.0:1787397452.264404:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1787397452.264411:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700905984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.264442:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700905984:12345-0@lo:400:kworker.0 Request processed in 32us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.264449:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1787397452.264468:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905216 00000100:00100000:3.0:1787397452.264472:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905216 00000100:00100000:3.0:1787397452.264507:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905728 00000100:00100000:3.0:1787397452.264511:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905728 00000100:00100000:3.0:1787397452.264547:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906240 00000100:00100000:3.0:1787397452.264551:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906240 00000100:00100000:3.0:1787397452.264566:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905088 00000100:00100000:3.0:1787397452.264570:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905088 00000100:00100000:3.0:1787397452.264586:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904832 00000100:00100000:3.0:1787397452.264588:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904832 00000100:00100000:3.0:1787397452.264603:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700904960 00000100:00100000:3.0:1787397452.264606:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700904960 00000100:00100000:3.0:1787397452.264619:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1787397452.264625:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700905216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.264677:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700905216:12345-0@lo:400:kworker.0 Request processed in 52us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.264683:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1787397452.264700:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1787397452.264706:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700905728:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397452.264722:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829b41c00 x1874218700905728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:648/0 lens 224/224 e 0 to 0 dl 1787397463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397452.264744:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397452.264750:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397452.264752:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700905728:12345-0@lo:400:kworker.0 Request processed in 45us (2284us total) trans 0 rc 0/0 00000100:00080000:1.0:1787397452.264754:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397452.264757:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397452.264843:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1787397452.264857:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787397452.264863:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700906240:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397452.264873:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829b43100 x1874218700906240/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:648/0 lens 224/224 e 0 to 0 dl 1787397463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397452.264931:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700906240:12345-0@lo:400:kworker.0 Request processed in 67us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.264937:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787397452.264950:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1787397452.264957:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700905088:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397452.264968:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b58380 x1874218700905088/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:648/0 lens 224/224 e 0 to 0 dl 1787397463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397452.264994:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700905088:12345-0@lo:400:kworker.0 Request processed in 38us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.265000:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1787397452.265021:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1787397452.265027:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700904832:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397452.265040:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b59880 x1874218700904832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:648/0 lens 224/224 e 0 to 0 dl 1787397463 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397452.265070:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700904832:12345-0@lo:400:kworker.0 Request processed in 43us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.265075:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1787397452.265088:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1787397452.265094:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700904960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265132:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700904960:12345-0@lo:400:kworker.0 Request processed in 39us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.265138:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1787397452.265160:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905344 00000100:00100000:3.0:1787397452.265164:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905344 00000100:00100000:3.0:1787397452.265190:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700905856 00000100:00100000:3.0:1787397452.265193:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700905856 00000100:00100000:3.0:1787397452.265210:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1787397452.265216:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700905344:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397452.265232:0:23942:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b5bb80 x1874218700905344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:648/0 lens 224/224 e 0 to 0 dl 1787397463 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397452.265266:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700905344:12345-0@lo:400:kworker.0 Request processed in 50us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.265273:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:3.0:1787397452.265285:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1787397452.265291:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700905856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265321:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700905856:12345-0@lo:400:kworker.0 Request processed in 30us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.265335:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1787397452.265850:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700904960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265865:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700905472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265876:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700905984:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265886:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700904832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265897:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700905344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265906:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700905856:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265964:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700905088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265977:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700906112:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265987:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700905216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.265997:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700905728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.266006:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700906240:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.269629:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700906368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397452.269703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397452.270248:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700905600:12345-0@lo:400:kworker.0 Request processed in 6506us (7575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397452.270262:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:3.0:1787397452.270367:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906368 00000100:00100000:3.0:1787397452.270375:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906368 00000100:00100000:3.0:1787397452.270414:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1787397452.270423:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700906368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397452.270459:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397452.270505:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700906368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397452.270518:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1787397452.270654:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700905600:0@lo:400:kworker.0 00000100:00100000:3.0:1787397452.270692:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700906368:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397452.581942:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397452.773816:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397452.773992:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700906496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397452.774060:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397452.774118:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906496 00000100:00100000:1.0:1787397452.774126:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906496 00000100:00100000:1.0:1787397452.774175:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1787397452.774184:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700906496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397452.774218:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00010000:00000080:1.0:1787397452.774233:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836692a00 x1874218700906496/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:648/0 lens 224/368 e 0 to 0 dl 1787397463 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397452.774274:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700906496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397452.774281:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1787397452.777563:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700906624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397452.777643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397452.777711:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906624 00000100:00100000:2.0:1787397452.777721:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906624 00000100:00100000:2.0:1787397452.777772:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1787397452.777781:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700906624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397452.777811:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397452.777857:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700906624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397452.777865:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1787397452.777930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700906624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397452.778324:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700906496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397452.780748:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700906752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397452.782828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397452.785769:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906752 00000100:00100000:3.0:1787397452.785784:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906752 00000100:00100000:2.0:1787397452.795338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1787397452.795358:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700906752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397452.795398:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397452.795492:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700906752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (12669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397452.795502:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1787397452.795609:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700906752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787397453.605950:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397454.093670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397454.093749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397454.093793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397454.093820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397454.093858:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124096 00000100:00100000:0.0:1787397454.093868:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124096 00000100:00100000:0.0:1787397454.093952:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2353 00000100:00100000:0.0:1787397454.093964:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681124096:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397454.094042:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681124096:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397454.094049:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2353 00000100:00080000:0.0:1787397454.094070:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397454.097515:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123840 00000100:00100000:3.0:1787397454.097551:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123840 00000100:00100000:0.0:1787397454.098171:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123968 00000100:00100000:0.0:1787397454.098179:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123968 00000100:00100000:0.0:1787397454.098224:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1063 00000100:00100000:0.0:1787397454.098233:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681123840:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787397454.098268:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af27b80 x1874218681123840/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:650/0 lens 224/224 e 0 to 0 dl 1787397465 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397454.098339:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681123840:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 107us (4679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397454.098346:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1063 00000100:00100000:0.0:1787397454.098365:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1064 00000100:00100000:0.0:1787397454.098371:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681123968:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397454.098411:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681123968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397454.098418:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1064 00000100:00080000:3.0:1787397454.098882:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397454.098888:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397454.099031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397454.099079:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123712 00000100:00100000:2.0:1787397454.099084:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123712 00000100:00100000:2.0:1787397454.099130:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787397454.099138:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681123712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397454.099176:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681123712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (5383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397454.099183:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:0.0:1787397454.099264:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124224 00000100:00100000:0.0:1787397454.099269:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124224 00000100:00100000:0.0:1787397454.099323:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2354 00000100:00100000:0.0:1787397454.099337:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681124224:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397454.099369:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681124224:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397454.099376:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2354 00000100:00080000:2.0:1787397454.099562:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787397454.630774:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397454.821071:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700906880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397454.821149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397454.821245:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700906880 00000100:00100000:3.0:1787397454.821253:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700906880 00000100:00100000:3.0:1787397454.821321:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:3.0:1787397454.821330:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700906880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397454.821359:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397454.821557:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397454.821643:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700906880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 311us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397454.821651:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1787397454.821807:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700906880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397454.822202:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700907008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397454.822252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397454.822322:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907008 00000100:00100000:3.0:1787397454.822327:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907008 00000100:00100000:3.0:1787397454.822368:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:3.0:1787397454.822375:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700907008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397454.822404:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787397454.822463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397454.829021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700907008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6635us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397454.829036:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1787397454.830880:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700907008:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397455.654661:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397456.676733:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787397456.870795:0:85106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247814 is committed 00010000:00010000:1.0:1787397456.875403:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875428:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875435:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875442:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397456.875448:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875478:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875499:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32e00) 00010000:00010000:1.0:1787397456.875502:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397456.875508:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875515:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18f868 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875684:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875691:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875696:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875701:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397456.875704:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875709:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875717:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32e00) 00010000:00010000:1.0:1787397456.875720:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397456.875722:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397456.875736:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18f8a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397457.383162:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700907264:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383265:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.383309:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700907776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.383359:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700908288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.383419:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787397457.383678:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907776 00000100:00100000:3.0:1787397457.383691:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907776 00000100:00100000:2.0:1787397457.383833:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700907136:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.383912:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700907648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.383967:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700908160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.383992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.384012:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700908672:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.384034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.384086:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700907392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.384114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.384134:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700907904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.384156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.384173:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700908416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.384194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397457.384947:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908288 00000100:00100000:3.0:1787397457.384958:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908288 00000100:00100000:3.0:1787397457.384988:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1787397457.384999:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700907776:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397457.385042:0:8445:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9c000 x1874218700907776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:653/0 lens 224/224 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397457.385122:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700907776:12345-0@lo:400:kworker.0 Request processed in 125us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.385131:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1787397457.385153:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1787397457.385159:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397457.385190:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700908288:12345-0@lo:400:kworker.0 Request processed in 31us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.385197:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1787397457.385574:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397457.385588:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700907520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.385632:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.385657:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700908032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.385684:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.385706:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700908544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.385875:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.385925:0:85111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907136 00000100:00100000:2.0:1787397457.385931:0:85111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907136 00000100:00100000:2.0:1787397457.385973:0:85111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397457.385981:0:85111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.386019:0:85111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700907136:12345-0@lo:400:kworker.0 Request processed in 38us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.386026:0:85111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397457.386064:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907264 00000100:00100000:2.0:1787397457.386069:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907264 00000100:00100000:2.0:1787397457.386108:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907648 00000100:00100000:2.0:1787397457.386112:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907648 00000100:00100000:2.0:1787397457.386129:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908160 00000100:00100000:2.0:1787397457.386132:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908160 00000100:00100000:2.0:1787397457.386143:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908672 00000100:00100000:2.0:1787397457.386165:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908672 00000100:00100000:2.0:1787397457.386184:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907392 00000100:00100000:2.0:1787397457.386187:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907392 00000100:00100000:2.0:1787397457.386202:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907520 00000100:00100000:2.0:1787397457.386204:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907520 00000100:00100000:2.0:1787397457.386218:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1787397457.386225:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700907264:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397457.386240:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9ce00 x1874218700907264/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:653/0 lens 224/224 e 0 to 0 dl 1787397468 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397457.386274:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700907264:12345-0@lo:400:kworker.0 Request processed in 50us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.386281:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1787397457.386293:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1787397457.386299:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700907648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397457.386330:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700907648:12345-0@lo:400:kworker.0 Request processed in 31us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.386336:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1787397457.386347:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1787397457.386353:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700908160:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397457.386364:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9fb80 x1874218700908160/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:653/0 lens 224/224 e 0 to 0 dl 1787397468 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397457.386392:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700908160:12345-0@lo:400:kworker.0 Request processed in 39us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.386398:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1787397457.386409:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1787397457.386414:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700908672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386625:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700907136:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386641:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700907648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386652:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700908160:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386664:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700907264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386676:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700907776:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.386688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700908288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397457.387191:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1787397457.387205:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700907392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397457.387274:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700907392:12345-0@lo:400:kworker.0 Request processed in 73us (3158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397457.387281:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1787397457.387299:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1787397457.387306:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700907520:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397457.387318:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a806b5df80 x1874218700907520/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:653/0 lens 224/224 e 0 to 0 dl 1787397468 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397457.387347:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700907520:12345-0@lo:400:kworker.0 Request processed in 43us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397457.387353:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1787397457.387621:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700907904 00000100:00100000:3.0:1787397457.387628:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700907904 00000100:00100000:3.0:1787397457.387670:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908416 00000100:00100000:3.0:1787397457.387673:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908416 00000100:00100000:3.0:1787397457.387696:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908032 00000100:00100000:3.0:1787397457.387699:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908032 00000100:00100000:3.0:1787397457.387795:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908544 00000100:00100000:3.0:1787397457.387799:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908544 00000100:00100000:3.0:1787397457.387837:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1787397457.387861:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397457.387906:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700907904:12345-0@lo:400:kworker.0 Request processed in 46us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.387913:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1787397457.387929:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1787397457.387935:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397457.387964:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700908416:12345-0@lo:400:kworker.0 Request processed in 29us (3769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.387970:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1787397457.387981:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1787397457.387986:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700908032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397457.388016:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700908032:12345-0@lo:400:kworker.0 Request processed in 29us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.388022:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1787397457.388032:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:3.0:1787397457.388037:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700908544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397457.388063:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700908544:12345-0@lo:400:kworker.0 Request processed in 27us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.388068:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:1.0:1787397457.388215:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700907520:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.388231:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700908032:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.388243:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700908544:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.388256:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700907392:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.388268:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700907904:0@lo:400:kworker.0 00000100:00100000:1.0:1787397457.388280:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700908416:0@lo:400:kworker.0 00010000:00000080:2.0:1787397457.388404:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9d180 x1874218700908672/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:653/0 lens 224/224 e 0 to 0 dl 1787397468 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397457.388634:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397457.388651:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700908800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397457.393657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397457.393768:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908800 00000100:00100000:1.0:1787397457.393782:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908800 00000100:00100000:1.0:1787397457.393896:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1787397457.393909:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700908800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397457.393963:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397457.394022:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700908800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397457.394030:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1787397457.394121:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700908800:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787397457.394596:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397457.394605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397457.394609:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397457.394611:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397457.395739:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700908672:12345-0@lo:400:kworker.0 Request processed in 9302us (11681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.395758:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1787397457.398995:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700908672:0@lo:400:kworker.0 00010000:00010000:1.0:1787397457.700861:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397457.853485:0:86329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1787397457.893395:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397457.893429:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700908928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397457.893552:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397457.893619:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700908928 00000100:00100000:2.0:1787397457.893629:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700908928 00000100:00100000:2.0:1787397457.893695:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1787397457.893706:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700908928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397457.893748:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397457.893825:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700908928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397457.893834:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1787397457.893913:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700908928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397457.894249:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397457.894290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397457.894331:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909056 00000100:00100000:1.0:1787397457.894336:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909056 00000100:00100000:3.0:1787397457.894613:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397457.894632:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700909184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397457.894671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397457.894686:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1787397457.894699:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700909056:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397457.894713:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909184 00000100:00100000:3.0:1787397457.894719:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909184 00002000:00000024:1.0:1787397457.894726:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397457.894759:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:3.0:1787397457.894846:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700909184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397457.894879:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:1.0:1787397457.894901:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700909056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397457.894910:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1787397457.894973:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700909056:0@lo:13:osp-pre-0-0.0 00010000:00000080:3.0:1787397457.895441:0:23942:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836692680 x1874218700909184/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:653/0 lens 224/368 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397457.895501:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700909184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 734us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.895511:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1787397457.899933:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700909184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397457.936172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397457.936587:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124352 00000100:00100000:3.0:1787397457.936601:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124352 00000100:00100000:3.0:1787397457.936716:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1078 00000100:00100000:3.0:1787397457.936728:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66329:x1874218681124352:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397457.936756:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787397457.936765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787397457.936787:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e77 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.936887:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.936904:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.936918:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397457.936997:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397457.937001:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397457.937048:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.937079:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e77 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.937101:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e77 expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.937110:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:3.0:1787397457.937114:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397457.937117:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62e00, rc 0) 00010000:00000080:3.0:1787397457.937127:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a806b5c380 x1874218681124352/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:653/0 lens 576/688 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397457.937266:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66329:x1874218681124352:12345-192.168.204.60@tcp:101:touch.0 Request processed in 539us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.937274:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1078 00000100:00100000:0.0:1787397457.945059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397457.945144:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124480 00000100:00100000:3.0:1787397457.945157:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124480 00000100:00100000:3.0:1787397457.945234:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1079 00000100:00100000:3.0:1787397457.945247:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66329:x1874218681124480:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397457.945275:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397457.945302:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e7e expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945414:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945431:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945446:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945475:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945483:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945491:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945651:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945661:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945668:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397457.945713:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787397457.945718:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397457.945746:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945781:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945788:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945805:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945813:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945820:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397457.945825:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945832:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945847:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:3.0:1787397457.945850:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397457.945856:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945862:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d18f8ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945874:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945879:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945895:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945900:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397457.945903:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945909:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945918:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a82ebb1400) 00010000:00010000:3.0:1787397457.945920:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397457.945924:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945930:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d18f8d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945969:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e7e expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945983:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e7e expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.945992:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1700) 00010000:00010000:3.0:1787397457.945994:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787397457.945997:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00010000:00000080:3.0:1787397457.946007:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd4000 x1874218681124480/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:653/0 lens 592/688 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397457.946109:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66329:x1874218681124480:12345-192.168.204.60@tcp:101:touch.0 Request processed in 864us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397457.946119:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1079 00000100:00100000:2.0:1787397457.950810:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397457.950894:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124736 00000100:00100000:3.0:1787397457.950908:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124736 00000100:00100000:3.0:1787397457.950991:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1080 00000100:00100000:3.0:1787397457.951003:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:66329:x1874218681124736:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397457.951036:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397457.951076:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d18f8df lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e85 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951254:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951271:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951286:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951302:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951309:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951316:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.951990:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952004:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952013:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397457.952064:0:77740:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787397457.952067:0:77740:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1787397457 00000004:00010000:3.0:1787397457.952071:0:77740:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1787397457 00000004:00010000:3.0:1787397457.952073:0:77740:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1787397457 00000004:00010000:3.0:1787397457.952076:0:77740:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1787397457.952080:0:77740:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1787397457.952086:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952093:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952100:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952107:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397457.952113:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952121:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952147:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82ebb1700) 00010000:00010000:3.0:1787397457.952150:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397457.952155:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952161:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18f8e6 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397457.952175:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091053d69 reply state 0000000029814332 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952187:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952193:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a82ebb1c00) 00010000:00010000:3.0:1787397457.952195:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397457.952198:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397457.952240:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d18f8df lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952256:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397457.952265:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:3.0:1787397457.952267:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787397457.952269:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63800, rc 0) 00010000:00000080:3.0:1787397457.952280:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a806b5f100 x1874218681124736/t98784247815(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:653/0 lens 752/824 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397457.952392:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:66329:x1874218681124736:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1390us (1608us total) trans 98784247815 rc 0/0 00000100:00100000:3.0:1787397457.952408:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1080 00000100:00100000:3.0:1787397457.964876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397457.964970:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124992 00000100:00100000:0.0:1787397457.964985:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124992 00000100:00100000:0.0:1787397457.965089:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1081 00000100:00100000:0.0:1787397457.965101:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:66329:x1874218681124992:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:0.0:1787397457.965267:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.965289:0:66178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.965299:0:66178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.965344:0:66178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.965361:0:66178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 11 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397457.965379:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66178:1874218700909312:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397457.965504:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397457.970419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397457.970914:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125120 00000100:00100000:1.0:1787397457.970928:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125120 00010000:00010000:1.0:1787397457.970980:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 12 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397457.971029:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2582 00000100:00100000:1.0:1787397457.971040:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2405:x1874218681125120:12345-192.168.204.60@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1787397457.971072:0:6508:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 12 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971086:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 12 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971120:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 12 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971132:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:1.0:1787397457.971143:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1787397457.971148:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971159:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971166:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397457.971196:0:6508:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 12 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397457.971278:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2405:x1874218681125120:12345-192.168.204.60@tcp:102:ldlm_bl.0 Request processed in 240us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397457.971287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2582 00000100:00100000:0.0:1787397457.971807:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66178:1874218700909312:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397457.971840:0:66178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.971850:0:66178:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.971857:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397457.972053:0:66178:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787397457.972057:0:66178:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1787397457 -> 1787397457 00000004:00010000:0.0:1787397457.972060:0:66178:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1787397457 -> 1787397457 00000004:00010000:0.0:1787397457.972062:0:66178:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1787397457 -> 1787397457 00000004:00010000:0.0:1787397457.972064:0:66178:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1787397457.972073:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc46797e reply state 00000000549af367 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.972090:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397457.972099:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:0.0:1787397457.972102:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397457.972106:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1787397457.972180:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836692300 x1874218681124992/t98784247816(0) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:653/0 lens 488/456 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397457.972246:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:66329:x1874218681124992:12345-192.168.204.60@tcp:36:touch.0 Request processed in 7148us (7387us total) trans 98784247816 rc 0/0 00000100:00100000:0.0:1787397457.972256:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1081 00000100:00100000:3.0:1787397457.985016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397457.985122:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125376 00000100:00100000:1.0:1787397457.985139:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125376 00000100:00100000:1.0:1787397457.985215:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00100000:1.0:1787397457.985236:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:66329:x1874218681125376:12345-192.168.204.60@tcp:35:touch.0 00010000:00000080:1.0:1787397457.985562:0:66179:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836690700 x1874218681125376/t98784247817(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:653/0 lens 392/456 e 0 to 0 dl 1787397468 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397457.985650:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:66329:x1874218681125376:12345-192.168.204.60@tcp:35:touch.0 Request processed in 416us (652us total) trans 98784247817 rc 0/0 00000100:00100000:1.0:1787397457.985659:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 215 00010000:00010000:1.0:1787397458.725834:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397459.206582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397459.206626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397459.206636:0:85112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125504 00000100:00100000:3.0:1787397459.206653:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397459.206674:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397459.206699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397459.206723:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126016 00000100:00100000:3.0:1787397459.206734:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126016 00000100:00100000:3.0:1787397459.206802:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125888 00000100:00100000:3.0:1787397459.206806:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125888 00000100:00100000:3.0:1787397459.206829:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2359 00000100:00100000:3.0:1787397459.206837:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681126016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397459.206904:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681126016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397459.206912:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2359 00000100:00100000:3.0:1787397459.207092:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2360 00000100:00100000:3.0:1787397459.207102:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681125888:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397459.207129:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681125888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397459.207135:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2360 00000100:00080000:3.0:1787397459.207172:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397459.207177:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397459.207362:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125760 00000100:00100000:1.0:1787397459.207368:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125760 00000100:00100000:1.0:1787397459.207411:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125632 00000100:00100000:1.0:1787397459.207414:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125632 00000100:00100000:1.0:1787397459.207439:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1071 00000100:00100000:1.0:1787397459.207447:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681125760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397459.207484:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681125760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397459.207491:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1071 00000100:00100000:1.0:1787397459.207507:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1072 00000100:00100000:1.0:1787397459.207513:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:2403:x1874218681125632:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787397459.207551:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836693800 x1874218681125632/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:655/0 lens 224/224 e 0 to 0 dl 1787397470 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397459.207575:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:2403:x1874218681125632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 63us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397459.207581:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1072 00000100:00100000:0.0:1787397459.207969:0:85112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125504 00000100:00100000:0.0:1787397459.208018:0:85112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:0.0:1787397459.208025:0:85112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681125504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397459.208056:0:85112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703661c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681125504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397459.208063:0:85112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00080000:3.0:1787397459.208618:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397459.208624:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397459.749552:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397459.945506:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700909440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397459.945605:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397459.945664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909440 00000100:00100000:0.0:1787397459.945671:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909440 00000100:00100000:0.0:1787397459.945730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:0.0:1787397459.945740:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700909440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397459.945780:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397459.945827:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700909440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397459.945835:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00080000:0.0:1787397459.945855:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397459.945889:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700909440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397459.946012:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700909568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397459.946044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397459.946079:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909568 00000100:00100000:3.0:1787397459.946083:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909568 00000100:00100000:3.0:1787397459.946111:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:3.0:1787397459.946117:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700909568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397459.946133:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397459.946166:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700909568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397459.946171:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:3.0:1787397459.946201:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700909568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787397459.947985:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1787397460.218474:0:86426:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787397460.219098:0:86426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.219132:0:86426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.219140:0:86426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.219145:0:86426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.219213:0:86426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787397460.219219:0:86426:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787397460.219251:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397460.219265:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397460.219272:0:86426:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397460.219301:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a83fa41000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397460.219582:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700909696:0@lo:39:umount.0 00000100:00100000:0.0:1787397460.219658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397460.220143:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909696 00000100:00100000:1.0:1787397460.220151:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909696 00000100:00100000:1.0:1787397460.220199:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1787397460.220212:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700909696:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787397460.220246:0:74374:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f59e 00000100:00080000:1.0:1787397460.220265:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787397460.222261:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397460.222278:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.222289:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397460.222294:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.222306:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397460.222312:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397460.222317:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787397460.222320:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787397460.222341:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787397460.222386:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.222394:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397460.222426:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.222434:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096a400/0x274786fe0d18f47f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f486 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.222448:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.222450:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.222452:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397460.222461:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397460.222480:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700909824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397460.222565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:1.0:1787397460.222875:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd5880 x1874218700909696/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:656/0 lens 224/224 e 0 to 0 dl 1787397471 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397460.222937:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218700909696:12345-0@lo:39:umount.0 Request processed in 2729us (3277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397460.222947:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000020:00000080:1.0:1787397460.222962:0:74374:0:(genops.c:906:class_export_put()) final put ffff89a829b1e800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787397460.223058:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397460.223120:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83fa41000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397460.223138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700909696:0@lo:39:umount.0 00000100:00080000:1.0:1787397460.223194:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397460.223198:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787397460.223202:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397460.223587:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397460.223639:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1f800 for lustre-MDT0000 00000100:00100000:2.0:1787397460.223664:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909824 00000100:00100000:2.0:1787397460.223678:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909824 00000100:00100000:2.0:1787397460.223741:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1787397460.223749:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700909824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397460.223778:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397460.223795:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b600/0x274786fe0d18f486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f47f expref: 24 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397460.223809:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397460.223851:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218700909824:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397460.223858:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1787397460.223889:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700909824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397460.227944:0:86426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.227965:0:86426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.227972:0:86426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.227978:0:86426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228008:0:86426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397460.228015:0:86426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228021:0:86426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228026:0:86426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228031:0:86426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228050:0:86426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397460.228057:0:86426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228090:0:86426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228100:0:86426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228107:0:86426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228188:0:86426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787397460.228194:0:86426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228200:0:86426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228204:0:86426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397460.228209:0:86426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.230601:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787397460.230617:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.230630:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397460.230635:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.230645:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397460.230677:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397460.230683:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787397460.230686:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787397460.230837:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397460.230846:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.230852:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397460.230855:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.230862:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397460.230869:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397460.230883:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397460.230885:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787397460.230888:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787397460.230942:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.230948:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397460.230979:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.230986:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d18f4b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f4be expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231003:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397460.231007:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231013:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397460.231016:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231023:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397460.231029:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397460.231034:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787397460.231036:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787397460.231038:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787397460.231061:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231067:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397460.231073:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231079:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096a200/0x274786fe0d18f471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f478 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231089:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397460.231093:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231098:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397460.231100:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231106:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397460.231111:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397460.231115:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397460.231117:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1787397460.231128:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231133:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397460.231152:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231170:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.231172:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.231174:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397460.231199:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700909952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.231285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397460.231334:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397460.231340:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700910080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.231360:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397460.231402:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700909952 00000100:00100000:0.0:1787397460.231410:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700909952 00000100:00100000:0.0:1787397460.231454:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910080 00000100:00100000:0.0:1787397460.231457:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910080 00000100:00100000:0.0:1787397460.231479:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1787397460.231487:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700909952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397460.231500:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397460.231513:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55400/0x274786fe0d18f4be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f4b7 expref: 24 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231546:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397460.231579:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218700909952:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397460.231586:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1787397460.231603:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1787397460.231608:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218700910080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397460.231616:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397460.231624:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f471 expref: 22 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.231639:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397460.231660:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218700910080:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397460.231666:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1787397460.232479:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397460.232500:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700910208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.232569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397460.232620:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910208 00000100:00100000:0.0:1787397460.232625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910208 00000100:00100000:0.0:1787397460.232664:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1787397460.232672:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218700910208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397460.232682:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397460.232832:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.232843:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397460.232861:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.232868:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096b800/0x274786fe0d18f3ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f3b4 expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.232882:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.232884:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.232887:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.232927:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74a00/0x274786fe0d18f39f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f38a expref: 21 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.232939:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397460.232969:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218700910208:12345-0@lo:103:ldlm_bl.0 Request processed in 297us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397460.232976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1787397460.233001:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700910336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.233020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397460.233058:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700910208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.233092:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700910080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397460.233099:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700909952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397460.233188:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910336 00000100:00100000:3.0:1787397460.233192:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910336 00000100:00100000:3.0:1787397460.233226:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1787397460.233233:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218700910336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397460.233241:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397460.233250:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74400/0x274786fe0d18f3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f3ad expref: 20 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.233269:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397460.233298:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218700910336:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397460.233315:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1787397460.235741:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700910336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397460.236411:0:86426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397460.236424:0:86426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18f38a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f39f expref: -99 pid: 85105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397460.236443:0:86426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1787397460.236457:0:86426:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787397460.236479:0:86426:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787397460.236516:0:86426:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787397460.236545:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1787397460.236551:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787397460.236558:0:86426:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1787397460.239540:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.242810:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1787397460.244015:0:86426:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1787397460.246603:0:85106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:3.0:1787397460.250392:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250411:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250421:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250427:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397460.250433:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250441:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250460:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a82ebb1c00) 00010000:00010000:3.0:1787397460.250464:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397460.250468:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250474:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d18f8ed lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250543:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250549:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250576:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250581:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397460.250584:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250591:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250600:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:3.0:1787397460.250602:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397460.250605:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397460.250611:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d18f902 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787397460.250966:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1787397460.250979:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b19000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397460.250985:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397460.250989:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397460.250994:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7090fa000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397460.251001:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7090fd800 e90f04db-6a63-4f01-92c7-7bf813f9f081 192.168.204.60@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 98784247817 stale:0 00000020:00080000:1.0:1787397460.251007:0:86426:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a838784d40) has exports, disconnecting them 00000020:00080000:1.0:1787397460.251013:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b19000), last request at 1787397431 00000020:00000080:1.0:1787397460.251021:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f597 00000100:00080000:1.0:1787397460.251030:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a829b1d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397460.251064:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b19000): rc 0 00000020:00000080:1.0:1787397460.251066:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a829b19000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787397460.251083:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b1f000), last request at 1787397457 00000020:00000080:1.0:1787397460.251087:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f590 00000100:00080000:1.0:1787397460.251091:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a829b19800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397460.251104:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1f000): rc 0 00000020:00000080:1.0:1787397460.251106:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787397460.251110:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b1c800), last request at 1787397457 00000020:00000080:1.0:1787397460.251113:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f589 00000100:00080000:1.0:1787397460.251117:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a829b1b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397460.251126:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1c800): rc 0 00000020:00000080:1.0:1787397460.251135:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a829b1c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787397460.251139:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7090fa000), last request at 1787397426 00000020:00000080:1.0:1787397460.251148:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3f3 00000100:00080000:1.0:1787397460.251160:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a706ff6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397460.251205:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7090fa000): rc 0 00000020:00000080:1.0:1787397460.251207:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a7090fa000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1787397460.251211:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a7090fd800), last request at 1787397459 00000020:00000080:1.0:1787397460.251215:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3ec 00000020:00010000:1.0:1787397460.251221:0:86426:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7090fd800: total 4 00000100:00080000:1.0:1787397460.251224:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a706ff5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397460.251233:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a7090fd800): rc 0 00000004:00000080:1.0:1787397460.251239:0:86426:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41f73ae0 00000020:00010000:2.0:1787397460.251347:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7090fd800: total 4 00010000:00010000:2.0:1787397460.251408:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7090fd800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1787397460.251440:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d18f8bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e77 expref: 4 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397460.251462:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d18f8f4 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 3 pid: 77740 timeout: 3437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397460.251479:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18f8d8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e7e expref: 2 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397460.251491:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7090fd800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1787397460.254472:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397460.255392:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397460.255399:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397460.256899:0:86426:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787397460.256935:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a819128000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397460.257002:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910464:0@lo:39:umount.0 00000100:00100000:0.0:1787397460.257088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787397460.257204:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b19000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397460.257267:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397460.257294:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397460.257316:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fa000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397460.257353:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1d000 for lustre-MDT0000 00000020:00000080:3.0:1787397460.257377:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b19800 for lustre-MDT0000 00000020:00000080:3.0:1787397460.257381:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1b000 for lustre-MDT0000 00000020:00000080:3.0:1787397460.257383:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706ff6000 for lustre-MDT0000 00010000:00010000:3.0:1787397460.257399:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397460.257405:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397460.260949:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397460.260958:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968725 gen 3 00000004:00080000:1.0:1787397460.260982:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787397460.261042:0:86426:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787397460.261074:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a83670c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787397460.261578:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397460.265088:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910592:0@lo:9:umount.0 00000100:00100000:0.0:1787397460.265172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397460.265246:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910592 00000100:00100000:0.0:1787397460.265581:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910592 00000100:00100000:0.0:1787397460.265655:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00000100:00100000:0.0:1787397460.265666:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700910592:12345-0@lo:9:umount.0 00000100:00080000:3.0:1787397460.265791:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1787397460.266454:0:26159:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f44e 00000100:00080000:0.0:1787397460.266469:0:26159:0:(import.c:65:import_set_state_nolock()) ffff89a835594000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397460.266549:0:26159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968725 00000100:00100000:0.0:1787397460.266740:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700910592:12345-0@lo:9:umount.0 Request processed in 1074us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397460.266758:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00080000:0.0:1787397460.266818:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397460.266832:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397460.266834:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397460.266837:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910592:0@lo:9:umount.0 00010000:00010000:3.0:1787397460.266917:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397460.272503:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397460.272512:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968722 gen 3 00000004:00080000:1.0:1787397460.272554:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787397460.272853:0:86426:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787397460.272888:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a835593000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787397460.272957:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a838784d40) has no exports 00000100:00100000:3.0:1787397460.273226:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910720:0@lo:9:umount.0 00000100:00100000:3.0:1787397460.273313:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397460.273483:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910720 00000100:00100000:3.0:1787397460.273491:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910720 00000100:00100000:3.0:1787397460.273576:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926 00000100:00100000:3.0:1787397460.273586:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700910720:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787397460.273616:0:26168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f45c 00000100:00080000:3.0:1787397460.273623:0:26168:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397460.273663:0:26168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968722 00000100:00100000:3.0:1787397460.274516:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700910720:12345-0@lo:9:umount.0 Request processed in 928us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397460.274543:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926 00000100:00080000:3.0:1787397460.274575:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787397460.274585:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397460.274617:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835593000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787397460.274629:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787397460.274631:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397460.274634:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910720:0@lo:9:umount.0 00000020:00080000:0.0:1787397460.274979:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a838784d40) has no exports 00000100:00100000:3.0:1787397460.275876:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910464 00000100:00100000:3.0:1787397460.275887:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910464 00000100:00100000:3.0:1787397460.279059:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1787397460.279086:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700910464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787397460.279124:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f424 00000100:00080000:3.0:1787397460.279134:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a7025d0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397460.279164:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000100:00100000:3.0:1787397460.279349:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218700910464:12345-0@lo:39:umount.0 Request processed in 274us (22259us total) trans 81604378731 rc 0/0 00000100:00100000:3.0:1787397460.279371:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00010000:00010000:3.0:1787397460.297507:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397460.297594:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819128000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397460.297607:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700910464:0@lo:39:umount.0 00000020:00000080:2.0:1787397460.315784:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a7090fd800/e90f04db-6a63-4f01-92c7-7bf813f9f081 00010000:00010000:2.0:1787397460.318832:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397460.318840:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397460.318862:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397460.320421:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd800/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0000 00000020:00000080:3.0:1787397460.326472:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706ff5000 for lustre-MDT0000 00000020:00000080:0.0:1787397460.362066:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f408 00000020:00000080:0.0:1787397460.362105:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a8364e3000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787397460.362171:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787397460.362260:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397460.362276:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787397460.362281:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a702478000) has no exports 00000020:00000080:2.0:1787397460.362813:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f401 00000020:00000080:2.0:1787397460.362824:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a7037c7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397460.366219:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787397460.366675:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397460.366856:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397460.366873:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787397460.366879:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a7054c4800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787397460.366882:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787397460.366891:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787397460.367055:0:86426:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a830e2ab40 - data ffff89a827f805e8/ffff89a805cbbc00 00000020:01000000:2.0:1787397460.367195:0:86426:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259c960 - data ffff89a827d7aa20/ffff89a828892c00 00000100:00080000:2.0:1787397460.427106:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397460.427117:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397460.427133:0:86426:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a706f9d500 x1874218700910464/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397470 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397460.427159:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787397460.429496:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397460.429504:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968725 gen 4 00000004:00080000:2.0:1787397460.429545:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397460.429548:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787397460.431788:0:85124:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787397460.431796:0:85124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1787397460.431808:0:85124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:2.0:1787397460.432476:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397460.432481:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968722 gen 4 00000004:00080000:2.0:1787397460.432503:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397460.432505:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787397460.433356:0:85126:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787397460.433371:0:85126:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:0.0:1787397460.433385:0:85126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:2.0:1787397460.434625:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3c2 00000020:00000080:2.0:1787397460.434637:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a83670d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397460.434794:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397460.435620:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3d7 00000020:00000080:2.0:1787397460.435628:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a70374b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397460.435640:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787397460.435645:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397460.435655:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397460.435659:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a8387819c0) has no exports 00000004:01000000:2.0:1787397460.436198:0:86426:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787397460.436208:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f455 00000020:00000080:2.0:1787397460.436213:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a83ae94800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397460.436218:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787397460.436222:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397460.436230:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397460.436232:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a829b919c0) has no exports 00000020:00000080:2.0:1787397460.436237:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f447 00000020:00000080:2.0:1787397460.436240:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a835591800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787397460.436592:0:86426:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787397460.436598:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397460.436602:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968722 gen 5 00000004:00080000:2.0:1787397460.436607:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397460.436608:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397460.436638:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397460.436646:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397460.436651:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f439 00000020:00000080:2.0:1787397460.436656:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a828787000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397460.436659:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787397460.436662:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397460.436665:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397460.436668:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a703c88000) has no exports 00000020:00000080:2.0:1787397460.436672:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f432 00000020:00000080:2.0:1787397460.436675:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a83670e000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787397460.436998:0:86426:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787397460.437001:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397460.437003:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968725 gen 5 00000004:00080000:2.0:1787397460.437007:0:86426:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397460.437008:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397460.437034:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397460.437040:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787397460.437050:0:86426:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787397460.437064:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f41d 00000020:00000080:2.0:1787397460.437069:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a828780800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397460.437073:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787397460.437075:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397460.437079:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397460.437082:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a828c199c0) has no exports 00000020:00000080:2.0:1787397460.437085:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f416 00000020:00000080:2.0:1787397460.437087:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a81912a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397460.438028:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70374b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787397460.438041:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787397460.438046:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835591800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397460.438051:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835593000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787397460.438058:0:8:0:(genops.c:906:class_export_put()) final put ffff89a828783000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397460.438060:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828783000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787397460.438064:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397460.438145:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828787000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787397460.438151:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397460.438154:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83670c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787397460.438157:0:8:0:(genops.c:906:class_export_put()) final put ffff89a828786800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397460.438159:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828786800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787397460.438161:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397460.438188:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828780800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787397460.438192:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a81912a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787397460.442593:0:86426:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787397460.442602:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787397460.442607:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397460.442615:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397460.442697:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397460.442713:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397460.442743:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397460.442754:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397460.442759:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a828856800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397460.442763:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828856800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787397460.442773:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397460.442870:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3de 00000020:00000080:0.0:1787397460.442876:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a70374b800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787397460.442880:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787397460.442883:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397460.442888:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397460.442892:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a838783380) has no exports 00000020:00000080:0.0:1787397460.442923:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397460.442926:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787397460.442929:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f3e5 00000020:00000080:0.0:1787397460.442933:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a703749000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787397460.442939:0:86426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a706d34800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787397460.442942:0:86426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a706d34800 3 00000020:01000004:0.0:1787397460.442945:0:86426:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a706d34800 from lustre-MDT0000 00000020:00000080:0.0:1787397460.442961:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397460.442965:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787397460.442967:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a83670a800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787397460.442969:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787397460.442975:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787397460.443001:0:86426:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787397460.443005:0:86426:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787397460.443008:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787397460.443010:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397460.443012:0:86426:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787397460.443020:0:86426:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a836711000 367372d5-1a70-4e8f-8f10-c0f943f3662d 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397460.443027:0:86426:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a7090fd000 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397460.443036:0:86426:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a838780000) has exports, disconnecting them 00000020:00080000:0.0:1787397460.443041:0:86426:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a836711000), last request at 1787397426 00000020:00000080:0.0:1787397460.443059:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f49b 00000020:00010000:0.0:1787397460.443064:0:86426:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a836711000: total 2 00000100:00080000:0.0:1787397460.443068:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a836714000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397460.443078:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a836711000): rc 0 00000020:00080000:0.0:1787397460.443081:0:86426:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a7090fd000), last request at 1787397426 00000020:00000080:0.0:1787397460.443122:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f383 00000020:00010000:0.0:1787397460.443125:0:86426:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7090fd000: total 2 00000100:00080000:0.0:1787397460.443127:0:86426:0:(import.c:65:import_set_state_nolock()) ffff89a7090fc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397460.443134:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7090fd000): rc 0 00000020:00080000:0.0:1787397460.443138:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a838780000) has no exports 00000100:00100000:0.0:1787397460.443186:0:85112:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a705b91600:85112] 1 exiting: rc = 0 00000100:00100000:1.0:1787397460.443563:0:85117:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a705862200:85117] 3 exiting: rc = 0 00000020:00000080:1.0:1787397460.443605:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a819128000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397460.443617:0:8:0:(genops.c:906:class_export_put()) final put ffff89a83476c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397460.443619:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83476c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787397460.443623:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397460.443672:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70374b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787397460.443675:0:8:0:(genops.c:906:class_export_put()) final put ffff89a83670b800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787397460.443677:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787397460.443679:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787397460.443710:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703749000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787397460.467660:0:85113:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a705b90e00:85113] 2 exiting: rc = 0 00000020:00010000:0.0:1787397460.467779:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a836711000: total 0 00010000:00010000:0.0:1787397460.467836:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a836711000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787397460.467870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a000/0x274786fe0d18f4b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e2a expref: 5 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.467886:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096ac00/0x274786fe0d18f520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e38 expref: 4 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.467898:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75800/0x274786fe0d18f4a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e23 expref: 3 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.467909:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75400/0x274786fe0d18f4ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e31 expref: 2 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.467918:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a836711000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1787397460.467949:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a836711000/367372d5-1a70-4e8f-8f10-c0f943f3662d 00000020:00010000:0.0:1787397460.467960:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7090fd000: total 1 00010000:00010000:0.0:1787397460.467962:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.467978:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7090fd000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787397460.467994:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031200/0x274786fe0d18f582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f57b expref: 14 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468005:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031400/0x274786fe0d18f574 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f56d expref: 13 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468016:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75c00/0x274786fe0d18f52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f527 expref: 12 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468026:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096ba00/0x274786fe0d18f4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f4f6 expref: 11 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b000/0x274786fe0d18f53c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f535 expref: 10 pid: 85111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468048:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096aa00/0x274786fe0d18f4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f4c5 expref: 9 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468058:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096be00/0x274786fe0d18f50b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f504 expref: 8 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468067:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74c00/0x274786fe0d18f54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f543 expref: 7 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468076:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55600/0x274786fe0d18f4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f4d3 expref: 6 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031000/0x274786fe0d18f519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f512 expref: 5 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468104:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030600/0x274786fe0d18f558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f551 expref: 4 pid: 85112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468113:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b200/0x274786fe0d18f4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f4e1 expref: 3 pid: 85113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468123:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030200/0x274786fe0d18f566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f55f expref: 2 pid: 85117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397460.468132:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7090fd000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787397460.468143:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a7090fd000/99b57a74-e5dc-42df-b087-b10fad741506 00010000:00010000:0.0:1787397460.468148:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.468150:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.468151:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397460.468159:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397460.468714:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836711000/367372d5-1a70-4e8f-8f10-c0f943f3662d for MGS 00000020:00000080:1.0:1787397460.468772:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd000/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:1.0:1787397460.468786:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836714000 for MGS 00000020:00000080:1.0:1787397460.468791:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7090fc800 for MGS 00000100:00100000:0.0:1787397460.540665:0:85111:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a704508400:85111] 0 exiting: rc = 1 00000100:00100000:1.0:1787397460.540823:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540832:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540838:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540844:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540850:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540856:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540861:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540867:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540872:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540876:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540882:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540888:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540894:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540901:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540923:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540928:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540934:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540940:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540945:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540951:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540974:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540980:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540993:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.540999:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541017:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541021:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541027:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541033:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541037:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541042:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541049:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541054:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541060:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541065:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541070:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541081:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541090:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541098:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541104:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541110:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541115:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541121:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541126:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541133:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541139:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541144:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541156:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541163:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541169:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541174:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541179:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541189:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541195:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541201:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541206:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541221:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541226:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541232:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541238:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541244:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541263:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541270:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541276:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397460.541282:0:86426:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787397460.543193:0:86426:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a704b882a0 - data ffff89a83ff24000/ffff89a7037aac00 00000020:01000000:1.0:1787397460.543440:0:86426:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a8187a4f60 - data ffff89a83fee7000/ffff89a827b8a800 00000020:00000080:1.0:1787397460.544227:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f37c 00000020:00000080:1.0:1787397460.544237:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a830a0c000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787397460.544508:0:86426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a706d34800 from MGS, refs=2 00000020:01000004:1.0:1787397460.544512:0:86426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a706d34800 2 00000020:01000004:1.0:1787397460.544515:0:86426:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a706d34800 from MGS 00000020:00000080:1.0:1787397460.544558:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397460.544566:0:86426:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787397460.544568:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a830a09000/MGS 00000020:00000080:1.0:1787397460.544571:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a09000/MGS for MGS 00000020:01000000:1.0:1787397460.544577:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787397460.544655:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787397460.544661:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397460.544671:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787397460.544678:0:86426:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a836715800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397460.544684:0:86426:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a706924d40) has exports, disconnecting them 00000020:00080000:1.0:1787397460.544689:0:86426:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a836715800), last request at 1787397426 00000020:00000080:1.0:1787397460.544703:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f494 00000020:00080000:1.0:1787397460.544714:0:86426:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a836715800): rc 0 00000020:00000080:1.0:1787397460.544719:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a836715800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787397460.550959:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397460.551241:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836715800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787397460.555579:0:86426:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787397460.555589:0:86426:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397460.555593:0:86426:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397460.555601:0:86426:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397460.555655:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83fa41000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787397460.555891:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397460.556427:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787397460.556434:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a836712000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787397460.556439:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836712000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787397460.556444:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787397460.556548:0:86426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a706d34800 1 00000020:00000080:0.0:1787397460.556555:0:86426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f36e 00000020:00000080:0.0:1787397460.556562:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a830a0e800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787397460.556577:0:86426:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787397460.556582:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397460.556588:0:86426:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397460.556592:0:86426:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a828c1cd40) has no exports 00000020:00000080:2.0:1787397460.556593:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787397460.791039:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397460.798790:0:86426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397460.798805:0:86426:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787397460.798822:0:86426:0:(genops.c:906:class_export_put()) final put ffff89a705060800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397460.798827:0:86426:0:(genops.c:865:class_export_destroy()) destroying export ffff89a705060800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787397460.798840:0:86426:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787397460.798958:0:86426:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a706d31800 00000020:02000400:1.0:1787397460.799027:0:86426:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787397461.801818:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397462.500732:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700911104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.500800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.500830:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700911616:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.500854:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.500876:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397462.500882:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700911232:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.500900:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.500916:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700911744:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.500933:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.500966:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911104 00000100:00100000:2.0:1787397462.500973:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911104 00000100:00100000:2.0:1787397462.501025:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911232 00000100:00100000:2.0:1787397462.501029:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911232 00000100:00100000:2.0:1787397462.501048:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1787397462.501056:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700911104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501118:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700911104:12345-0@lo:400:kworker.0 Request processed in 63us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397462.501126:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1787397462.501141:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1787397462.501158:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874218700911232:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397462.501164:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397462.501189:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874218700911232:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397462.501194:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1787397462.501210:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911616 00000100:00100000:2.0:1787397462.501213:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911616 00000100:00100000:2.0:1787397462.501236:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911744 00000100:00100000:2.0:1787397462.501239:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911744 00000100:00100000:2.0:1787397462.501256:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:2.0:1787397462.501261:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700911616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501290:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700911616:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397462.501296:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:2.0:1787397462.501307:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:2.0:1787397462.501313:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700911744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501336:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700911744:12345-0@lo:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397462.501341:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00080000:2.0:1787397462.501360:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397462.501364:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397462.501366:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397462.501394:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397462.501398:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397462.501402:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397462.501407:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397462.501410:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3311 00000100:00080000:2.0:1787397462.501421:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397462.501445:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350a680 x1874218700912000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397462.501466:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700911232:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700911744:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501492:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700911104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501501:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700911616:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.501555:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700912000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397462.501582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.501608:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912000 00000100:00100000:2.0:1787397462.501611:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912000 00000100:00100000:2.0:1787397462.501631:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1787397462.501635:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700912000:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397462.501652:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397462.501680:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700912000:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (97us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397462.501685:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:2.0:1787397462.501722:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397462.501727:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397462.501730:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700912000:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787397462.501900:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700910848:0@lo:400:kworker.0 00000400:00000100:0.0:1787397462.501927:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700910848 offset 0 length 224: 4 00000100:00100000:0.0:1787397462.501949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700911360:0@lo:400:kworker.0 00000100:00100000:0.0:1787397462.501973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397462.501987:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700911872:0@lo:400:kworker.0 00000100:00100000:0.0:1787397462.502004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397462.502020:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397462.502026:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700910976:0@lo:400:kworker.0 00000100:00100000:0.0:1787397462.502044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397462.502055:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700911488:0@lo:400:kworker.0 00000100:00100000:0.0:1787397462.502089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397462.502472:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911488 00000100:00100000:3.0:1787397462.502479:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911488 00000100:00100000:3.0:1787397462.502511:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1787397462.502517:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1874218700911488:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397462.502542:0:23942:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397462.502580:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1874218700911488:12345-0@lo:400:kworker.0 Request processed in 62us (490us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397462.502586:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00080000:3.0:1787397462.502629:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397462.502633:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397462.502636:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397462.502641:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397462.502644:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3311 00000100:00080000:3.0:1787397462.502648:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397462.502666:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a836691500 x1874218700912128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397462.502689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700911488:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.505194:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911360 00000100:00100000:2.0:1787397462.505208:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911360 00000100:00100000:2.0:1787397462.505276:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700911872 00000100:00100000:2.0:1787397462.505280:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700911872 00000100:00100000:2.0:1787397462.505304:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700910976 00000100:00100000:2.0:1787397462.505307:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700910976 00000100:00100000:2.0:1787397462.505325:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1787397462.505335:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700911360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.505427:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700911360:12345-0@lo:400:kworker.0 Request processed in 94us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397462.505435:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1787397462.505452:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1787397462.505456:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874218700911872:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397462.505462:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397462.505486:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874218700911872:12345-0@lo:400:kworker.0 Request processed in 29us (3480us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397462.505491:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1787397462.505500:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1787397462.505504:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874218700910976:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397462.505508:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397462.505551:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874218700910976:12345-0@lo:400:kworker.0 Request processed in 45us (3505us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397462.505557:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1787397462.505596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700912128:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397462.505635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397462.505692:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397462.505697:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397462.505701:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397462.505718:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397462.505723:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3311 00000100:00080000:2.0:1787397462.505735:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397462.505759:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a703509c00 x1874218700912256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397462.505781:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700910976:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.505798:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700911360:0@lo:400:kworker.0 00000100:00080000:2.0:1787397462.505807:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397462.505810:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397462.505813:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397462.505816:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397462.505819:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3311 00000100:00080000:2.0:1787397462.505823:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397462.505834:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a703508700 x1874218700912384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397462.505844:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700911872:0@lo:400:kworker.0 00000100:00100000:2.0:1787397462.505869:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700912256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397462.505895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.505910:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700912384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397462.505929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397462.505949:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912256 00000100:00100000:2.0:1787397462.505953:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912256 00000100:00100000:2.0:1787397462.505966:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912384 00000100:00100000:2.0:1787397462.505969:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912384 00000100:00100000:2.0:1787397462.505979:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1787397462.505983:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700912256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787397462.506006:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397462.506031:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700912256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 47us (136us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397462.506037:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1787397462.506048:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1787397462.506051:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700912384:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787397462.506060:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787397462.506909:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397462.506929:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912128 00000100:00100000:3.0:1787397462.506936:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912128 00000100:00100000:3.0:1787397462.506975:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1787397462.506981:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700912128:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787397462.506996:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397462.507041:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700912128:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 59us (1405us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397462.507047:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1787397462.508991:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700912384:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2930us (3053us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397462.509004:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:2.0:1787397462.509124:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397462.509130:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397462.509134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700912256:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787397462.509149:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397462.509152:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397462.509155:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700912384:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787397462.509165:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397462.509168:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397462.509171:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700912128:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1787397462.820943:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397463.844729:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787397464.324433:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681126144 offset 0 length 224: 4 00000100:00100000:0.0:1787397464.324475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397464.324507:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397464.324562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397464.324600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397464.324683:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126400 00000100:00100000:1.0:1787397464.324693:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126400 00000100:00100000:1.0:1787397464.324754:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126272 00000100:00100000:1.0:1787397464.324757:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126272 00000100:00100000:1.0:1787397464.324772:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1075 00000100:00100000:1.0:1787397464.324782:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681126400:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397464.324862:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681126400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397464.324869:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1075 00000100:00100000:1.0:1787397464.324886:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1089 00000100:00100000:1.0:1787397464.324890:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1874218681126272:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:1.0:1787397464.324896:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397464.324916:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2402:x1874218681126272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (354us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397464.324922:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1089 00000100:00080000:0.0:1787397464.324971:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397464.325064:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126656 00000100:00100000:3.0:1787397464.325071:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126656 00000100:00100000:3.0:1787397464.325126:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126528 00000100:00100000:3.0:1787397464.325130:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126528 00000100:00100000:3.0:1787397464.325159:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2363 00000100:00100000:3.0:1787397464.325165:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681126656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397464.325193:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681126656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397464.325200:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2363 00000100:00100000:3.0:1787397464.325212:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2364 00000100:00100000:3.0:1787397464.325217:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681126528:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397464.325239:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681126528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 21us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397464.325244:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2364 00000100:00080000:0.0:1787397464.325495:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397464.325498:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397464.332120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397464.332230:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681126784 00000100:00100000:0.0:1787397464.332241:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681126784 00000100:00100000:0.0:1787397464.332287:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1090 00000100:00100000:0.0:1787397464.332296:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681126784:12345-192.168.204.60@tcp:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1787397464.332327:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397464.332392:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681126784:12345-192.168.204.60@tcp:38:ptlrpcd_00_00.0 Request processed in 96us (282us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397464.332400:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1090 00010000:00010000:0.0:1787397464.869610:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397465.063696:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397465.063722:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700912512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397465.063805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397465.064114:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912512 00000100:00100000:0.0:1787397465.064122:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912512 00000100:00100000:0.0:1787397465.064181:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1787397465.064190:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700912512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397465.064216:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397465.064263:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700912512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397465.064270:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1787397465.064315:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700912512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397465.064418:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397465.064428:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700912640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397465.064457:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397465.064589:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912640 00000100:00100000:0.0:1787397465.064593:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912640 00000100:00100000:0.0:1787397465.064627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:0.0:1787397465.064632:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700912640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397465.064648:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397465.064693:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700912640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397465.064699:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:0.0:1787397465.064734:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700912640:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787397465.065012:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397465.065017:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787397465.576604:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397465.576615:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a819129800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397465.576712:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a819129800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787397465.576772:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a81912e000 for lustre-OST0001 00000001:00100000:0.0:1787397465.579221:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397465.579236:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:0.0:1787397465.579241:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a7025d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397465.579322:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787397465.579381:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7025d0000 for lustre-MDT0001 00000001:00100000:1.0:1787397465.579714:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397465.579719:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a835590800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397465.581952:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835590800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787397465.582033:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835594000 for lustre-OST0000 00010000:00010000:3.0:1787397465.892696:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397466.917389:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397467.622705:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397467.622712:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397467.622716:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397467.622724:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3341 00000100:00080000:0.0:1787397467.622729:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397467.622736:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397467.622762:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8288c3480 x1874218700912896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397467.622807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397467.622811:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397467.622813:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397467.622816:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3341 00000100:00080000:0.0:1787397467.622818:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397467.622822:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397467.622832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8288c2a00 x1874218700913152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397467.622836:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700912896:0@lo:38:kworker.0 00000100:00080000:0.0:1787397467.622847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397467.622850:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397467.622851:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397467.622867:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3341 00000100:00080000:0.0:1787397467.622869:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1787397467.622903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397467.622939:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397467.622949:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700913152:0@lo:38:kworker.0 00000100:00100000:0.0:1787397467.622958:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806914e00 x1874218700913408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397467.622970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397467.622980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397467.622983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397467.622985:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787397467.622989:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700913408:0@lo:38:kworker.0 00000100:00080000:0.0:1787397467.622989:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3341 00000100:00080000:0.0:1787397467.622991:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397467.622995:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397467.623005:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915c00 x1874218700913792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397467.623012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397467.623031:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700913792:0@lo:38:kworker.0 00000100:00100000:0.0:1787397467.623035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700913024:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623059:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397467.623083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700913536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623095:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700912896 00000100:00100000:3.0:1787397467.623102:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700912896 00000100:00100000:0.0:1787397467.623108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397467.623129:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397467.623135:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700912768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623142:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913152 00000100:00100000:3.0:1787397467.623145:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913152 00000100:00100000:3.0:1787397467.623159:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913792 00000100:00100000:3.0:1787397467.623161:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913792 00000400:00000100:0.0:1787397467.623164:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700912768 offset 0 length 224: 4 00000100:00100000:3.0:1787397467.623177:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1787397467.623183:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700913664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623184:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700912896:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397467.623201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1787397467.623203:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397467.623367:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1787397467.623373:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700913152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397467.623384:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397467.623414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397467.623429:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700912896:12345-0@lo:38:kworker.0 Request processed in 243us (525us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397467.623430:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397467.623435:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700913280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623436:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1787397467.623450:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913024 00000100:00100000:3.0:1787397467.623453:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913024 00000100:00100000:0.0:1787397467.623465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397467.623484:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913280 00000100:00100000:3.0:1787397467.623487:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913280 00000100:00100000:0.0:1787397467.623504:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913536 00000100:00100000:0.0:1787397467.623507:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913536 00000100:00100000:3.0:1787397467.623511:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1787397467.623516:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700913024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397467.623558:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913664 00000100:00100000:0.0:1787397467.623561:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913664 00000100:00100000:3.0:1787397467.623582:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700913024:12345-0@lo:400:kworker.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397467.623582:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1787397467.623587:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700913536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623589:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1787397467.623600:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1787397467.623616:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700913280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397467.623634:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700913536:12345-0@lo:400:kworker.0 Request processed in 46us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397467.623642:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700913280:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397467.623642:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:3.0:1787397467.623647:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1787397467.623654:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:3.0:1787397467.623655:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1787397467.623659:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700913792:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397467.623659:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700913664:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1787397467.623669:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397467.623685:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700913664:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397467.623686:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700913792:12345-0@lo:38:kworker.0 Request processed in 27us (627us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397467.623691:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:3.0:1787397467.623692:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00080000:0.0:1787397467.623712:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397467.623715:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397467.623718:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397467.623747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700913280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397467.623758:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700913024:0@lo:400:kworker.0 00000100:00080000:3.0:1787397467.623787:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397467.623792:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397467.623795:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700913792:0@lo:38:kworker.0 00000100:00080000:3.0:1787397467.623802:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397467.623805:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397467.623808:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700912896:0@lo:38:kworker.0 00000100:00100000:3.0:1787397467.623861:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913408 00000100:00100000:3.0:1787397467.623864:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913408 00000100:00100000:3.0:1787397467.623884:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1787397467.623889:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700913408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397467.623898:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397467.623930:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700913408:12345-0@lo:38:kworker.0 Request processed in 40us (916us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397467.623935:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00080000:3.0:1787397467.623959:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397467.623962:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397467.623964:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700913408:0@lo:38:kworker.0 00000100:00100000:0.0:1787397467.630902:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700913664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397467.630925:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700913536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397467.631154:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700913152:12345-0@lo:38:kworker.0 Request processed in 7776us (8179us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397467.631166:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:3.0:1787397467.631452:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397467.631459:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397467.631462:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700913152:0@lo:38:kworker.0 00010000:00010000:2.0:1787397467.941143:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397468.964810:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397469.446461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397469.446505:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:0.0:1787397469.446563:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681126912 offset 0 length 224: 4 00000100:00100000:0.0:1787397469.446600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397469.446771:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127424 00000100:00100000:1.0:1787397469.446782:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127424 00000100:00100000:1.0:1787397469.446862:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127296 00000100:00100000:1.0:1787397469.446866:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127296 00000100:00100000:1.0:1787397469.446915:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2367 00000100:00100000:1.0:1787397469.446927:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681127424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397469.447390:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681127424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 464us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397469.447399:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2367 00000100:00100000:1.0:1787397469.447420:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2368 00000100:00100000:1.0:1787397469.447427:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681127296:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397469.447452:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681127296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397469.447458:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2368 00000100:00080000:0.0:1787397469.448547:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397469.448554:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397469.449858:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127168 00000100:00100000:3.0:1787397469.449871:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127168 00000100:00080000:0.0:1787397469.450012:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397469.450356:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1078 00000100:00100000:3.0:1787397469.450369:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681127168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397469.450459:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681127168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 93us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397469.450467:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1078 00000100:00100000:0.0:1787397469.463332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397469.472977:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127040 00000100:00100000:2.0:1787397469.472995:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127040 00000100:00100000:2.0:1787397469.473135:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1094 00000100:00100000:2.0:1787397469.473144:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681127040:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397469.473170:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397469.473261:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681127040:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 116us (9940us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397469.473269:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1094 00010000:00010000:0.0:1787397469.988867:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397470.181012:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397470.181040:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700913920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397470.181121:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397470.181545:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700913920 00000100:00100000:3.0:1787397470.181564:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700913920 00000100:00100000:3.0:1787397470.181636:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1787397470.181646:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700913920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397470.181690:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397470.181740:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700913920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397470.181748:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00080000:0.0:1787397470.181884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397470.181975:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700913920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397470.182307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397470.182319:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700914048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397470.182369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397470.182580:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914048 00000100:00100000:3.0:1787397470.182585:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914048 00000100:00100000:3.0:1787397470.182644:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1787397470.182653:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700914048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397470.182674:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397470.182712:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700914048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397470.182719:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00080000:0.0:1787397470.182820:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397470.182847:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700914048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397471.014049:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397472.036702:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397472.742274:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1787397472.745574:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397472.745584:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397472.745589:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397472.745596:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3346 00000100:00080000:0.0:1787397472.745602:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787397472.745609:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397472.745653:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915500 x1874218700914304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397472.745771:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700914304:0@lo:38:kworker.0 00000100:00100000:2.0:1787397472.745846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397472.746177:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914304 00000100:00100000:1.0:1787397472.746187:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914304 00000100:00100000:1.0:1787397472.746236:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1787397472.746244:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700914304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397472.746265:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397472.746308:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700914304:12345-0@lo:38:kworker.0 Request processed in 63us (460us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397472.746315:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00080000:2.0:1787397472.746472:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397472.746485:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397472.746579:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700914304:0@lo:38:kworker.0 00000100:00100000:3.0:1787397472.750338:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700914432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397472.750431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397472.750603:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700914176:0@lo:400:kworker.0 00000400:00000100:3.0:1787397472.750623:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700914176 offset 0 length 224: 4 00000100:00100000:2.0:1787397472.755109:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914432 00000100:00100000:2.0:1787397472.755239:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914432 00000100:00100000:2.0:1787397472.755406:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1787397472.755418:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700914432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397472.755517:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700914432:12345-0@lo:400:kworker.0 Request processed in 92us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397472.755542:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:0.0:1787397472.755592:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397472.755597:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397472.755600:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397472.755601:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397472.755605:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3346 00000100:00080000:0.0:1787397472.755609:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787397472.755613:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397472.755639:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700914432:0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.755641:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915f80 x1874218700914560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397472.755677:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397472.755693:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397472.755694:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787397472.755697:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700914688:0@lo:400:kworker.0 00000100:00080000:0.0:1787397472.755698:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3346 00000100:00080000:0.0:1787397472.755700:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787397472.755704:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397472.755717:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806917100 x1874218700914816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397472.755730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397472.755742:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397472.755745:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397472.755747:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397472.755750:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3346 00000100:00080000:0.0:1787397472.755753:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787397472.755756:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397472.755769:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806914e00 x1874218700915200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397472.755808:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700914944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.755838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397472.755873:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914944 00000100:00100000:0.0:1787397472.755877:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914944 00000100:00100000:0.0:1787397472.756449:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:0.0:1787397472.756463:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.756544:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700914944:12345-0@lo:400:kworker.0 Request processed in 63us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397472.756552:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00080000:0.0:1787397472.756574:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397472.756596:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700915072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.756627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397472.756655:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915072 00000100:00100000:0.0:1787397472.756659:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915072 00000100:00100000:0.0:1787397472.756688:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:0.0:1787397472.756694:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700915072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.756723:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700915072:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397472.756728:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00080000:0.0:1787397472.756739:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397472.756756:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700914944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.756778:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700915072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397472.756904:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700914560:0@lo:38:kworker.0 00000100:00100000:3.0:1787397472.759214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397472.759515:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914688 00000100:00100000:1.0:1787397472.759544:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914688 00000100:00100000:1.0:1787397472.759609:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1787397472.759635:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700914688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397472.759712:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700914688:12345-0@lo:400:kworker.0 Request processed in 79us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397472.759720:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00080000:1.0:1787397472.759743:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397472.760272:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700914688:0@lo:400:kworker.0 00000100:00100000:3.0:1787397472.760494:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700914816:0@lo:38:kworker.0 00000100:00100000:3.0:1787397472.760582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397472.760600:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700915200:0@lo:38:kworker.0 00000100:00100000:3.0:1787397472.760623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397472.760663:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914816 00000100:00100000:2.0:1787397472.760668:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914816 00000100:00100000:2.0:1787397472.760695:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:2.0:1787397472.760701:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700914816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397472.760722:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397472.760756:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700914816:12345-0@lo:38:kworker.0 Request processed in 54us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397472.760762:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00080000:3.0:1787397472.761287:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397472.761294:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397472.761298:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700914816:0@lo:38:kworker.0 00000100:00100000:0.0:1787397472.761503:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700914560 00000100:00100000:0.0:1787397472.761517:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700914560 00000100:00100000:0.0:1787397472.761592:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915200 00000100:00100000:0.0:1787397472.761596:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915200 00000100:00100000:0.0:1787397472.761615:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1787397472.761621:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700914560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397472.761637:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397472.761678:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700914560:12345-0@lo:38:kworker.0 Request processed in 55us (2469us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397472.761684:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1787397472.761700:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1787397472.761704:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700915200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397472.761713:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397472.761749:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700915200:12345-0@lo:38:kworker.0 Request processed in 43us (1124us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397472.761754:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:3.0:1787397472.761863:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397472.761867:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397472.761871:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700914560:0@lo:38:kworker.0 00000100:00080000:3.0:1787397472.761881:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397472.761884:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397472.761886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700915200:0@lo:38:kworker.0 00010000:00010000:2.0:1787397473.060756:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397474.084837:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397474.583370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397474.583413:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681127552 offset 0 length 224: 4 00000100:00100000:1.0:1787397474.583433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397474.583464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397474.583515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397474.583654:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127808 00000100:00100000:2.0:1787397474.583664:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127808 00000100:00100000:2.0:1787397474.583721:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127680 00000100:00100000:2.0:1787397474.583724:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127680 00000100:00100000:2.0:1787397474.583746:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1081 00000100:00100000:2.0:1787397474.583755:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681127808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397474.583832:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681127808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397474.583851:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1081 00000100:00100000:2.0:1787397474.583870:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1098 00000100:00100000:2.0:1787397474.583875:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681127680:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397474.583894:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397474.583924:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681127680:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 47us (490us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397474.583931:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1098 00000100:00100000:2.0:1787397474.583951:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681127936 00000100:00100000:2.0:1787397474.583955:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681127936 00000100:00100000:2.0:1787397474.583983:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128064 00000100:00100000:2.0:1787397474.583987:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128064 00000100:00100000:2.0:1787397474.584012:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4927 00000100:00100000:2.0:1787397474.584019:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681127936:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787397474.584037:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f7c0 00000100:00080000:2.0:1787397474.584046:0:26160:0:(import.c:65:import_set_state_nolock()) ffff89a831149800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397474.584089:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968725 00000100:00100000:2.0:1787397474.584204:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681127936:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 185us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397474.584210:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4927 00000100:00100000:2.0:1787397474.584223:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4928 00000100:00100000:2.0:1787397474.584229:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681128064:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787397474.584240:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f7c7 00000100:00080000:2.0:1787397474.584246:0:26160:0:(import.c:65:import_set_state_nolock()) ffff89a817ecc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397474.584267:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968722 00000100:00100000:2.0:1787397474.584332:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681128064:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 103us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397474.584344:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4928 00010000:00010000:2.0:1787397474.584457:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397474.584462:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397474.585106:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397474.585111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397474.585114:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397475.109095:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397475.300691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397475.300716:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700915328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397475.300789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397475.300850:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915328 00000100:00100000:1.0:1787397475.300857:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915328 00000100:00100000:1.0:1787397475.300917:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:1.0:1787397475.300926:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700915328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397475.300954:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397475.300997:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700915328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397475.301004:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00080000:1.0:1787397475.301027:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397475.301060:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700915328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397475.301237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397475.301247:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700915456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397475.301276:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397475.301303:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915456 00000100:00100000:0.0:1787397475.301307:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915456 00000100:00100000:0.0:1787397475.301332:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1787397475.301338:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700915456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397475.301355:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397475.301387:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700915456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397475.301394:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1787397475.301423:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700915456:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397475.301502:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787397476.132730:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397477.157691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397477.861440:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397477.861447:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397477.861451:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397477.861459:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3352 00000100:00080000:0.0:1787397477.861466:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397477.861472:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397477.861494:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe52d80 x1874218700915712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397477.861554:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397477.861558:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397477.861560:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397477.861563:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3352 00000100:00080000:0.0:1787397477.861566:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397477.861570:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397477.861581:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe51c00 x1874218700915968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397477.861597:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397477.861600:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397477.861602:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397477.861605:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3352 00000100:00080000:0.0:1787397477.861607:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397477.861612:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397477.861623:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe53800 x1874218700916224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397477.861645:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397477.861649:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397477.861651:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397477.861654:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3352 00000100:00080000:0.0:1787397477.861657:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397477.861660:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397477.861669:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe52300 x1874218700916608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397477.861717:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700916352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.861786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.861823:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397477.861829:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700915584:0@lo:400:kworker.0 00000400:00000100:0.0:1787397477.861850:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700915584 offset 0 length 224: 4 00000100:00100000:0.0:1787397477.861871:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700916480:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.861891:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.861918:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700915712:0@lo:38:kworker.0 00000100:00100000:0.0:1787397477.861941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.861957:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700915968:0@lo:38:kworker.0 00000100:00100000:0.0:1787397477.861974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.861988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700916224:0@lo:38:kworker.0 00000100:00100000:0.0:1787397477.862007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.862022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700916608:0@lo:38:kworker.0 00000100:00100000:0.0:1787397477.862040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.862066:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700915840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.862105:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397477.862110:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700916096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397477.862160:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916352 00000100:00100000:0.0:1787397477.862167:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916352 00000100:00100000:0.0:1787397477.862212:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916480 00000100:00100000:0.0:1787397477.862215:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916480 00000100:00100000:0.0:1787397477.862250:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:0.0:1787397477.862261:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700916352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862313:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700916352:12345-0@lo:400:kworker.0 Request processed in 55us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397477.862320:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000100:00100000:0.0:1787397477.862334:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1787397477.862340:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700916480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862366:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700916480:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397477.862372:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1787397477.862395:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915712 00000100:00100000:0.0:1787397477.862399:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915712 00000100:00100000:0.0:1787397477.862442:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915968 00000100:00100000:0.0:1787397477.862447:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915968 00000100:00100000:0.0:1787397477.862455:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916608 00000100:00100000:0.0:1787397477.862457:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916608 00000100:00100000:0.0:1787397477.862464:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700915840 00000100:00100000:0.0:1787397477.862465:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700915840 00000100:00100000:0.0:1787397477.862480:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916096 00000100:00100000:0.0:1787397477.862482:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916096 00000100:00100000:0.0:1787397477.862495:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1787397477.862501:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700915840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862559:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700915840:12345-0@lo:400:kworker.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397477.862566:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1787397477.862579:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1787397477.862585:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700916096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862613:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700916096:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397477.862626:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1787397477.862639:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1787397477.862643:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700915712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397477.862661:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397477.862693:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700915712:12345-0@lo:38:kworker.0 Request processed in 48us (751us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397477.862700:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1787397477.862710:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1787397477.862714:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700915968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397477.862723:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397477.862744:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700915968:12345-0@lo:38:kworker.0 Request processed in 28us (768us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397477.862750:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1787397477.862760:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1787397477.862764:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700916608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397477.862773:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397477.862793:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700916608:12345-0@lo:38:kworker.0 Request processed in 28us (752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397477.862799:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1787397477.862821:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916224 00000100:00100000:0.0:1787397477.862825:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916224 00000100:00100000:0.0:1787397477.862845:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:0.0:1787397477.862850:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700916224:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397477.862859:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397477.862892:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700916224:12345-0@lo:38:kworker.0 Request processed in 40us (884us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397477.862899:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00080000:0.0:1787397477.862926:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397477.862930:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397477.862932:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397477.862973:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700916096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.862985:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700915840:0@lo:400:kworker.0 00000100:00080000:0.0:1787397477.863019:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397477.863024:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397477.863027:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700915712:0@lo:38:kworker.0 00000100:00080000:0.0:1787397477.863035:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397477.863037:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397477.863040:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700915968:0@lo:38:kworker.0 00000100:00080000:0.0:1787397477.863047:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397477.863050:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397477.863053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700916224:0@lo:38:kworker.0 00000100:00080000:0.0:1787397477.863059:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397477.863062:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397477.863064:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700916608:0@lo:38:kworker.0 00000100:00100000:0.0:1787397477.863091:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700916480:0@lo:400:kworker.0 00000100:00100000:0.0:1787397477.863102:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700916352:0@lo:400:kworker.0 00010000:00010000:0.0:1787397478.184736:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787397478.888343:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397462/real 1787397462] req@ffff89a806b5e300 x1874218700910848/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397478 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397478.947166:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a806b5e300 x1874218700910848/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397478.947182:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787397478.947186:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787397478.994823:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787397478.994829:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787397478.994838:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a806b5e300 x1874218700910848/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397478 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397478.994851:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a827b7b100 x1874218700912768/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397478.994866:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a806916300 x1874218700914176/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397478.994884:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a80fe51500 x1874218700915584/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787397478.994893:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787397478.994896:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787397478.994897:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787397478.994899:0:3648:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1787397478.994959:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700912768:0@lo:400:kworker.0 00000100:00080000:1.0:1787397478.995009:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397478.995014:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787397478.995017:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397478.995021:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3305 00000100:00080000:1.0:1787397478.995030:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397478.995059:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9d500 x1874218700916736/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397478.995091:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397478.995094:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397478.995096:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397478.995099:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3357 00000100:00080000:1.0:1787397478.995102:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397478.995106:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397478.995120:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9e300 x1874218700916864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397478.995139:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397478.995143:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397478.995144:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397478.995147:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3357 00000100:00080000:1.0:1787397478.995149:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397478.995152:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397478.995161:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750700 x1874218700917120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397478.995173:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397478.995176:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397478.995177:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397478.995180:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3357 00000100:00080000:1.0:1787397478.995182:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397478.995185:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397478.995194:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750380 x1874218700917376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397478.995229:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397478.995232:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397478.995234:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397478.995237:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3357 00000100:00080000:1.0:1787397478.995239:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397478.995242:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397478.995253:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7030c3800 x1874218700917760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397478.995283:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700917248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397478.996645:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700916992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397478.996714:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700916736:0@lo:250:kworker.0 00000400:00000100:2.0:1787397478.996736:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700916736 offset 0 length 520: 4 00000100:00100000:2.0:1787397478.996774:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700916864:0@lo:38:kworker.0 00000100:00100000:1.0:1787397479.001726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397479.004821:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700917632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397479.004929:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700917504:0@lo:400:kworker.0 00000100:00100000:1.0:1787397479.004990:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700914176:0@lo:400:kworker.0 00000100:00100000:2.0:1787397479.007630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397479.007699:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700917120:0@lo:38:kworker.0 00000100:00100000:2.0:1787397479.007768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397479.007788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700917376:0@lo:38:kworker.0 00000100:00100000:2.0:1787397479.007817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397479.007836:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700917760:0@lo:38:kworker.0 00000100:00100000:2.0:1787397479.007857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397479.007959:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917248 00000100:00100000:2.0:1787397479.007968:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917248 00000100:00100000:3.0:1787397479.009670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397479.009751:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916864 00000100:00100000:3.0:1787397479.009759:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916864 00000100:00100000:3.0:1787397479.009797:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917120 00000100:00100000:3.0:1787397479.009800:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917120 00000100:00100000:3.0:1787397479.009814:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917760 00000100:00100000:3.0:1787397479.009817:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917760 00000100:00100000:3.0:1787397479.009832:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1787397479.009840:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700916864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397479.009863:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397479.009909:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700916864:12345-0@lo:38:kworker.0 Request processed in 69us (2285us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397479.009933:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1787397479.009951:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1787397479.009955:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700917120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397479.009965:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397479.009989:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700917120:12345-0@lo:38:kworker.0 Request processed in 33us (2220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397479.010010:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1787397479.010021:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1787397479.010025:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700917760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397479.010035:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397479.010059:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700917760:12345-0@lo:38:kworker.0 Request processed in 32us (2201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397479.010065:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1787397479.010083:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917632 00000100:00100000:3.0:1787397479.010087:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917632 00000100:00100000:3.0:1787397479.010121:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:3.0:1787397479.010128:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700917632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397479.010170:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700917632:12345-0@lo:400:kworker.0 Request processed in 42us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397479.010176:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00080000:3.0:1787397479.010217:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397479.010223:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397479.010226:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700916864:0@lo:38:kworker.0 00000100:00080000:3.0:1787397479.010236:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397479.010246:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397479.010249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700917120:0@lo:38:kworker.0 00000100:00080000:3.0:1787397479.010262:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397479.010267:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397479.010270:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700917760:0@lo:38:kworker.0 00000100:00100000:3.0:1787397479.010324:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700917632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397479.010364:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917376 00000100:00100000:3.0:1787397479.010369:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917376 00000100:00100000:3.0:1787397479.010403:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:3.0:1787397479.010408:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700917376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397479.010418:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397479.010675:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700917376:12345-0@lo:38:kworker.0 Request processed in 265us (2857us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397479.010682:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00080000:3.0:1787397479.010711:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397479.010716:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397479.010719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700917376:0@lo:38:kworker.0 00000100:00100000:2.0:1787397479.012685:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1787397479.012702:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700917248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397479.012794:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700917248:12345-0@lo:400:kworker.0 Request processed in 98us (11077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397479.012801:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:2.0:1787397479.012830:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397479.012836:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397479.017598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397479.018002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700915584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397479.018012:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700910848:0@lo:400:kworker.0 00000100:00100000:0.0:1787397479.018100:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700917248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397479.021428:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917504 00000100:00100000:3.0:1787397479.021453:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917504 00000100:00100000:3.0:1787397479.021548:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:3.0:1787397479.021558:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700917504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397479.021657:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700917504:12345-0@lo:400:kworker.0 Request processed in 100us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397479.021664:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00080000:0.0:1787397479.021852:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397479.021894:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700917504:0@lo:400:kworker.0 00000100:00100000:1.0:1787397479.026123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397479.026277:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700916992 00000100:00100000:3.0:1787397479.026287:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700916992 00000100:00100000:3.0:1787397479.026369:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1787397479.026379:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700916992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397479.026475:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700916992:12345-0@lo:400:kworker.0 Request processed in 97us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397479.026483:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:1.0:1787397479.026672:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397479.026751:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700916992:0@lo:400:kworker.0 00010000:00010000:3.0:1787397479.205806:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397479.685053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397479.685085:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681128192 offset 0 length 224: 4 00000100:00100000:3.0:1787397479.686825:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128448 00000100:00100000:3.0:1787397479.686842:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128448 00000100:00080000:1.0:1787397479.686916:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397479.687613:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1086 00000100:00100000:3.0:1787397479.687627:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681128448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397479.687719:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681128448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 95us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397479.687726:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1086 00000100:00100000:1.0:1787397479.687874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397479.688240:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128320 00000100:00100000:0.0:1787397479.688247:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128320 00000100:00100000:0.0:1787397479.688291:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1105 00000100:00100000:0.0:1787397479.688298:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681128320:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397479.688319:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397479.688362:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681128320:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 61us (486us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397479.688377:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1105 00010000:00010000:0.0:1787397480.243458:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397480.422418:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700917888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397480.422492:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397480.422574:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700917888 00000100:00100000:0.0:1787397480.422582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700917888 00000100:00100000:0.0:1787397480.422638:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:0.0:1787397480.422647:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700917888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397480.422675:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397480.422731:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700917888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397480.422738:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:0.0:1787397480.422820:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700917888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397480.425661:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700918016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397480.425739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397480.425922:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918016 00000100:00100000:3.0:1787397480.425930:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918016 00000100:00100000:3.0:1787397480.425984:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1787397480.425993:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700918016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397480.426025:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397480.426726:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700918016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 730us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397480.426736:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1787397480.428796:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700918016:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1787397480.429984:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:1.0:1787397480.429992:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a817eca000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:3.0:1787397480.432709:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:3.0:1787397480.432719:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a829b1a000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:2.0:1787397480.439640:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817eca000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0001 00000020:00000080:2.0:1787397480.439745:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1a000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0000 00000020:00000080:2.0:1787397480.439781:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecc000 for lustre-OST0001 00000020:00000080:2.0:1787397480.439786:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a831149800 for lustre-OST0000 00000400:00000100:1.0:1787397480.710307:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681128576 offset 0 length 520: 4 00000100:00100000:1.0:1787397480.710377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397480.710414:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397480.710507:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128704 00000100:00100000:3.0:1787397480.710517:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128704 00000100:00100000:3.0:1787397480.710606:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128832 00000100:00100000:3.0:1787397480.710609:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128832 00000100:00100000:3.0:1787397480.710649:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1087 00000100:00100000:3.0:1787397480.710659:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681128832:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397480.710734:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681128832:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397480.710741:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1087 00000100:00100000:3.0:1787397480.710759:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1106 00000100:00100000:3.0:1787397480.710764:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681128704:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397480.710784:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397480.710812:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681128704:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 47us (436us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397480.710819:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1106 00010000:00010000:3.0:1787397481.261088:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397482.278118:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397483.301507:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397484.004667:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397484.004678:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397484.004681:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397484.004685:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397484.004689:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397484.004697:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3358 00000100:00080000:1.0:1787397484.004702:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397484.004710:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397484.004768:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7030c2680 x1874218700918144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397484.004827:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397484.004831:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397484.004832:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397484.004836:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3358 00000100:00080000:1.0:1787397484.004839:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397484.004843:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397484.004853:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7030c1880 x1874218700918400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397484.004869:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397484.004872:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397484.004874:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397484.004877:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3358 00000100:00080000:1.0:1787397484.004879:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397484.004883:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397484.004904:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7030c0380 x1874218700918656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397484.004938:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397484.004942:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397484.004944:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397484.004947:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3358 00000100:00080000:1.0:1787397484.004949:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397484.004952:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397484.004962:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee5f80 x1874218700919040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397484.004994:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700918144:0@lo:38:kworker.0 00000100:00100000:1.0:1787397484.005065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700918400:0@lo:38:kworker.0 00000100:00100000:1.0:1787397484.005118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005134:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700918656:0@lo:38:kworker.0 00000100:00100000:1.0:1787397484.005156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005175:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700919040:0@lo:38:kworker.0 00000100:00100000:1.0:1787397484.005195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005229:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700918528:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005251:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005270:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397484.005275:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700918272:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005310:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005335:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700918784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005393:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397484.005398:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700918912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397484.005451:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918144 00000100:00100000:1.0:1787397484.005458:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918144 00000100:00100000:1.0:1787397484.005490:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918400 00000100:00100000:1.0:1787397484.005492:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918400 00000100:00100000:1.0:1787397484.005500:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919040 00000100:00100000:1.0:1787397484.005502:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919040 00000100:00100000:1.0:1787397484.005509:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918528 00000100:00100000:1.0:1787397484.005511:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918528 00000100:00100000:1.0:1787397484.005564:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918272 00000100:00100000:1.0:1787397484.005567:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918272 00000100:00100000:1.0:1787397484.005585:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1787397484.005593:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005647:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700918528:12345-0@lo:400:kworker.0 Request processed in 54us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397484.005654:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1787397484.005676:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1787397484.005682:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700918272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.005709:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700918272:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397484.005716:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1787397484.005728:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1787397484.005732:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700918144:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397484.005750:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397484.005788:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700918144:12345-0@lo:38:kworker.0 Request processed in 54us (723us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397484.005794:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1787397484.005808:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1787397484.005813:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700918400:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397484.005822:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397484.005844:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700918400:12345-0@lo:38:kworker.0 Request processed in 30us (725us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397484.005850:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1787397484.005861:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1787397484.005865:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700919040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397484.005874:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397484.005895:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700919040:12345-0@lo:38:kworker.0 Request processed in 29us (700us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397484.005901:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1787397484.005922:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918656 00000100:00100000:1.0:1787397484.005925:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918656 00000100:00100000:1.0:1787397484.005946:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1787397484.005950:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700918656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397484.005959:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397484.005984:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700918656:12345-0@lo:38:kworker.0 Request processed in 32us (826us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397484.005989:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1787397484.006016:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918784 00000100:00100000:1.0:1787397484.006019:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918784 00000100:00100000:1.0:1787397484.006052:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700918912 00000100:00100000:1.0:1787397484.006055:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700918912 00000100:00100000:1.0:1787397484.006074:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1787397484.006080:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700918784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.006112:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700918784:12345-0@lo:400:kworker.0 Request processed in 32us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397484.006117:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1787397484.006127:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1787397484.006133:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700918912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.006155:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700918912:12345-0@lo:400:kworker.0 Request processed in 22us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397484.006161:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00080000:1.0:1787397484.006185:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397484.006190:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397484.006192:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397484.006231:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700918912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.006243:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700918784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.006272:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700918272:0@lo:400:kworker.0 00000100:00100000:1.0:1787397484.006281:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700918528:0@lo:400:kworker.0 00000100:00080000:1.0:1787397484.006316:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397484.006320:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397484.006322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700918144:0@lo:38:kworker.0 00000100:00080000:1.0:1787397484.006329:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397484.006332:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397484.006334:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700918400:0@lo:38:kworker.0 00000100:00080000:1.0:1787397484.006351:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397484.006354:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397484.006356:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700918656:0@lo:38:kworker.0 00000100:00080000:1.0:1787397484.006363:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397484.006365:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397484.006367:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700919040:0@lo:38:kworker.0 00010000:00010000:3.0:1787397484.324606:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397485.350098:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397485.540727:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397485.540753:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700919168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397485.540820:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397485.540896:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919168 00000100:00100000:1.0:1787397485.540903:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919168 00000100:00100000:1.0:1787397485.540945:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:1.0:1787397485.540952:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700919168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397485.540978:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397485.541015:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700919168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397485.541022:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:1.0:1787397485.541052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700919296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397485.541077:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397485.541117:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700919168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397485.541147:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919296 00000100:00100000:1.0:1787397485.541151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919296 00000100:00100000:1.0:1787397485.541175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1787397485.541181:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700919296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397485.541196:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397485.541240:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700919296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397485.541247:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1787397485.541290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700919296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397485.838576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397485.838633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397485.838663:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681128960 00000100:00100000:1.0:1787397485.838673:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681128960 00000100:00100000:1.0:1787397485.838710:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129088 00000100:00100000:1.0:1787397485.838713:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129088 00000100:00100000:1.0:1787397485.838755:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1090 00000100:00100000:1.0:1787397485.838769:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681129088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397485.838859:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681129088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397485.838868:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1090 00000100:00100000:1.0:1787397485.838890:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1110 00000100:00100000:1.0:1787397485.838894:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681128960:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397485.838913:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397485.838939:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681128960:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 43us (373us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397485.838945:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1110 00000100:00080000:1.0:1787397485.838966:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:2.0:1787397485.966085:0:87047:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787397485.966092:0:87047:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787397485.966094:0:87047:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787397485.966209:0:87047:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a829b1e800 00000020:01000004:2.0:1787397485.966225:0:87047:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787397485.966238:0:87047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787397485.966264:0:87047:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a828c1cd40) 00000020:00000080:2.0:1787397485.966285:0:87047:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787397486.123954:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787397486.124254:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.164661:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.169649:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.170385:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.170620:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.171095:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.171920:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.173122:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.174091:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.175338:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.175951:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.176660:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.177845:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787397486.181445:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787397486.190654:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.191067:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.191443:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.191896:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.192433:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.192824:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.193815:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.194142:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.194506:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.195101:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.195375:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.195631:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.195921:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.196166:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.197035:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.197332:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.197581:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.198019:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787397486.198292:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787397486.198510:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.199054:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.199390:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.199605:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.199935:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.205863:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.206401:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.206687:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.207101:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.207453:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.207834:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.208079:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787397486.208472:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787397486.209746:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787397486.210437:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787397486.210799:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787397486.211395:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787397486.211635:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787397486.211987:0:87047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1787397486.214984:0:87047:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787397486.215228:0:87047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787397486.215238:0:87047:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787397486.215262:0:87047:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f910 00000020:01000004:2.0:1787397486.215270:0:87047:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787397486.215282:0:87047:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787397486.215288:0:87047:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a829b1e800 from MGS 00000020:01000004:2.0:1787397486.215292:0:87047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787397486.215302:0:87047:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a828c199c0) 00000020:00000080:2.0:1787397486.215314:0:87047:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1787397486.215376:0:87047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b1e800 from MGS, refs=2 00080000:01000000:2.0:1787397486.215382:0:87047:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787397486.215387:0:87047:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f91e 00010000:00010000:2.0:1787397486.215511:0:87047:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1787397486.221138:0:87047:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787397486.224668:0:87051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787397486.224764:0:87047:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787397486.224823:0:87047:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397486.227277:0:87047:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787397486.227605:0:87047:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397486.227760:0:87047:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787397486.227765:0:87047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787397486.231556:0:87047:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787397486.231569:0:87047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787397486.235636:0:87047:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787397486.235648:0:87047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787397486.236360:0:87047:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787397486.236384:0:87047:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1787397486.236386:0:87047:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1787397486.236390:0:87047:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1787397486.236394:0:87047:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 59, was 0): CONNECTING 00000100:00100000:0.0:1787397486.236400:0:87047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:3.0:1787397486.372700:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397487.397500:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397488.100694:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397478/real 1787397478] req@ffff89a706f9d500 x1874218700916736/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397488 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397488.100731:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a706f9d500 x1874218700916736/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397488 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397488.100752:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397488.100781:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787397488.100803:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700916736:0@lo:250:kworker.0 00000100:00080000:3.0:1787397488.100995:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.101000:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787397488.101003:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.101008:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3358 00000100:00080000:3.0:1787397488.101013:0:65702:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397488.101021:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.101056:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82e4f4380 x1874218700919424/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397488.101086:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.101090:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397488.101091:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.101094:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3363 00000100:00080000:3.0:1787397488.101097:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397488.101100:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.101114:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82e4f5500 x1874218700919552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397488.101147:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.101151:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397488.101152:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.101155:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3363 00000100:00080000:3.0:1787397488.101172:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397488.101177:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.101190:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835751f80 x1874218700919808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397488.101223:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.101226:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397488.101228:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.101231:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3363 00000100:00080000:3.0:1787397488.101233:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397488.101237:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.101250:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835753b80 x1874218700920064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397488.101284:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.101287:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397488.101289:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.101292:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3363 00000100:00080000:3.0:1787397488.101295:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397488.101298:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.101308:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9e300 x1874218700920448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397488.101338:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700920192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397488.101412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.101441:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397488.101446:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700920320:0@lo:400:kworker.0 00000100:00100000:3.0:1787397488.101482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.101698:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700919680:0@lo:400:kworker.0 00000100:00100000:1.0:1787397488.101732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.101768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397488.101774:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700919936:0@lo:400:kworker.0 00000100:00100000:1.0:1787397488.101797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.101850:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919680 00000100:00100000:1.0:1787397488.101859:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919680 00000100:00100000:1.0:1787397488.101918:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919936 00000100:00100000:1.0:1787397488.101922:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919936 00000100:00100000:1.0:1787397488.101947:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1787397488.101956:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700919680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397488.102003:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700919680:12345-0@lo:400:kworker.0 Request processed in 47us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.102010:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1787397488.102030:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1787397488.102037:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700919936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397488.102059:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700919936:12345-0@lo:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.102075:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:1.0:1787397488.102094:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397488.102133:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700919936:0@lo:400:kworker.0 00000100:00100000:1.0:1787397488.102145:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700919680:0@lo:400:kworker.0 00000100:00020000:2.0:1787397488.103968:0:3647:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff89a82e4f4380 x1874218700919424/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397488.105969:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920192 00000100:00100000:0.0:1787397488.105985:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920192 00000100:00100000:0.0:1787397488.106079:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920320 00000100:00100000:0.0:1787397488.106083:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920320 00000100:00100000:0.0:1787397488.106115:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:0.0:1787397488.106126:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700920192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397488.106239:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700920192:12345-0@lo:400:kworker.0 Request processed in 115us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.106247:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:0.0:1787397488.106263:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:0.0:1787397488.106270:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700920320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397488.106301:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700920320:12345-0@lo:400:kworker.0 Request processed in 31us (4818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.106323:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:0.0:1787397488.106378:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700920320:0@lo:400:kworker.0 00000100:00100000:0.0:1787397488.106394:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700920192:0@lo:400:kworker.0 10000000:01000000:0.0:1787397488.106430:0:87047:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1787397488.106446:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106457:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106462:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1787397488.106472:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106481:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d18f56d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f574 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106499:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106505:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106510:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106513:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106516:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d18f4c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f4cc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106570:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106591:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106596:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106599:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106604:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096a600/0x274786fe0d18f4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f4e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106611:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106616:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106620:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106623:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106626:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d18f512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f519 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106634:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106640:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106645:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106648:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106651:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d18f527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f52e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106670:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106677:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106681:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106684:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106688:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800031600/0x274786fe0d18f543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f54a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106698:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106704:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106710:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106712:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106716:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a75a00/0x274786fe0d18f551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f558 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106723:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106729:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106733:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106743:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106747:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d18f57b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f582 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106759:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106766:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106772:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106775:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106778:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096bc00/0x274786fe0d18f4d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f4da expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106789:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106795:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106799:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397488.106802:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106805:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74e00/0x274786fe0d18f4f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f4fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106814:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106818:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106832:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787397488.106835:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106839:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54a00/0x274786fe0d18f504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f50b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106847:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106852:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106856:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787397488.106859:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106862:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d18f535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f53c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.106869:0:87047:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397488.106874:0:87047:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397488.106878:0:87047:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787397488.106880:0:87047:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397488.106883:0:87047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096ae00/0x274786fe0d18f55f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18f566 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397488.112123:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397488.112134:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397488.166860:0:87047:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 60, was 0): CONNECTING 00000100:00080000:0.0:1787397488.166874:0:87047:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1787397488.170061:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397488.170098:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1787397488.170172:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:0:1874218700919424:0@lo:250:kworker.0 00000100:00080000:3.0:1787397488.170364:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397488.170372:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787397488.170374:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397488.170379:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3367 00000100:00080000:3.0:1787397488.170384:0:65702:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397488.170391:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.170425:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70538ad80 x1874218700920576/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397488.196870:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700919552:0@lo:38:kworker.0 00000100:00100000:3.0:1787397488.196966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.197026:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700919808:0@lo:38:kworker.0 00000100:00100000:3.0:1787397488.197049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.197076:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700920064:0@lo:38:kworker.0 00000100:00100000:3.0:1787397488.197102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.197137:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920064 00000100:00100000:3.0:1787397488.197144:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920064 00000100:00100000:3.0:1787397488.197193:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:3.0:1787397488.197209:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700920064:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397488.197577:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919552 00000100:00100000:0.0:1787397488.197583:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919552 00000100:00100000:0.0:1787397488.197608:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700919808 00000100:00100000:0.0:1787397488.197611:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700919808 00000100:00100000:2.0:1787397488.197618:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1787397488.197624:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700919552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397488.197653:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787397488.197657:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397488.208198:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1787397488.208222:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700919808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397488.208246:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787397488.208379:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397488.208386:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397488.208390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700920064:0@lo:38:kworker.0 00000100:00100000:0.0:1787397488.208401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700920448:0@lo:38:kworker.0 00000100:00100000:2.0:1787397488.209380:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700919552:12345-0@lo:38:kworker.0 Request processed in 11750us (12410us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397488.209391:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1787397488.224294:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700920064:12345-0@lo:38:kworker.0 Request processed in 27077us (27175us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397488.224311:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1787397488.237763:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700919808:12345-0@lo:38:kworker.0 Request processed in 29533us (40703us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397488.237809:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1787397488.240432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397488.240511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700920576:0@lo:250:kworker.0 00000100:00100000:2.0:1787397488.240577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.240603:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920576 00000100:00100000:0.0:1787397488.240611:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920576 00000100:00080000:2.0:1787397488.240621:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397488.240626:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397488.240629:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700919552:0@lo:38:kworker.0 00000100:00080000:2.0:1787397488.240652:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787397488.240652:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787397488.240656:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397488.240658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700919808:0@lo:38:kworker.0 00000100:00100000:0.0:1787397488.240660:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1874218700920576:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1787397488.240688:0:87053:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:0.0:1787397488.240715:0:87053:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d18f925 00000100:00080000:0.0:1787397488.240868:0:87053:0:(import.c:65:import_set_state_nolock()) ffff89a83ae97000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397488.240938:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218700920576:12345-0@lo:250:kworker.0 Request processed in 278us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.240947:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397488.241338:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 24 00000100:00080000:2.0:1787397488.241348:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1787397488.241357:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787397488.241361:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787397488.241364:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787397488.241367:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787397488.241402:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787397488.241411:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700920576:0@lo:250:kworker.0 00000020:01000000:0.0:1787397488.241747:0:65702:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:0.0:1787397488.241773:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1787397488.241776:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397488.241778:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397488.241780:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.241781:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.241782:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.241783:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.241785:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397488.241786:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.241788:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397488.241849:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397488.241857:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1787397488.241865:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397488.241867:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397488.241868:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.241869:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.241870:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.241872:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.241873:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397488.241874:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.241875:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397488.241892:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397488.241906:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1787397488.241908:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397488.241910:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397488.241911:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.241912:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.241913:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.241914:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.241915:0:65702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397488.241917:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.241918:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397488.241941:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1787397488.241981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700920960:0@lo:253:kworker.0 00000100:00100000:3.0:1787397488.242266:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700920832:0@lo:253:kworker.0 00000100:00100000:1.0:1787397488.242363:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920448 00000100:00100000:1.0:1787397488.242370:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920448 00000100:00100000:1.0:1787397488.242401:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1787397488.242408:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700920448:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397488.242425:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397488.242477:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700920704:0@lo:253:kworker.0 00000100:00100000:3.0:1787397488.249557:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.249669:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920832 00000100:00100000:3.0:1787397488.249677:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920832 00000100:00100000:3.0:1787397488.249727:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787397488.249737:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+5:3651:x1874218700920832:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1787397488.249770:0:87055:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1787397488.250406:0:87047:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1787397488.250421:0:87047:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787397488.250460:0:87047:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787397488.250466:0:87047:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787397488.250603:0:87047:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787397488.250634:0:87047:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787397488.250638:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787397488.250640:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397488.250641:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397488.250642:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397488.250643:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397488.250644:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397488.250646:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397488.250647:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397488.250649:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397488.250650:0:87047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397488.250652:0:87047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787397488.250654:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787397488.250655:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397488.250656:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397488.250658:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397488.250658:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397488.250659:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397488.250660:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397488.250661:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397488.250662:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397488.250663:0:87047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397488.250686:0:87047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787397488.250702:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787397488.250756:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.251142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.251209:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920960 00000100:00100000:0.0:1787397488.251215:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920960 00000100:00100000:0.0:1787397488.251245:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397488.251253:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+6:3648:x1874218700920960:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397488.251278:0:87053:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1787397488.251336:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd480 going to sleep for 11 seconds 10000000:01000000:0.0:1787397488.251355:0:87056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787397488.251422:0:87055:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 104 00000100:00100000:3.0:1787397488.252988:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921088 00000100:00100000:3.0:1787397488.253000:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921088 00000100:00100000:1.0:1787397488.253588:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700920448:12345-0@lo:38:kworker.0 Request processed in 11173us (13157us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397488.253599:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:0.0:1787397488.256321:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397488.256334:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397488.256339:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700920448:0@lo:38:kworker.0 20000000:01000000:3.0:1787397488.258642:0:87057:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787397488.258653:0:87057:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787397488.258656:0:87057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787397488.258659:0:87057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787397488.263053:0:87057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787397488.263437:0:87055:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787397488.263474:0:87055:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787397488.264823:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.265195:0:87054:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787397488.265218:0:87054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1787397488.267396:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700920704 00000100:00100000:3.0:1787397488.267409:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700920704 00000100:00100000:0.0:1787397488.268129:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397488.268141:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:87047:x1874218700921088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787397488.268198:0:87058:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787397488.268210:0:87058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787397488.268213:0:87058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1787397488.268221:0:87058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787397488.269975:0:87055:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397488.269993:0:87055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787397488.270319:0:87053:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787397488.271302:0:87056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397488.271310:0:87056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397488.271337:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271354:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397488.271363:0:87056:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054778s 00010000:00010000:3.0:1787397488.271368:0:87056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271374:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271380:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271386:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271391:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397488.271395:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271415:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271428:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271435:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.271441:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f92c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.272286:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:3651:x1874218700920832:12345-0@lo:253:kworker.0 Request processed in 22544us (22732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.272303:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787397488.272347:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787397488.272359:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:3650:x1874218700920704:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787397488.272387:0:87055:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:3.0:1787397488.272495:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787397488.272498:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787397488.272499:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397488.272500:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397488.272501:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397488.272503:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397488.272504:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397488.272506:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397488.272507:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787397488.272510:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700920832:0@lo:253:kworker.0 00000100:00100000:0.0:1787397488.273379:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+7:87047:x1874218700921088:12345-0@lo:253:mount.lustre.0 Request processed in 5238us (22619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.273389:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787397488.274325:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787397488.274344:0:87047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787397488.274347:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787397488.274349:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787397488.274350:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397488.274351:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397488.274352:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397488.274353:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397488.274355:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397488.274356:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787397488.274358:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397488.274359:0:87047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787397488.274395:0:87047:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a829b1e800 from lustre-MDT0000 10000000:01000000:1.0:1787397488.274429:0:87047:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787397488.274433:0:87047:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787397488.274443:0:87047:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a829b1e800 10000000:01000000:1.0:1787397488.274448:0:87047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787397488.274455:0:87047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a829b1e800 10000000:01000000:1.0:1787397488.274458:0:87047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787397488.274461:0:87047:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a829b1e800 from 1 10000000:01000000:1.0:1787397488.274465:0:87047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787397488.274502:0:87047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.274513:0:87047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.274563:0:87047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.274586:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397488.274640:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.274682:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8011cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.274891:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921216 00000100:00100000:0.0:1787397488.274907:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921216 00000100:00100000:0.0:1787397488.274953:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787397488.274962:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:87047:x1874218700921216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397488.274973:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397488.274988:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54a00/0x274786fe0d18f93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f933 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.275019:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54a00/0x274786fe0d18f93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f933 expref: 8 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.275030:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54a00/0x274786fe0d18f93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f933 expref: 8 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.275038:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54a00, rc 0) 00000100:00100000:0.0:1787397488.275071:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:87047:x1874218700921216:12345-0@lo:101:mount.lustre.0 Request processed in 110us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.275085:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787397488.275406:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397488.275422:0:87047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275432:0:87047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397488.275449:0:87047:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787397488.275466:0:87047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275481:0:87047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397488.275488:0:87047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787397488.275492:0:87047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787397488.275497:0:87047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a829b1e800 10000000:01000000:1.0:1787397488.275499:0:87047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787397488.275503:0:87047:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787397488.275505:0:87047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397488.275562:0:87047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275570:0:87047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275578:0:87047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.275593:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397488.275623:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.275647:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8011cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.275661:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921344 00000100:00100000:1.0:1787397488.275667:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921344 00000100:00100000:1.0:1787397488.275691:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397488.275698:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:87047:x1874218700921344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397488.275706:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397488.275717:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ee200/0x274786fe0d18f948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18f941 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275741:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ee200/0x274786fe0d18f948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18f941 expref: 9 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275749:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ee200/0x274786fe0d18f948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18f941 expref: 9 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275756:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ee200, rc 0) 00000100:00100000:1.0:1787397488.275784:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700921344:12345-0@lo:101:mount.lustre.0 Request processed in 87us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.275802:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397488.275841:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397488.275851:0:87047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.275859:0:87047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.275923:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397488.275947:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.275958:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8011cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.275972:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921472 00000100:00100000:1.0:1787397488.275975:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921472 00000100:00100000:1.0:1787397488.275991:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787397488.275997:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700921472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397488.276428:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700921472:12345-0@lo:501:mount.lustre.0 Request processed in 428us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.276445:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397488.276552:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397488.276582:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397488.276621:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.276638:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.278667:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921600 00000100:00100000:1.0:1787397488.278680:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921600 00000100:00100000:1.0:1787397488.278739:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787397488.278748:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700921600:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1787397488.279500:0:87053:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397488.279515:0:87053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787397488.279654:0:87056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397488.279660:0:87056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397488.279681:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279696:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397488.279705:0:87056:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054778s 00010000:00010000:0.0:1787397488.279710:0:87056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279717:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279724:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279731:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279736:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397488.279740:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279747:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279757:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279776:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.279782:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55000/0x274786fe0d18f94f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.280255:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:3648:x1874218700920960:12345-0@lo:253:kworker.0 Request processed in 28999us (29109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.280276:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1787397488.280407:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397488.280410:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397488.280411:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.280412:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.280414:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.280415:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.280417:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397488.280418:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.280420:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397488.280423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700920960:0@lo:253:kworker.0 20000000:01000000:1.0:1787397488.280608:0:87055:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397488.281633:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700921600:12345-0@lo:503:mount.lustre.0 Request processed in 2881us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.281649:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787397488.281843:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700921600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397488.283314:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87059:1874218700921728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397488.283395:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.283441:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a9af540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397488.283570:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921728 00000100:00100000:3.0:1787397488.283577:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921728 00000100:00100000:3.0:1787397488.283622:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397488.283631:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:87059:x1874218700921728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397488.289464:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:87059:x1874218700921728:12345-0@lo:502:llog_process_th.0 Request processed in 5818us (6052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.289485:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397488.289590:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87059:1874218700921728:0@lo:502:llog_process_th.0 20000000:01000000:0.0:1787397488.289751:0:87055:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397488.289772:0:87055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787397488.289846:0:87056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397488.289853:0:87056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397488.289889:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289911:0:87056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397488.289923:0:87056:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071456s 00010000:00010000:3.0:1787397488.289929:0:87056:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289937:0:87056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289944:0:87056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289952:0:87056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289977:0:87056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397488.289983:0:87056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.289993:0:87056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.290010:0:87056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.290020:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.290027:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62a00/0x274786fe0d18f956 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1787397488.290130:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.290143:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.290145:0:87059:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787397488.291122:0:87059:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787397488.291130:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1787397488.291488:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218700920704:12345-0@lo:253:kworker.0 Request processed in 19128us (26673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.291503:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:1.0:1787397488.292107:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a706923380) 00000020:00000080:1.0:1787397488.292136:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1787397488.292158:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787397488.292254:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787397488.292262:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f964 00000020:00000080:1.0:1787397488.292514:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397488.292536:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.292541:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.292543:0:87059:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787397488.292546:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.292551:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.292553:0:87059:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787397488.292556:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397488.292573:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a706924d40) 00000020:00000080:1.0:1787397488.292586:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1787397488.292590:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787397488.292592:0:87059:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787397488.292595:0:87059:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787397488.292600:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787397488.293541:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787397488.293547:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787397488.293548:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397488.293549:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397488.293551:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397488.293553:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397488.293554:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397488.293556:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397488.293558:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787397488.293564:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700920704:0@lo:253:kworker.0 00000020:01000004:1.0:1787397488.295806:0:87059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b1e800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787397488.295846:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a706920000) 00000020:00000080:1.0:1787397488.295868:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1787397488.295976:0:87059:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787397488.295983:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f979 00000020:00000080:1.0:1787397488.297964:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787397488.297980:0:87059:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787397488.297991:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d18f980 00080000:01000000:1.0:1787397488.297999:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787397488.298004:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f987 00010000:00010000:0.0:1787397488.422128:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397488.488380:0:87059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1787397488.493372:0:87059:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: e90f04db-6a63-4f01-92c7-7bf813f9f081 idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:0.0:1787397488.493431:0:87059:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:0.0:1787397488.493455:0:87059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:0.0:1787397488.495088:0:87059:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1787397488.495155:0:87059:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a703d47240: xid 1874218681122304, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:0.0:1787397488.495166:0:87059:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a703d47d80: xid 1874218681122048, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:0.0:1787397488.496446:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a703c88000) 00000020:00000080:0.0:1787397488.496473:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1787397488.496599:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787397488.496607:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f9a3 00000020:00000080:3.0:1787397488.503510:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787397488.521339:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d18f9aa 00000020:00000080:1.0:1787397488.523679:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787397488.523965:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.523974:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.523976:0:87059:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787397488.523981:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397488.523985:0:87059:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787397488.523986:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397488.523988:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397488.523989:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397488.523992:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.523994:0:87059:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787397488.523996:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.524001:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.524003:0:87059:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787397488.525363:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787397488.525441:0:87059:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787397488.525469:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.525485:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.525486:0:87059:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787397488.525490:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.525494:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.525495:0:87059:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787397488.525497:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787397488.525503:0:87059:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:1.0:1787397488.525556:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397488.525573:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a7033a3380) 00000020:00000080:1.0:1787397488.525594:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787397488.525602:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787397488.525680:0:87059:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787397488.525685:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787397488.525692:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f9b8 00010000:00080000:1.0:1787397488.527147:0:87059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a83476c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397488.530715:0:87059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787397488.537313:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397488.537329:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787397488.537370:0:87059:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787397488.537396:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9bf 00000100:00080000:0.0:1787397488.537407:0:87059:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397488.537412:0:87059:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a83476c000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397488.537451:0:87059:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9d500 x1874218700921856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397488.537484:0:87059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787397488.537577:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397488.537581:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397488.537584:0:87059:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787397488.537587:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397488.537590:0:87059:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787397488.537591:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397488.537592:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397488.537593:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397488.537596:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397488.537598:0:87059:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397488.537600:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397488.537605:0:87059:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787397488.537608:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397488.537610:0:87059:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787397488.537612:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397488.537616:0:87059:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787397488.537724:0:87059:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787397488.537728:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397488.537753:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a703c899c0) 00000020:00000080:0.0:1787397488.537769:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787397488.537774:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397488.538182:0:87059:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787397488.538189:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787397488.538206:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f9cd 00010000:00080000:0.0:1787397488.538242:0:87059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a706ff1800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397488.538448:0:87059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1787397488.538841:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700921856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397488.538919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.539326:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921856 00000100:00100000:3.0:1787397488.539335:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921856 00000100:00100000:3.0:1787397488.539371:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:3.0:1787397488.539379:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700921856:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787397488.539414:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:3.0:1787397488.539450:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9d4 00000004:00100000:3.0:1787397488.539466:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397488.539579:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a828784000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397488.539646:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700921856:12345-0@lo:38:llog_process_th.0 Request processed in 265us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.539654:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1787397488.540494:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397488.540505:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1787397488.540514:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787397488.540547:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787397488.540550:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83476c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787397488.540568:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700921856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397488.542294:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700921984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397488.542369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.543181:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700921984 00000100:00100000:3.0:1787397488.543192:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700921984 00000100:00100000:3.0:1787397488.543255:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1787397488.543264:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700921984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397488.543299:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397488.543357:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700921984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.543365:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:1.0:1787397488.544608:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700921984:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1787397488.546255:0:87059:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787397488.546292:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787397488.547371:0:87059:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1787397488.553234:0:87059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397488.553280:0:87059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:0.0:1787397488.553489:0:87059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:0.0:1787397488.555672:0:87065:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1787397488.555681:0:87065:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1787397488.555921:0:87065:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1787397488.555944:0:87065:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1787397488.556080:0:87065:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1787397488.556083:0:87065:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787397488.557460:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397488.557475:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397488.557517:0:87059:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787397488.557574:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9db 00000100:00080000:3.0:1787397488.557586:0:87059:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397488.557592:0:87059:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a706ff1800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397488.557641:0:87059:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70538ad80 x1874218700922112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397488.557669:0:87059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787397488.557738:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397488.557742:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.557753:0:87059:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787397488.557757:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397488.557760:0:87059:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787397488.557761:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397488.557763:0:87059:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397488.557765:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397488.557767:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.557769:0:87059:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397488.557772:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397488.557776:0:87059:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397488.557779:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.557781:0:87059:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787397488.557784:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397488.557788:0:87059:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:3.0:1787397488.557830:0:87059:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397488.557833:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397488.557843:0:87059:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a829b94d40) 00000020:00000080:3.0:1787397488.557858:0:87059:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787397488.557864:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787397488.557943:0:87059:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787397488.557949:0:87059:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787397488.557955:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18f9e9 00010000:00080000:3.0:1787397488.557987:0:87059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a835591800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397488.558167:0:87059:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1787397488.558258:0:87059:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787397488.558273:0:87059:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787397488.558937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700922112:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787397488.559017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.559315:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922112 00000100:00100000:3.0:1787397488.559324:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922112 00000100:00100000:3.0:1787397488.559355:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929 00000100:00100000:3.0:1787397488.559363:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218700922112:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787397488.559391:0:26167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:3.0:1787397488.559416:0:26167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9f0 00002000:00100000:3.0:1787397488.559436:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a835593000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787397488.559440:0:26167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787397488.559442:0:26167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787397488.559514:0:26167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397488.559563:0:26167:0:(import.c:65:import_set_state_nolock()) ffff89a835591000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397488.559614:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700922112:12345-0@lo:8:llog_process_th.0 Request processed in 250us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.559620:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929 00000100:00100000:3.0:1787397488.559664:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397488.559672:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787397488.559680:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787397488.559684:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787397488.559686:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a706ff1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787397488.559706:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787397488.559712:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700922112:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787397488.560329:0:87065:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787397488.560390:0:87065:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3367850866571ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787397488.560397:0:87065:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:1.0:1787397488.561015:0:87059:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:0.0:1787397488.561256:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700922240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397488.561321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.561920:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922240 00000100:00100000:1.0:1787397488.561930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922240 00000100:00100000:1.0:1787397488.561998:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1787397488.562007:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700922240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397488.562034:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397488.562086:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700922240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.562093:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00080000:0.0:1787397488.562216:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397488.562254:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700922240:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787397488.564311:0:87059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397488.564349:0:87059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1787397488.564518:0:87059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:2.0:1787397488.565255:0:87067:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1787397488.565263:0:87067:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787397488.565412:0:87067:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1787397488.565431:0:87067:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787397488.565604:0:87067:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1787397488.565607:0:87067:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1787397488.567617:0:87048:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1787397488.568973:0:87059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397488.568991:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787397488.569042:0:87059:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787397488.569068:0:87059:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9f7 00000100:00080000:1.0:1787397488.569079:0:87059:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397488.569086:0:87059:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a835591800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397488.569127:0:87059:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705987800 x1874218700922368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397488.569204:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700922368:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787397488.569279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397488.569377:0:87059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787397488.569451:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.569456:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.569458:0:87059:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787397488.569462:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.569466:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.569467:0:87059:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787397488.569470:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787397488.569495:0:87059:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787397488.569498:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.569501:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.569502:0:87059:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787397488.569505:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397488.569508:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.569509:0:87059:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787397488.569513:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787397488.569569:0:87059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87059:1874218700922496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397488.569618:0:87059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.569649:0:87059:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397488.570088:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922368 00000100:00100000:2.0:1787397488.570095:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922368 00000100:00100000:2.0:1787397488.570212:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:2.0:1787397488.570220:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218700922368:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787397488.570250:0:15073:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3367 last 0 00000020:00000080:2.0:1787397488.570284:0:15073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18f9fe 00002000:00100000:2.0:1787397488.570301:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a828a5a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787397488.570305:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787397488.570309:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397488.570401:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787397488.570431:0:15073:0:(import.c:65:import_set_state_nolock()) ffff89a828a59000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397488.570870:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700922368:12345-0@lo:8:llog_process_th.0 Request processed in 586us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.570880:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00000100:00100000:2.0:1787397488.570977:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922496 00000100:00100000:2.0:1787397488.570982:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922496 00000100:00100000:2.0:1787397488.571056:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787397488.571064:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:87059:x1874218700922496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397488.571213:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:87059:x1874218700922496:12345-0@lo:502:llog_process_th.0 Request processed in 150us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.571221:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787397488.571316:0:87059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87059:1874218700922496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397488.571351:0:87059:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397488.571361:0:87059:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397488.571363:0:87059:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787397488.571369:0:87059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1787397488.571603:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397488.571615:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787397488.571640:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787397488.571646:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787397488.571650:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835591800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787397488.571672:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787397488.571679:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700922368:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1787397488.571717:0:87047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787397488.571745:0:87047:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787397488.571767:0:87047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.571778:0:87047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397488.571786:0:87047:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a829b1e800 from 1 10000000:01000000:3.0:1787397488.571790:0:87047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397488.571835:0:87047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.571843:0:87047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.571851:0:87047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.571868:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700922624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397488.572173:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.572412:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac600 going to sleep for 11 seconds 00000004:00080000:3.0:1787397488.572440:0:87067:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787397488.572503:0:87067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3367862980154ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787397488.572510:0:87067:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787397488.572651:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922624 00000100:00100000:0.0:1787397488.572657:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922624 00000100:00100000:0.0:1787397488.572712:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787397488.572721:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:87047:x1874218700922624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397488.572732:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397488.572750:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa05 expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.572774:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 9 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.572785:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 9 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.572793:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55000, rc 0) 00000100:00100000:0.0:1787397488.572852:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700922624:12345-0@lo:101:mount.lustre.0 Request processed in 132us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.572859:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787397488.572906:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700922752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397488.572943:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.572980:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922752 00000100:00100000:0.0:1787397488.572984:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922752 00000100:00100000:0.0:1787397488.573018:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1787397488.573024:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700922752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397488.573045:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397488.573077:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700922752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.573083:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1787397488.573115:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700922752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787397488.573153:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397488.573849:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700922624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397488.573867:0:87047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.573877:0:87047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.574454:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700922880:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787397488.574514:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.574578:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.576075:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700922880 00000100:00100000:0.0:1787397488.576089:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700922880 00000100:00100000:0.0:1787397488.576135:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397488.576144:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700922880:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787397488.576169:0:87053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787397488.576202:0:87053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787397488.576208:0:87053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787397488.576211:0:87053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787397488.576213:0:87053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:0.0:1787397488.576338:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700922880:12345-0@lo:256:mount.lustre.0 Request processed in 195us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.576347:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397488.579162:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700922880:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787397488.580245:0:87047:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397488.580267:0:87047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.580280:0:87047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397488.580290:0:87047:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a829b1e800 from 1 10000000:01000000:3.0:1787397488.580292:0:87047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397488.580333:0:87047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.580341:0:87047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.580350:0:87047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.580373:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397488.580436:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.580470:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.580649:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923008 00000100:00100000:0.0:1787397488.580656:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923008 00000100:00100000:0.0:1787397488.580707:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397488.580715:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:87047:x1874218700923008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397488.580727:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397488.580740:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55400/0x274786fe0d18fa1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa13 expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.580760:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55400/0x274786fe0d18fa1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa13 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.580770:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55400/0x274786fe0d18fa1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa13 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.580778:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55400, rc 0) 00000100:00100000:0.0:1787397488.580827:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923008:12345-0@lo:101:mount.lustre.0 Request processed in 112us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.580844:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397488.583668:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397488.583723:0:87047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.583736:0:87047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.584172:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397488.584249:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.584288:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.584404:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923136 00000100:00100000:0.0:1787397488.584410:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923136 00000100:00100000:0.0:1787397488.584455:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397488.584464:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397488.584637:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923136:12345-0@lo:501:mount.lustre.0 Request processed in 162us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.584645:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397488.584719:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397488.584747:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397488.584787:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.585025:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.585039:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923264 00000100:00100000:0.0:1787397488.585042:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923264 00000100:00100000:0.0:1787397488.585063:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787397488.585068:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397488.585142:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923264:12345-0@lo:503:mount.lustre.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.585148:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787397488.585187:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923264:0@lo:503:mount.lustre.0 00000004:00080000:2.0:1787397488.585602:0:87048:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787397488.586226:0:87069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87069:1874218700923392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397488.586291:0:87069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.586328:0:87069:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.586383:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923392 00000100:00100000:0.0:1787397488.586388:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923392 00000100:00100000:0.0:1787397488.586434:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397488.586442:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87069:x1874218700923392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397488.589686:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:87069:x1874218700923392:12345-0@lo:502:llog_process_th.0 Request processed in 3236us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.589713:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397488.590108:0:87069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87069:1874218700923392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397488.590147:0:87069:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397488.590156:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.590159:0:87069:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787397488.590166:0:87069:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a829b1e800 00000020:00000080:3.0:1787397488.590169:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787397488.590177:0:87069:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397488.590179:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.590180:0:87069:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787397488.590183:0:87069:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397488.590185:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.590186:0:87069:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787397488.590190:0:87069:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a829b1e800 00000020:00000080:3.0:1787397488.590192:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787397488.590300:0:87069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87069:1874218700923520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397488.590355:0:87069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.590401:0:87069:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397488.591084:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923520 00000100:00100000:0.0:1787397488.591093:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923520 00000100:00100000:0.0:1787397488.591138:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397488.591148:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:87069:x1874218700923520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397488.591277:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:87069:x1874218700923520:12345-0@lo:502:llog_process_th.0 Request processed in 130us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397488.591285:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397488.595269:0:87069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87069:1874218700923520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397488.595315:0:87069:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397488.595323:0:87069:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397488.595326:0:87069:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787397488.595330:0:87069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787397488.596038:0:87047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787397488.596066:0:87047:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787397488.596086:0:87047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.596098:0:87047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397488.596152:0:87047:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787397488.596156:0:87047:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a829b1e800 10000000:01000000:1.0:1787397488.596159:0:87047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a829b1e800 10000000:01000000:1.0:1787397488.596163:0:87047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787397488.596169:0:87047:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a829b1e800 from 1 10000000:01000000:1.0:1787397488.596172:0:87047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397488.596218:0:87047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.596233:0:87047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.596246:0:87047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.596268:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397488.596334:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.596373:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397488.597012:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923648 00000100:00100000:2.0:1787397488.597021:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923648 00000100:00100000:2.0:1787397488.597073:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787397488.597082:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:87047:x1874218700923648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397488.597096:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397488.597112:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aba00/0x274786fe0d18fa28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa21 expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.597134:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aba00/0x274786fe0d18fa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa21 expref: 11 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.597144:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aba00/0x274786fe0d18fa28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa21 expref: 11 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.597153:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:2.0:1787397488.597210:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700923648:12345-0@lo:101:mount.lustre.0 Request processed in 129us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.597218:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787397488.597859:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397488.597878:0:87047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.597889:0:87047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.597964:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397488.598000:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.598029:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397488.598821:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923776 00000100:00100000:2.0:1787397488.598830:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923776 00000100:00100000:2.0:1787397488.598873:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397488.598882:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700923776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397488.599025:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700923776:12345-0@lo:501:mount.lustre.0 Request processed in 143us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.599039:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397488.599455:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397488.599499:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397488.599583:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.599611:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397488.600670:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700923904 00000100:00100000:2.0:1787397488.600681:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700923904 00000100:00100000:2.0:1787397488.600739:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397488.600748:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700923904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397488.601157:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700923904:12345-0@lo:503:mount.lustre.0 Request processed in 408us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397488.601166:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397488.601315:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700923904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397488.603300:0:87071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397488.603378:0:87071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397488.603423:0:87071:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397488.604028:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924032 00000100:00100000:3.0:1787397488.604037:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924032 00000100:00100000:3.0:1787397488.604084:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397488.604092:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397488.604241:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924032:12345-0@lo:502:llog_process_th.0 Request processed in 150us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397488.604249:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787397488.605960:0:87071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924032:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787397488.606036:0:87071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787397488.606051:0:87071:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a828c18000) 00000020:00000080:2.0:1787397488.606087:0:87071:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787397488.606278:0:87071:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b1e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787397488.606282:0:87071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a829b1e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787397488.606285:0:87071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a829b1e800 4 00010000:00080000:2.0:1787397488.606313:0:87071:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a81912e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397488.607981:0:87071:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1787397488.608089:0:87071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787397488.608131:0:87071:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787397488.608144:0:87071:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d18fa36 00000100:00080000:2.0:1787397488.608153:0:87071:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787397488.608159:0:87071:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a81912e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397488.608208:0:87071:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350aa00 x1874218700924160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397488.608241:0:87071:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787397488.609835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700924160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397488.609922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.613184:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924160 00000100:00100000:1.0:1787397488.613209:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924160 00000100:00100000:1.0:1787397488.613257:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1787397488.613274:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700924160:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397488.613374:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700924160:12345-0@lo:38:llog_process_th.0 Request processed in 100us (3450us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397488.613382:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1787397488.616109:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397488.616124:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a81912e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397488.616131:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397488.616135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700924160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397488.617989:0:87071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397488.618079:0:87071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.618125:0:87071:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.618413:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924288 00000100:00100000:1.0:1787397488.618421:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924288 00000100:00100000:1.0:1787397488.618476:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787397488.618486:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397488.618654:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924288:12345-0@lo:502:llog_process_th.0 Request processed in 168us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.618662:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787397488.619883:0:87071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397488.620035:0:87071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397488.620093:0:87071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397488.620128:0:87071:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.620214:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924416 00000100:00100000:1.0:1787397488.620220:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924416 00000100:00100000:1.0:1787397488.620261:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397488.620270:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397488.620368:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:87071:x1874218700924416:12345-0@lo:502:llog_process_th.0 Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.620376:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787397488.620544:0:87071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:87071:1874218700924416:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397488.620567:0:87071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787397488.630954:0:87047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787397488.631007:0:87047:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397488.631038:0:87047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397488.631051:0:87047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397488.631121:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787397488.631124:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397488.631125:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.631126:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.631128:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.631129:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.631131:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397488.631132:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397488.631139:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.631140:0:87047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397488.631144:0:87047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787397488.631146:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397488.631147:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397488.631148:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.631149:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.631150:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.631151:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.631152:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397488.631153:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397488.631154:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.631155:0:87047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397488.631185:0:87047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787397488.631217:0:87047:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700924544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397488.631289:0:87047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397488.634594:0:87047:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.635278:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924544 00000100:00100000:1.0:1787397488.635288:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924544 00000100:00100000:1.0:1787397488.635352:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787397488.635362:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700924544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397488.635393:0:87055:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397488.635411:0:87055:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787397488.639063:0:87055:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397488.639081:0:87055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787397488.639360:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:87047:x1874218700924544:12345-0@lo:253:mount.lustre.0 Request processed in 3994us (8065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.639379:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787397488.639471:0:87047:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:87047:1874218700924544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397488.639485:0:87047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787397488.639487:0:87047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397488.639489:0:87047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397488.639491:0:87047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397488.639492:0:87047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397488.639493:0:87047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397488.639495:0:87047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397488.639496:0:87047:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397488.639498:0:87047:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397488.639499:0:87047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397488.639501:0:87047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787397488.639514:0:87047:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787397488.639785:0:87056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397488.639790:0:87056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397488.639812:0:87056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.639828:0:87056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.639848:0:87056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.639880:0:87056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.639972:0:87056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 10 pid: 87053 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.639986:0:87056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87056:1874218700924672:0@lo:104: 00000100:00100000:3.0:1787397488.640023:0:87056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397488.641027:0:87056:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.646663:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924672 00000100:00100000:1.0:1787397488.646674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924672 00000100:00100000:1.0:1787397488.646791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787397488.646801:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:87056:x1874218700924672:12345-0@lo:104: 00010000:00010000:1.0:1787397488.646819:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.647099:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397488.647107:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:87056:x1874218700924672:12345-0@lo:104: Request processed in 308us (7082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.647114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:2.0:1787397488.647506:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397488.647518:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.647549:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397488.647553:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.647561:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397488.647569:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397488.647575:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397488.647616:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.647622:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397488.647647:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.647668:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d18fa05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18fa0c expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397488.647683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397488.647684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397488.647686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397488.647795:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700924800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397488.647844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.647911:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924800 00000100:00100000:1.0:1787397488.647916:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924800 00010000:00010000:1.0:1787397488.647934:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 11 pid: 87053 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397488.647971:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1787397488.647980:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218700924800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397488.647991:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397488.647997:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 11 pid: 87053 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648007:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 11 pid: 87053 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648034:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648043:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397488.648059:0:19657:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008268753s 00010000:00010000:1.0:1787397488.648064:0:19657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648071:0:19657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648078:0:19657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648084:0:19657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648090:0:19657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397488.648094:0:19657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648102:0:19657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648110:0:19657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397488.648118:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397488.648148:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218700924800:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.648161:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1787397488.648237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700924800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397488.653433:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55000/0x274786fe0d18fa0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d18fa05 expref: 10 pid: 87053 timeout: 3467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397488.653455:0:87056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87056:1874218700924672:0@lo:104: 00010000:00010000:3.0:1787397488.653481:0:87056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.653492:0:87056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.653498:0:87056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397488.653504:0:87056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63c00/0x274786fe0d18fa3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787397488.663653:0:87047:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:1.0:1787397488.664045:0:87047:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787397488.667963:0:87078:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397488.668329:0:87047:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787397488.668687:0:87079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700924928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.668765:0:87079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.668807:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700924928 00000100:00100000:1.0:1787397488.668813:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700924928 00000100:00100000:1.0:1787397488.668859:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1787397488.668868:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700924928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.668952:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700924928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.668959:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1787397488.668984:0:87079:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.669009:0:87079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700924928:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787397488.669038:0:87079:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787397488.669062:0:87079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700925056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.669091:0:87079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.669109:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925056 00000100:00100000:1.0:1787397488.669113:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925056 00000100:00100000:1.0:1787397488.669133:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1787397488.669139:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700925056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.669242:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700925056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.669261:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1787397488.669280:0:87079:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.669295:0:87079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700925056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.669346:0:87079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700925184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.669371:0:87079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397488.669390:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925184 00000100:00100000:1.0:1787397488.669393:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925184 00000100:00100000:1.0:1787397488.669415:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1787397488.669421:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700925184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397488.669462:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87079:x1874218700925184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397488.669469:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1787397488.669485:0:87079:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397488.669497:0:87079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87079:1874218700925184:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787397488.669570:0:87079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397488.671363:0:87079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787397488.671453:0:87079:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787397488.672539:0:87047:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787397488.672587:0:87047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787397488.673064:0:87047:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787397488.673071:0:87047:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787397488.673103:0:87047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397488.674018:0:87047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787397488.674589:0:87047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787397488.674714:0:87047:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787397488.674821:0:87047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787397488.675285:0:87077:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:3.0:1787397488.675304:0:87077:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:00080000:0.0:1787397488.678129:0:87078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787397488.679324:0:87047:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:0.0:1787397488.680557:0:87078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787397488.680681:0:87078:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787397488.680687:0:87078:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1787397488.684456:0:87047:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:0.0:1787397488.687721:0:87080:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87080 00010000:02000000:0.0:1787397488.687739:0:87080:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1787397488.687742:0:87080:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787397488.687746:0:87080:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1787397488.688349:0:87047:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787397488.688370:0:87047:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787397488.688389:0:87047:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787397488.688417:0:87047:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787397488.691405:0:87047:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397488.691738:0:87047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1787397489.188828:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397489.188836:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a829b1e800 from 108 10000000:01000000:0.0:1787397489.188842:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397489.188897:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.188908:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.188919:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.188946:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.189024:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.189085:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397489.190271:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925312 00000100:00100000:3.0:1787397489.190283:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925312 00000100:00100000:3.0:1787397489.190350:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397489.190362:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218700925312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397489.190378:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397489.190396:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62000/0x274786fe0d18fa4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa44 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.190424:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62000/0x274786fe0d18fa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa44 expref: 11 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.190435:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62000/0x274786fe0d18fa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa44 expref: 11 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.190443:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:3.0:1787397489.190552:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700925312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.190561:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787397489.191041:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.191072:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.191082:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.191151:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.191199:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.191235:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.191351:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925440 00000100:00100000:2.0:1787397489.191355:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925440 00000100:00100000:2.0:1787397489.191396:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787397489.191403:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700925440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397489.191418:0:87053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787397489.191433:0:87053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397489.191436:0:87053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:2.0:1787397489.191509:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700925440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.191515:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397489.192235:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787397489.192295:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397489.192304:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.192313:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.192322:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397489.192325:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:0.0:1787397489.192327:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397489.192352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.192359:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.192367:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.192383:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.192422:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.192455:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397489.194850:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925568 00000100:00100000:3.0:1787397489.194864:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925568 00000100:00100000:3.0:1787397489.194925:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787397489.194947:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700925568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397489.194963:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397489.194981:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63600/0x274786fe0d18fa59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa52 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.195009:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63600/0x274786fe0d18fa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa52 expref: 12 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.195020:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63600/0x274786fe0d18fa59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa52 expref: 12 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.195029:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63600, rc 0) 00000100:00100000:3.0:1787397489.195107:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.195113:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787397489.195776:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.195805:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.195816:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.195915:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.195955:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.195990:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397489.196010:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925696 00000100:00100000:0.0:1787397489.196014:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925696 00000100:00100000:0.0:1787397489.196060:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787397489.196069:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.196194:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.196202:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787397489.196236:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.196261:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.196300:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.196322:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397489.196603:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925824 00000100:00100000:3.0:1787397489.196607:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925824 00000100:00100000:3.0:1787397489.196632:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397489.196639:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397489.196721:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.196728:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787397489.196741:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397489.198413:0:87099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787397489.198920:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787397489.198947:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397489.198959:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.198983:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397489.198994:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397489.198996:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 105 10000000:01000000:2.0:1787397489.198999:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397489.199035:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.199043:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.199066:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.199088:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.199148:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.199193:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703e899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397489.199365:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700925952 00000100:00100000:3.0:1787397489.199372:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700925952 00000100:00100000:3.0:1787397489.199420:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787397489.199431:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700925952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397489.199444:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397489.199457:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63200/0x274786fe0d18fa67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa60 expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.199490:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63200/0x274786fe0d18fa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa60 expref: 13 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.199502:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63200/0x274786fe0d18fa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa60 expref: 13 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.199511:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:3.0:1787397489.199711:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700925952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.199719:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787397489.200316:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700925952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.200333:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.200342:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.200395:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.200434:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.200467:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703e899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397489.200646:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926080 00000100:00100000:3.0:1787397489.200652:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926080 00000100:00100000:3.0:1787397489.203971:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397489.203996:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700926080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397489.204026:0:87058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787397489.204052:0:87058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397489.204056:0:87058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1787397489.204060:0:87058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1787397489.204063:0:87058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1787397489.204065:0:87058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:3.0:1787397489.204231:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700926080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (3795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.204239:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787397489.204271:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787397489.204354:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397489.204365:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.204376:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397489.204384:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397489.204387:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1787397489.204390:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397489.204421:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.204430:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.204440:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.204459:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.204489:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.213853:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926208 00000100:00100000:0.0:1787397489.213870:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926208 00000100:00100000:0.0:1787397489.213940:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397489.213951:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700926208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.213966:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397489.213986:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55c00/0x274786fe0d18fa75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa6e expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.214034:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55c00/0x274786fe0d18fa75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa6e expref: 14 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.214045:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55c00/0x274786fe0d18fa75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa6e expref: 14 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.214054:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55c00, rc 0) 00000100:00100000:0.0:1787397489.214132:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (9641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.214139:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787397489.214415:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703e899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.214438:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.214453:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.214463:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.214729:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.214765:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.214878:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703e899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.214946:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926336 00000100:00100000:1.0:1787397489.214951:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926336 00000100:00100000:0.0:1787397489.215054:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397489.215063:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.215305:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.215313:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787397489.215391:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397489.215423:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397489.215463:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397489.215500:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.215879:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926464 00000100:00100000:2.0:1787397489.215885:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926464 00000100:00100000:2.0:1787397489.215917:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787397489.215924:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7025df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.218828:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7025df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2893us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.218843:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397489.220744:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397489.231664:0:87100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1787397489.232034:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1787397489.232063:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787397489.232076:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.232091:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397489.232102:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1787397489.232105:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:3.0:1787397489.232108:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787397489.232151:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.232174:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.232194:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397489.232220:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397489.232290:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397489.232334:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.232543:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926592 00000100:00100000:1.0:1787397489.232558:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926592 00000100:00100000:1.0:1787397489.232602:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787397489.232611:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700926592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.232625:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397489.232639:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052efa00/0x274786fe0d18fa83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa7c expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.232680:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052efa00/0x274786fe0d18fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa7c expref: 15 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.232692:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052efa00/0x274786fe0d18fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa7c expref: 15 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.232701:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052efa00, rc 0) 00000100:00100000:1.0:1787397489.232753:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700926592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.232760:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787397489.235064:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.235091:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.235104:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.235124:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787397489.235129:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.235148:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.235157:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787397489.235160:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:0.0:1787397489.235162:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787397489.235201:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.235208:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.235217:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.235235:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.235289:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.235328:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.235764:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926720 00000100:00100000:2.0:1787397489.235772:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926720 00000100:00100000:2.0:1787397489.235820:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787397489.235828:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700926720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.235843:0:87055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397489.235856:0:87055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab600/0x274786fe0d18fa91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa8a expref: -99 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.235875:0:87055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab600/0x274786fe0d18fa91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa8a expref: 16 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.235885:0:87055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab600/0x274786fe0d18fa91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa8a expref: 16 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.235894:0:87055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:2.0:1787397489.235944:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700926720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.235958:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787397489.235994:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397489.236007:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397489.236027:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397489.236090:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397489.236118:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397489.236148:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.236412:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926848 00000100:00100000:2.0:1787397489.236417:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926848 00000100:00100000:2.0:1787397489.236452:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787397489.236459:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700926848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.236608:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700926848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.236626:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787397489.236897:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.236934:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.236977:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.237007:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.237420:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700926976 00000100:00100000:2.0:1787397489.237426:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700926976 00000100:00100000:2.0:1787397489.237467:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787397489.237474:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700926976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.237604:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700926976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.237611:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787397489.237666:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700926976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397489.238575:0:87101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397489.242239:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397489.242284:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397489.242296:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.242310:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.242320:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397489.242323:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:0.0:1787397489.242326:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397489.242383:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.242392:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.242403:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.242428:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.242498:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.242559:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.243143:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927104 00000100:00100000:2.0:1787397489.243152:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927104 00000100:00100000:2.0:1787397489.243218:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787397489.243228:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700927104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.243243:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397489.243258:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d18fa9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fa98 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.243283:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d18fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fa98 expref: 17 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.243305:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab200/0x274786fe0d18fa9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fa98 expref: 17 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.243314:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:2.0:1787397489.243363:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.243370:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787397489.247389:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.247419:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.247433:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397489.247519:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.247607:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.247652:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397489.250817:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927232 00000100:00100000:0.0:1787397489.250831:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927232 00000100:00100000:0.0:1787397489.250889:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787397489.250899:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83660e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.251079:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83660e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.251087:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787397489.253128:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.253202:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.253272:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.253308:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.253333:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927360 00000100:00100000:2.0:1787397489.253339:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927360 00000100:00100000:2.0:1787397489.253388:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397489.253397:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.253505:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.253513:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397489.253585:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397489.255710:0:87103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787397489.256068:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787397489.256092:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397489.256103:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.256114:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397489.256132:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787397489.256134:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787397489.256137:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397489.256175:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.256193:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.256205:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.256229:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.256290:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.256335:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.256386:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927488 00000100:00100000:1.0:1787397489.256394:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927488 00000100:00100000:2.0:1787397489.257219:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787397489.257233:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700927488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.257250:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397489.257266:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050abc00/0x274786fe0d18faad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18faa6 expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.257290:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050abc00/0x274786fe0d18faad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18faa6 expref: 18 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.257301:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050abc00/0x274786fe0d18faad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18faa6 expref: 18 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.257309:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:2.0:1787397489.257412:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.257419:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787397489.257508:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.257558:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.257569:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.257645:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.257677:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.257710:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.258175:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927616 00000100:00100000:2.0:1787397489.258191:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927616 00000100:00100000:2.0:1787397489.258237:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787397489.258245:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.258397:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.258404:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787397489.258477:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.258513:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.258734:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.258765:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.258970:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927744 00000100:00100000:2.0:1787397489.258975:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927744 00000100:00100000:2.0:1787397489.259010:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787397489.259017:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.260624:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1591us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.260637:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397489.261027:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397489.263032:0:87104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1787397489.263969:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787397489.264000:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787397489.264012:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.264025:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397489.264036:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787397489.264039:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:1.0:1787397489.264042:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787397489.264086:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.264094:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.264104:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397489.264128:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.264206:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.264290:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397489.264332:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700927872 00000100:00100000:0.0:1787397489.264340:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700927872 00000100:00100000:0.0:1787397489.264846:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787397489.264858:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700927872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.264873:0:87055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397489.264907:0:87055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54000/0x274786fe0d18fabb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fab4 expref: -99 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.264932:0:87055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54000/0x274786fe0d18fabb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fab4 expref: 19 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.264943:0:87055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54000/0x274786fe0d18fabb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fab4 expref: 19 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.264951:0:87055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54000, rc 0) 00000100:00100000:0.0:1787397489.264996:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700927872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.265004:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787397489.268162:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700927872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.268199:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.268225:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397489.268314:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.268376:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.268417:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.268440:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928000 00000100:00100000:1.0:1787397489.268446:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928000 00000100:00100000:1.0:1787397489.268499:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397489.268507:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700928000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.268665:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700928000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.268674:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397489.268714:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.268737:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.268774:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.268787:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.268799:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928128 00000100:00100000:1.0:1787397489.268803:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928128 00000100:00100000:1.0:1787397489.268823:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397489.268828:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8130f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700928128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.268899:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8130f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700928128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.268905:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397489.268949:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397489.270102:0:87106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787397489.270478:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787397489.270505:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397489.270515:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.278947:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397489.278960:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397489.278963:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:2.0:1787397489.278966:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397489.279014:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.279022:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.279033:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.279419:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.279493:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.279742:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928256 00000100:00100000:1.0:1787397489.279750:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928256 00000100:00100000:1.0:1787397489.279808:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397489.279818:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8130fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700928256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.279833:0:87058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397489.279850:0:87058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052eea00/0x274786fe0d18fac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fac2 expref: -99 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.279874:0:87058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052eea00/0x274786fe0d18fac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fac2 expref: 20 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.279885:0:87058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052eea00/0x274786fe0d18fac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fac2 expref: 20 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.279895:0:87058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052eea00, rc 0) 00000100:00100000:1.0:1787397489.279931:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8130fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.279939:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787397489.280135:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.280159:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.280173:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.280191:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397489.280256:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.280283:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.280345:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397489.285821:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928384 00000100:00100000:0.0:1787397489.285840:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928384 00000100:00100000:0.0:1787397489.287565:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397489.287581:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8130f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.287742:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8130f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.287756:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787397489.290301:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.290368:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.290445:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397489.290563:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397489.297066:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928512 00000100:00100000:0.0:1787397489.297081:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928512 00000100:00100000:0.0:1787397489.297149:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787397489.297160:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.297336:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397489.297344:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787397489.297785:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397489.298724:0:87108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1787397489.301093:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1787397489.301134:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397489.301146:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.301158:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.301167:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787397489.301170:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1787397489.301172:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787397489.301219:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.301227:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.301238:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.301262:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.301335:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.301371:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.301681:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928640 00000100:00100000:1.0:1787397489.301689:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928640 00000100:00100000:2.0:1787397489.301952:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787397489.301962:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700928640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.301975:0:87058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397489.301990:0:87058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa800/0x274786fe0d18fad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fad0 expref: -99 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.302014:0:87058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa800/0x274786fe0d18fad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fad0 expref: 21 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.302026:0:87058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa800/0x274786fe0d18fad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fad0 expref: 21 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.302036:0:87058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa800, rc 0) 00000100:00100000:2.0:1787397489.302093:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700928640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.302101:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787397489.303563:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.303592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.303604:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.303687:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.303737:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.303773:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.303974:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928768 00000100:00100000:2.0:1787397489.303981:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928768 00000100:00100000:2.0:1787397489.304020:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787397489.304028:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700928768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.304203:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700928768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.304212:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397489.304341:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.304370:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.304413:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.304442:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.304588:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700928896 00000100:00100000:2.0:1787397489.304593:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700928896 00000100:00100000:2.0:1787397489.304623:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397489.304631:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700928896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.305894:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700928896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1258us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.305906:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397489.306330:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700928896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397489.310741:0:87109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1787397489.311660:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787397489.311690:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787397489.311703:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.311720:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397489.311730:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787397489.311733:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:1.0:1787397489.311735:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787397489.311774:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.311782:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.311792:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397489.311817:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.311884:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397489.311929:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.312143:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929024 00000100:00100000:2.0:1787397489.312151:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929024 00000100:00100000:2.0:1787397489.312209:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787397489.312219:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700929024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397489.312233:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397489.312248:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab800/0x274786fe0d18fae5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fade expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.312272:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab800/0x274786fe0d18fae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fade expref: 22 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.312283:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab800/0x274786fe0d18fae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fade expref: 22 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397489.312291:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab800, rc 0) 00000100:00100000:2.0:1787397489.312339:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.312346:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787397489.312393:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.312409:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.312417:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.312477:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.312504:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.312539:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.312580:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929152 00000100:00100000:1.0:1787397489.312584:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929152 00000100:00100000:1.0:1787397489.312619:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397489.312626:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.312731:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.312755:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787397489.312800:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.312828:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.312865:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.312900:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:2.0:1787397489.313313:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929280 00000100:00100000:2.0:1787397489.313319:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929280 00000100:00100000:2.0:1787397489.313418:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397489.313427:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397489.314241:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 812us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397489.314257:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787397489.316164:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397489.322115:0:87111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397489.323247:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397489.323285:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397489.323296:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.323309:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.323319:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1787397489.323322:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:0.0:1787397489.323324:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787397489.323364:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.323372:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.323382:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.323409:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.323477:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.323519:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.324071:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929408 00000100:00100000:1.0:1787397489.324080:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929408 00000100:00100000:1.0:1787397489.324140:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397489.324149:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700929408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.324162:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397489.324187:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ee400/0x274786fe0d18faf3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18faec expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.324212:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ee400/0x274786fe0d18faf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18faec expref: 23 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.324222:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ee400/0x274786fe0d18faf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18faec expref: 23 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.324231:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ee400, rc 0) 00000100:00100000:1.0:1787397489.324277:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700929408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.324284:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787397489.324718:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.324733:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.324759:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.324781:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787397489.324785:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.324806:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397489.324814:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787397489.324815:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:0.0:1787397489.324817:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787397489.324837:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.324844:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.324851:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.324866:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.324899:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.324930:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.325033:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929536 00000100:00100000:1.0:1787397489.325038:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929536 00000100:00100000:1.0:1787397489.325081:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787397489.325097:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700929536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397489.325105:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397489.325115:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ee800/0x274786fe0d18fb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fafa expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.325143:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ee800/0x274786fe0d18fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fafa expref: 24 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.325151:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ee800/0x274786fe0d18fb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fafa expref: 24 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397489.325158:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ee800, rc 0) 00000100:00100000:1.0:1787397489.325196:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700929536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.325203:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787397489.325367:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397489.325378:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.325398:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397489.325449:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397489.325475:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397489.325497:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397489.325555:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929664 00000100:00100000:1.0:1787397489.325560:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929664 00000100:00100000:1.0:1787397489.325586:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397489.325592:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700929664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397489.325664:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700929664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397489.325671:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397489.325876:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700929664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787397489.325904:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787397489.325910:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.325918:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397489.445701:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397489.939288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397489.939394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397489.939755:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129216 00000100:00100000:3.0:1787397489.939767:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129216 00000100:00100000:3.0:1787397489.939824:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:3.0:1787397489.939833:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1874218681129216:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:3.0:1787397489.939863:0:87054:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 367372d5-1a70-4e8f-8f10-c0f943f3662d@192.168.204.60@tcp t0 exp 0000000000000000 cur 3369 last 0 00000020:00000080:3.0:1787397489.939895:0:87054:0:(genops.c:1406:class_connect()) connect: client 367372d5-1a70-4e8f-8f10-c0f943f3662d, cookie 0x274786fe0d18fb08 00000100:00080000:3.0:1787397489.940028:0:87054:0:(import.c:65:import_set_state_nolock()) ffff89a830a0b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397489.940094:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:2401:x1874218681129216:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 260us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.940103:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:1.0:1787397489.941045:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129472 00000100:00100000:1.0:1787397489.941056:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129472 00000100:00100000:1.0:1787397489.941126:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1093 00000100:00100000:1.0:1787397489.941135:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681129472:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397489.941206:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681129472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 71us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397489.941214:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1093 00000100:00080000:2.0:1787397489.941327:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397489.943055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397489.943148:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129344 00000100:00100000:3.0:1787397489.943155:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129344 00000100:00100000:3.0:1787397489.943230:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1115 00000100:00100000:3.0:1787397489.943238:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681129344:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:3.0:1787397489.943278:0:66177:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e90f04db-6a63-4f01-92c7-7bf813f9f081' at ffff89a83ae94800, cookie 0x274786fe0d18f98e 00010000:00080000:3.0:1787397489.943284:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp recovering/t98784247813 exp ffff89a83ae94800 cur 3369 last 1787397488 00010000:02000400:3.0:1787397489.943291:0:66177:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1787397489.943303:0:66177:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787397489.943330:0:66177:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787397489.943469:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397489.943554:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681129344:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 316us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397489.943562:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1115 00000100:00100000:0.0:1787397489.958071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397489.959416:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123072 00000100:00100000:2.0:1787397489.959429:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123072 00000100:00100000:2.0:1787397489.959488:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1116 00000100:00100000:2.0:1787397489.959498:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681123072:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:2.0:1787397489.959542:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:2.0:1787397489.959556:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681123072:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 60us (1493us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397489.959562:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1116 00010000:00080000:0.0:1787397489.962814:0:87080:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1787397490.471564:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397490.663387:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397490.663413:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700929792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397490.663490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397490.663567:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929792 00000100:00100000:0.0:1787397490.663576:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929792 00000100:00100000:0.0:1787397490.663649:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1787397490.663670:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700929792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397490.663931:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397490.663993:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700929792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 336us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397490.664087:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00080000:0.0:1787397490.664110:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397490.664149:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700929792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397490.665242:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397490.665258:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700929920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397490.665318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397490.665423:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700929920 00000100:00100000:2.0:1787397490.665432:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700929920 00000100:00100000:2.0:1787397490.665500:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1787397490.665511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700929920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397490.665560:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397490.665628:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700929920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397490.665636:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1787397490.665710:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700929920:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787397490.669337:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787397491.494976:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397491.717473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397491.717569:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129600 00000100:00100000:1.0:1787397491.717593:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129600 00000100:00100000:1.0:1787397491.717667:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:1.0:1787397491.717680:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:42362:x1874218681129600:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397491.717702:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397491.717733:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052eee00/0x274786fe0d18fb0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e8c expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.717774:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052eee00/0x274786fe0d18fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e8c expref: 6 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.717788:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052eee00/0x274786fe0d18fb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e8c expref: 6 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.717800:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052eee00, rc 0) 00000100:00100000:1.0:1787397491.717876:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681129600:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 198us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397491.717885:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:0.0:1787397491.722992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397491.723158:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129728 00000100:00100000:1.0:1787397491.723174:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129728 00000100:00100000:1.0:1787397491.723247:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:1.0:1787397491.723260:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681129728:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397491.723298:0:87054:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787397491.723331:0:87054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397491.723336:0:87054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787397491.723340:0:87054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787397491.723343:0:87054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787397491.723345:0:87054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:1.0:1787397491.730464:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681129728:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 7188us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397491.730495:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787397491.736927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397491.737126:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129856 00000100:00100000:2.0:1787397491.737161:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129856 00000100:00100000:2.0:1787397491.737387:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787397491.737399:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681129856:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397491.737437:0:87055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397491.737464:0:87055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aae00/0x274786fe0d18fb16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e93 expref: -99 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.737501:0:87055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aae00/0x274786fe0d18fb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e93 expref: 7 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.737513:0:87055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aae00/0x274786fe0d18fb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e93 expref: 7 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.737790:0:87055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aae00, rc 0) 00000100:00100000:2.0:1787397491.737914:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681129856:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 515us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397491.737922:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787397491.751562:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397491.751821:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681129984 00000100:00100000:3.0:1787397491.751836:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681129984 00000100:00100000:3.0:1787397491.751986:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787397491.751998:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681129984:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397491.752293:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681129984:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 295us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397491.754154:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787397491.758696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397491.758805:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130112 00000100:00100000:0.0:1787397491.758819:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130112 00000100:00100000:0.0:1787397491.758986:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:0.0:1787397491.758999:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681130112:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397491.759202:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681130112:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 204us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397491.759211:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:0.0:1787397491.769274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397491.776930:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130240 00000100:00100000:2.0:1787397491.776957:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130240 00000100:00100000:2.0:1787397491.777046:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:2.0:1787397491.777059:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681130240:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397491.777084:0:87054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397491.777111:0:87054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aac00/0x274786fe0d18fb1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e9a expref: -99 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.777164:0:87054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aac00/0x274786fe0d18fb1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e9a expref: 9 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.777177:0:87054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aac00/0x274786fe0d18fb1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e9a expref: 9 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397491.777201:0:87054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:2.0:1787397491.777299:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130240:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 242us (8040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397491.777321:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:0.0:1787397491.782129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397491.782236:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130368 00000100:00100000:2.0:1787397491.782256:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130368 00000100:00100000:2.0:1787397491.782435:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787397491.782449:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130368:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397491.782709:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130368:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 262us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397491.782718:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787397491.788244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397491.788445:0:87054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130496 00000100:00100000:3.0:1787397491.788459:0:87054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130496 00000100:00100000:3.0:1787397491.788565:0:87054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787397491.788577:0:87054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130496:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397491.788989:0:87054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130496:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 412us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397491.789000:0:87054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:0.0:1787397491.806367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397491.808444:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130624 00000100:00100000:1.0:1787397491.808466:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130624 00000100:00100000:1.0:1787397491.808790:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:1.0:1787397491.808805:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681130624:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397491.808829:0:87053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397491.808853:0:87053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052eec00/0x274786fe0d18fb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ea1 expref: -99 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.808902:0:87053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052eec00/0x274786fe0d18fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea1 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.808917:0:87053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052eec00/0x274786fe0d18fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea1 expref: 10 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397491.808929:0:87053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052eec00, rc 0) 00000100:00100000:1.0:1787397491.809021:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681130624:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 220us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397491.809030:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:0.0:1787397491.814400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397491.815069:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130752 00000100:00100000:2.0:1787397491.815084:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130752 00000100:00100000:2.0:1787397491.815413:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:2.0:1787397491.815426:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681130752:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397491.815611:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681130752:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 187us (1227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397491.815621:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00010000:00010000:1.0:1787397492.519749:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397493.542906:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397493.734570:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397493.734597:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700930048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397493.734672:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397493.734718:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930048 00000100:00100000:2.0:1787397493.734736:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930048 00000100:00100000:2.0:1787397493.734785:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1787397493.734950:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700930048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397493.734986:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397493.735177:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700930048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 240us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397493.735187:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1787397493.735239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700930048:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787397493.737938:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397493.737955:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397493.737958:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397493.737966:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1787397493.737971:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397493.737978:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397493.738020:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a836691180 x1874218700930304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397493.738046:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397493.738050:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397493.738052:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397493.738055:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1787397493.738057:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397493.738061:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397493.738073:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd7100 x1874218700930560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397493.738109:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397493.738113:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397493.738115:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397493.738118:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1787397493.738121:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397493.738125:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397493.738137:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4a80 x1874218700930816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397493.738162:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397493.738165:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397493.738166:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397493.738170:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1787397493.738172:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397493.738175:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397493.738196:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835750700 x1874218700931200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397493.738218:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787397493.738221:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397493.738223:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a81912e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397493.738228:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a81912e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397493.738239:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7030c0380 x1874218700931584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397493.738273:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700930176:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700931072:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738454:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397493.738461:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700930432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738510:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700931328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700930304:0@lo:38:kworker.0 00000100:00100000:1.0:1787397493.738614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700930560:0@lo:38:kworker.0 00000100:00100000:1.0:1787397493.738651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738669:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700930816:0@lo:38:kworker.0 00000100:00100000:1.0:1787397493.738692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700931200:0@lo:38:kworker.0 00000100:00100000:1.0:1787397493.738738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738757:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700931584:0@lo:38:kworker.0 00000100:00100000:1.0:1787397493.738782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738828:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700930944:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738867:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787397493.738872:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700930688:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738893:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738910:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700931456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.738932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.738961:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930176 00000100:00100000:1.0:1787397493.738968:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930176 00000100:00100000:1.0:1787397493.739007:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787397493.739017:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.739062:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700930176:12345-0@lo:400:kworker.0 Request processed in 46us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739070:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787397493.739123:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930432 00000100:00100000:1.0:1787397493.739127:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930432 00000100:00100000:1.0:1787397493.739151:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930304 00000100:00100000:1.0:1787397493.739153:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930304 00000100:00100000:1.0:1787397493.739162:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930560 00000100:00100000:1.0:1787397493.739164:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930560 00000100:00100000:1.0:1787397493.739170:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931200 00000100:00100000:1.0:1787397493.739172:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931200 00000100:00100000:1.0:1787397493.739179:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931584 00000100:00100000:1.0:1787397493.739181:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931584 00000100:00100000:1.0:1787397493.739187:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1787397493.739201:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.739233:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700930432:12345-0@lo:400:kworker.0 Request processed in 33us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739239:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1787397493.739251:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930688 00000100:00100000:1.0:1787397493.739254:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930688 00000100:00100000:1.0:1787397493.739269:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1787397493.739274:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.739307:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700930688:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739312:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1787397493.739324:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1787397493.739328:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700930304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.739352:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:1.0:1787397493.739394:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d18fb2b 00000004:00100000:1.0:1787397493.739410:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397493.739570:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a817efa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397493.739612:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218700930304:12345-0@lo:38:kworker.0 Request processed in 282us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739618:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1787397493.739632:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1787397493.739636:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700930560:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.739649:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:1.0:1787397493.739672:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d18fb32 00000004:00100000:1.0:1787397493.739678:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397493.739705:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a803e9b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397493.739734:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218700930560:12345-0@lo:38:kworker.0 Request processed in 96us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739740:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1787397493.739753:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1787397493.739757:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700931200:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.739768:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:1.0:1787397493.739792:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d18fb39 00000004:00100000:1.0:1787397493.739798:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397493.739811:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a836716000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397493.739835:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218700931200:12345-0@lo:38:kworker.0 Request processed in 76us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739841:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1787397493.739853:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1787397493.739857:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700931584:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.739870:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3373 last 0 00000020:00000080:1.0:1787397493.739890:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d18fb40 00000004:00100000:1.0:1787397493.739896:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397493.739910:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a836715800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397493.739935:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700931584:12345-0@lo:38:kworker.0 Request processed in 77us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.739941:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1787397493.739981:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931072 00000100:00100000:1.0:1787397493.739986:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931072 00000100:00100000:1.0:1787397493.740011:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931328 00000100:00100000:1.0:1787397493.740014:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931328 00000100:00100000:1.0:1787397493.740040:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930944 00000100:00100000:1.0:1787397493.740043:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930944 00000100:00100000:1.0:1787397493.740058:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931456 00000100:00100000:1.0:1787397493.740060:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931456 00000100:00100000:1.0:1787397493.740078:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1787397493.740084:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700931072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740132:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700931072:12345-0@lo:400:kworker.0 Request processed in 48us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.740138:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1787397493.740150:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:1.0:1787397493.740156:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740182:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700931328:12345-0@lo:400:kworker.0 Request processed in 26us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.740188:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:1.0:1787397493.740200:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1787397493.740206:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700930944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740230:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700930944:12345-0@lo:400:kworker.0 Request processed in 24us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.740236:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1787397493.740246:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1787397493.740251:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740274:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700931456:12345-0@lo:400:kworker.0 Request processed in 22us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397493.740279:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1787397493.740323:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700930688:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740336:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700931456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.740355:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700930944:0@lo:400:kworker.0 00010000:00080000:1.0:1787397493.740399:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a836691180 x1874218700930304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.740409:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:0.0:1787397493.741307:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700930816 00000100:00100000:0.0:1787397493.741316:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700930816 00000100:00100000:0.0:1787397493.741358:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1787397493.741363:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700930816:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397493.741403:0:23942:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a83ae92000, cookie 0x274786fe0d18f995 00010000:00080000:0.0:1787397493.741409:0:23942:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff89a83ae92000 cur 3373 last 1787397488 00000004:00100000:0.0:1787397493.741423:0:23942:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397493.741449:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a817ecf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397493.741504:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700930816:12345-0@lo:38:kworker.0 Request processed in 139us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397493.741511:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00080000:0.0:1787397493.741561:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397493.741566:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397493.741568:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787397493.741577:0:87080:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787397493.741582:0:87080:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:0.0:1787397493.741586:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.741590:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:0.0:1787397493.741593:0:87080:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:0.0:1787397493.741595:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.741604:0:87080:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681123072 t98784247813 from 192.168.204.60@tcp req@ffff89a827b7b100 x1874218681123072/t0(98784247813) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:685/0 lens 528/0 e 0 to 0 dl 1787397500 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.753497:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a836691180 x1874218700930304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.753513:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397493.753541:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397493.753547:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397493.753554:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700930304:0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.753600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a82ebd7100 x1874218700930560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.753617:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000004:00080000:3.0:1787397493.754106:0:87080:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12455us 00000100:00080000:1.0:1787397493.760926:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a82ebd7100 x1874218700930560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.761011:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397493.761017:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397493.761022:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397493.761028:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700930560:0@lo:38:kworker.0 00000100:00080000:1.0:1787397493.761080:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1787397493.761103:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787397493.761107:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787397493.761110:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1787397493.761127:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1787397493.761130:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1787397493.761273:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700930432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.761289:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700931328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.761300:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700930176:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.761313:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700931072:0@lo:400:kworker.0 00000100:00100000:1.0:1787397493.761374:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700930816:0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.761389:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835750700 x1874218700931200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.761399:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1787397493.766930:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a835750700 x1874218700931200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397518 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.767076:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397493.767082:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397493.767087:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397493.767104:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700931200:0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.767144:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a7030c0380 x1874218700931584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397493.767161:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:1.0:1787397493.767171:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787397493.767176:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787397493.767178:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a81912e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787397493.767182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700931584:0@lo:38:kworker.0 00010000:00080000:1.0:1787397493.767250:0:87292:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1787397493.767255:0:87292:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1787397493.767260:0:87292:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1787397493.768184:0:87292:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787397493.768246:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700931712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787397493.768312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397493.768469:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931712 00000100:00100000:2.0:1787397493.768477:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931712 00000100:00100000:2.0:1787397493.768548:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1787397493.768557:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700931712:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787397493.768576:0:8445:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a803421f80 x1874218700931712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:689/0 lens 224/0 e 0 to 0 dl 1787397504 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397493.768587:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700931712:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (276us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397493.769020:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00010000:00010000:3.0:1787397493.795680:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.795717:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.795731:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.795746:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.795753:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.795760:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800440:0:87080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800460:0:87080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800468:0:87080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800475:0:87080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397493.800479:0:87080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800487:0:87080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800505:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81301c300) 00010000:00010000:3.0:1787397493.800538:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397493.800544:0:87080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800550:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d18fb47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397493.800572:0:87080:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1ad955c reply state 00000000ed9012c7 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800585:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.800607:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81301cc00) 00010000:00010000:3.0:1787397493.800609:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397493.800612:0:87080:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397493.800822:0:87080:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397493.801049:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.801054:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:3.0:1787397493.801058:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.801060:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:3.0:1787397493.809182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397493.809219:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681123584 00000100:00100000:3.0:1787397493.809228:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681123584 00000100:00100000:3.0:1787397493.809287:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1121 00000100:00100000:3.0:1787397493.809299:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681123584:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:3.0:1787397493.809321:0:67264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1787397493.809333:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681123584:12345-192.168.204.60@tcp:36:rm.0 Request processed in 38us (163us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397493.809340:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1121 00000020:00080000:2.0:1787397493.820458:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397493.820469:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1787397493.820474:0:87080:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1787397493.820478:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397493.820494:0:87080:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681123584 t98784247814 from 192.168.204.60@tcp req@ffff89a8179a1880 x1874218681123584/t0(98784247814) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 512/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787397493.823927:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.823974:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.823989:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824001:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824009:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824015:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824125:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824133:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824139:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824393:0:87080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824400:0:87080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824406:0:87080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824422:0:87080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397493.824426:0:87080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824434:0:87080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824448:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff89a835da1900) 00010000:00010000:2.0:1787397493.824451:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397493.824455:0:87080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824461:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fb63 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824484:0:87080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824491:0:87080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824496:0:87080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824500:0:87080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397493.824503:0:87080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.824509:0:87080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.825233:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1c00) 00010000:00010000:2.0:1787397493.825236:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397493.825241:0:87080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.825247:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fb55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397493.825264:0:87080:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000360f4e56 reply state 00000000cdb9c611 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.825274:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.825281:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81301cc00) 00010000:00010000:2.0:1787397493.825283:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397493.825286:0:87080:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787397493.825434:0:87080:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397493.825460:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397493.825463:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1787397493.825467:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397493.825469:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000001:00080000:2.0:1787397493.827500:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:2.0:1787397493.828730:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828745:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828752:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828765:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397493.828770:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828778:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828797:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81301cc00) 00010000:00010000:2.0:1787397493.828800:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397493.828805:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397493.828811:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d18fb4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397493.837827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397493.838152:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124736 00000100:00100000:3.0:1787397493.838162:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124736 00000100:00100000:3.0:1787397493.838217:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1122 00000100:00100000:3.0:1787397493.838226:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681124736:12345-192.168.204.60@tcp:101:touch.0 00010000:00080000:3.0:1787397493.838249:0:66178:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:3.0:1787397493.838263:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681124736:12345-192.168.204.60@tcp:101:touch.0 Request processed in 39us (446us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397493.838271:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1122 00000020:00080000:3.0:1787397493.838288:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.838293:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:3.0:1787397493.838297:0:87080:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:3.0:1787397493.838300:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.838309:0:87080:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681124736 t98784247815 from 192.168.204.60@tcp req@ffff89a80fe53480 x1874218681124736/t0(98784247815) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 752/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787397493.838329:0:87080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397493.838351:0:87080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb6a lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7e85 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838587:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838600:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838611:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838622:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838642:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.838649:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397493.839152:0:87080:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0x274786fe0d18f8fb 00000004:00080000:3.0:1787397493.839156:0:87080:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x274786fe0d18f8fb in new mfd 00010000:00010000:3.0:1787397493.839168:0:87080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839175:0:87080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839182:0:87080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839187:0:87080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397493.839191:0:87080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839199:0:87080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839212:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397493.839215:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397493.839220:0:87080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839226:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d18fb71 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397493.839251:0:87080:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001db7727d reply state 0000000055598446 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839264:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839270:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a82e43e800) 00010000:00010000:3.0:1787397493.839273:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397493.839276:0:87080:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397493.839303:0:87080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb6a lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 10 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839314:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397493.839317:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397493.839320:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb6a lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e85 expref: 10 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.839334:0:87080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00010000:00080000:3.0:1787397493.839408:0:87080:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397493.839546:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.839549:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:3.0:1787397493.839554:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.839556:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:1.0:1787397493.895397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397493.895480:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681124992 00000100:00100000:3.0:1787397493.895491:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681124992 00000100:00100000:3.0:1787397493.895734:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1123 00000100:00100000:3.0:1787397493.895747:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681124992:12345-192.168.204.60@tcp:36:touch.0 00010000:00080000:3.0:1787397493.895789:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:3.0:1787397493.895804:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681124992:12345-192.168.204.60@tcp:36:touch.0 Request processed in 60us (417us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397493.895811:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1123 00000020:00080000:3.0:1787397493.905549:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.905560:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:3.0:1787397493.905566:0:87080:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:3.0:1787397493.905570:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.905584:0:87080:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681124992 t98784247816 from 192.168.204.60@tcp req@ffff89a803421c00 x1874218681124992/t0(98784247816) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 488/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397493.905716:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.905733:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.905746:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397493.905860:0:87080:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068608003 reply state 000000006c41b844 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.905873:0:87080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397493.905881:0:87080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397493.905884:0:87080:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397493.905889:0:87080:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397493.907303:0:87080:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397493.907339:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.907343:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:3.0:1787397493.907347:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397493.907349:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:3.0:1787397493.912250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397493.912351:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681125376 00000100:00100000:1.0:1787397493.912362:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681125376 00000100:00100000:1.0:1787397493.912420:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00100000:1.0:1787397493.912430:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681125376:12345-192.168.204.60@tcp:35:touch.0 00010000:00080000:1.0:1787397493.912451:0:66179:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:1.0:1787397493.912476:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681125376:12345-192.168.204.60@tcp:35:touch.0 Request processed in 48us (235us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397493.912484:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 216 00000020:00080000:0.0:1787397493.912542:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.912546:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:0.0:1787397493.912550:0:87080:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:0.0:1787397493.912553:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.912562:0:87080:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681125376 t98784247817 from 192.168.204.60@tcp req@ffff89a8179a3100 x1874218681125376/t0(98784247817) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 392/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397493.912823:0:87080:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787397493.912849:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.912851:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:0.0:1787397493.912854:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397493.912856:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:3.0:1787397493.932350:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397493.933894:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681130880 00000100:00100000:1.0:1787397493.933924:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681130880 00000100:00100000:1.0:1787397493.935162:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1096 00000100:00100000:1.0:1787397493.935176:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681130880:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787397493.935203:0:67264:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a8179a0700 x1874218681130880/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 224/0 e 0 to 0 dl 1787397504 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397493.935229:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681130880:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 56us (2898us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397493.935240:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1096 00000020:00080000:1.0:1787397493.935277:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397493.935282:0:87080:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:1.0:1787397493.935286:0:87080:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1787397493.935290:0:87080:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397493.935298:0:87080:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397493.935301:0:87080:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787397493.935410:0:87080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1787397493.943572:0:87048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:3.0:1787397493.943586:0:87048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1787397493.943616:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00000001:00080000:1.0:1787397493.944307:0:87080:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1787397493.944364:0:87080:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1787397493.944382:0:87080:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a803421f80 x1874218700931712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:689/0 lens 224/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397493.944516:0:87080:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a8179a0700 x1874218681130880/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:689/0 lens 224/0 e 0 to 0 dl 1787397504 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787397493.944607:0:87080:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1787397493.944677:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787397493.944693:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a803420e00 x1874218700931712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397509 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397493.944704:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a803420e00 x1874218700931712/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397509 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397493.944712:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787397493.944728:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787397493.944733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700931712:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787397493.945005:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700931840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397493.945075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397493.945240:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931840 00000100:00100000:3.0:1787397493.945248:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931840 00000100:00100000:3.0:1787397493.945311:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1787397493.945323:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700931840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397493.945366:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:3.0:1787397493.945418:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700931840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397493.945460:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1787397493.945883:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700931840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397493.948328:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948347:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948355:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948361:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397493.948366:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948374:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948396:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81301cc00) 00010000:00010000:0.0:1787397493.948399:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397493.948403:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948409:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fb5c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948440:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948447:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948462:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948468:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397493.948471:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948478:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948487:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a82e43e800) 00010000:00010000:0.0:1787397493.948489:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397493.948492:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948497:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d18fb78 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948514:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948544:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948550:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948554:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397493.948557:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948573:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948582:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:0.0:1787397493.948584:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397493.948587:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397493.948592:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d18fb86 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87080 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1787397493.993264:0:87080:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe4868fe10 00100000:10000000:0.0:1787397493.993279:0:87080:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1787397493.995879:0:87068:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x45c:0x0] 00000100:00100000:1.0:1787397493.996012:0:87068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87068:1874218700931968:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397493.996081:0:87068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397493.996128:0:87068:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e4def00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397493.996160:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700931968 00000100:00100000:1.0:1787397493.996166:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700931968 00000100:00100000:1.0:1787397493.996210:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1787397493.996219:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:87068:x1874218700931968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787397493.996248:0:26159:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -645 00002000:02000040:1.0:1787397493.996253:0:26159:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1117 to 0x2c0000401:1761) 00000004:00080000:2.0:1787397493.996487:0:87066:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x682:0x0] 00000100:00100000:2.0:1787397493.996510:0:87066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87066:1874218700932096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397493.996567:0:87066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397493.996608:0:87066:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025becc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397494.001817:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932096 00000100:00100000:3.0:1787397494.001846:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932096 00000100:00100000:3.0:1787397494.001949:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00000100:00100000:3.0:1787397494.001963:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:87066:x1874218700932096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787397494.002023:0:26158:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -95 00002000:02000040:3.0:1787397494.002029:0:26158:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1667 to 0x280000401:1761) 00002000:00010000:1.0:1787397494.017571:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.017600:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.017627:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.017631:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.017638:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.017654:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.017666:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.017674:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.017693:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.018103:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.018110:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018119:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.018121:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.018125:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018134:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018151:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018158:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018176:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397494.018186:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.018191:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018199:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.018204:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018213:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018231:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018239:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fb8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018259:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.018269:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018276:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.018279:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018287:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018299:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018306:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fb94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.018319:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.018320:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.018322:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.020809:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.020822:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.020839:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.020843:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.020849:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.020880:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.020890:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.020897:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.020916:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.021175:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.021181:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021188:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.021191:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.021196:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021204:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021212:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021231:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021249:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397494.021261:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.021267:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021274:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.021278:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021287:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021302:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021310:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fb9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021330:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.021333:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021350:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.021353:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021361:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.021751:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.021778:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.021903:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.021911:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fba2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.022461:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.022464:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.022466:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.022580:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.023207:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.023222:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.023226:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.023232:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.023245:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.023262:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.023269:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.023297:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.023356:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.023362:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397494.023639:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.023653:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.023670:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.023675:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.023681:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.023701:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.023713:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023713:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397494.023725:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.023728:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023766:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397494.023772:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023817:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.023836:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397494.023838:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023862:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fba9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023887:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397494.023891:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023898:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397494.023904:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023913:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023926:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023933:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d18fbb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.023964:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.023966:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.023968:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.024102:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.024105:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.024110:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024124:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024132:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024140:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024167:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.024178:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.024186:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024192:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.024199:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.024204:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.024208:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.024218:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.024229:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.024237:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.024256:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397494.024268:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.024278:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024288:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.024291:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.024296:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024306:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024314:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024321:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.024345:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787397494.025474:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397494.025484:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025500:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397494.025505:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025515:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025548:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025556:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fbb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025576:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397494.025580:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.025586:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.026142:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.026157:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.026172:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.026192:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.026201:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.026220:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.026226:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fbc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.026250:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.026254:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.026256:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.026641:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.026658:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.026679:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.026697:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d18fbbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.026730:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.026732:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.026735:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.026744:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.027335:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.027346:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.027358:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.028037:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.028045:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028061:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028071:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028078:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028104:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.028185:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.028191:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028199:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.028202:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.028206:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028215:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028223:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028237:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028251:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397494.028261:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.028268:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028275:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.028280:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028290:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028303:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028311:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fbd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028336:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.028340:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.028358:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.028362:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.029098:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787397494.029147:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787397494.029893:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.029909:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.029927:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.029931:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.029937:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.029953:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.029982:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.029991:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030019:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.030035:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.030041:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030049:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.030056:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030065:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030151:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030160:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d18fbcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030191:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.030200:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.030202:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.030339:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.030345:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030355:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.030359:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.030363:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030373:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030380:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030388:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030403:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397494.030627:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.030634:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030644:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.030647:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.030651:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030667:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030676:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030684:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030768:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397494.030818:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.030823:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030831:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.030834:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.030839:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030848:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030855:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030889:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030903:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397494.030947:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.030952:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030960:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.030963:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.030967:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030976:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030985:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.030992:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031009:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787397494.031018:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787397494.031021:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031036:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.031040:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031049:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031061:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031068:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d18fbe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031166:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397494.031170:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031178:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.031182:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031190:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031201:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031214:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d18fbe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031229:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397494.031232:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031239:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.031242:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031249:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031261:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031268:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d18fbef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031281:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.031284:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031291:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.031301:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031652:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031665:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031673:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d18fbf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031693:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.031696:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.031697:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.031844:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.031852:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031861:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.031864:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.031869:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031878:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031899:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031906:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031928:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.031935:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.031940:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031947:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.031950:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031959:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031971:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031978:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d18fbfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.031992:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032000:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032002:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.032048:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.032054:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032063:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.032066:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.032070:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032078:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032100:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032108:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032121:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.032128:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.032131:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032139:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.032142:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032160:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032170:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032177:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d18fc04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032191:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032193:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032194:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.032238:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.032243:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032252:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.032255:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.032259:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032268:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032276:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032291:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032303:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.032310:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.032314:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032321:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096bc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.032324:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032332:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032343:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032351:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff25c8b2/0x274786fe0d18fc0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032364:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032366:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032368:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.032411:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.032421:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032430:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.032432:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.032436:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032445:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032454:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032462:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032478:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.032486:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.032489:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032497:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.032502:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032511:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032630:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032639:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c35636/0x274786fe0d18fc12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032658:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032661:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032663:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.032803:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.032811:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032819:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.032822:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.032827:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032837:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032846:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032854:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032882:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.032891:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.032897:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032904:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.032908:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032916:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032928:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032935:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d18fc19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.032951:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032953:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.032955:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.033005:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.033010:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033019:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.033028:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.033032:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033042:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033050:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033058:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033073:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.033080:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.033084:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033101:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.033105:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033115:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033125:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033143:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d18fc20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033156:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.033158:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.033159:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.033209:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.033215:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033224:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.033227:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.033232:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033242:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033250:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033257:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033272:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.033286:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.033289:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033296:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096be00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.033300:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033308:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033320:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033327:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093145dbd/0x274786fe0d18fc27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033342:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.033345:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.033346:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.033392:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.033398:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033406:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.033409:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.033412:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033433:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033441:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033449:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033461:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.033468:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.033471:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033478:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.033481:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033489:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033499:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.033507:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013af30b8/0x274786fe0d18fc2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034015:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034020:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034022:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.034096:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.034103:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034112:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.034115:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.034120:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034131:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034140:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034148:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034165:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.034173:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.034178:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034196:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.034199:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034209:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034222:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034229:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080fc5301/0x274786fe0d18fc35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034243:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034245:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034246:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.034292:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.034297:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034305:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.034308:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.034311:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034320:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034334:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034340:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034352:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.034358:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.034362:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034368:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.034371:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034379:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034390:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034398:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f5b9b6/0x274786fe0d18fc3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034412:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034420:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034422:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.034666:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.034672:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034680:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.034683:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.034687:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034697:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034776:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034784:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034799:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.034806:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.034810:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034817:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.034820:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034841:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034853:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034860:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1f334e5/0x274786fe0d18fc43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034876:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034878:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.034879:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.034929:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.034934:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034942:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.034945:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.034949:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034958:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034965:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034979:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.034993:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.034999:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.035003:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035010:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.035014:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035023:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035033:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035041:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e21109e/0x274786fe0d18fc4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035056:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.035059:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.035060:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.035117:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.035128:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035137:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.035139:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.035144:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035154:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035162:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035170:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035183:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.035189:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.035192:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035199:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.035203:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035212:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035229:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035237:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000980ec48d/0x274786fe0d18fc51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035253:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.035254:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.035256:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.035487:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.035493:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035502:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.035506:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.035510:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035520:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035622:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035629:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035655:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.035663:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.035666:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035674:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.035677:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035685:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035699:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.035775:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035781:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c7d39c6/0x274786fe0d18fc58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035821:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.035824:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.035826:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035828:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.035839:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fbda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.035869:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.035872:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.035876:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.035888:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.035896:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035904:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.035913:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.035917:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035926:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035934:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035941:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035957:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.035967:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.035971:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035978:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.035981:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.035989:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.036000:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.036019:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b27a8ed/0x274786fe0d18fc5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.036036:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.036038:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.036040:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.036780:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.036791:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036804:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.036808:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.036814:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036826:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036850:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036856:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036878:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397494.036890:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.036895:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036903:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.036908:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036916:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.036929:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397494.037343:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.037351:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397494.037355:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.037491:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.037505:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037518:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.037811:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.037817:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037829:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037837:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037841:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037860:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.037886:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.037890:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037895:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.037899:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037905:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037916:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037921:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bedad44/0x274786fe0d18fc66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.037946:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.037947:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.037948:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.038973:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.038985:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039000:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.039004:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.039009:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039040:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039064:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fff8416/0x274786fe0d18fc6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039108:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.039119:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.039121:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039123:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.039134:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039164:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397494.039233:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.039241:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039249:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.039253:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.039258:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039269:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039278:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397494.039278:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.039301:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039335:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.039341:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039343:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.039357:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039371:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397494.039375:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039387:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039396:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039420:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397494.039435:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.039444:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039457:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.039460:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.039465:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039475:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397494.039482:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.039484:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039493:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039500:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039517:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.039541:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.039546:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039566:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039575:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039581:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039602:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787397494.039644:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.039652:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039660:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.039663:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.039667:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039676:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039682:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1787397494.039692:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039712:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039725:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787397494.039730:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039738:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.039743:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039751:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039766:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039772:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787397494.039773:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045aed72a/0x274786fe0d18fc74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039783:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039805:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.039806:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397494.039813:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039814:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039858:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.039859:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039882:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039890:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.039903:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039906:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb9f889/0x274786fe0d18fc7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039954:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397494.039959:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039966:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.039969:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039977:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.039989:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040004:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9702f2a/0x274786fe0d18fc90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040026:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.040030:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040037:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.040041:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040125:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040137:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040145:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677d3e91/0x274786fe0d18fc89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040162:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040164:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040166:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.040233:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.040239:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040255:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.040258:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.040263:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040274:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040281:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040289:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040306:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.040314:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.040317:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040324:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.040327:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040335:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040356:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040363:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1de3d1e/0x274786fe0d18fc9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040377:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040378:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040380:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.040432:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.040437:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040445:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.040449:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.040453:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040462:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040470:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040476:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040500:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.040507:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.040511:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040518:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.040577:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040587:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058812326/0x274786fe0d18fc82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040619:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040621:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040623:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040640:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397494.040650:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.040654:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040660:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.040664:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040671:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040697:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040704:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000917b51a8/0x274786fe0d18fc97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040719:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040722:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040724:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040777:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040792:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040809:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397494.040810:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.040839:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d18fca5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040839:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040877:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.040880:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.040883:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040887:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.040888:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.040893:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.040910:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040920:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040928:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397494.040967:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.040968:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.040982:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.040985:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.040996:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041001:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.041007:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.041016:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041019:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.041034:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041040:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041055:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041061:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000231f33a/0x274786fe0d18fcac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041078:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.041080:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.041082:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.041127:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041137:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041146:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397494.041149:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.041175:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041182:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397494.041188:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.041195:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.041205:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041206:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.041225:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041228:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.041238:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041267:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041268:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041321:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041326:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.041343:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041364:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c9b84ea/0x274786fe0d18fcb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041382:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.041387:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041394:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.041397:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041406:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041417:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.041425:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.041427:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.043032:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397494.043045:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b9ecf57/0x274786fe0d18fcba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.044299:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.044493:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.044505:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.045985:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.045998:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.046003:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397494.046060:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787397494.046185:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.046221:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.046233:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.046266:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.046279:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.046289:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.046322:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397494.047176:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397494.047189:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.047206:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.047225:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.047237:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.047260:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.047268:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026222758/0x274786fe0d18fcc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.047295:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.047297:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.047299:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397494.048238:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.048254:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.048272:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.048276:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.048283:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.048300:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.048311:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.048333:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.048365:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397494.048465:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397494.048476:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397494.048482:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.048500:0:26158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.048501:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.048511:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.048554:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.048573:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.048605:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d18fcc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.048628:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.048630:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.048632:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.050169:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.050187:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.050199:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.050220:0:26158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.050233:0:26158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.050242:0:26158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.050276:0:26158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397494.052033:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397494.052048:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.052063:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.052069:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.052081:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.052113:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.052121:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090208088/0x274786fe0d18fccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.052151:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.052153:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.052172:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.052888:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.053136:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.053144:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053158:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.053162:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.053168:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053180:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053199:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053207:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053233:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.053279:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.053284:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053291:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.053295:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.053298:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053307:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053315:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053321:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053343:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397494.053445:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397494.053450:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053458:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.053463:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053471:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053485:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053491:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030105228/0x274786fe0d18fcd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053513:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397494.053515:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053689:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.053692:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053699:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053716:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053724:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6681fd9/0x274786fe0d18fcdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.053736:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.053738:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.053740:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.053899:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.053905:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053914:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.053917:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.053921:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.053931:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054055:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054062:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054079:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.054134:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.054140:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054147:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.054156:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.054160:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054168:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054175:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054183:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054197:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397494.054235:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.054240:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054247:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.054249:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.054253:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054260:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054267:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054280:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054294:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787397494.054302:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397494.054307:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054314:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.054318:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054326:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054337:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054343:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d18fce4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054358:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.054362:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054389:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.054392:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054399:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054410:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054417:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056fa93e2/0x274786fe0d18fceb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054428:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.054431:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054437:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.054440:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054446:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054454:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054467:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05e11c/0x274786fe0d18fcf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054480:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.054482:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.054483:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.054547:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.054552:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054560:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.054563:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.054566:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054575:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054583:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054735:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054751:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.054799:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.054804:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054812:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.054816:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.054820:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054829:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054836:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054842:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054859:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397494.054865:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.054869:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054875:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.054878:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054896:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054906:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054912:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004332fbfc/0x274786fe0d18fcf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.054927:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.054930:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055127:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.055130:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055138:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055149:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055157:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044009fc4/0x274786fe0d18fd00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055181:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055182:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055184:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.055229:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.055234:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055242:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.055245:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.055249:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055258:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055266:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055272:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055284:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397494.055290:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.055293:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055310:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.055313:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055321:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055332:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055339:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d18fd07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055352:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055353:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055355:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.055412:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.055418:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055427:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.055430:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.055434:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055443:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055457:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055464:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055476:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397494.055483:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397494.055486:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055492:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.055495:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055502:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055513:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055538:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b15fc7e8/0x274786fe0d18fd0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055553:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055561:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.055562:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.055724:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.055731:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055739:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.055743:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.055748:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055759:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055767:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055773:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055794:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.055817:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.055832:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397494.055840:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.055849:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.055891:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.055894:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.055901:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.055902:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.055919:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.055925:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.055954:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.055961:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008624731e/0x274786fe0d18fd15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.055986:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.055988:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.055990:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.056078:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056097:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056105:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056128:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397494.056174:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.056179:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056186:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.056188:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.056192:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056200:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056207:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056226:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056235:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397494.056273:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.056279:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397494.056281:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056289:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056294:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:3.0:1787397494.056315:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397494.056316:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397494.056325:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.056327:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056367:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056392:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056400:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f14a1d/0x274786fe0d18fd1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056423:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.056427:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056436:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.056439:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056447:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056457:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056466:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1afa417/0x274786fe0d18fd23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.056478:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.056480:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.056488:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.057201:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.057211:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.057217:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.057502:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.057515:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.057537:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.058862:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787397494.059330:0:26158:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1666 00000100:00100000:2.0:1787397494.059447:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:87066:x1874218700932096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 57483us (62874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397494.059458:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00000100:00100000:3.0:1787397494.059781:0:87066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87066:1874218700932096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787397494.059807:0:87066:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x682:0x0] 00010000:00010000:1.0:1787397494.062358:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787397494.062574:0:87066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87066:1874218700932352:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397494.062658:0:87066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397494.062689:0:87066:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397494.062708:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700932224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397494.062737:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397494.063044:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932352 00000100:00100000:0.0:1787397494.063053:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932352 00000100:00100000:0.0:1787397494.063115:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1787397494.063125:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:87066:x1874218700932352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787397494.063169:0:26168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00002000:00010000:1.0:1787397494.063839:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.063849:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.063883:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.063888:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.063895:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.063911:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.063923:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.063930:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.064828:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397494.064889:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.064896:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.064906:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.064909:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.064913:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.064923:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397494.065697:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932224 00000100:00100000:3.0:1787397494.065970:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932224 00000100:00100000:3.0:1787397494.066065:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1787397494.066080:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700932224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397494.066124:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397494.066248:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700932224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397494.066259:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1787397494.066350:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700932224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787397494.066389:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397494.066397:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066410:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.066415:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066427:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.066478:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066481:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.066518:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066519:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061888e6/0x274786fe0d18fd2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.066562:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397494.066719:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397494.066728:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066737:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397494.066742:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066768:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066789:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066799:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023485fe/0x274786fe0d18fd31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066826:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397494.066831:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066837:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.066841:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.066844:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.066846:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.066850:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.066858:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.066861:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066874:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066881:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d18fd38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397494.066909:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.066911:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397494.066913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397494.067808:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397494.067818:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067832:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.067837:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.067843:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067855:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067863:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067872:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067907:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.067949:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.067960:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.067973:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b600 already unused, calling callback (ffffffffc0e6de90) 00002000:00010000:1.0:1787397494.067974:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397494.067979:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.067982:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.068017:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.068018:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=3373s v=(0 0) 00010000:00010000:1.0:1787397494.068032:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397494.068045:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.068065:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.068073:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.068075:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.068101:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d18fd3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.068142:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.068145:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.068146:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397494.070480:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397494.070512:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397494.070666:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397494.070679:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.070692:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397494.070763:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.070779:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.070805:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.070813:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d18fd46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397494.070848:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.070850:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397494.070853:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397494.071494:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:87066:x1874218700932352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8365us (8831us total) trans 4294968726 rc 0/0 00000100:00100000:0.0:1787397494.071506:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:3.0:1787397494.072019:0:87066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87066:1874218700932352:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787397494.072346:0:87066:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00002000:00080000:3.0:1787397494.092135:0:26159:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1116 00000100:00100000:3.0:1787397494.092238:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:87068:x1874218700931968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96015us (96151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397494.092250:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1787397494.092880:0:87068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87068:1874218700931968:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787397494.092898:0:87068:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x45c:0x0] 00000100:00100000:1.0:1787397494.092981:0:87068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87068:1874218700932608:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397494.093021:0:87068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397494.093056:0:87068:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e4def00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397494.093081:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932608 00000100:00100000:1.0:1787397494.093097:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932608 00000100:00100000:1.0:1787397494.093138:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:1.0:1787397494.093146:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:87068:x1874218700932608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787397494.093183:0:26160:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:0.0:1787397494.093741:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397494.093755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700932480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397494.093789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397494.093825:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932480 00000100:00100000:0.0:1787397494.093829:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932480 00000100:00100000:0.0:1787397494.093861:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1787397494.093868:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700932480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397494.093889:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397494.093927:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700932480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397494.093934:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1787397494.093974:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700932480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397494.096849:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:87068:x1874218700932608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3697us (3821us total) trans 4294968723 rc 0/0 00000100:00100000:1.0:1787397494.096863:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1787397494.097750:0:87068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87068:1874218700932608:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787397494.097772:0:87068:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00010000:00010000:3.0:1787397494.564960:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397494.684763:0:87334:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:0.0:1787397494.758854:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787397495.047858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397495.047895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397495.047922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397495.047952:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131008 00000100:00100000:2.0:1787397495.047962:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131008 00000100:00100000:2.0:1787397495.048013:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:2.0:1787397495.048024:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681131008:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397495.048113:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681131008:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397495.048121:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:2.0:1787397495.048154:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131264 00000100:00100000:2.0:1787397495.048158:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131264 00000100:00100000:2.0:1787397495.048204:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131136 00000100:00100000:2.0:1787397495.048208:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131136 00000100:00100000:2.0:1787397495.048231:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1097 00000100:00100000:2.0:1787397495.048237:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681131264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397495.048269:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681131264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397495.048275:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1097 00000100:00100000:2.0:1787397495.048286:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1098 00000100:00100000:2.0:1787397495.048292:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681131136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397495.048315:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681131136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397495.048329:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1098 00000100:00080000:2.0:1787397495.051725:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397495.051735:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397495.598685:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787397495.726988:0:87386:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397495.727282:0:87386:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787397495.781636:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397495.781659:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700932736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397495.781740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397495.781788:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932736 00000100:00100000:2.0:1787397495.781796:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932736 00000100:00100000:2.0:1787397495.781846:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1787397495.781856:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700932736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397495.781887:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397495.781930:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700932736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397495.781937:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:2.0:1787397495.781957:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397495.782002:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700932736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397495.782419:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397495.782430:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700932864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397495.782463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397495.782615:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932864 00000100:00100000:2.0:1787397495.782620:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932864 00000100:00100000:2.0:1787397495.782672:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1787397495.782681:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700932864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397495.782698:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397495.782732:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700932864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397495.782739:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1787397495.782770:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700932864:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397495.782860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397496.615513:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397496.892166:0:87436:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397496.893511:0:87436:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787397497.636774:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397498.660970:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397498.852761:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700933120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397498.852803:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700932992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.852844:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397498.852847:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397498.852922:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700932992 00000100:00100000:2.0:1787397498.852930:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700932992 00000100:00100000:2.0:1787397498.852983:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787397498.853002:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700932992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.853053:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700932992:12345-0@lo:400:kworker.0 Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.853061:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787397498.853094:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933120 00000100:00100000:2.0:1787397498.853098:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933120 00000100:00100000:2.0:1787397498.853125:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1787397498.853131:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700933120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397498.853156:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397498.853234:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700932992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.857775:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700933248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.857786:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700933632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.858038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397498.858083:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700934144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.858461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397498.858489:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700933120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5354us (5636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.858501:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1787397498.858567:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700933376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.858618:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700933120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397498.858628:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933632 00000100:00100000:1.0:1787397498.858634:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933632 00000100:00100000:3.0:1787397498.858640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787397498.858645:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700933504:0@lo:400:kworker.0 00000100:00100000:1.0:1787397498.858690:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934144 00000100:00100000:1.0:1787397498.858694:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934144 00000100:00100000:1.0:1787397498.858719:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1787397498.858728:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700933632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.862699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397498.862764:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700933888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.862804:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397498.862825:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700934400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.862851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397498.862909:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933888 00000100:00100000:2.0:1787397498.862917:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933888 00000100:00100000:2.0:1787397498.862980:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934400 00000100:00100000:2.0:1787397498.862984:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934400 00000100:00100000:2.0:1787397498.863045:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1787397498.863054:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863121:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700933888:12345-0@lo:400:kworker.0 Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.863129:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1787397498.863145:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1787397498.863152:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700934400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863181:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700934400:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.863187:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1787397498.863244:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700933888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863257:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700934400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863319:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933376 00000100:00100000:2.0:1787397498.863323:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933376 00000100:00100000:2.0:1787397498.863372:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1787397498.863380:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700934144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863417:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700934144:12345-0@lo:400:kworker.0 Request processed in 38us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.863423:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1787397498.863440:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1787397498.863446:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700933376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.863478:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700933376:12345-0@lo:400:kworker.0 Request processed in 32us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.863498:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1787397498.863557:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700933376:0@lo:400:kworker.0 00000100:00080000:2.0:1787397498.863593:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397498.863596:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397498.863599:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397498.865293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397498.865476:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700934016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.865732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397498.865758:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7030c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700934528:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.865781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397498.865837:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700934144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.865891:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934016 00000100:00100000:3.0:1787397498.865897:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934016 00000100:00100000:3.0:1787397498.866084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1787397498.866094:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700934016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.866148:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700934016:12345-0@lo:400:kworker.0 Request processed in 55us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397498.866155:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1787397498.866185:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933504 00000100:00100000:3.0:1787397498.866188:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933504 00000100:00100000:3.0:1787397498.866281:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934528 00000100:00100000:3.0:1787397498.866284:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934528 00000100:00100000:3.0:1787397498.866305:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1787397498.866311:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700933504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.866358:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700933504:12345-0@lo:400:kworker.0 Request processed in 47us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397498.866365:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1787397498.866377:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1787397498.866382:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700934528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.866408:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700934528:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397498.866415:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:3.0:1787397498.866438:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397498.866443:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397498.866462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700933504:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.866473:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700934016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397498.866832:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7030c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700934528:0@lo:400:kworker.0 00000100:00100000:1.0:1787397498.868325:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700933632:12345-0@lo:400:kworker.0 Request processed in 9591us (10281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397498.868339:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1787397498.868445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397498.868491:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700933760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.868544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397498.868573:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700934272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.868598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397498.868702:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933760 00000100:00100000:1.0:1787397498.868709:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933760 00000100:00100000:1.0:1787397498.868749:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1787397498.868757:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700933760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397498.868805:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700933760:12345-0@lo:400:kworker.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397498.868811:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1787397498.868882:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934272 00000100:00100000:0.0:1787397498.868886:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934272 00000100:00100000:0.0:1787397498.868933:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1787397498.868940:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700934272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.868989:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700934272:12345-0@lo:400:kworker.0 Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397498.869008:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:0.0:1787397498.869050:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700934272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.869080:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700933760:0@lo:400:kworker.0 00000100:00080000:1.0:1787397498.869169:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397498.869975:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700933248 00000100:00100000:2.0:1787397498.869983:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700933248 00000100:00100000:2.0:1787397498.870051:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1787397498.870060:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700933248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397498.870125:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700933248:12345-0@lo:400:kworker.0 Request processed in 67us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397498.870131:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00080000:1.0:1787397498.870257:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397498.870759:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700933632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397498.872097:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700933248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397499.107194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397499.108106:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131392 00000100:00100000:2.0:1787397499.108117:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131392 00000100:00100000:2.0:1787397499.108225:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1124 00000100:00100000:2.0:1787397499.108236:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681131392:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397499.108256:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397499.108281:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ea8 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108350:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108365:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108378:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397499.108431:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397499.108435:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397499.108496:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108570:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea8 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108589:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea8 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397499.108598:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00000100:00080000:1.0:1787397499.108996:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787397499.109037:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397499.109042:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa200, rc 0) 00000100:00100000:2.0:1787397499.109117:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66654:x1874218681131392:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 882us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397499.109125:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1124 00000100:00100000:2.0:1787397499.113975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397499.114068:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131520 00000100:00100000:3.0:1787397499.114079:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131520 00000100:00100000:3.0:1787397499.114146:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1125 00000100:00100000:3.0:1787397499.114157:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66654:x1874218681131520:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397499.114194:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:3.0:1787397499.114271:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:66654:x1874218681131520:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397499.114279:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1125 00000100:00100000:1.0:1787397499.116965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397499.117052:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131648 00000100:00100000:2.0:1787397499.117063:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131648 00000100:00100000:2.0:1787397499.117137:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1126 00000100:00100000:2.0:1787397499.117146:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681131648:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397499.117181:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397499.117265:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681131648:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 119us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397499.117273:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1126 00000100:00080000:1.0:1787397499.117442:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397499.124015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397499.124183:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131776 00000100:00100000:0.0:1787397499.124199:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131776 00000100:00100000:0.0:1787397499.124256:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4935 00000100:00100000:0.0:1787397499.124265:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2401:x1874218681131776:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:0.0:1787397499.124304:0:26165:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3378 last 0 00000020:00000080:0.0:1787397499.124335:0:26165:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18fd5b 00002000:00100000:0.0:1787397499.124348:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a838799000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397499.124366:0:26165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787397499.124446:0:26165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787397499.124475:0:26165:0:(import.c:65:import_set_state_nolock()) ffff89a83879c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397499.124597:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681131776:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 332us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397499.124613:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4935 00000100:00100000:2.0:1787397499.129758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397499.129973:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681131904 00000100:00100000:0.0:1787397499.129994:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681131904 00000100:00100000:0.0:1787397499.130085:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1905 00000100:00100000:0.0:1787397499.130095:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681131904:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397499.130122:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397499.130222:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681131904:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 128us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397499.130230:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1905 00000100:00080000:1.0:1787397499.130415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787397499.132877:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:3.0:1787397499.132898:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968726 is committed 00000100:00100000:1.0:1787397499.141840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397499.142008:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132032 00000100:00100000:0.0:1787397499.142022:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132032 00000100:00100000:0.0:1787397499.145000:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4936 00000100:00100000:0.0:1787397499.145016:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874218681132032:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:0.0:1787397499.145082:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3378 last 0 00000020:00000080:0.0:1787397499.145131:0:8436:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d18fd62 00002000:00100000:0.0:1787397499.145147:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a83879b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397499.145172:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787397499.145312:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787397499.145357:0:8436:0:(import.c:65:import_set_state_nolock()) ffff89a83879d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397499.145462:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681132032:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 446us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397499.145470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4936 00000100:00100000:3.0:1787397499.155735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397499.155905:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132160 00000100:00100000:2.0:1787397499.155919:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132160 00000100:00100000:2.0:1787397499.156041:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1906 00000100:00100000:2.0:1787397499.156053:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681132160:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397499.156093:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397499.156177:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:66654:x1874218681132160:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 126us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397499.156185:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1906 00000100:00080000:1.0:1787397499.156414:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787397499.159076:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:0.0:1787397499.159097:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968723 is committed 00000100:00100000:1.0:1787397499.364970:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700934656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397499.365081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397499.365258:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934656 00000100:00100000:3.0:1787397499.365269:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934656 00000100:00100000:3.0:1787397499.365335:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:3.0:1787397499.365345:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700934656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397499.365375:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397499.365428:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700934656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397499.365435:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:1.0:1787397499.365519:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968726 gen 2 00000100:00100000:1.0:1787397499.365567:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700934656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397499.365726:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700934784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397499.365780:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397499.366825:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934784 00000100:00100000:2.0:1787397499.366835:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934784 00000100:00100000:2.0:1787397499.366891:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1787397499.366900:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700934784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397499.366929:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:2.0:1787397499.367008:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700934784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397499.367016:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1787397499.367071:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700934784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397499.367386:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397499.367398:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700934912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397499.367441:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397499.367513:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700934912 00000100:00100000:3.0:1787397499.367518:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700934912 00000100:00100000:3.0:1787397499.367577:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1787397499.367585:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700934912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397499.367623:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397499.367673:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700934912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397499.367680:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1787397499.367707:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968723 gen 2 00000100:00100000:3.0:1787397499.367727:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700934912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787397499.685288:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397500.178290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397500.178364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397500.178396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397500.178427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397500.178456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397500.178491:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132416 00000100:00100000:1.0:1787397500.178504:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132416 00000100:00100000:1.0:1787397500.178607:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132544 00000100:00100000:1.0:1787397500.178610:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132544 00000100:00100000:1.0:1787397500.178637:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1105 00000100:00100000:1.0:1787397500.178649:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681132416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397500.178747:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681132416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 99us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397500.178755:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1105 00000100:00100000:1.0:1787397500.178780:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1106 00000100:00100000:1.0:1787397500.178786:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681132544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397500.178829:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681132544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397500.178850:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1106 00000100:00100000:1.0:1787397500.179105:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132672 00000100:00100000:1.0:1787397500.179111:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132672 00000100:00100000:1.0:1787397500.179145:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132800 00000100:00100000:1.0:1787397500.179148:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132800 00000100:00100000:1.0:1787397500.179171:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2387 00000100:00100000:1.0:1787397500.179177:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681132672:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397500.179223:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681132672:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397500.179231:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2387 00000100:00100000:1.0:1787397500.179244:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2388 00000100:00100000:1.0:1787397500.179251:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681132800:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397500.179276:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681132800:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397500.179283:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2388 00000100:00100000:0.0:1787397500.180250:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132288 00000100:00100000:0.0:1787397500.180263:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132288 00000100:00100000:0.0:1787397500.180327:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:0.0:1787397500.180348:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681132288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397500.180405:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681132288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 58us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397500.180412:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00010000:00010000:0.0:1787397500.709836:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397500.902031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397500.902060:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700935040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397500.902140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397500.902381:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935040 00000100:00100000:1.0:1787397500.902391:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935040 00000100:00100000:1.0:1787397500.902466:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1787397500.902476:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700935040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397500.902507:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397500.902664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700935040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397500.902672:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1787397500.902723:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700935040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397500.902790:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397500.904183:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700935168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397500.904248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397500.904392:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935168 00000100:00100000:3.0:1787397500.904400:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935168 00000100:00100000:3.0:1787397500.904458:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1787397500.904467:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700935168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397500.904493:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397500.904605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397500.904692:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700935168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 225us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397500.904701:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1787397500.907189:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700935168:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787397501.733848:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397502.756762:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397503.780721:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397503.972951:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397503.972978:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700935296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397503.973050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.974800:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935296 00000100:00100000:1.0:1787397503.974815:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935296 00000100:00100000:1.0:1787397503.974911:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1787397503.974921:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700935296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397503.974969:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397503.975063:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700935296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397503.975071:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:3.0:1787397503.975217:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700935296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397503.975734:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700935552:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.975774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.975860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700935808:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.975887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.975917:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700936320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.975940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.975953:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700936832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.975970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.975986:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787397503.975991:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700935424:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.976014:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.976034:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700935936:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.976051:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.976064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700936448:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.976100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397503.976124:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935552 00000100:00100000:1.0:1787397503.976129:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935552 00000100:00100000:1.0:1787397503.976168:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935808 00000100:00100000:1.0:1787397503.976170:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935808 00000100:00100000:1.0:1787397503.976183:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936832 00000100:00100000:1.0:1787397503.976302:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936832 00000100:00100000:1.0:1787397503.976322:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935936 00000100:00100000:1.0:1787397503.976324:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935936 00000100:00100000:1.0:1787397503.976336:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936448 00000100:00100000:1.0:1787397503.976338:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936448 00000100:00100000:1.0:1787397503.976350:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1787397503.976357:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700935552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.976399:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700935552:12345-0@lo:400:kworker.0 Request processed in 41us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397503.976406:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1787397503.976434:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1787397503.976440:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700935808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.976471:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700935808:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397503.976477:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1787397503.976488:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1787397503.976494:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700936832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.976636:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700935552:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.976644:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700936064:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.976671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397503.976693:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700936576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.976713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397503.976740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397503.976747:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700935680:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.976769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397503.976778:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700936192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.977032:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936320 00000100:00100000:3.0:1787397503.977038:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936320 00000100:00100000:3.0:1787397503.977074:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936576 00000100:00100000:3.0:1787397503.977077:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936576 00000100:00100000:3.0:1787397503.977097:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:3.0:1787397503.977103:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700936320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.977141:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700936320:12345-0@lo:400:kworker.0 Request processed in 38us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.977158:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:3.0:1787397503.977170:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1787397503.977176:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700936576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.977220:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700936576:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.977226:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1787397503.977278:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936064 00000100:00100000:3.0:1787397503.977281:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936064 00000100:00100000:3.0:1787397503.977306:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1787397503.977312:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700936064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.977344:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700936064:12345-0@lo:400:kworker.0 Request processed in 32us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.977351:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00080000:3.0:1787397503.977367:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397503.977371:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397503.977373:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397503.977375:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397503.977385:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935680 00000100:00100000:3.0:1787397503.977388:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935680 00000100:00100000:3.0:1787397503.977413:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1787397503.977420:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700935936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.977451:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700935936:12345-0@lo:400:kworker.0 Request processed in 32us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.977456:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1787397503.977470:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1787397503.977476:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700936448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.977878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397503.977913:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700936704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.977943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397503.977972:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700936064:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.977993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700936576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.978038:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1787397503.978048:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700935680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.978087:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700935680:12345-0@lo:400:kworker.0 Request processed in 42us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397503.978094:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1787397503.978126:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700935680:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.978160:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700935936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.978172:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700935808:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.978183:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700936320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.978380:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700936832:12345-0@lo:400:kworker.0 Request processed in 1884us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397503.978388:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1787397503.978413:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936192 00000100:00100000:1.0:1787397503.978418:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936192 00000100:00100000:1.0:1787397503.978454:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936704 00000100:00100000:1.0:1787397503.978458:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936704 00000100:00100000:1.0:1787397503.978483:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:1.0:1787397503.978489:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700936192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.979105:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700936448:12345-0@lo:400:kworker.0 Request processed in 1619us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.979122:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1787397503.979189:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1787397503.979207:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700936704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397503.979291:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700936704:12345-0@lo:400:kworker.0 Request processed in 93us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397503.979298:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00080000:3.0:1787397503.979323:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397503.979329:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397503.979332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397503.979483:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700936704:0@lo:400:kworker.0 00000100:00100000:1.0:1787397503.980744:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700936192:12345-0@lo:400:kworker.0 Request processed in 2245us (2857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397503.980758:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:1.0:1787397503.980841:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700936192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.980987:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700936832:0@lo:400:kworker.0 00000100:00100000:0.0:1787397503.981018:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700936448:0@lo:400:kworker.0 00000100:00100000:2.0:1787397503.981136:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700935424 00000100:00100000:2.0:1787397503.981146:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700935424 00000100:00100000:2.0:1787397503.981206:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787397503.981215:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397503.981270:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700935424:12345-0@lo:400:kworker.0 Request processed in 56us (5254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397503.981277:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787397503.983865:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700935424:0@lo:400:kworker.0 00000100:00100000:2.0:1787397504.485681:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397504.485705:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700936960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397504.485781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397504.485999:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700936960 00000100:00100000:0.0:1787397504.486009:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700936960 00000100:00100000:0.0:1787397504.486066:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1787397504.486076:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700936960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397504.486113:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:0.0:1787397504.486163:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700936960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397504.486171:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1787397504.486229:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700936960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397504.486945:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397504.486958:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700937088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397504.487005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397504.487044:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937088 00000100:00100000:2.0:1787397504.487050:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937088 00000100:00100000:2.0:1787397504.487091:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1787397504.487105:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700937088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397504.487131:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397504.487168:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700937088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397504.487175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1787397504.487227:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700937088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397504.496114:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397504.496200:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397504.496285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397504.496413:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937216 00000100:00100000:2.0:1787397504.496424:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937216 00000100:00100000:2.0:1787397504.496560:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:2.0:1787397504.496570:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700937216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397504.496603:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397504.496651:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700937216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397504.496659:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1787397504.496738:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700937216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787397504.807120:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397505.229977:0:87629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:0.0:1787397505.292862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397505.292923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397505.292954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397505.292977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397505.293003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397505.293036:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133184 00000100:00100000:0.0:1787397505.293047:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133184 00000100:00100000:0.0:1787397505.293119:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133056 00000100:00100000:0.0:1787397505.293122:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133056 00000100:00100000:0.0:1787397505.293150:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1113 00000100:00100000:0.0:1787397505.293161:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681133184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397505.293239:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681133184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397505.293248:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1113 00000100:00100000:0.0:1787397505.293269:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1114 00000100:00100000:0.0:1787397505.293276:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681133056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397505.293303:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681133056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397505.293310:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1114 00000100:00100000:0.0:1787397505.293331:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133440 00000100:00100000:0.0:1787397505.293335:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133440 00000100:00100000:0.0:1787397505.293360:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133312 00000100:00100000:0.0:1787397505.293363:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133312 00000100:00100000:0.0:1787397505.293402:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2393 00000100:00100000:0.0:1787397505.293409:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681133440:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397505.293440:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681133440:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397505.293447:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2393 00000100:00100000:0.0:1787397505.293459:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2394 00000100:00100000:0.0:1787397505.293465:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681133312:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397505.293491:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681133312:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397505.293498:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2394 00000100:00080000:0.0:1787397505.293549:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397505.293553:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397505.293556:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397505.293558:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397505.294957:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681132928 00000100:00100000:3.0:1787397505.294970:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681132928 00000100:00100000:3.0:1787397505.295018:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:3.0:1787397505.295027:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681132928:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397505.295089:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681132928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 63us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397505.295098:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00010000:00010000:0.0:1787397505.850429:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397506.021566:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397506.021592:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700937344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397506.021675:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397506.022119:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937344 00000100:00100000:2.0:1787397506.022128:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937344 00000100:00100000:2.0:1787397506.022195:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1787397506.022203:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700937472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397506.022206:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700937344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397506.022250:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397506.022251:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397506.022282:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937472 00000100:00100000:3.0:1787397506.022286:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937472 00000100:00100000:2.0:1787397506.022292:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700937344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397506.022299:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00080000:0.0:1787397506.022355:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397506.022360:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397506.022370:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700937344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397506.022494:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1787397506.022513:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700937472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397506.022563:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397506.022597:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700937472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397506.022603:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1787397506.022741:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700937472:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787397506.853115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397507.744262:0:87678:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1787397507.876655:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397508.900993:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397509.092849:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700937984:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.092924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.092959:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700938496:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.092987:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.093002:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700939008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.093020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.093043:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787397509.093067:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700937856:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.093090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.093104:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700938368:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.093124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.093138:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700938880:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.093175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397509.093205:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937984 00000100:00100000:0.0:1787397509.093214:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937984 00000100:00100000:0.0:1787397509.093267:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937856 00000100:00100000:0.0:1787397509.093271:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937856 00000100:00100000:0.0:1787397509.093301:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1787397509.093312:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700937984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.093365:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700937984:12345-0@lo:400:kworker.0 Request processed in 56us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397509.093374:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1787397509.093395:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1787397509.093404:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700937856:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397509.093412:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397509.093418:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397509.093432:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938496 00000100:00100000:3.0:1787397509.093437:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938496 00000100:00100000:0.0:1787397509.093439:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218700937856:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397509.093447:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1787397509.093475:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939008 00000100:00100000:3.0:1787397509.093478:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939008 00000100:00100000:3.0:1787397509.093494:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938368 00000100:00100000:0.0:1787397509.093497:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218700937856:0@lo:400:kworker.0 00000100:00100000:3.0:1787397509.093498:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938368 00000100:00100000:3.0:1787397509.093538:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938880 00000100:00100000:3.0:1787397509.093541:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938880 00000100:00100000:3.0:1787397509.093561:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1787397509.093567:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700938496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397509.093603:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700938496:12345-0@lo:400:kworker.0 Request processed in 36us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397509.093610:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1787397509.093623:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:3.0:1787397509.093629:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700939008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093655:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700937728:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093712:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700938240:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093752:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700938752:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093802:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700939264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397509.093824:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093843:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787397509.093849:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700937600:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093902:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700938112:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093942:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700938624:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.093975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.093997:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700939136:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.094083:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1787397509.094096:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700938368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094134:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700938368:12345-0@lo:400:kworker.0 Request processed in 43us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094140:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1787397509.094167:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1787397509.094175:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700938880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094202:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700938880:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094208:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1787397509.094226:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937728 00000100:00100000:2.0:1787397509.094230:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937728 00000100:00100000:2.0:1787397509.094258:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938112 00000100:00100000:2.0:1787397509.094261:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938112 00000100:00100000:2.0:1787397509.094273:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938624 00000100:00100000:2.0:1787397509.094274:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938624 00000100:00100000:2.0:1787397509.094283:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939136 00000100:00100000:2.0:1787397509.094285:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939136 00000100:00100000:2.0:1787397509.094294:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1787397509.094299:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700937728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094327:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700937728:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094333:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1787397509.094344:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1787397509.094349:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700938112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094373:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700938112:12345-0@lo:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094389:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1787397509.094401:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1787397509.094405:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700938624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094436:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700938624:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094443:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1787397509.094457:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1787397509.094464:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700939008:12345-0@lo:400:kworker.0 Request processed in 834us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094466:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700939136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397509.094479:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1787397509.094506:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700939136:12345-0@lo:400:kworker.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094514:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1787397509.094516:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938240 00000100:00100000:3.0:1787397509.094541:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938240 00000100:00100000:3.0:1787397509.094567:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700938752 00000100:00100000:2.0:1787397509.094568:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939264 00000100:00100000:3.0:1787397509.094570:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700938752 00000100:00100000:2.0:1787397509.094574:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939264 00000100:00100000:3.0:1787397509.094586:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:3.0:1787397509.094595:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700938240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094603:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1787397509.094613:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700938752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397509.094629:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700938240:12345-0@lo:400:kworker.0 Request processed in 35us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094734:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700938752:12345-0@lo:400:kworker.0 Request processed in 123us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094741:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:2.0:1787397509.094753:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1787397509.094759:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700939264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397509.094783:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397509.094824:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700939264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094830:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1787397509.094854:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700937600 00000100:00100000:2.0:1787397509.094864:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700937600 00000100:00100000:2.0:1787397509.094893:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787397509.094898:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700937600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094927:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700937600:12345-0@lo:400:kworker.0 Request processed in 29us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.094932:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787397509.094979:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700937600:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.094993:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700938112:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095003:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700938624:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095010:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700939136:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095018:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700937728:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095026:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700938240:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095034:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700938752:0@lo:400:kworker.0 00000100:00100000:2.0:1787397509.095046:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700939264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397509.095123:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700937984:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.095206:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700938496:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.095226:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700939008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.095259:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700938368:0@lo:400:kworker.0 00000100:00100000:0.0:1787397509.095269:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700938880:0@lo:400:kworker.0 00000100:00080000:2.0:1787397509.096129:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397509.096136:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397509.096139:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397509.096141:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397509.101447:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1787397509.605297:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397509.605409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397509.605468:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397509.605476:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700939520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397509.605508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397509.605762:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939392 00000100:00100000:2.0:1787397509.605774:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939392 00000100:00100000:1.0:1787397509.605976:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700939648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397509.606008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397509.606041:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939648 00000100:00100000:1.0:1787397509.606046:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939648 00000100:00100000:2.0:1787397509.606080:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1787397509.606092:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700939392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397509.606125:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397509.606211:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700939392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397509.606331:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939520 00000100:00100000:0.0:1787397509.606336:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939520 00000100:00100000:0.0:1787397509.606401:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1787397509.606412:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700939520:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397509.606437:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700939392:0@lo:13:osp-pre-0-0.0 00000004:00000024:0.0:1787397509.606445:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:0.0:1787397509.606569:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700939520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397509.606579:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1787397509.606585:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700939520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397509.616224:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1787397509.616259:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700939648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397509.616300:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397509.616398:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700939648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (10388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397509.616407:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1787397509.619253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700939648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397509.620113:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1787397509.893930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397509.894022:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133568 00000100:00100000:2.0:1787397509.894035:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133568 00000100:00100000:2.0:1787397509.894131:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1127 00000100:00100000:2.0:1787397509.894142:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:67125:x1874218681133568:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397509.894184:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:2.0:1787397509.894271:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:67125:x1874218681133568:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 130us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.894278:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1127 00000100:00080000:3.0:1787397509.894333:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397509.902851:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397509.903016:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133696 00000100:00100000:2.0:1787397509.903031:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133696 00000100:00100000:2.0:1787397509.903133:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1128 00000100:00100000:2.0:1787397509.903144:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:67125:x1874218681133696:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397509.903189:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397509.903277:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:67125:x1874218681133696:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 134us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.903284:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1128 00000100:00080000:3.0:1787397509.903403:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397509.914868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397509.914981:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133824 00000100:00100000:2.0:1787397509.914992:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133824 00000100:00100000:2.0:1787397509.915071:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1917 00000100:00100000:2.0:1787397509.915082:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67125:x1874218681133824:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397509.915112:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397509.915227:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67125:x1874218681133824:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 147us (370us total) trans 0 rc 0/0 00000100:00080000:3.0:1787397509.915322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397509.915397:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1917 00010000:00010000:3.0:1787397509.928642:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397509.928833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397509.929289:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681133952 00000100:00100000:2.0:1787397509.929300:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681133952 00000100:00100000:2.0:1787397509.929389:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1918 00000100:00100000:2.0:1787397509.929399:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67125:x1874218681133952:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397509.929428:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397509.929496:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67125:x1874218681133952:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 98us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397509.929504:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1918 00000100:00080000:3.0:1787397509.929879:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397510.022207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397510.022367:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681134080 00000100:00100000:2.0:1787397510.022379:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681134080 00000100:00100000:2.0:1787397510.022465:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1129 00000100:00100000:2.0:1787397510.022477:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:67142:x1874218681134080:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397510.022500:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397510.022561:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fd69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7eaf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.022660:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.022677:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.022978:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.022996:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023019:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023028:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023148:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023158:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023166:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397510.023214:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787397510.023219:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397510.023245:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023259:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023266:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023272:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023279:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397510.023283:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023298:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023312:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00010000:00010000:2.0:1787397510.023315:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397510.023321:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023328:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d18fd70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023357:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023364:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023370:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023376:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397510.023379:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023509:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023518:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff89a817898200) 00010000:00010000:2.0:1787397510.023820:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397510.023825:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023843:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d18fd77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023885:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d18fd69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eaf expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023900:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eaf expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.023907:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a817898f00) 00010000:00010000:2.0:1787397510.023910:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397510.023912:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00000100:00100000:2.0:1787397510.023985:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67142:x1874218681134080:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1510us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397510.023994:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1129 00000100:00100000:1.0:1787397510.040697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397510.040812:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681134336 00000100:00100000:2.0:1787397510.040822:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681134336 00000100:00100000:2.0:1787397510.040903:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1130 00000100:00100000:2.0:1787397510.040916:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67142:x1874218681134336:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397510.040947:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397510.040973:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd85 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7eb6 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041064:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041078:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041102:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041118:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041136:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041143:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041241:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041249:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041256:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041262:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041268:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397510.041273:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041281:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041293:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a817898f00) 00010000:00010000:2.0:1787397510.041302:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397510.041308:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041314:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d18fd8c lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041344:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041351:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041356:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041361:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397510.041364:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041370:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041379:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a817898200) 00010000:00010000:2.0:1787397510.041382:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397510.041384:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041390:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d18fd93 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041426:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd85 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eb6 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041443:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a817898f00) 00010000:00010000:2.0:1787397510.041445:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397510.041450:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd85 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eb6 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.041461:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:2.0:1787397510.041582:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67142:x1874218681134336:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 669us (896us total) trans 0 rc 301/301 00000100:00100000:2.0:1787397510.041591:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1130 00000100:00100000:1.0:1787397510.054750:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397510.054867:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681134592 00000100:00100000:2.0:1787397510.054878:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681134592 00000100:00100000:2.0:1787397510.054953:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1131 00000100:00100000:2.0:1787397510.054964:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67142:x1874218681134592:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397510.054985:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397510.055005:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ebd expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397510.055105:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787397510.055225:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ebd expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.055241:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00010000:00010000:2.0:1787397510.055244:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397510.055250:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d18fd9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ebd expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397510.055298:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:2.0:1787397510.055366:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67142:x1874218681134592:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 404us (626us total) trans 103079215105 rc 301/301 00000100:00100000:2.0:1787397510.055374:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1131 00000100:00100000:1.0:1787397510.060262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397510.060796:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681134720 00000100:00100000:0.0:1787397510.060813:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681134720 00000100:00100000:0.0:1787397510.060891:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1132 00000100:00100000:0.0:1787397510.060902:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67142:x1874218681134720:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:0.0:1787397510.060999:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061017:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061029:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061046:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061070:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061077:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061172:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061181:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061188:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397510.061233:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397510.061264:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061279:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061285:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 2/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061292:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061298:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397510.061302:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061319:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061331:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff89a817898f00) 00010000:00010000:0.0:1787397510.061334:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397510.061338:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061344:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fda8 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061360:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061367:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061372:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061377:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397510.061380:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061386:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061393:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff89a807d24c00) 00010000:00010000:0.0:1787397510.061395:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397510.061398:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061415:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdaf lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061432:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061438:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061444:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061448:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397510.061451:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061457:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061465:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff89a807d24400) 00010000:00010000:0.0:1787397510.061467:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397510.061470:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397510.061477:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdb6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397510.061611:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67142:x1874218681134720:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 709us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397510.061620:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1132 00000100:00100000:1.0:1787397510.074849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397510.077153:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681134976 00000100:00100000:3.0:1787397510.077169:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681134976 00000100:00100000:3.0:1787397510.077261:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:3.0:1787397510.077273:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67142:x1874218681134976:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397510.078311:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67142:x1874218681134976:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 1034us (3468us total) trans 103079215106 rc 0/0 00000100:00100000:3.0:1787397510.078340:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00100000:1.0:1787397510.417090:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397510.417198:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135104 00000100:00100000:3.0:1787397510.417209:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135104 00000100:00100000:3.0:1787397510.417285:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:3.0:1787397510.417296:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681135104:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397510.417614:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681135104:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 319us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397510.417622:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:1.0:1787397510.430938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397510.430985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397510.431067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397510.431391:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135360 00000100:00100000:0.0:1787397510.431402:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135360 00000100:00100000:0.0:1787397510.431456:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135488 00000100:00100000:0.0:1787397510.431458:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135488 00000100:00100000:0.0:1787397510.431481:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2399 00000100:00100000:0.0:1787397510.431490:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681135360:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397510.431596:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681135360:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 107us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397510.431603:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2399 00000100:00100000:0.0:1787397510.431619:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2400 00000100:00100000:0.0:1787397510.431624:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681135488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397510.431643:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681135488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 19us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397510.431649:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2400 00000100:00100000:2.0:1787397510.432140:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135232 00000100:00100000:2.0:1787397510.432147:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135232 00000100:00100000:2.0:1787397510.432195:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1121 00000100:00100000:2.0:1787397510.432203:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681135232:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397510.432242:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681135232:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397510.432248:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1121 00010000:00010000:0.0:1787397510.948770:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397511.141009:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397511.141046:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700939776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397511.141133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397511.141180:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700939904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397511.141229:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397511.141326:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939776 00000100:00100000:2.0:1787397511.141334:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939776 00000100:00100000:1.0:1787397511.141375:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700939904 00000100:00100000:1.0:1787397511.141381:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700939904 00000100:00100000:2.0:1787397511.141399:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1787397511.141416:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700939776:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397511.141427:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1787397511.141438:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700939904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397511.141453:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787397511.141461:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397511.141516:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700939776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397511.141556:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700939904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397511.141557:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1787397511.141585:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1787397511.141618:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700939776:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397511.141981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397511.141986:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397511.142024:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700939904:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787397511.973565:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397512.996706:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397514.021140:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397514.214822:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397514.214850:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700940032:0@lo:400:kworker.0 00000100:00100000:0.0:1787397514.214938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397514.215045:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700940160:0@lo:400:kworker.0 00000100:00100000:0.0:1787397514.215087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397514.215144:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397514.215156:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940160 00000100:00100000:2.0:1787397514.215182:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940160 00000100:00100000:2.0:1787397514.215277:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1787397514.215292:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700940160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.216761:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940032 00000100:00100000:3.0:1787397514.216776:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940032 00000100:00100000:3.0:1787397514.216865:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787397514.216885:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700940032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397514.216929:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700940800:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.217376:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700940032:12345-0@lo:400:kworker.0 Request processed in 498us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397514.217388:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787397514.217452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.217501:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940800 00000100:00100000:3.0:1787397514.217509:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940800 00000100:00100000:1.0:1787397514.217510:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700941312:0@lo:400:kworker.0 00000100:00100000:1.0:1787397514.217585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397514.217612:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787397514.217619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700940672:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.217659:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941312 00000100:00100000:3.0:1787397514.217666:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941312 00000100:00100000:1.0:1787397514.217674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.217708:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:1.0:1787397514.217716:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700941184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.217726:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397514.217795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.217806:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700940800:12345-0@lo:400:kworker.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397514.217833:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700941696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.217834:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1787397514.217859:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:3.0:1787397514.217869:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700941312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397514.217881:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.217934:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700941312:12345-0@lo:400:kworker.0 Request processed in 65us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397514.217939:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700940800:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.217954:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1787397514.217970:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700941312:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.218031:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940672 00000100:00100000:1.0:1787397514.218033:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941184 00000100:00100000:3.0:1787397514.218039:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940672 00000100:00100000:1.0:1787397514.218043:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941184 00000100:00100000:3.0:1787397514.218089:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941696 00000100:00100000:3.0:1787397514.218095:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941696 00000100:00100000:1.0:1787397514.218103:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1787397514.218122:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700940672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.218130:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1787397514.218143:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700941184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.218191:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700941184:12345-0@lo:400:kworker.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397514.218199:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1787397514.218219:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1787397514.218225:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700941696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.218253:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700941696:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397514.218259:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:3.0:1787397514.218276:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397514.218283:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397514.218474:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700940288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397514.218885:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700941184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.229919:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700941696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.230719:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700940544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.231240:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700940160:12345-0@lo:400:kworker.0 Request processed in 15946us (16149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.231258:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1787397514.231596:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700940416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.231755:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397514.231799:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700940928:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.231827:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397514.231846:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700941440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.231869:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397514.231911:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700940032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.231955:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940416 00000100:00100000:2.0:1787397514.231964:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940416 00000100:00100000:2.0:1787397514.232031:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1787397514.232040:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700940416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.232256:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700940416:12345-0@lo:400:kworker.0 Request processed in 215us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.232265:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1787397514.232292:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940928 00000100:00100000:2.0:1787397514.232296:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940928 00000100:00100000:2.0:1787397514.232516:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941440 00000100:00100000:2.0:1787397514.232538:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941440 00000100:00100000:2.0:1787397514.232574:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1787397514.232581:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700940928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.232746:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700940928:12345-0@lo:400:kworker.0 Request processed in 57us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.232753:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1787397514.232766:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:2.0:1787397514.232772:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700941440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.232802:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700941440:12345-0@lo:400:kworker.0 Request processed in 31us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.232808:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00080000:2.0:1787397514.232831:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397514.232837:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397514.232879:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700940416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.232892:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700940928:0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.232903:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700941440:0@lo:400:kworker.0 00000100:00100000:1.0:1787397514.235176:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700940672:12345-0@lo:400:kworker.0 Request processed in 17052us (17497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397514.235189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397514.235198:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1787397514.235251:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940288 00000100:00100000:0.0:1787397514.235262:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940288 00000100:00100000:2.0:1787397514.235300:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700940672:0@lo:400:kworker.0 00000100:00100000:0.0:1787397514.235320:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1787397514.235337:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700940288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397514.235378:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397514.235426:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700940288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397514.235433:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1787397514.235482:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700940288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397514.235499:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700940160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.235594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397514.235762:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700940544 00000100:00100000:2.0:1787397514.235769:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700940544 00000100:00080000:0.0:1787397514.235839:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397514.235852:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1787397514.235864:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700940544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397514.235920:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700940544:12345-0@lo:400:kworker.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.235929:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1787397514.235992:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700940544:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.236008:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700941056:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.236203:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.236241:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700941568:0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.236284:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397514.236284:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941056 00000100:00100000:0.0:1787397514.236297:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941056 00000100:00080000:2.0:1787397514.236411:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397514.239753:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941568 00000100:00100000:0.0:1787397514.239769:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941568 00000100:00100000:0.0:1787397514.239851:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1787397514.239863:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700941056:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397514.239894:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397514.239995:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700941056:12345-0@lo:400:kworker.0 Request processed in 133us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397514.240005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1787397514.240036:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:0.0:1787397514.240046:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700941568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397514.240074:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700941056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397514.240112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700941568:12345-0@lo:400:kworker.0 Request processed in 66us (3828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397514.240127:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700941568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397514.240160:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1787397514.724926:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700941824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397514.725041:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700942080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397514.725062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397514.725126:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700941952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397514.726290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397514.726342:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942080 00000100:00100000:2.0:1787397514.726355:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942080 00000100:00100000:2.0:1787397514.726428:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1787397514.726438:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941824 00000100:00100000:0.0:1787397514.726444:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941824 00000100:00100000:2.0:1787397514.726463:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700942080:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397514.726487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1787397514.726496:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700941824:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:2.0:1787397514.726515:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:2.0:1787397514.726608:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700942080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397514.726617:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00002000:00000024:0.0:1787397514.726708:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397514.726749:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700941824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397514.726757:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1787397514.726812:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700942080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397514.729344:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700941824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397514.731323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397514.735239:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700941952 00000100:00100000:0.0:1787397514.735261:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700941952 00000100:00100000:0.0:1787397514.735478:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:0.0:1787397514.735493:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700941952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397514.735574:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397514.735893:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700941952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 403us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397514.735903:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1787397514.737504:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700941952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787397515.044769:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397515.531306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397515.531419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397515.531459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397515.531494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397515.531582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397515.531623:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135872 00000100:00100000:1.0:1787397515.531638:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135872 00000100:00100000:1.0:1787397515.531738:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135744 00000100:00100000:1.0:1787397515.531742:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135744 00000100:00100000:1.0:1787397515.531776:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1128 00000100:00100000:1.0:1787397515.531789:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681135872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397515.535427:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1129 00000100:00100000:2.0:1787397515.535468:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681135744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397515.535651:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136128 00000100:00100000:0.0:1787397515.535674:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136128 00000100:00100000:0.0:1787397515.535759:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136000 00000100:00100000:0.0:1787397515.535764:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136000 00000100:00100000:0.0:1787397515.535804:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2405 00000100:00100000:0.0:1787397515.535814:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681136128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397515.535945:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2406 00000100:00100000:1.0:1787397515.535956:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681136000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397515.539901:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681135616 00000100:00100000:3.0:1787397515.539924:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681135616 00000100:00080000:3.0:1787397515.539969:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397515.539977:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397515.539982:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397515.539985:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397515.540072:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:3.0:1787397515.540084:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681135616:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397515.540344:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2403:x1874218681135744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 4894us (8844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397515.540358:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1129 00000100:00100000:2.0:1787397515.540481:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681135872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 8695us (9061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397515.540489:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1128 00000100:00100000:2.0:1787397515.543427:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681136128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 7592us (11942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397515.543458:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2405 00000100:00100000:0.0:1787397515.548319:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681136000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 12344us (16714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397515.548340:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2406 00000100:00100000:0.0:1787397515.567106:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681135616:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27004us (35803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397515.567130:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000001:00080000:1.0:1787397515.762983:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00010000:00010000:0.0:1787397516.072090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397516.261837:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397516.261888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700942208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397516.261992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397516.262055:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942208 00000100:00100000:0.0:1787397516.262066:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942208 00000100:00100000:0.0:1787397516.262135:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1787397516.262148:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700942208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397516.262179:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397516.262229:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700942208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397516.262238:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00080000:0.0:1787397516.262262:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397516.262314:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700942208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397516.263481:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700942336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397516.263922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397516.264266:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942336 00000100:00100000:3.0:1787397516.264277:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942336 00000100:00100000:3.0:1787397516.264354:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1787397516.264366:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700942336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397516.264405:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397516.266624:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700942336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2249us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397516.266646:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1787397516.266782:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700942336:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397516.267666:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787397517.092837:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397518.122699:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397518.552113:0:87873:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 07:18:35 (1787397515) 00000100:00100000:0.0:1787397518.623903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397518.623961:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136256 00000100:00100000:0.0:1787397518.623974:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136256 00000100:00100000:0.0:1787397518.624070:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1133 00000100:00100000:0.0:1787397518.624085:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67732:x1874218681136256:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397518.624116:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397518.624154:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fdbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ec4 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625846:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625875:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625893:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625913:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625920:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625926:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.625999:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626008:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626015:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626022:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397518.626027:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626049:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626065:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00010000:00010000:0.0:1787397518.626068:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397518.626073:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626079:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d18fdc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626091:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626096:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626101:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626106:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397518.626109:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626115:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626123:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff89a807d24400) 00010000:00010000:0.0:1787397518.626125:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397518.626128:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626142:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fdcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626193:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fdbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ec4 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.626205:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00010000:00010000:0.0:1787397518.626207:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397518.626211:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fdbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ec4 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397518.627353:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54800, rc 0) 00000100:00100000:0.0:1787397518.627490:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67732:x1874218681136256:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3403us (3597us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397518.627503:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1133 00000100:00080000:0.0:1787397518.627577:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397518.648933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397518.650983:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136512 00000100:00100000:3.0:1787397518.651006:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136512 00000100:00100000:3.0:1787397518.651105:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1134 00000100:00100000:3.0:1787397518.651118:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67732:x1874218681136512:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397518.651151:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397518.651155:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787397518.651196:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d18fd54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea8 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651216:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a835da1900) 00010000:00010000:3.0:1787397518.651230:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397518.651251:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fdd2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ecb expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651408:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651424:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651436:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651469:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651478:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.651486:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653485:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653513:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653563:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397518.653578:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:3.0:1787397518.653623:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653632:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653639:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653648:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653655:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397518.653678:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653687:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653702:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:3.0:1787397518.653705:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397518.653710:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653717:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fdd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397518.653735:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f98a9bb0 reply state 000000004be53e66 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653748:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653755:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff89a817ea6a00) 00010000:00010000:3.0:1787397518.653758:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397518.653761:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397518.653804:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fdd2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653829:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.653837:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397518.653839:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397518.653848:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397518.653980:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67732:x1874218681136512:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 2864us (5064us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1787397518.653991:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1134 00000100:00100000:1.0:1787397518.662943:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397518.663095:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136768 00000100:00100000:3.0:1787397518.663121:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136768 00000100:00100000:3.0:1787397518.663209:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1135 00000100:00100000:3.0:1787397518.663233:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67732:x1874218681136768:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397518.663272:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397518.663307:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fdf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ed2 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.663693:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.663714:0:66176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.663724:0:66176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.663774:0:66176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.663791:0:66176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 11 pid: 66177 timeout: 3497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397518.663811:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218700942464:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397518.663955:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397518.668802:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218700942464:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397518.668854:0:66176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397518.672294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397518.675186:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681136896 00000100:00100000:2.0:1787397518.675209:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681136896 00010000:00010000:2.0:1787397518.675269:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 12 pid: 66177 timeout: 3497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397518.675338:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2584 00000100:00100000:2.0:1787397518.675349:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2404:x1874218681136896:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397518.675369:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397518.675388:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 12 pid: 66177 timeout: 3497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675404:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 12 pid: 66177 timeout: 3497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675433:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fde7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ecb expref: 12 pid: 66177 timeout: 3497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675454:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397518.675460:0:19659:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675481:0:19659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675490:0:19659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397518.675618:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397518.675678:0:66176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.675690:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397518.675717:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00000100:00100000:2.0:1787397518.675849:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2404:x1874218681136896:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 500us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397518.675859:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2584 00010000:00010000:3.0:1787397518.676057:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676068:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676075:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676083:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397518.676089:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676099:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676118:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397518.676122:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397518.676127:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676143:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fdfc lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676228:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fdf5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ed2 expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676240:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6b00) 00010000:00010000:3.0:1787397518.676243:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397518.676247:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fdf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ed2 expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397518.676261:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031c00, rc 0) 00000100:00100000:3.0:1787397518.676318:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67732:x1874218681136768:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 13089us (13393us total) trans 103079215108 rc 301/301 00000100:00100000:3.0:1787397518.676327:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1135 00000100:00100000:2.0:1787397518.683611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397518.683874:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137152 00000100:00100000:3.0:1787397518.683890:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137152 00000100:00100000:3.0:1787397518.683973:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 218 00000100:00100000:3.0:1787397518.683987:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67732:x1874218681137152:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787397518.684888:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:67732:x1874218681137152:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 897us (1296us total) trans 103079215109 rc 0/0 00000100:00100000:0.0:1787397518.684903:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 218 00000100:00100000:2.0:1787397518.690190:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397518.690292:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137408 00000100:00100000:3.0:1787397518.690307:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137408 00000100:00100000:3.0:1787397518.690388:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 219 00000100:00100000:3.0:1787397518.690400:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:67732:x1874218681137408:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397518.690792:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:67732:x1874218681137408:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 392us (614us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1787397518.690800:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 219 00010000:00010000:1.0:1787397519.143350:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397519.333701:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397519.333737:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700942592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397519.333823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.335821:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942592 00000100:00100000:3.0:1787397519.335844:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942592 00000100:00100000:3.0:1787397519.335955:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1787397519.335968:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700942592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397519.336026:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397519.336154:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700942592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.336163:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1787397519.336296:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700942592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397519.337307:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700942848:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337441:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700943360:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337480:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700943872:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337551:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397519.337558:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700942976:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337608:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700943488:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337650:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700944000:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397519.337723:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942848 00000100:00100000:2.0:1787397519.337731:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942848 00000100:00100000:2.0:1787397519.337790:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942976 00000100:00100000:2.0:1787397519.337793:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942976 00000100:00100000:2.0:1787397519.337820:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1787397519.337827:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700942848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337874:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700942848:12345-0@lo:400:kworker.0 Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.337881:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1787397519.337910:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1787397519.337916:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700942976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.337941:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700942976:12345-0@lo:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.337947:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1787397519.337976:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943360 00000100:00100000:2.0:1787397519.337981:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943360 00000100:00100000:2.0:1787397519.338006:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1787397519.338011:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700943360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338045:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700943360:12345-0@lo:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.338051:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1787397519.338072:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943872 00000100:00100000:2.0:1787397519.338075:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943872 00000100:00100000:2.0:1787397519.338104:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943488 00000100:00100000:2.0:1787397519.338107:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943488 00000100:00100000:2.0:1787397519.338125:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944000 00000100:00100000:2.0:1787397519.338128:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944000 00000100:00100000:2.0:1787397519.338150:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:2.0:1787397519.338155:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338187:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700943872:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.338193:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:2.0:1787397519.338396:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1787397519.338403:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338429:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700943488:12345-0@lo:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.338435:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1787397519.338446:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:2.0:1787397519.338452:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338477:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700944000:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397519.338492:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00080000:2.0:1787397519.338551:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397519.338556:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397519.338559:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397519.338561:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397519.338622:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700942976:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338633:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700943488:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338642:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700944000:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338652:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700942848:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338661:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700943360:0@lo:400:kworker.0 00000100:00100000:2.0:1787397519.338669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700943872:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339006:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700942720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339100:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700943232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339147:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700943744:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339188:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787397519.339195:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700943104:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339235:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700943616:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339280:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700944128:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.339343:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700942720 00000100:00100000:3.0:1787397519.339349:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700942720 00000100:00100000:3.0:1787397519.339393:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787397519.339401:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700942720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339453:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700942720:12345-0@lo:400:kworker.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.339460:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787397519.339493:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943232 00000100:00100000:3.0:1787397519.339497:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943232 00000100:00100000:3.0:1787397519.339556:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943744 00000100:00100000:3.0:1787397519.339560:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943744 00000100:00100000:3.0:1787397519.339579:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943104 00000100:00100000:3.0:1787397519.339582:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943104 00000100:00100000:3.0:1787397519.339611:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944128 00000100:00100000:3.0:1787397519.339614:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944128 00000100:00100000:3.0:1787397519.339628:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1787397519.339633:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700943232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339666:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700943232:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.339672:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1787397519.339805:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1787397519.339812:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700943744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339842:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218700943744:12345-0@lo:400:kworker.0 Request processed in 30us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.339849:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1787397519.339859:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1787397519.339865:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700943104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339892:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700943104:12345-0@lo:400:kworker.0 Request processed in 27us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.339897:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1787397519.339907:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1787397519.339919:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700944128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.339947:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218700944128:12345-0@lo:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.339952:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1787397519.339977:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700943616 00000100:00100000:3.0:1787397519.339980:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700943616 00000100:00100000:3.0:1787397519.340024:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:3.0:1787397519.340030:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700943616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340061:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700943616:12345-0@lo:400:kworker.0 Request processed in 31us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.340068:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00080000:3.0:1787397519.340098:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397519.340103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397519.340105:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397519.340139:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700943104:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340150:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700943616:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340160:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218700944128:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340168:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700942720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340178:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700943232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397519.340187:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218700943744:0@lo:400:kworker.0 00000001:00080000:1.0:1787397519.573624:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:2.0:1787397519.573765:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573782:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573791:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573797:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397519.573802:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573811:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573861:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff89a817ea6a00) 00010000:00010000:2.0:1787397519.573865:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397519.573871:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397519.573878:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fde0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397519.668897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397519.671242:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137536 00000100:00100000:0.0:1787397519.671261:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137536 00000100:00100000:0.0:1787397519.671884:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1136 00000100:00100000:0.0:1787397519.671898:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:67741:x1874218681137536:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397519.671931:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397519.671966:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fe0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ed9 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672057:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672075:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672091:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397519.672153:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397519.672158:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397519.672182:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672515:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d18fe0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ed9 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672606:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ed9 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397519.672618:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81301cc00) 00010000:00010000:0.0:1787397519.672622:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397519.672627:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54800, rc 0) 00000100:00100000:0.0:1787397519.672909:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67741:x1874218681137536:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1013us (4028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397519.672920:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1136 00000100:00100000:3.0:1787397519.680033:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397519.680439:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137664 00000100:00100000:0.0:1787397519.680472:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137664 00000100:00100000:0.0:1787397519.680566:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1137 00000100:00100000:0.0:1787397519.680578:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67741:x1874218681137664:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397519.680643:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:0.0:1787397519.680758:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67741:x1874218681137664:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 182us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397519.680767:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1137 00000100:00100000:2.0:1787397519.687634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397519.687905:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137792 00000100:00100000:3.0:1787397519.687919:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137792 00000100:00100000:3.0:1787397519.688012:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1138 00000100:00100000:3.0:1787397519.688025:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:67741:x1874218681137792:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397519.688086:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397519.688171:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:67741:x1874218681137792:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 148us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.688179:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1138 00000100:00080000:2.0:1787397519.691419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397519.698212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397519.698344:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681137920 00000100:00100000:1.0:1787397519.698358:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681137920 00000100:00100000:1.0:1787397519.698452:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1925 00000100:00100000:1.0:1787397519.698463:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67741:x1874218681137920:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397519.698546:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397519.698648:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67741:x1874218681137920:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 186us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397519.698656:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1925 00000100:00080000:2.0:1787397519.698872:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397519.703791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397519.703905:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138048 00000100:00100000:0.0:1787397519.703920:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138048 00000100:00100000:0.0:1787397519.704019:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1926 00000100:00100000:0.0:1787397519.704033:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67741:x1874218681138048:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397519.704085:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397519.704167:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:67741:x1874218681138048:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397519.704176:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1926 00000100:00080000:2.0:1787397519.704280:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397519.808473:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397519.808557:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138304 00000100:00100000:3.0:1787397519.808571:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138304 00000100:00100000:3.0:1787397519.808656:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1139 00000100:00100000:3.0:1787397519.808669:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67748:x1874218681138304:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:3.0:1787397519.808752:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397519.808794:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d18fe11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ed9 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.808821:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81301cc00) 00010000:00010000:3.0:1787397519.809807:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397519.810045:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.810065:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.810080:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.810097:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.810118:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.810127:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817897:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817921:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817929:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817948:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817956:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397519.817961:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817971:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.817996:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6b00) 00010000:00010000:1.0:1787397519.817999:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397519.818005:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.818013:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397519.818043:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad6c074d reply state 00000000c2fcfed2 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.818059:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397519.818069:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817ea6f00) 00010000:00010000:1.0:1787397519.818072:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397519.818075:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397519.819302:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67748:x1874218681138304:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 10620us (10832us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1787397519.819316:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1139 00000100:00100000:3.0:1787397519.860010:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700944256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397519.860121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.860628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397519.860794:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944256 00000100:00100000:3.0:1787397519.860804:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944256 00000100:00100000:3.0:1787397519.860868:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1787397519.860879:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700944256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397519.860923:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00000100:00100000:3.0:1787397519.860982:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700944256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.860989:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1787397519.861017:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700944384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397519.861050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.861087:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138432 00000100:00100000:3.0:1787397519.861091:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138432 00000100:00100000:3.0:1787397519.861123:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1140 00000100:00100000:3.0:1787397519.861129:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67751:x1874218681138432:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397519.861146:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397519.861175:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ee0 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.862477:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.864703:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.864727:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397519.864804:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397519.864808:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397519.864842:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.864887:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee0 expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.864911:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee0 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.864922:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:3.0:1787397519.864925:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397519.864929:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030a00, rc 0) 00000100:00100000:3.0:1787397519.865029:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67751:x1874218681138432:12345-192.168.204.60@tcp:101:rm.0 Request processed in 3897us (4403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.865040:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1140 00000100:00100000:3.0:1787397519.865156:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700944256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397519.868632:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944384 00000100:00100000:3.0:1787397519.868660:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944384 00000100:00100000:3.0:1787397519.868735:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1787397519.868747:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700944384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397519.868778:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397519.868874:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700944384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (7822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.868882:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1787397519.872929:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700944512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397519.873033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397519.873152:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700944384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397519.873206:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944512 00000100:00100000:3.0:1787397519.873215:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944512 00000100:00100000:3.0:1787397519.873269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1787397519.873279:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700944512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397519.873307:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397519.873355:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700944512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.873363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1787397519.873732:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700944512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397519.881564:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397519.881626:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138560 00000100:00100000:3.0:1787397519.881639:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138560 00000100:00100000:3.0:1787397519.881711:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1141 00000100:00100000:3.0:1787397519.881723:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67751:x1874218681138560:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397519.881753:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397519.881795:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d18fe34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ee7 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881883:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881899:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881912:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881924:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881930:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.881937:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882041:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882049:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882055:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397519.882113:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787397519.882118:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397519.882139:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882158:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882167:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882173:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882179:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.882185:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397519.882190:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.883946:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.883969:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:3.0:1787397519.883972:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397519.883978:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.883987:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d18fe3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884012:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884019:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884043:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884049:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397519.884053:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884058:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884067:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397519.884069:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397519.884072:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884078:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d18fe42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884133:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d18fe34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee7 expref: 12 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884148:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee7 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.884155:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff89a817ea6700) 00010000:00010000:3.0:1787397519.884157:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397519.884159:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397519.886816:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:67751:x1874218681138560:12345-192.168.204.60@tcp:101:rm.0 Request processed in 5073us (5245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397519.886848:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1141 00000100:00100000:3.0:1787397519.894845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397519.894895:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138816 00000100:00100000:3.0:1787397519.894909:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138816 00000100:00100000:3.0:1787397519.894979:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1142 00000100:00100000:3.0:1787397519.894992:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:67751:x1874218681138816:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397519.895072:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787397519.895107:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d18fe49 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee7 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895132:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff89a817ea6700) 00010000:00010000:3.0:1787397519.895151:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d18fe2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ee0 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895161:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:3.0:1787397519.895168:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397519.895200:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895228:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895239:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895251:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895286:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895295:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895403:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895412:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895418:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895819:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895829:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895837:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895845:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895851:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895857:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895891:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397519.895914:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895921:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895928:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895935:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397519.895940:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895948:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895958:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff89a817ea6e00) 00010000:00010000:3.0:1787397519.895961:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397519.895965:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895971:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d18fe5e lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.895996:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896002:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896007:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896020:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896025:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397519.896028:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896034:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896044:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:3.0:1787397519.896046:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397519.896049:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896055:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d18fe50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397519.896071:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d37c347 reply state 00000000632aac18 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896083:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.896089:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397519.896091:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397519.896094:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397519.897360:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:67751:x1874218681138816:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1197us (1357us total) trans 103079215112 rc 0/0 00000100:00100000:3.0:1787397519.897383:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1142 00010000:00010000:3.0:1787397519.897453:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397519.897462:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.897472:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397519.897477:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.897560:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.897589:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff89a817ea6e00) 00010000:00010000:3.0:1787397519.897592:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397519.897597:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.897604:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d18fe65 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397519.897632:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397519.897634:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397519.897636:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397520.164762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397520.648180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397520.649195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397520.649325:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139072 00000100:00100000:3.0:1787397520.649341:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139072 00000100:00100000:3.0:1787397520.649447:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1136 00000100:00100000:3.0:1787397520.649459:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2402:x1874218681139072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397520.649603:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2402:x1874218681139072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 146us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397520.649612:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1136 00000100:00080000:1.0:1787397520.651415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397520.653094:0:87058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138944 00000100:00100000:2.0:1787397520.653112:0:87058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138944 00000100:00100000:2.0:1787397520.653331:0:87058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:2.0:1787397520.653343:0:87058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681138944:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397520.653456:0:87058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681138944:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 115us (5292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397520.653465:0:87058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:1.0:1787397520.661460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397520.661508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397520.661576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397520.661600:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139200 00000100:00100000:1.0:1787397520.661622:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139328 00000100:00100000:3.0:1787397520.661632:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139200 00000100:00100000:1.0:1787397520.661632:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139328 00000100:00100000:1.0:1787397520.661706:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139456 00000100:00100000:1.0:1787397520.661710:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139456 00000100:00100000:3.0:1787397520.661715:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1137 00000100:00100000:3.0:1787397520.661730:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681139200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397520.661741:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2411 00000100:00100000:1.0:1787397520.661752:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139328:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397520.661845:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2412 00000100:00100000:2.0:1787397520.661856:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397520.661915:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397520.661923:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2412 00000100:00100000:3.0:1787397520.661936:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681139200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 209us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397520.661946:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1137 00000100:00100000:1.0:1787397520.663266:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139328:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1504us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397520.663282:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2411 00000020:00000080:0.0:1787397521.008927:0:87972:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe980531b0 00000020:00000080:0.0:1787397521.008957:0:87972:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:0.0:1787397521.009685:0:87972:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:3.0:1787397521.188741:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397521.381055:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700944640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397521.381156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397521.381354:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944640 00000100:00100000:3.0:1787397521.381364:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944640 00000100:00100000:2.0:1787397521.381402:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700944768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397521.381437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397521.381440:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1787397521.381451:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700944640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397521.382062:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787397521.382274:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397521.382323:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700944640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 871us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397521.382333:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1787397521.382360:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944768 00000100:00100000:3.0:1787397521.382365:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944768 00000100:00100000:3.0:1787397521.382472:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1787397521.382480:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700944768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397521.382501:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787397521.382659:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397521.382708:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700944640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397521.393001:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700944768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10503us (11544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397521.393021:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:2.0:1787397521.393693:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700944768:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787397522.212689:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397523.236743:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397524.263626:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397524.452813:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700945024:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.452882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.452923:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700945536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.452949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.452968:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700946048:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.452989:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453013:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787397524.453019:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700944896:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453069:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700945408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453101:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700945920:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453133:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700946432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453174:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700945152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453199:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453216:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700945664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.453762:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946176:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.453788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.454630:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787397524.454642:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700945280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.454676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.454696:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700945792:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.454718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397524.454767:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945664 00000100:00100000:1.0:1787397524.454777:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945664 00000100:00100000:1.0:1787397524.454831:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946176 00000100:00100000:1.0:1787397524.454834:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946176 00000100:00100000:1.0:1787397524.454859:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1787397524.454867:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700945664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.454919:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700945664:12345-0@lo:400:kworker.0 Request processed in 52us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397524.454933:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1787397524.454956:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:1.0:1787397524.454967:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.454998:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946176:12345-0@lo:400:kworker.0 Request processed in 37us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397524.455004:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00080000:1.0:1787397524.455021:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397524.455033:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397524.455043:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700946560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397524.455102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397524.456277:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945792 00000100:00100000:2.0:1787397524.456288:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945792 00000100:00100000:3.0:1787397524.456306:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787397524.456349:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:3.0:1787397524.456355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.456405:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700945664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.456418:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946176:0@lo:400:kworker.0 00000100:00080000:1.0:1787397524.456419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397524.456602:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945024 00000100:00100000:3.0:1787397524.456606:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945024 00000100:00100000:3.0:1787397524.456637:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945408 00000100:00100000:3.0:1787397524.456640:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945408 00000100:00100000:3.0:1787397524.456652:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945920 00000100:00100000:3.0:1787397524.456654:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945920 00000100:00100000:3.0:1787397524.456663:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946432 00000100:00100000:3.0:1787397524.456665:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946432 00000100:00100000:3.0:1787397524.456673:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945152 00000100:00100000:3.0:1787397524.456675:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945152 00000100:00100000:3.0:1787397524.456798:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945280 00000100:00100000:3.0:1787397524.456802:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945280 00000100:00100000:2.0:1787397524.456816:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700945792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397524.456875:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700945792:12345-0@lo:400:kworker.0 Request processed in 517us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397524.456883:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:2.0:1787397524.456904:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946304 00000100:00080000:1.0:1787397524.456906:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397524.456908:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946304 00000100:00080000:1.0:1787397524.456911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397524.456912:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1787397524.456921:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700945024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397524.456954:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00080000:1.0:1787397524.456974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00000080:3.0:1787397524.457028:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828835880 x1874218700945024/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787397535 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397524.457039:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457078:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700945024:12345-0@lo:400:kworker.0 Request processed in 158us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457087:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1787397524.457088:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946304:12345-0@lo:400:kworker.0 Request processed in 52us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397524.457098:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:3.0:1787397524.457106:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1787397524.457114:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700945408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457143:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700945408:12345-0@lo:400:kworker.0 Request processed in 31us (4054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457148:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1787397524.457173:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1787397524.457179:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700945920:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397524.457189:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828834000 x1874218700945920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787397535 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397524.457216:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700945920:12345-0@lo:400:kworker.0 Request processed in 37us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457222:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1787397524.457238:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1787397524.457244:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700946432:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397524.457254:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828834380 x1874218700946432/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787397535 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397524.457279:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700946432:12345-0@lo:400:kworker.0 Request processed in 36us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457285:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1787397524.457295:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1787397524.457300:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457324:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700945152:12345-0@lo:400:kworker.0 Request processed in 25us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457329:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1787397524.457340:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1787397524.457346:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700945280:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397524.457358:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828836300 x1874218700945280/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787397535 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397524.457382:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700945280:12345-0@lo:400:kworker.0 Request processed in 37us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457394:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1787397524.457413:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700945536 00000100:00100000:3.0:1787397524.457418:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700945536 00000100:00100000:3.0:1787397524.457545:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946048 00000100:00100000:3.0:1787397524.457548:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946048 00000100:00100000:3.0:1787397524.457562:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946560 00000100:00100000:3.0:1787397524.457565:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946560 00000100:00100000:3.0:1787397524.457574:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1787397524.457580:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700945536:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397524.457595:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828835180 x1874218700945536/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:720/0 lens 224/224 e 0 to 0 dl 1787397535 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397524.457609:0:87053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700944896 00000100:00100000:1.0:1787397524.457614:0:87053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700944896 00000100:00100000:3.0:1787397524.457623:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700945536:12345-0@lo:400:kworker.0 Request processed in 44us (4675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457629:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1787397524.457640:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1787397524.457641:0:87053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787397524.457645:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.457647:0:87053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700944896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457670:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700946048:12345-0@lo:400:kworker.0 Request processed in 26us (4681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397524.457672:0:87053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700944896:12345-0@lo:400:kworker.0 Request processed in 26us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.457676:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1787397524.457678:0:87053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787397524.457688:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1787397524.457694:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700946560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397524.457715:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397524.457729:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700944896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.457743:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700945408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457751:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700946560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397524.457754:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700945920:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457756:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:1.0:1787397524.457764:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700946432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.457784:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700945024:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457792:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700946560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397524.457796:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700945536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397524.457805:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700946048:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457831:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700945280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457842:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700945792:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457852:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946304:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.457861:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700945152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397524.965363:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397524.965443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.965491:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397524.965497:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700946816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397524.965539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397524.965580:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946688 00000100:00100000:3.0:1787397524.965586:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946688 00000100:00100000:3.0:1787397524.965630:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1787397524.965638:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397524.965666:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397524.965706:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700946688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397524.965712:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1787397524.965930:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397524.967332:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700946944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397524.967388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397524.967492:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946944 00000100:00100000:2.0:1787397524.967499:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946944 00000100:00100000:2.0:1787397524.967565:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1787397524.967575:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700946944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397524.967602:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397524.967644:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700946944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397524.967652:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1787397524.968161:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700946944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397524.970150:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700946816 00000100:00100000:0.0:1787397524.970166:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700946816 00000100:00100000:0.0:1787397524.970231:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1787397524.970242:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700946816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397524.970278:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445117952 avail 1298878464 00010000:00000080:0.0:1787397524.970296:0:23942:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876f480 x1874218700946816/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:720/0 lens 224/368 e 0 to 0 dl 1787397535 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397524.971515:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700946816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1270us (5969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397524.971540:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1787397524.971614:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700946816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397525.284732:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397525.766636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397525.766716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397525.766750:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397525.766771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397525.766796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397525.766827:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140096 00000100:00100000:1.0:1787397525.766835:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140096 00000100:00100000:1.0:1787397525.766887:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139968 00000100:00100000:1.0:1787397525.766890:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139968 00000100:00100000:1.0:1787397525.766912:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2417 00000100:00100000:1.0:1787397525.766921:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681140096:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397525.766993:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681140096:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397525.767001:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2417 00000100:00100000:1.0:1787397525.767021:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2418 00000100:00100000:1.0:1787397525.767028:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139968:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397525.767054:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681139968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397525.767060:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2418 00000100:00100000:1.0:1787397525.767078:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139840 00000100:00100000:1.0:1787397525.767081:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139840 00000100:00100000:1.0:1787397525.767117:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139712 00000100:00100000:1.0:1787397525.767120:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139712 00000100:00100000:1.0:1787397525.767160:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1144 00000100:00100000:1.0:1787397525.767167:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681139840:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397525.767201:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681139840:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397525.767208:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1144 00000100:00100000:1.0:1787397525.767222:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1145 00000100:00100000:1.0:1787397525.767229:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2403:x1874218681139712:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787397525.767246:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678f480 x1874218681139712/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:721/0 lens 224/224 e 0 to 0 dl 1787397536 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397525.767271:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2403:x1874218681139712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397525.767277:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1145 00000100:00080000:1.0:1787397525.767297:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397525.767302:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397525.767305:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397525.767307:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397525.767647:0:87055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681139584 00000100:00100000:3.0:1787397525.767654:0:87055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681139584 00000100:00100000:3.0:1787397525.767707:0:87055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:3.0:1787397525.767717:0:87055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681139584:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397525.767759:0:87055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681139584:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397525.767767:0:87055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 84 00000001:00080000:3.0:1787397525.864239:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215112 is committed 00010000:00010000:0.0:1787397525.866200:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866216:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866224:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866231:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397525.866236:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866244:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866264:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397525.866268:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397525.866273:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866280:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031c00/0x274786fe0d18fe1f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866299:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866313:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866319:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866325:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397525.866328:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866334:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866343:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397525.866346:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397525.866349:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397525.866355:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d18fe57 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397526.311145:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397526.500738:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397526.500814:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397526.500941:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947072 00000100:00100000:3.0:1787397526.500950:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947072 00000100:00100000:3.0:1787397526.501011:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1787397526.501020:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700947072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397526.501043:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397526.505896:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700947200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397526.505972:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397526.506081:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947200 00000100:00100000:1.0:1787397526.506091:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947200 00000100:00100000:1.0:1787397526.506135:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1787397526.506144:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700947200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397526.506169:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397526.506224:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700947200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397526.506231:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1787397526.506285:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700947200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397526.508258:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700947072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7230us (7435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397526.508273:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00080000:3.0:1787397526.508314:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397526.508319:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397526.509295:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700947072:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1787397526.764054:0:88268:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1787397526.842879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397526.846959:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140224 00000100:00100000:2.0:1787397526.846977:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140224 00000100:00100000:2.0:1787397526.847362:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1143 00000100:00100000:2.0:1787397526.847394:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:67819:x1874218681140224:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397526.847416:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397526.847451:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d18fe6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7eee expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847549:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847566:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847579:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397526.847633:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397526.847637:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397526.847680:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847706:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d18fe6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eee expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847727:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eee expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.847736:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817898100) 00010000:00010000:2.0:1787397526.847738:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397526.847742:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00010000:00000080:2.0:1787397526.847751:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678d500 x1874218681140224/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 576/688 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397526.847847:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67819:x1874218681140224:12345-192.168.204.60@tcp:101:dd.0 Request processed in 465us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397526.847854:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1143 00000100:00100000:1.0:1787397526.854325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397526.854555:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140480 00000100:00100000:2.0:1787397526.854565:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140480 00000100:00100000:3.0:1787397526.854665:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1144 00000100:00100000:3.0:1787397526.854679:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:67819:x1874218681140480:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397526.854704:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397526.854707:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787397526.854736:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d18fe73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eee expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854752:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817898100) 00010000:00010000:3.0:1787397526.854765:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397526.854782:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18fe7a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ef5 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854932:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854945:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854955:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854970:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854977:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.854984:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855046:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855268:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855279:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397526.855631:0:74374:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787397526.855635:0:74374:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1787397517 00000004:00010000:3.0:1787397526.855638:0:74374:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1787397517 00000004:00010000:3.0:1787397526.855646:0:74374:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1787397517 00000004:00010000:3.0:1787397526.855648:0:74374:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1787397526.855653:0:74374:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1787397526.855659:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855666:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855673:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855680:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397526.855686:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855694:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855705:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:3.0:1787397526.855709:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397526.855713:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855720:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef800/0x274786fe0d18fe81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855732:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855737:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855752:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855757:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397526.855760:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855766:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855775:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff89a817be7800) 00010000:00010000:3.0:1787397526.855778:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397526.855781:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855787:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee000/0x274786fe0d18fe88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855833:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18fe7a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855846:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.855853:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7a00) 00010000:00010000:3.0:1787397526.855855:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787397526.855857:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ef000, rc 0) 00010000:00000080:3.0:1787397526.855865:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678ea00 x1874218681140480/t103079215113(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 752/824 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397526.856493:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67819:x1874218681140480:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1816us (2177us total) trans 103079215113 rc 0/0 00000100:00100000:3.0:1787397526.856505:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1144 00000100:00100000:1.0:1787397526.875212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397526.875322:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140608 00000100:00100000:2.0:1787397526.875331:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140608 00000100:00100000:2.0:1787397526.875430:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1145 00000100:00100000:2.0:1787397526.875451:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:67819:x1874218681140608:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397526.875485:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397526.875505:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d18fe9d lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7efc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875570:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d18fea4 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875585:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d18fea4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875599:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d18fea4 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875728:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d18fe9d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7efc expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875745:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d18fea4 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7efc expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397526.875765:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7a00) 00010000:00010000:2.0:1787397526.875768:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397526.875772:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ac00, rc 0) 00010000:00000080:2.0:1787397526.875781:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678e300 x1874218681140608/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 568/1272 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397526.875845:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67819:x1874218681140608:12345-192.168.204.60@tcp:101:dd.0 Request processed in 406us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397526.875853:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1145 00000100:00100000:0.0:1787397526.880711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397526.880952:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140864 00000100:00100000:3.0:1787397526.880962:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140864 00000100:00100000:3.0:1787397526.881021:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1146 00000100:00100000:3.0:1787397526.881033:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:67819:x1874218681140864:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:3.0:1787397526.881179:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.881197:0:66176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.881206:0:66176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.881341:0:66176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.881355:0:66176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397526.881370:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218700947328:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397526.881465:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397526.885630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397526.885684:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140992 00000100:00100000:3.0:1787397526.885702:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140992 00010000:00010000:3.0:1787397526.885745:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397526.885784:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2585 00000100:00100000:3.0:1787397526.885795:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2405:x1874218681140992:12345-192.168.204.60@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1787397526.885813:0:19662:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885826:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885840:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885849:0:19662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7a00) 00010000:00010000:3.0:1787397526.885852:0:19662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787397526.885857:0:19662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885867:0:19662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885874:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.885898:0:19662:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397526.885952:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2405:x1874218681140992:12345-192.168.204.60@tcp:102:ldlm_bl.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397526.885967:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2585 00000100:00100000:3.0:1787397526.888936:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218700947328:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397526.888966:0:66176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.888980:0:66176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.888986:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397526.889151:0:66176:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787397526.889154:0:66176:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1787397517 -> 1787397526 00000004:00010000:3.0:1787397526.889157:0:66176:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1787397517 -> 1787397517 00000004:00010000:3.0:1787397526.889160:0:66176:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1787397517 -> 1787397526 00000004:00010000:3.0:1787397526.889162:0:66176:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1787397526.889169:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007982ce4e reply state 000000008374ca2b transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.889186:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397526.889195:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7a00) 00010000:00010000:3.0:1787397526.889198:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397526.889201:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1787397526.889251:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8047cbb80 x1874218681140864/t103079215114(0) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 488/456 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397526.889308:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:67819:x1874218681140864:12345-192.168.204.60@tcp:36:dd.0 Request processed in 8279us (8606us total) trans 103079215114 rc 0/0 00000100:00100000:3.0:1787397526.889325:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1146 00000100:00100000:0.0:1787397526.908921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397526.909027:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141120 00000100:00100000:1.0:1787397526.909038:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141120 00002000:00010000:1.0:1787397526.909080:0:66201:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1787397526.909085:0:66201:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a8047ca300 with x1874218681141120 00000100:00100000:1.0:1787397526.909124:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787397526.909134:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2404:x1874218681141120:12345-192.168.204.60@tcp:10:dd.0 00000004:00010000:1.0:1787397526.909324:0:66201:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1787397526.909328:0:66201:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1787397526 -> 1787397526 00000004:00010000:1.0:1787397526.909331:0:66201:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1787397517 -> 1787397517 00000004:00010000:1.0:1787397526.909333:0:66201:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1787397526 -> 1787397526 00000004:00010000:1.0:1787397526.909336:0:66201:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1787397526.909354:0:66201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8047ca300 x1874218681141120/t103079215115(0) o10->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 440/432 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397526.909418:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2404:x1874218681141120:12345-192.168.204.60@tcp:10:dd.0 Request processed in 284us (508us total) trans 103079215115 rc 0/0 00000100:00100000:1.0:1787397526.909426:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00002000:00010000:1.0:1787397526.909429:0:66201:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1787397526.909432:0:66201:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a8047ca300 with x1874218681141120 00000100:00100000:0.0:1787397526.916600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397526.916868:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141376 00000100:00100000:1.0:1787397526.916886:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141376 00000100:00100000:1.0:1787397526.916947:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 220 00000100:00100000:1.0:1787397526.916957:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:67819:x1874218681141376:12345-192.168.204.60@tcp:35:dd.0 00010000:00000080:1.0:1787397526.917170:0:66180:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8040bc450 x1874218681141376/t103079215116(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:722/0 lens 392/456 e 0 to 0 dl 1787397537 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397526.917256:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:67819:x1874218681141376:12345-192.168.204.60@tcp:35:dd.0 Request processed in 300us (669us total) trans 103079215116 rc 0/0 00000100:00100000:1.0:1787397526.917265:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 220 00010000:00010000:3.0:1787397527.332643:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.358102:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787397528.525171:0:88365:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787397528.525281:0:88365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.525304:0:88365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.525313:0:88365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.525322:0:88365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.525360:0:88365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787397528.525370:0:88365:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787397528.525424:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397528.525430:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397528.525438:0:88365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397528.525475:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a81912e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787397528.525701:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700947456:0@lo:39:umount.0 00010000:00010000:0.0:1787397528.525735:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397528.525745:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.525755:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397528.525760:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.525771:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397528.525780:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397528.525786:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397528.525790:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397528.525794:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397528.525836:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.525844:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397528.525870:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.525879:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ee600/0x274786fe0d18fa21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa28 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.525895:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.525897:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.525900:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397528.525913:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700947584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397528.526474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397528.526585:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947456 00000100:00100000:2.0:1787397528.526596:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947456 00000100:00100000:2.0:1787397528.526672:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1787397528.526684:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700947456:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397528.526719:0:77740:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fb40 00000100:00080000:2.0:1787397528.526741:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a836715800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1787397528.526776:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876c380 x1874218700947456/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:724/0 lens 224/224 e 0 to 0 dl 1787397539 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397528.526848:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397528.526857:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218700947456:12345-0@lo:39:umount.0 Request processed in 174us (385us total) trans 0 rc 0/0 00000100:00080000:3.0:1787397528.526879:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a81912e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397528.526895:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700947456:0@lo:39:umount.0 00000100:00100000:0.0:1787397528.526922:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947584 00000100:00100000:0.0:1787397528.526928:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947584 00000100:00100000:0.0:1787397528.526967:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1787397528.526975:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218700947584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397528.526988:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397528.527007:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aba00/0x274786fe0d18fa28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa21 expref: 24 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.527024:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397528.527050:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218700947584:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397528.527058:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1787397528.527092:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700947584:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787397528.527128:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397528.527131:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787397528.527136:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787397528.527389:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000020:00000080:2.0:1787397528.527399:0:77740:0:(genops.c:906:class_export_put()) final put ffff89a836712000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787397528.527472:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787397528.527484:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836712000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397528.527577:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836715800 for lustre-MDT0000 00010000:00010000:0.0:1787397528.528160:0:88365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528177:0:88365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528185:0:88365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528193:0:88365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528237:0:88365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397528.528245:0:88365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528253:0:88365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528259:0:88365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528266:0:88365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528288:0:88365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397528.528296:0:88365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528303:0:88365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528310:0:88365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528313:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397528.528317:0:88365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528323:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528333:0:88365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397528.528346:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef200 already unused, calling callback (ffffffffc1466c20) 00010000:00010000:0.0:1787397528.528349:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1787397528.528352:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528365:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528367:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528383:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397528.528386:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397528.528389:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397528.528401:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397528.528404:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397528.528406:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:00010000:0.0:1787397528.528427:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397528.528433:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397528.528435:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787397528.528438:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787397528.528458:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528462:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.528470:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397528.528471:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397528.528478:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397528.528480:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.528491:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397528.528495:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528502:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528502:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.528503:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528558:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d18fa44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397528.528559:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528561:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ef200/0x274786fe0d18f941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f948 expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397528.528582:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787397528.528586:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787397528.528589:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787397528.528589:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.528590:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.528593:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.528595:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.528598:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.528600:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397528.528618:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397528.528625:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700947712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397528.528625:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700947840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397528.528629:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397528.528656:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.528674:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d18fa13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fa1a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.528687:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397528.528689:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397528.528691:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397528.528707:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700947968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397528.528723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397528.528728:0:88365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528745:0:88365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397528.528754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397528.528760:0:88365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528768:0:88365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528787:0:88365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787397528.528792:0:88365:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787397528.528797:0:88365:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1787397528.528822:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947712 00000100:00100000:2.0:1787397528.528824:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947968 00000100:00100000:2.0:1787397528.528831:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947968 00000100:00100000:3.0:1787397528.528832:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947712 00010000:00010000:0.0:1787397528.528843:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397528.528849:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528857:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397528.528861:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528868:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397528.528874:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397528.528880:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397528.528882:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787397528.528884:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1787397528.528908:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00010000:00010000:0.0:1787397528.528908:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528917:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397528.528924:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700947968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397528.528933:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.528942:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052efc00/0x274786fe0d18f933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18f93a expref: -99 pid: 87047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.528943:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397528.528957:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.528959:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397528.528961:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.528967:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55400/0x274786fe0d18fa1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa13 expref: 24 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397528.528980:0:88365:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1787397528.528982:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000000:0.0:1787397528.528987:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787397528.528994:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787397528.529002:0:88365:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1787397528.529033:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218700947968:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397528.529042:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1787397528.529062:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1787397528.529071:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218700947712:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397528.529079:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700948096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397528.529080:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787397528.529114:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397528.529224:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ee200/0x274786fe0d18f948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f941 expref: 22 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.529236:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397528.529241:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700947968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397528.529272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948096 00000100:00100000:2.0:1787397528.529276:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218700947712:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397528.529283:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1787397528.529328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397528.529350:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948096 00000100:00100000:2.0:1787397528.529362:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700947840 00000100:00100000:2.0:1787397528.529371:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700947840 00000100:00100000:3.0:1787397528.529699:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1787397528.529708:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1787397528.529712:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218700948096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397528.529723:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218700947840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397528.529726:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397528.529736:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397528.529743:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54a00/0x274786fe0d18f93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18f933 expref: 22 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397528.529751:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62000/0x274786fe0d18fa4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa44 expref: 22 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397528.529758:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397528.529778:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397528.529799:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218700948096:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397528.529808:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1787397528.529824:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218700947840:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397528.529832:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1787397528.529851:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700948096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397528.529910:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700947840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397528.529934:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700947712:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1787397528.534365:0:88365:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1787397528.537421:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537464:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537473:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537479:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397528.537484:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537845:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537871:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7a00) 00010000:00010000:1.0:1787397528.537874:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397528.537880:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.537887:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef400/0x274786fe0d18feab lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397528.538157:0:87048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00000020:00000080:0.0:1787397528.538312:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1787397528.538324:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a803e9d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.538331:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a817eff000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.538336:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a817ef9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.538341:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a83ae92000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.538349:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a83ae94800 e90f04db-6a63-4f01-92c7-7bf813f9f081 192.168.204.60@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215116 stale:0 00000020:00080000:0.0:1787397528.538356:0:88365:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a706924d40) has exports, disconnecting them 00000020:00080000:0.0:1787397528.538362:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a803e9d800), last request at 1787397493 00000020:00000080:0.0:1787397528.538372:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fb39 00000100:00080000:0.0:1787397528.538384:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a836716000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397528.538430:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a803e9d800): rc 0 00000020:00000080:0.0:1787397528.538443:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a803e9d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787397528.538464:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a817eff000), last request at 1787397524 00000020:00000080:0.0:1787397528.538468:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fb32 00000100:00080000:0.0:1787397528.538473:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a803e9b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397528.538881:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817eff000): rc 0 00000020:00000080:0.0:1787397528.538884:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a817eff000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787397528.538891:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a817ef9000), last request at 1787397524 00000020:00000080:0.0:1787397528.538895:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fb2b 00000100:00080000:0.0:1787397528.538901:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a817efa800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787397528.539222:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397528.539296:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817eff000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397528.539317:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836716000 for lustre-MDT0000 00000020:00000080:1.0:1787397528.539322:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a803e9b000 for lustre-MDT0000 00010000:00010000:3.0:1787397528.539666:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.539778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787397528.539793:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817ef9000): rc 0 00000020:00000080:0.0:1787397528.539797:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a817ef9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787397528.539805:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a83ae92000), last request at 1787397488 00000020:00000080:0.0:1787397528.539818:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f995 00000020:00000080:3.0:1787397528.539830:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ef9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1787397528.539837:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a817ecf000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397528.539895:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83ae92000): rc 0 00000020:00000080:0.0:1787397528.539897:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a83ae92000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1787397528.540098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397528.540230:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787397528.540591:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a83ae94800), last request at 1787397526 00000020:00000080:0.0:1787397528.540598:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f98e 00000020:00010000:0.0:1787397528.540615:0:88365:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83ae94800: total 1 00000100:00080000:0.0:1787397528.540620:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787397528.540640:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83ae94800: total 1 00010000:00010000:0.0:1787397528.540736:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83ae94800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1787397528.540780:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d18fea4 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7efc expref: 7 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.540806:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef000/0x274786fe0d18fe8f lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 6 pid: 74374 timeout: 3506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.540833:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d18fd7e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7eaf expref: 5 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397528.540886:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83ae94800, canceled 3 locks, left on hash table 0. 00000020:00080000:1.0:1787397528.541679:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a83ae94800): rc 0 00000004:00000080:1.0:1787397528.541694:0:88365:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41d6bae0 00000020:00000080:3.0:1787397528.541821:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efa800 for lustre-MDT0000 00000020:00000080:3.0:1787397528.541834:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae92000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397528.541898:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecf000 for lustre-MDT0000 00000100:00080000:1.0:1787397528.541960:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397528.541967:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397528.545672:0:88365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787397528.545807:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a83476c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787397528.546391:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397528.546398:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968726 gen 3 00000004:00080000:1.0:1787397528.546464:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787397528.546563:0:88365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787397528.546581:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a706ff1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787397528.546589:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397528.546592:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968723 gen 3 00000004:00080000:1.0:1787397528.546604:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787397528.546672:0:88365:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787397528.546694:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a835591800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787397528.546766:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a706924d40) has no exports 00000100:00100000:3.0:1787397528.547365:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948224:0@lo:39:umount.0 00000100:00100000:3.0:1787397528.547500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397528.547569:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948352:0@lo:9:umount.0 00000100:00100000:3.0:1787397528.547600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397528.547631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948480:0@lo:9:umount.0 00000100:00100000:3.0:1787397528.547657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397528.547713:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948224 00000100:00100000:3.0:1787397528.547724:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948224 00000100:00100000:3.0:1787397528.547799:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:3.0:1787397528.547811:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700948224:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787397528.547852:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9d4 00000020:00080000:2.0:1787397528.547890:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a706924d40) has no exports 00000100:00080000:3.0:1787397528.548020:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a828784000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397528.548051:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00000100:00100000:3.0:1787397528.548336:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218700948224:12345-0@lo:39:umount.0 Request processed in 527us (835us total) trans 81604378732 rc 0/0 00000100:00100000:3.0:1787397528.548346:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:3.0:1787397528.548378:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948352 00000100:00100000:3.0:1787397528.548383:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948352 00000100:00100000:3.0:1787397528.548437:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948480 00000100:00100000:3.0:1787397528.548441:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948480 00000100:00100000:3.0:1787397528.548473:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:3.0:1787397528.548480:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700948352:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787397528.548514:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9f0 00000100:00080000:3.0:1787397528.548552:0:26160:0:(import.c:65:import_set_state_nolock()) ffff89a835591000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397528.548604:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968726 00000100:00100000:3.0:1787397528.548717:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700948352:12345-0@lo:9:umount.0 Request processed in 237us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397528.548724:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:3.0:1787397528.548737:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:3.0:1787397528.548745:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700948480:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787397528.548759:0:26160:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9fe 00000100:00080000:3.0:1787397528.548766:0:26160:0:(import.c:65:import_set_state_nolock()) ffff89a828a59000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397528.548792:0:26160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968723 00000100:00100000:3.0:1787397528.550551:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700948480:12345-0@lo:9:umount.0 Request processed in 1775us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397528.550570:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00010000:00010000:1.0:1787397528.550588:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397528.550630:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397528.550639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787397528.550659:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397528.550691:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397528.550757:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83476c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397528.550770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948224:0@lo:39:umount.0 00000100:00080000:3.0:1787397528.550791:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a706ff1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787397528.550808:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787397528.550810:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.550813:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948352:0@lo:9:umount.0 00000100:00080000:3.0:1787397528.550830:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835591800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787397528.550842:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787397528.550844:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.550880:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700948480:0@lo:9:umount.0 00000020:00000080:0.0:1787397528.575259:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a83ae94800/e90f04db-6a63-4f01-92c7-7bf813f9f081 00010000:00010000:1.0:1787397528.575379:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397528.575383:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397528.575387:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397528.575388:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae94800/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0000 00000020:00000080:3.0:1787397528.575778:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830a0f800 for lustre-MDT0000 00000020:00000080:2.0:1787397528.594777:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9aa 00000020:00000080:2.0:1787397528.594801:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a7050a1800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787397528.594828:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787397528.595083:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787397528.595116:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397528.595135:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787397528.595140:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a703c88000) has no exports 00000020:00000080:3.0:1787397528.597214:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9a3 00000020:00000080:3.0:1787397528.597236:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a83fa46000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397528.597338:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397528.597358:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397528.597361:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a8364eb800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787397528.597366:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364eb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787397528.597380:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787397528.597494:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa46000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787397528.598098:0:88365:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70441c9c0 - data ffff89a83fc191b0/ffff89a70a0f8c00 00000020:01000000:3.0:1787397528.599054:0:88365:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14000 - data ffff89a827fb1a20/ffff89a8067fb000 00000100:00080000:3.0:1787397528.661255:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397528.661267:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787397528.661288:0:88365:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a83678ce00 x1874218700948224/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397538 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397528.661323:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787397528.663342:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397528.663352:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968726 gen 4 00000004:00080000:3.0:1787397528.663661:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.663665:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787397528.663965:0:87065:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787397528.663971:0:87065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1787397528.663983:0:87065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1787397528.665769:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397528.665779:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968723 gen 4 00000004:00080000:3.0:1787397528.665846:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.665850:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787397528.666553:0:87067:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787397528.666560:0:87067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1787397528.666573:0:87067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:3.0:1787397528.669008:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f964 00000020:00000080:3.0:1787397528.669049:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a706d32000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397528.669196:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d32000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787397528.670203:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f979 00000020:00000080:3.0:1787397528.670215:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a8364e2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397528.670274:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787397528.670281:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397528.670296:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787397528.670301:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a706923380) has no exports 00000004:01000000:3.0:1787397528.670509:0:88365:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787397528.670811:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9f7 00000020:00000080:3.0:1787397528.670818:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a835449000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397528.671656:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787397528.671861:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397528.671871:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397528.671887:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397528.671893:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a829b94d40) has no exports 00000020:00000080:3.0:1787397528.671903:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9e9 00000020:00000080:3.0:1787397528.671911:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a835594000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397528.671936:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835449000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1787397528.673035:0:88365:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787397528.673045:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397528.673051:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968723 gen 5 00000004:00080000:3.0:1787397528.673060:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.673063:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397528.673215:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835594000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787397528.673813:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397528.673832:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397528.673856:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9db 00000020:00000080:3.0:1787397528.673869:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a7050a2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397528.673877:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397528.673882:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397528.673889:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397528.673893:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a703c899c0) has no exports 00000020:00000080:3.0:1787397528.673904:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9cd 00000020:00000080:3.0:1787397528.673908:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a8037dc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397528.674199:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835591800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787397528.674210:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a7050a0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397528.674213:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787397528.674220:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397528.674352:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397528.674358:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787397528.674804:0:88365:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787397528.674825:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397528.674828:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968726 gen 5 00000004:00080000:3.0:1787397528.674835:0:88365:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397528.674837:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397528.674879:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397528.674888:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787397528.674905:0:88365:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787397528.674913:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9bf 00000020:00000080:3.0:1787397528.674921:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a7050a4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397528.674926:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787397528.674931:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397528.674935:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397528.674939:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a7033a3380) has no exports 00000020:00000080:3.0:1787397528.674944:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f9b8 00000020:00000080:3.0:1787397528.674948:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a706d36800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397528.679963:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706ff1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397528.679986:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a7050a3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397528.679991:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787397528.680015:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397528.680154:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397528.680161:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d36800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787397528.680797:0:88365:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787397528.680806:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787397528.680812:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397528.680819:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397528.680888:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397528.680908:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397528.680943:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397528.680947:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397528.680952:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a705062000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397528.680955:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a705062000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787397528.680964:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397528.681174:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83476c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397528.681184:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a8037d8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397528.681187:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037d8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787397528.681191:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397528.681274:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f980 00000020:00000080:0.0:1787397528.681283:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a8364e6800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787397528.681298:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787397528.681302:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397528.681310:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787397528.681314:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a706920000) has no exports 00000020:00000080:0.0:1787397528.681339:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397528.681356:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787397528.681361:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f987 00000020:00000080:0.0:1787397528.681365:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a8364e2800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787397528.681374:0:88365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a829b1e800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787397528.681377:0:88365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a829b1e800 3 00000020:01000004:0.0:1787397528.681381:0:88365:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a829b1e800 from lustre-MDT0000 00000020:00000080:0.0:1787397528.681402:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397528.681415:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787397528.681418:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a706d34800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787397528.681420:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d34800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787397528.681430:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787397528.681466:0:88365:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787397528.681470:0:88365:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787397528.681473:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787397528.681476:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397528.681479:0:88365:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787397528.681490:0:88365:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a830a08800 367372d5-1a70-4e8f-8f10-c0f943f3662d 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.681497:0:88365:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a83ae92800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.681501:0:88365:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a828c199c0) has exports, disconnecting them 00000020:00080000:0.0:1787397528.681506:0:88365:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a830a08800), last request at 1787397489 00000020:00000080:0.0:1787397528.681553:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fb08 00000020:00010000:0.0:1787397528.681558:0:88365:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a830a08800: total 2 00000100:00080000:0.0:1787397528.681563:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a830a0b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397528.681584:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a830a08800): rc 0 00000020:00080000:0.0:1787397528.681588:0:88365:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a83ae92800), last request at 1787397488 00000020:00000080:0.0:1787397528.681635:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f925 00000020:00010000:0.0:1787397528.681639:0:88365:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83ae92800: total 2 00000100:00080000:0.0:1787397528.681642:0:88365:0:(import.c:65:import_set_state_nolock()) ffff89a83ae97000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787397528.681650:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83ae92800): rc 0 00000020:00080000:0.0:1787397528.681655:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a828c199c0) has no exports 00000020:00010000:1.0:1787397528.681757:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a830a08800: total 2 00010000:00010000:1.0:1787397528.681790:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a830a08800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1787397528.681833:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052eee00/0x274786fe0d18fb0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e8c expref: 5 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681854:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aac00/0x274786fe0d18fb1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e9a expref: 4 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681868:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aae00/0x274786fe0d18fb16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7e93 expref: 3 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052eec00/0x274786fe0d18fb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ea1 expref: 2 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681889:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a830a08800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1787397528.681910:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a830a08800/367372d5-1a70-4e8f-8f10-c0f943f3662d 00000020:00010000:1.0:1787397528.681915:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83ae92800: total 3 00010000:00010000:1.0:1787397528.681930:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83ae92800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787397528.681947:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050abc00/0x274786fe0d18faad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18faa6 expref: 14 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681960:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54000/0x274786fe0d18fabb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fab4 expref: 13 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681982:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052eea00/0x274786fe0d18fac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fac2 expref: 12 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.681993:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63600/0x274786fe0d18fa59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa52 expref: 11 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682004:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa800/0x274786fe0d18fad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fad0 expref: 10 pid: 87058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682015:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63200/0x274786fe0d18fa67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa60 expref: 9 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682030:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55c00/0x274786fe0d18fa75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa6e expref: 8 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682041:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ee400/0x274786fe0d18faf3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18faec expref: 7 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682052:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052efa00/0x274786fe0d18fa83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa7c expref: 6 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682063:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab800/0x274786fe0d18fae5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fade expref: 5 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682073:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d18fa9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa98 expref: 4 pid: 87054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682098:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ee800/0x274786fe0d18fb01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fafa expref: 3 pid: 87053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab600/0x274786fe0d18fa91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fa8a expref: 2 pid: 87055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397528.682135:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83ae92800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787397528.682147:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a83ae92800/99b57a74-e5dc-42df-b087-b10fad741506 00010000:00010000:1.0:1787397528.682153:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397528.682155:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397528.682156:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397528.682194:0:87053:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a804fc1a00:87053] 0 exiting: rc = 1 00000100:00100000:1.0:1787397528.682327:0:87058:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a7059e2c00:87058] 3 exiting: rc = 0 00000020:00000080:1.0:1787397528.682385:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787397528.682390:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a8037dd000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787397528.682393:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037dd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787397528.682397:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787397528.682449:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397528.682455:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a08800/367372d5-1a70-4e8f-8f10-c0f943f3662d for MGS 00000020:00000080:1.0:1787397528.682483:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae92800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:1.0:1787397528.682498:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830a0b800 for MGS 00000020:00000080:1.0:1787397528.682503:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae97000 for MGS 00000100:00100000:1.0:1787397528.682591:0:87055:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a828c68600:87055] 2 exiting: rc = 0 00000100:00100000:1.0:1787397528.682651:0:87054:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a804fc1600:87054] 1 exiting: rc = 0 00000100:00100000:0.0:1787397528.682838:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682852:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682862:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682870:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682878:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682885:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682893:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682900:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682907:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682914:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682921:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682928:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682934:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682941:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682947:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682954:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682960:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682965:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682971:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682977:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682983:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682989:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.682995:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683001:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683007:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683014:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683022:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683029:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683034:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683040:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683047:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683054:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683060:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683067:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683074:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683185:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683192:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683198:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683204:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683209:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683215:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683221:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683227:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683233:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683239:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683245:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683251:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683257:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683263:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683270:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683276:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683282:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683288:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683294:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683299:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683305:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683312:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683319:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683326:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683332:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683339:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683345:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683351:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397528.683357:0:88365:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1787397528.684511:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787397528.685036:0:88365:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d147e0 - data ffff89a827f83798/ffff89a7037a9c00 00000020:01000000:0.0:1787397528.685193:0:88365:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7056ea0c0 - data ffff89a818838e58/ffff89a70ac2f000 00000020:00000080:0.0:1787397528.685763:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f91e 00000020:00000080:0.0:1787397528.685774:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a828a5c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787397528.685792:0:88365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a829b1e800 from MGS, refs=2 00000020:01000004:0.0:1787397528.685811:0:88365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a829b1e800 2 00000020:01000004:0.0:1787397528.685815:0:88365:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a829b1e800 from MGS 00000020:00000080:0.0:1787397528.685846:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397528.685857:0:88365:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787397528.685861:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/MGS 00000020:00000080:0.0:1787397528.685865:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/MGS for MGS 00000020:01000000:0.0:1787397528.685874:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787397528.685974:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787397528.685979:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397528.685990:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787397528.685998:0:88365:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a81912b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397528.686005:0:88365:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a828c18000) has exports, disconnecting them 00000020:00080000:0.0:1787397528.686011:0:88365:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a81912b000), last request at 1787397488 00000020:00000080:0.0:1787397528.686016:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fa36 00000020:00080000:0.0:1787397528.686028:0:88365:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a81912b000): rc 0 00000020:00000080:0.0:1787397528.686032:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a81912b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397528.686833:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397528.686850:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a81912b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787397528.687814:0:88365:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787397528.687823:0:88365:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397528.687828:0:88365:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787397528.687836:0:88365:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397528.687884:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a81912e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397528.688029:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397528.688043:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787397528.688050:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a836492000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787397528.688053:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836492000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787397528.688075:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787397528.688187:0:88365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a829b1e800 1 00000020:00000080:1.0:1787397528.688194:0:88365:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18f910 00000020:00000080:1.0:1787397528.688201:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a829b1f800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787397528.688213:0:88365:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787397528.688222:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397528.688231:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397528.688238:0:88365:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787397528.688242:0:88365:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a828c1cd40) has no exports 00000020:00000080:1.0:1787397528.786379:0:88365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397528.786400:0:88365:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787397528.786419:0:88365:0:(genops.c:906:class_export_put()) final put ffff89a829b1b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397528.786427:0:88365:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787397528.786445:0:88365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787397528.786648:0:88365:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a829b1a000 00000020:02000400:1.0:1787397528.786787:0:88365:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787397529.381847:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397529.574076:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700948736:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574173:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574224:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700949248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574290:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787397529.574297:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700948608:0@lo:400:kworker.0 00000400:00000100:2.0:1787397529.574322:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700948608 offset 0 length 224: 4 00000100:00100000:2.0:1787397529.574346:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700949120:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574493:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700949632:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574585:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700948864:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574635:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700949376:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574660:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574681:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397529.574687:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700948992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574708:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700949504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.574746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.574781:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949248 00000100:00100000:2.0:1787397529.574790:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949248 00000100:00100000:2.0:1787397529.574842:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1787397529.574851:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1874218700949248:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397529.574860:0:8445:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397529.574904:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1874218700949248:12345-0@lo:400:kworker.0 Request processed in 53us (647us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397529.574912:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1787397529.574938:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948736 00000100:00100000:2.0:1787397529.574942:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948736 00000100:00100000:2.0:1787397529.575209:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949120 00000100:00100000:2.0:1787397529.575214:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949120 00000100:00100000:2.0:1787397529.575250:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949632 00000100:00100000:2.0:1787397529.575254:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949632 00000100:00100000:2.0:1787397529.575269:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948864 00000100:00100000:2.0:1787397529.575273:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948864 00000100:00100000:2.0:1787397529.575293:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700948992 00000100:00100000:2.0:1787397529.575301:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700948992 00000100:00100000:2.0:1787397529.575317:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1787397529.575324:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700949120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.575374:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700949120:12345-0@lo:400:kworker.0 Request processed in 50us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397529.575381:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1787397529.575406:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1787397529.575413:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.575599:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700948864:12345-0@lo:400:kworker.0 Request processed in 186us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397529.575606:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1787397529.575623:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1787397529.575627:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218700948736:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397529.575632:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397529.575656:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218700948736:12345-0@lo:400:kworker.0 Request processed in 28us (1485us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397529.575662:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1787397529.575674:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1787397529.575678:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218700949632:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397529.575682:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397529.575705:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218700949632:12345-0@lo:400:kworker.0 Request processed in 26us (1152us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397529.575711:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1787397529.575722:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1787397529.575726:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874218700948992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397529.575731:0:66177:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397529.575761:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874218700948992:12345-0@lo:400:kworker.0 Request processed in 33us (1051us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397529.575766:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1787397529.575793:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949376 00000100:00100000:2.0:1787397529.575797:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949376 00000100:00100000:2.0:1787397529.575824:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949504 00000100:00100000:2.0:1787397529.575827:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949504 00000100:00100000:2.0:1787397529.575850:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:2.0:1787397529.575856:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700949376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397529.576268:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1787397529.576280:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700949504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397529.576322:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700949504:12345-0@lo:400:kworker.0 Request processed in 46us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397529.576328:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1787397529.576381:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700949120:0@lo:400:kworker.0 00000100:00080000:3.0:1787397529.576414:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397529.576420:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397529.576423:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787397529.579096:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700949376:12345-0@lo:400:kworker.0 Request processed in 38us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397529.579113:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00080000:2.0:1787397529.579160:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397529.579167:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397529.579170:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397529.579230:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397529.579235:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397529.579239:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397529.579245:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397529.579249:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3373 00000100:00080000:2.0:1787397529.579256:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397529.579301:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9f800 x1874218700949760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397529.579349:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700948992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.579369:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700949504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.579380:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700948864:0@lo:400:kworker.0 00000100:00100000:2.0:1787397529.579420:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700949376:0@lo:400:kworker.0 00000100:00100000:0.0:1787397529.579593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700949760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787397529.579664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397529.579761:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949760 00000100:00100000:2.0:1787397529.579769:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949760 00000100:00100000:2.0:1787397529.579843:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1787397529.579850:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700949760:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397529.579871:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397529.579930:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700949760:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 78us (264us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397529.579938:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00080000:1.0:1787397529.579985:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397529.579992:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397529.579995:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700949760:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787397529.607371:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397529.607385:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00080000:3.0:1787397529.607406:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397529.607547:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d180 x1874218700949888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397529.607574:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700949632:0@lo:400:kworker.0 00000100:00080000:3.0:1787397529.607618:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397529.607622:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397529.607625:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397529.607629:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397529.607633:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3373 00000100:00080000:3.0:1787397529.607637:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397529.607653:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d880 x1874218700950016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397529.607662:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700948736:0@lo:400:kworker.0 00000100:00080000:3.0:1787397529.607680:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397529.607683:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397529.607686:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397529.607692:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397529.607695:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00100000:0.0:1787397529.607700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700949888:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787397529.607702:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397529.607719:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876e680 x1874218700950144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397529.607731:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700949248:0@lo:400:kworker.0 00000100:00100000:0.0:1787397529.607775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397529.607806:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700949888 00000100:00100000:0.0:1787397529.607812:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700950016:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787397529.607821:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700949888 00000100:00100000:0.0:1787397529.607839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397529.607868:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700950144:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787397529.607869:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950016 00000100:00100000:3.0:1787397529.607874:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950016 00000100:00100000:3.0:1787397529.607904:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1787397529.607904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397529.607915:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700949888:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1787397529.607936:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397529.607947:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1787397529.607954:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700950016:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787397529.607978:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397529.607986:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700949888:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 69us (210us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397529.607995:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1787397529.608023:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700950016:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 66us (182us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397529.608030:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00080000:0.0:1787397529.608067:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397529.608071:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397529.608074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700949888:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787397529.608083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397529.608086:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397529.608089:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700950016:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787397529.609617:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950144 00000100:00100000:2.0:1787397529.609628:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950144 00000100:00100000:2.0:1787397529.609672:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1787397529.609680:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700950144:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787397529.609699:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397529.609777:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700950144:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 96us (1877us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397529.609785:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00080000:0.0:1787397529.609877:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397529.609882:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397529.609886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700950144:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1787397530.404635:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397530.888965:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397530.889055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397530.889113:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681141504 offset 0 length 224: 4 00000100:00100000:1.0:1787397530.889135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397530.892221:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141888 00000100:00100000:3.0:1787397530.892236:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141888 00000100:00100000:3.0:1787397530.892343:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2421 00000100:00100000:3.0:1787397530.892354:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681141888:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397530.892447:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681141888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 95us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397530.892456:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2421 00000100:00080000:3.0:1787397530.892485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397530.893084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397530.895478:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141632 00000100:00100000:0.0:1787397530.895502:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141632 00000100:00100000:0.0:1787397530.895595:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141760 00000100:00100000:0.0:1787397530.895600:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141760 00000100:00080000:0.0:1787397530.895633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397530.895651:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142016 00000100:00100000:0.0:1787397530.895654:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142016 00000100:00100000:0.0:1787397530.895698:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2422 00000100:00100000:0.0:1787397530.895709:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681142016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397530.895799:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681142016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397530.895807:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2422 00000100:00080000:0.0:1787397530.895879:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397530.895908:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1148 00000100:00100000:0.0:1787397530.895928:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681141760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397530.895966:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681141760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (6829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397530.895972:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1148 00000100:00100000:0.0:1787397530.896119:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1154 00000100:00100000:0.0:1787397530.896124:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1874218681141632:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:0.0:1787397530.896131:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:0.0:1787397530.896156:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1874218681141632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (7202us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787397530.896161:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1154 00000100:00100000:1.0:1787397530.905739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397530.905819:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142144 00000100:00100000:3.0:1787397530.905832:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142144 00000100:00100000:3.0:1787397530.905886:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1155 00000100:00100000:3.0:1787397530.905896:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681142144:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1787397530.905923:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397530.906011:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681142144:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 Request processed in 115us (279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397530.906020:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1155 00010000:00010000:1.0:1787397531.428783:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397531.620749:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397531.620773:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700950272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397531.620843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397531.621388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950272 00000100:00100000:0.0:1787397531.621398:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950272 00000100:00100000:0.0:1787397531.621474:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1787397531.621483:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700950272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397531.621543:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397531.621605:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700950272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397531.621613:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1787397531.621655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700950272:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787397531.621765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397531.622709:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700950400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397531.622759:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397531.623078:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950400 00000100:00100000:3.0:1787397531.623085:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950400 00000100:00100000:3.0:1787397531.623218:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1787397531.623229:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700950400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397531.623253:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397531.623428:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700950400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397531.623435:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00080000:1.0:1787397531.623493:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397531.623607:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700950400:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787397532.455117:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397533.476818:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397533.957466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397533.957512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397533.957605:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397533.957702:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142784 00000100:00100000:2.0:1787397533.957714:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142784 00000100:00100000:2.0:1787397533.957786:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142656 00000100:00100000:2.0:1787397533.957790:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142656 00000100:00100000:2.0:1787397533.957837:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4939 00000100:00100000:2.0:1787397533.957847:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681142784:12345-192.168.204.60@tcp:17:kworker.0 00000100:00100000:2.0:1787397533.957955:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681142784:12345-192.168.204.60@tcp:17:kworker.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397533.957977:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4939 00000100:00100000:2.0:1787397533.957995:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4940 00000100:00100000:2.0:1787397533.958002:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681142656:12345-192.168.204.60@tcp:17:kworker.0 00000100:00100000:2.0:1787397533.958044:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681142656:12345-192.168.204.60@tcp:17:kworker.0 Request processed in 41us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397533.958051:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4940 00000100:00080000:0.0:1787397533.958952:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397533.958969:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397533.959123:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142528 00000100:00100000:3.0:1787397533.959133:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142528 00000100:00100000:3.0:1787397533.959208:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1156 00000100:00100000:3.0:1787397533.959218:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681142528:12345-192.168.204.60@tcp:17:kworker.0 00000100:00100000:3.0:1787397533.959310:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681142528:12345-192.168.204.60@tcp:17:kworker.0 Request processed in 85us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397533.959318:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1156 00000100:00080000:0.0:1787397533.959929:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787397534.501016:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397534.695615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397534.695623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397534.695627:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397534.695636:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3408 00000100:00100000:1.0:1787397534.695847:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700950528:0@lo:400:kworker.0 00000400:00000100:1.0:1787397534.695906:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700950528 offset 0 length 224: 4 00000100:00080000:3.0:1787397534.698041:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397534.698057:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397534.698094:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876f100 x1874218700950656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397534.698147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397534.698158:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397534.698161:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397534.698165:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3408 00000100:00080000:3.0:1787397534.698169:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397534.698173:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397534.698188:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d880 x1874218700950912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397534.698205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397534.698208:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397534.698209:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397534.698213:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3408 00000100:00080000:3.0:1787397534.698215:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397534.698219:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397534.698231:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d500 x1874218700951168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397534.698262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397534.698266:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397534.698268:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397534.698271:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3408 00000100:00080000:3.0:1787397534.698274:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397534.698277:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397534.698297:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876e300 x1874218700951552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397534.698329:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700951040:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.698405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397534.698439:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397534.698445:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700950784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.698469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397534.698593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700950656:0@lo:38:kworker.0 00000100:00100000:1.0:1787397534.698625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397534.698649:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700950912:0@lo:38:kworker.0 00000100:00100000:1.0:1787397534.698669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397534.698684:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700951168:0@lo:38:kworker.0 00000100:00100000:1.0:1787397534.698706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397534.698722:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700951552:0@lo:38:kworker.0 00000100:00100000:1.0:1787397534.698740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397534.698809:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951040 00000100:00100000:3.0:1787397534.698817:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951040 00000100:00100000:1.0:1787397534.698845:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950784 00000100:00100000:1.0:1787397534.698850:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950784 00000100:00100000:3.0:1787397534.698871:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950656 00000100:00100000:3.0:1787397534.698876:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950656 00000100:00100000:1.0:1787397534.698880:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700950912 00000100:00100000:1.0:1787397534.698885:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700950912 00000100:00100000:3.0:1787397534.698893:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951552 00000100:00100000:3.0:1787397534.698898:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951552 00000100:00100000:1.0:1787397534.698918:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1787397534.698927:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700951040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397534.699038:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700951040:12345-0@lo:400:kworker.0 Request processed in 111us (632us total) trans 0 rc 0/0 00000100:00080000:0.0:1787397534.699103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397534.699238:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1787397534.699247:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700950784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.699280:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700950784:12345-0@lo:400:kworker.0 Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397534.699296:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1787397534.699318:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1787397534.699323:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700950656:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397534.699341:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397534.699376:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700950656:12345-0@lo:38:kworker.0 Request processed in 52us (750us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397534.699382:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1787397534.699396:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1787397534.699400:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700950912:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397534.699409:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397534.699434:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700950912:12345-0@lo:38:kworker.0 Request processed in 32us (764us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397534.699449:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1787397534.699462:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1787397534.699466:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700951552:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397534.699475:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397534.699500:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700951552:12345-0@lo:38:kworker.0 Request processed in 33us (759us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397534.699506:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1787397534.699546:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951168 00000100:00100000:3.0:1787397534.699550:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951168 00000100:00100000:3.0:1787397534.699572:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:3.0:1787397534.699577:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700951168:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397534.699587:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397534.699614:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700951168:12345-0@lo:38:kworker.0 Request processed in 35us (906us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397534.699620:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:3.0:1787397534.699673:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700950784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.699692:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700951040:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.699885:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700951424:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.699924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397534.699946:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397534.699951:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700951296:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.699970:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397534.700006:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951424 00000100:00100000:3.0:1787397534.700010:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951424 00000100:00100000:3.0:1787397534.700051:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951296 00000100:00100000:3.0:1787397534.700054:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951296 00000100:00100000:3.0:1787397534.700072:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:3.0:1787397534.700078:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700951424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.700124:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700951424:12345-0@lo:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397534.700131:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:3.0:1787397534.700143:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1787397534.700149:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700951296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.700175:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700951296:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397534.700181:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1787397534.701975:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700951296:0@lo:400:kworker.0 00000100:00100000:3.0:1787397534.701995:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700951424:0@lo:400:kworker.0 00000100:00080000:3.0:1787397534.702070:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397534.702076:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397534.702080:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700950656:0@lo:38:kworker.0 00000100:00080000:3.0:1787397534.702091:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397534.702094:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397534.702097:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700950912:0@lo:38:kworker.0 00000100:00080000:3.0:1787397534.702107:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397534.702111:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397534.702113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700951168:0@lo:38:kworker.0 00000100:00080000:3.0:1787397534.702123:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397534.702138:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397534.702142:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700951552:0@lo:38:kworker.0 00000100:00080000:3.0:1787397534.702283:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397534.702297:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397534.702805:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000001:00100000:3.0:1787397534.710052:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787397534.710069:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:3.0:1787397534.710075:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a828785800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787397534.710373:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397534.710378:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a835593000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397534.710381:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828785800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1787397534.710639:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397534.710644:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a828a5a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397534.715714:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835593000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787397534.715918:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828784000 for lustre-MDT0001 00000020:00000080:2.0:1787397534.715924:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787397534.716074:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835591000 for lustre-OST0000 00000020:00000080:2.0:1787397534.716079:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a59000 for lustre-OST0001 00010000:00010000:3.0:1787397535.524661:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787397536.008297:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681142912 offset 0 length 224: 4 00000100:00100000:0.0:1787397536.008347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397536.008384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397536.008431:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143040 00000100:00100000:0.0:1787397536.008434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397536.008452:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143040 00000100:00100000:3.0:1787397536.008583:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143168 00000100:00100000:3.0:1787397536.008588:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143168 00000100:00100000:0.0:1787397536.008636:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397536.008666:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1151 00000100:00100000:3.0:1787397536.008685:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681143168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397536.008714:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1160 00000100:00100000:1.0:1787397536.008725:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681143040:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397536.008760:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397536.008842:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681143040:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 115us (493us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397536.008851:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1160 00000100:00100000:3.0:1787397536.008979:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681143168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 299us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397536.008990:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1151 00000100:00080000:3.0:1787397536.009023:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397536.009996:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143424 00000100:00100000:2.0:1787397536.010009:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143424 00000100:00100000:2.0:1787397536.010127:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143296 00000100:00100000:2.0:1787397536.010131:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143296 00000100:00080000:1.0:1787397536.010275:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397536.010280:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397536.010313:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2425 00000100:00100000:1.0:1787397536.010325:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681143424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397536.010643:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681143424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 320us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397536.010651:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2425 00000100:00100000:2.0:1787397536.011334:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2426 00000100:00100000:2.0:1787397536.011347:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681143296:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397536.013240:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681143296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 49us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397536.013256:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2426 00010000:00010000:1.0:1787397536.548963:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397536.741101:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700951680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397536.741207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397536.741268:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397536.741275:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700951808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397536.741281:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951680 00000100:00100000:1.0:1787397536.741290:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951680 00000100:00100000:0.0:1787397536.741298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397536.741353:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700951808 00000100:00100000:1.0:1787397536.741356:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700951808 00000100:00100000:3.0:1787397536.741386:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00080000:0.0:1787397536.741429:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397536.741541:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1787397536.741551:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700951808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397536.741579:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397536.741626:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700951808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397536.741635:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00080000:0.0:1787397536.742099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397536.742136:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700951808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397536.743323:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700951680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397536.743377:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397536.743500:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700951680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2098us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397536.743511:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:0.0:1787397536.744313:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700951680:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787397537.572835:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397538.596839:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397539.620833:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397539.816171:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397539.816179:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397539.816184:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397539.816211:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3413 00000100:00080000:3.0:1787397539.816221:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397539.816241:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397539.816282:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700951936:0@lo:400:kworker.0 00000100:00100000:3.0:1787397539.816291:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d500 x1874218700952064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397539.816334:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397539.816338:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397539.816340:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397539.816345:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3413 00000100:00080000:3.0:1787397539.816348:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397539.816355:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000400:00000100:0.0:1787397539.816357:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700951936 offset 0 length 224: 4 00000100:00100000:3.0:1787397539.816373:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876f100 x1874218700952320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397539.816412:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397539.816416:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397539.816418:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397539.816428:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3413 00000100:00080000:3.0:1787397539.816433:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1787397539.816436:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787397539.816440:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397539.816449:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700952192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397539.816462:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876ce00 x1874218700952576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397539.816498:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397539.816501:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397539.816557:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397539.816560:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397539.816566:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3413 00000100:00080000:3.0:1787397539.816569:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397539.816575:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397539.816582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700952832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397539.816593:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835751c00 x1874218700952960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397539.816621:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397539.816647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700952064:0@lo:38:kworker.0 00000100:00100000:0.0:1787397539.816702:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952832 00000100:00100000:0.0:1787397539.816713:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952832 00000100:00100000:3.0:1787397539.816721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397539.816775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700952320:0@lo:38:kworker.0 00000100:00100000:0.0:1787397539.816784:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1787397539.816802:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700952832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397539.816810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397539.816835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700952576:0@lo:38:kworker.0 00000100:00100000:3.0:1787397539.816877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397539.816885:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700952832:12345-0@lo:400:kworker.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397539.816896:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1787397539.816906:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700952960:0@lo:38:kworker.0 00000100:00100000:3.0:1787397539.816932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397539.816942:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397539.816978:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952576 00000100:00100000:3.0:1787397539.816987:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952576 00000100:00100000:0.0:1787397539.817451:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700952448:0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.817491:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952192 00000100:00100000:1.0:1787397539.817499:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952192 00000100:00100000:0.0:1787397539.817501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397539.817583:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397539.817594:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952064 00000100:00100000:0.0:1787397539.817595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700952704:0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.817601:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952064 00000100:00100000:0.0:1787397539.817632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397539.817635:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952320 00000100:00100000:1.0:1787397539.817641:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952320 00000100:00100000:1.0:1787397539.817660:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952960 00000100:00100000:1.0:1787397539.817664:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952960 00000100:00100000:1.0:1787397539.817678:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952448 00000100:00100000:1.0:1787397539.817681:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952448 00000100:00100000:0.0:1787397539.817691:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1787397539.817709:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700952192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.817716:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1787397539.817731:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700952448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397539.817764:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700952192:12345-0@lo:400:kworker.0 Request processed in 62us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397539.817773:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1787397539.817817:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700952448:12345-0@lo:400:kworker.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397539.818173:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1787397539.818182:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700952064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397539.818215:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397539.818271:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700952064:12345-0@lo:38:kworker.0 Request processed in 87us (1555us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397539.818488:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700952704 00000100:00100000:2.0:1787397539.818496:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700952704 00000100:00100000:2.0:1787397539.818563:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1787397539.818572:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700952704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.818976:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1787397539.819134:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:3.0:1787397539.819143:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700952576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397539.819167:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397539.819252:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700952576:12345-0@lo:38:kworker.0 Request processed in 108us (2376us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397539.819260:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1787397539.819315:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1787397539.819322:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700952320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397539.819334:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397539.819365:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700952320:12345-0@lo:38:kworker.0 Request processed in 43us (2557us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397539.819372:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1787397539.819392:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1787397539.819397:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700952960:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397539.819408:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397539.819434:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700952960:12345-0@lo:38:kworker.0 Request processed in 35us (2502us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397539.819439:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:1.0:1787397539.819480:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397539.819485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397539.819576:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700952832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.819593:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700952192:0@lo:400:kworker.0 00000100:00100000:1.0:1787397539.819663:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700952448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397539.819686:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:1.0:1787397539.819710:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397539.819718:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397539.819723:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700952064:0@lo:38:kworker.0 00000100:00080000:1.0:1787397539.819740:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397539.819744:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397539.819747:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700952320:0@lo:38:kworker.0 00000100:00080000:1.0:1787397539.819758:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397539.819762:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397539.819765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700952576:0@lo:38:kworker.0 00000100:00080000:1.0:1787397539.819775:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397539.819778:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397539.819781:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700952960:0@lo:38:kworker.0 00000100:00100000:2.0:1787397539.819932:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700952704:12345-0@lo:400:kworker.0 Request processed in 1361us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397539.819941:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1787397539.819978:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700952704:0@lo:400:kworker.0 00010000:00010000:3.0:1787397540.644733:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397541.131571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397541.131822:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143680 00000100:00100000:3.0:1787397541.131848:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143680 00000100:00100000:1.0:1787397541.131859:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397541.131896:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143808 00000100:00100000:1.0:1787397541.131896:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397541.131901:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143808 00000400:00000100:1.0:1787397541.131922:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681143552 offset 0 length 224: 4 00000100:00100000:1.0:1787397541.131950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397541.131990:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1164 00000100:00100000:1.0:1787397541.132001:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681143680:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397541.132038:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397541.132052:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1154 00000100:00100000:3.0:1787397541.132064:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681143808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397541.132274:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681143680:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 273us (1310us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397541.132294:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1164 00000100:00100000:1.0:1787397541.132332:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144064 00000100:00100000:1.0:1787397541.132335:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144064 00000100:00100000:1.0:1787397541.132367:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681143936 00000100:00100000:1.0:1787397541.132370:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681143936 00000100:00100000:1.0:1787397541.132393:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2429 00000100:00100000:1.0:1787397541.132399:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681144064:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397541.132885:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681143808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 822us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397541.132899:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1154 00000100:00100000:1.0:1787397541.132905:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681144064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 498us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397541.132920:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2429 00000100:00100000:1.0:1787397541.132948:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2430 00000100:00100000:1.0:1787397541.132960:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681143936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397541.133010:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2405:x1874218681143936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397541.133017:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2430 00000100:00080000:3.0:1787397541.133335:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397541.133343:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397541.133347:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787397541.668795:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397541.860741:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700953088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397541.860837:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397541.860932:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953088 00000100:00100000:0.0:1787397541.860940:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953088 00000100:00100000:0.0:1787397541.861013:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1787397541.861238:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700953088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397541.861274:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397541.861322:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700953088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 300us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397541.861330:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00080000:0.0:1787397541.861356:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397541.861449:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700953088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397541.861863:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397541.861889:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700953216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397541.861937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397541.861970:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953216 00000100:00100000:1.0:1787397541.861975:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953216 00000100:00100000:1.0:1787397541.862011:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:1.0:1787397541.862019:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700953216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397541.862051:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787397541.863192:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397541.863315:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700953216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1293us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397541.863325:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:1.0:1787397541.863383:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700953216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787397542.692911:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397543.719847:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397544.740671:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397544.934822:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397544.934832:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397544.934837:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397544.934848:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3419 00000100:00080000:3.0:1787397544.934855:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397544.934863:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397544.934908:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397544.934929:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700953344:0@lo:400:kworker.0 00000400:00000100:0.0:1787397544.935009:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700953344 offset 0 length 224: 4 00000100:00100000:3.0:1787397544.935906:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835753480 x1874218700953472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397544.935968:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397544.935973:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397544.935975:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397544.935981:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3419 00000100:00080000:3.0:1787397544.935984:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397544.935991:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397544.936018:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b67480 x1874218700953728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397544.936036:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397544.936040:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397544.936041:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397544.936045:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3419 00000100:00080000:3.0:1787397544.936048:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397544.936052:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397544.936067:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828835500 x1874218700953984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397544.936109:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397544.936112:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397544.936114:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397544.936118:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3419 00000100:00080000:3.0:1787397544.936120:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397544.936124:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397544.936134:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828835c00 x1874218700954368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397544.937145:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700953600:0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.937242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397544.937304:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397544.937312:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700953856:0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.937338:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397544.937390:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953600 00000100:00100000:0.0:1787397544.937401:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953600 00000100:00100000:0.0:1787397544.937467:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953856 00000100:00100000:0.0:1787397544.937470:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953856 00000100:00100000:0.0:1787397544.937498:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1787397544.937508:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.937603:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700953600:12345-0@lo:400:kworker.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397544.937627:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1787397544.937647:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1787397544.937654:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700953856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.937684:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700953856:12345-0@lo:400:kworker.0 Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397544.937690:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00080000:0.0:1787397544.937839:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397544.937903:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700953472:0@lo:38:kworker.0 00000100:00100000:1.0:1787397544.937956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.937979:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700953728:0@lo:38:kworker.0 00000100:00100000:1.0:1787397544.938004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.938022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700953984:0@lo:38:kworker.0 00000100:00100000:1.0:1787397544.938049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.938069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700954368:0@lo:38:kworker.0 00000100:00100000:1.0:1787397544.938104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.938139:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953472 00000100:00100000:1.0:1787397544.938144:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953472 00000100:00100000:1.0:1787397544.938169:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953728 00000100:00100000:1.0:1787397544.938172:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953728 00000100:00100000:1.0:1787397544.938180:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954368 00000100:00100000:1.0:1787397544.938183:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954368 00000100:00100000:1.0:1787397544.938194:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1787397544.938200:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700953472:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397544.938222:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397544.938259:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700953472:12345-0@lo:38:kworker.0 Request processed in 58us (302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397544.938265:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1787397544.938293:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1787397544.938296:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700953728:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397544.938306:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397544.938331:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700953728:12345-0@lo:38:kworker.0 Request processed in 33us (326us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397544.938338:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1787397544.938349:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1787397544.938353:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954368:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397544.938361:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397544.938383:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954368:12345-0@lo:38:kworker.0 Request processed in 28us (278us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397544.938389:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1787397544.938415:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700953984 00000100:00100000:1.0:1787397544.938419:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700953984 00000100:00100000:1.0:1787397544.938440:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1787397544.938444:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700953984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397544.938453:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397544.938477:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700953984:12345-0@lo:38:kworker.0 Request processed in 32us (428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397544.938483:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00080000:1.0:1787397544.938545:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397544.938551:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397544.938555:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700953472:0@lo:38:kworker.0 00000100:00080000:1.0:1787397544.938567:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397544.938571:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397544.938583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700953728:0@lo:38:kworker.0 00000100:00080000:1.0:1787397544.938595:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397544.938598:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397544.938600:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700953984:0@lo:38:kworker.0 00000100:00080000:1.0:1787397544.938608:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397544.938611:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397544.938613:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700954368:0@lo:38:kworker.0 00000100:00100000:1.0:1787397544.938662:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700954240:0@lo:400:kworker.0 00000100:00100000:1.0:1787397544.938696:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.938737:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397544.938743:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700954112:0@lo:400:kworker.0 00000100:00100000:1.0:1787397544.938767:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397544.938795:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954240 00000100:00100000:1.0:1787397544.938799:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954240 00000100:00100000:0.0:1787397544.944881:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700953856:0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.944904:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700953600:0@lo:400:kworker.0 00000100:00080000:0.0:1787397544.947106:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397544.947266:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954112 00000100:00100000:1.0:1787397544.947283:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954112 00000100:00080000:0.0:1787397544.947353:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397544.947400:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1787397544.947418:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.947595:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:0.0:1787397544.947605:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700954112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397544.947684:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700954112:12345-0@lo:400:kworker.0 Request processed in 80us (8914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397544.947693:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1787397544.947897:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700954240:12345-0@lo:400:kworker.0 Request processed in 486us (9199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397544.947904:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1787397544.948110:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700954112:0@lo:400:kworker.0 00000100:00100000:1.0:1787397544.948129:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700954240:0@lo:400:kworker.0 00010000:00010000:2.0:1787397545.764812:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787397545.958143:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397529/real 1787397529] req@ffff89a828411c00 x1874218700948608/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397545.958183:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a828411c00 x1874218700948608/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397545.958194:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787397545.958198:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787397545.958201:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787397545.958204:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787397545.958209:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a828411c00 x1874218700948608/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397545.958220:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83876dc00 x1874218700950528/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397550 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397545.958248:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83876e300 x1874218700951936/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397545.958261:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a835751c00 x1874218700953344/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787397545.958281:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787397545.958284:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787397545.958287:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787397545.958289:0:3649:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1787397545.958315:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700948608:0@lo:400:kworker.0 00000100:00100000:2.0:1787397545.958397:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700953344:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.958463:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700950528:0@lo:400:kworker.0 00000100:00080000:0.0:1787397545.958489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397545.958493:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787397545.958496:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397545.958509:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3367 00000100:00080000:0.0:1787397545.958550:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397545.958593:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698c380 x1874218700954496/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397545.958635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397545.958639:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397545.958641:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397545.958646:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3424 00000100:00080000:0.0:1787397545.958650:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397545.958658:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397545.958679:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698f100 x1874218700954624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397545.958705:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397545.958708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397545.958710:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397545.958714:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3424 00000100:00080000:0.0:1787397545.958716:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397545.958720:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397545.958740:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698df80 x1874218700954880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397545.958759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397545.958764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397545.958765:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397545.958769:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3424 00000100:00080000:0.0:1787397545.958772:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397545.958777:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397545.958792:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698d880 x1874218700955136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397545.958849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397545.958853:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397545.958855:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397545.958859:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3424 00000100:00080000:0.0:1787397545.958862:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397545.958866:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397545.958882:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698ce00 x1874218700955520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397545.958931:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700954752:0@lo:400:kworker.0 00000100:00100000:2.0:1787397545.959287:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700954496:0@lo:250:kworker.0 00000400:00000100:2.0:1787397545.959350:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700954496 offset 0 length 520: 4 00000100:00100000:2.0:1787397545.959388:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700954624:0@lo:38:kworker.0 00000100:00100000:2.0:1787397545.959423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397545.959449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700954880:0@lo:38:kworker.0 00000100:00100000:2.0:1787397545.959470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397545.959489:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700955136:0@lo:38:kworker.0 00000100:00100000:2.0:1787397545.959516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397545.959568:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700955520:0@lo:38:kworker.0 00000100:00100000:2.0:1787397545.959608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397545.959653:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954624 00000100:00100000:2.0:1787397545.959663:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954624 00000100:00100000:2.0:1787397545.959710:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954880 00000100:00100000:2.0:1787397545.959714:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954880 00000100:00100000:2.0:1787397545.959729:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955520 00000100:00100000:2.0:1787397545.959731:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955520 00000100:00100000:2.0:1787397545.959749:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1787397545.959756:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397545.959779:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397545.959828:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954624:12345-0@lo:38:kworker.0 Request processed in 69us (401us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397545.959849:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1787397545.959877:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1787397545.959883:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397545.960110:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397545.960139:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700954880:12345-0@lo:38:kworker.0 Request processed in 256us (667us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397545.960145:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1787397545.960158:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1787397545.960162:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700955520:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397545.960170:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397545.960193:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700955520:12345-0@lo:38:kworker.0 Request processed in 29us (584us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397545.960197:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1787397545.960222:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955136 00000100:00100000:2.0:1787397545.960227:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955136 00000100:00100000:2.0:1787397545.960248:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1787397545.960253:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700955136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397545.960262:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397545.960287:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700955136:12345-0@lo:38:kworker.0 Request processed in 32us (772us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397545.960293:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00080000:2.0:1787397545.960347:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397545.960352:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397545.960356:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700954624:0@lo:38:kworker.0 00000100:00080000:2.0:1787397545.960365:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397545.960369:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397545.960372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700954880:0@lo:38:kworker.0 00000100:00080000:2.0:1787397545.960393:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397545.960397:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397545.960399:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700955136:0@lo:38:kworker.0 00000100:00080000:2.0:1787397545.960407:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397545.960410:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397545.960413:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700955520:0@lo:38:kworker.0 00000100:00100000:0.0:1787397545.960605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397545.960635:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700951936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.960652:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397545.960658:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700955008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.960678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397545.960704:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700954752 00000100:00100000:0.0:1787397545.960707:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700954752 00000100:00100000:0.0:1787397545.960739:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955008 00000100:00100000:0.0:1787397545.960741:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955008 00000100:00100000:0.0:1787397545.960758:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1787397545.960765:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700954752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.960810:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700954752:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397545.960817:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1787397545.960913:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1787397545.960923:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700955008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961127:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700955008:12345-0@lo:400:kworker.0 Request processed in 206us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397545.961134:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1787397545.961163:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700955264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397545.961213:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397545.961219:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700955392:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397545.961262:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955264 00000100:00100000:0.0:1787397545.961266:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955264 00000100:00100000:0.0:1787397545.961290:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955392 00000100:00100000:0.0:1787397545.961293:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955392 00000100:00100000:0.0:1787397545.961309:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:0.0:1787397545.961316:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961350:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700955264:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397545.961356:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:0.0:1787397545.961367:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1787397545.961373:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700955392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961399:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700955392:12345-0@lo:400:kworker.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397545.961406:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1787397545.961445:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700955392:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961455:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700955264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961478:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700955008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397545.961498:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700954752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397546.245376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:3.0:1787397546.245427:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681144192 offset 0 length 224: 4 00000100:00100000:3.0:1787397546.245610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397546.245641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397546.246084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397546.246134:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144576 00000100:00100000:3.0:1787397546.246148:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144576 00000100:00100000:2.0:1787397546.246295:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144320 00000100:00100000:2.0:1787397546.246303:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144320 00000100:00100000:2.0:1787397546.246374:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144448 00000100:00100000:2.0:1787397546.246378:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144448 00000100:00100000:2.0:1787397546.246454:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1159 00000100:00100000:2.0:1787397546.246468:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681144448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397546.246592:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681144448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 127us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397546.246601:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1159 00000100:00100000:2.0:1787397546.246627:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1171 00000100:00100000:2.0:1787397546.246632:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681144320:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397546.246660:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397546.246869:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144704 00000100:00100000:3.0:1787397546.246874:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144704 00000100:00100000:3.0:1787397546.246901:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2435 00000100:00100000:3.0:1787397546.246910:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681144576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397546.246941:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681144576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397546.246948:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2435 00000100:00100000:3.0:1787397546.246963:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2436 00000100:00100000:2.0:1787397546.247088:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681144320:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 453us (1934us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397546.247097:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1171 00000100:00080000:1.0:1787397546.247956:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397546.247964:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397546.247981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397546.248876:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681144704:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397546.249376:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681144704:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2400us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397546.249392:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2436 00010000:00010000:3.0:1787397546.789570:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397546.980918:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397546.980942:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700955648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397546.981018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397546.981168:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955648 00000100:00100000:3.0:1787397546.981178:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955648 00000100:00100000:3.0:1787397546.981258:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1787397546.981268:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700955648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397546.981303:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397546.981352:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700955648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397546.981360:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1787397546.981469:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700955648:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787397546.981545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397546.982171:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700955776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397546.982217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397546.982282:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955776 00000100:00100000:1.0:1787397546.982288:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955776 00000100:00100000:1.0:1787397546.982344:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:1.0:1787397546.982353:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700955776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397546.982383:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787397546.982497:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397546.982829:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700955776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 476us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397546.982837:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:0.0:1787397546.982912:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700955776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397547.082896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:0.0:1787397547.086814:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681144832 offset 0 length 520: 4 00000100:00100000:0.0:1787397547.086964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397547.087054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397547.087357:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145216 00000100:00100000:1.0:1787397547.087370:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145216 00000100:00100000:1.0:1787397547.087430:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2437 00000100:00100000:1.0:1787397547.087441:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397547.087540:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (4638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397547.087549:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2437 00000100:00100000:0.0:1787397547.093548:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397547.093939:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681144960 00000100:00100000:2.0:1787397547.093940:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145088 00000100:00100000:2.0:1787397547.093950:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145088 00000100:00100000:3.0:1787397547.093951:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681144960 00000100:00100000:3.0:1787397547.093997:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1160 00000100:00100000:2.0:1787397547.094005:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1172 00000100:00100000:3.0:1787397547.094012:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681145088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397547.094018:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681144960:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397547.094054:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397547.094104:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681144960:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 85us (7235us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397547.094105:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681145088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (7057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397547.094119:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1172 00000100:00100000:2.0:1787397547.094142:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145344 00000100:00100000:2.0:1787397547.094145:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145344 00000100:00100000:2.0:1787397547.094169:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2438 00000100:00100000:2.0:1787397547.094175:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145344:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397547.094201:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145344:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397547.094207:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2438 00000100:00100000:3.0:1787397547.099730:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1160 00010000:00010000:1.0:1787397547.816094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397548.848152:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397549.860684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397550.886922:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397551.077054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397551.077068:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397551.077071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397551.077075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397551.077081:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397551.077089:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3425 00000100:00080000:1.0:1787397551.077095:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397551.077103:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397551.077166:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876d880 x1874218700955904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397551.077230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397551.077234:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397551.077260:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397551.077265:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3425 00000100:00080000:1.0:1787397551.077267:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397551.077272:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397551.077286:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876dc00 x1874218700956160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397551.077297:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700955904:0@lo:38:kworker.0 00000100:00080000:1.0:1787397551.077301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397551.077304:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397551.077306:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397551.077309:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3425 00000100:00080000:1.0:1787397551.077311:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397551.077314:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397551.077323:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b67b80 x1874218700956416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397551.077351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397551.077354:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397551.077355:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397551.077358:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3425 00000100:00080000:1.0:1787397551.077360:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397551.077364:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397551.077366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397551.077373:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835753480 x1874218700956800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397551.077401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700956160:0@lo:38:kworker.0 00000100:00100000:2.0:1787397551.077426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.077456:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700956416:0@lo:38:kworker.0 00000100:00100000:2.0:1787397551.077493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.077548:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700956800:0@lo:38:kworker.0 00000100:00100000:2.0:1787397551.077582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.077612:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700956544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.077638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.077660:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397551.077666:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700956672:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.077687:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397551.077799:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700955904 00000100:00100000:1.0:1787397551.077807:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700955904 00000100:00100000:1.0:1787397551.077851:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956160 00000100:00100000:1.0:1787397551.077862:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956160 00000100:00100000:1.0:1787397551.077879:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956800 00000100:00100000:1.0:1787397551.077881:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956800 00000100:00100000:1.0:1787397551.077899:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1787397551.077906:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700955904:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787397551.077913:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1787397551.077917:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700956160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397551.077925:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1787397551.077927:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397551.077978:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700955904:12345-0@lo:38:kworker.0 Request processed in 70us (610us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397551.077986:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1787397551.078003:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1787397551.078007:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700956800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397551.078016:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397551.078076:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700956288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078076:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700956160:12345-0@lo:38:kworker.0 Request processed in 156us (648us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397551.078083:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1787397551.078104:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956416 00000100:00100000:3.0:1787397551.078105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.078108:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956416 00000100:00100000:3.0:1787397551.078125:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397551.078128:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1787397551.078131:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700956032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078132:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700956416:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397551.078141:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397551.078151:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397551.078162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700956416:12345-0@lo:38:kworker.0 Request processed in 29us (668us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397551.078167:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1787397551.078186:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956288 00000100:00100000:2.0:1787397551.078189:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956288 00000100:00100000:2.0:1787397551.078232:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956032 00000100:00100000:2.0:1787397551.078235:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956032 00000100:00100000:2.0:1787397551.078251:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1787397551.078257:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700956288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078311:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700956288:12345-0@lo:400:kworker.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397551.078318:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1787397551.078331:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1787397551.078336:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700956032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078359:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700956032:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397551.078364:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1787397551.078381:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956544 00000100:00100000:2.0:1787397551.078385:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956544 00000100:00100000:2.0:1787397551.078411:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956672 00000100:00100000:2.0:1787397551.078413:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956672 00000100:00100000:2.0:1787397551.078429:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:2.0:1787397551.078434:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078464:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700956544:12345-0@lo:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397551.078470:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:2.0:1787397551.078479:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:2.0:1787397551.078507:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700956672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078554:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700956672:12345-0@lo:400:kworker.0 Request processed in 54us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397551.078559:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:2.0:1787397551.078613:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700956032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078624:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700956288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078656:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700956672:0@lo:400:kworker.0 00000100:00100000:2.0:1787397551.078674:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700956544:0@lo:400:kworker.0 00000100:00080000:2.0:1787397551.078703:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397551.078707:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397551.078710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700956160:0@lo:38:kworker.0 00000100:00080000:3.0:1787397551.079759:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397551.079766:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397551.079769:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397551.080021:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397551.080028:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397551.080032:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700956416:0@lo:38:kworker.0 00000100:00100000:1.0:1787397551.080034:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700956800:12345-0@lo:38:kworker.0 Request processed in 2023us (2450us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397551.080043:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:2.0:1787397551.080051:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397551.080053:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397551.080056:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700956800:0@lo:38:kworker.0 00000100:00080000:2.0:1787397551.080211:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397551.080216:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397551.080219:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700955904:0@lo:38:kworker.0 00000020:01000004:0.0:1787397551.743927:0:88984:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787397551.743934:0:88984:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787397551.743936:0:88984:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787397551.744066:0:88984:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a703748000 00000020:01000004:0.0:1787397551.744082:0:88984:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787397551.744097:0:88984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787397551.744112:0:88984:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a703c8b380) 00000020:00000080:0.0:1787397551.744128:0:88984:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787397551.860823:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787397551.861296:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787397551.876216:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787397551.879644:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787397551.880315:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787397551.880678:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787397551.880931:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787397551.881206:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787397551.881415:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787397551.885351:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787397551.886974:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787397551.887250:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787397551.888162:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787397551.888493:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787397551.889892:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787397551.891885:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.892216:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.892473:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.892868:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.893123:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.893368:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.893745:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.894001:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.894238:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.894490:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.895003:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.895214:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.895417:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.895791:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.896087:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.896281:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.897706:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.898194:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.898449:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.898894:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.899157:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.899370:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.900198:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.900427:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.900770:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.900987:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.901183:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.901380:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787397551.901693:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.901914:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.902127:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787397551.902317:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787397551.903489:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787397551.904384:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787397551.904640:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787397551.905572:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787397551.906089:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787397551.906318:0:88984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1787397551.907129:0:88984:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787397551.907353:0:88984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787397551.907362:0:88984:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787397551.907373:0:88984:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18feb9 00000020:01000004:0.0:1787397551.907390:0:88984:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787397551.907401:0:88984:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787397551.907406:0:88984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a703748000 from MGS 00000020:01000004:0.0:1787397551.907410:0:88984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787397551.907419:0:88984:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a703c8cd40) 00000020:00000080:0.0:1787397551.907431:0:88984:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:0.0:1787397551.907490:0:88984:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a703748000 from MGS, refs=2 00080000:01000000:0.0:1787397551.907495:0:88984:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00010000:00010000:3.0:1787397551.908653:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397551.908995:0:88984:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18fec7 00010000:00010000:0.0:1787397551.909157:0:88984:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1787397551.920490:0:88984:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787397551.927252:0:88988:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787397551.928899:0:88984:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787397551.928979:0:88984:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787397551.929719:0:88984:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787397551.929994:0:88984:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787397551.930181:0:88984:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787397551.930186:0:88984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787397551.930987:0:88984:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787397551.930995:0:88984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787397551.931315:0:88984:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787397551.931325:0:88984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787397551.931988:0:88984:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787397551.932013:0:88984:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1787397551.932015:0:88984:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1787397551.932018:0:88984:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1787397551.932024:0:88984:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 62, was 0): CONNECTING 00000100:00100000:2.0:1787397551.932029:0:88984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1787397552.101023:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700956928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397552.101102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397552.101634:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700956928 00000100:00100000:1.0:1787397552.101643:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700956928 00000100:00100000:1.0:1787397552.101697:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:1.0:1787397552.101715:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700956928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397552.101747:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397552.101802:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700956928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397552.101809:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:0.0:1787397552.102987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700957056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397552.103049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397552.103124:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700956928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397552.104065:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957056 00000100:00100000:1.0:1787397552.104076:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957056 00000100:00100000:1.0:1787397552.104131:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1787397552.104156:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700957056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397552.104189:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397552.104251:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700957056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397552.104259:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:0.0:1787397552.104912:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700957056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397552.398614:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397552.398662:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397552.398709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397552.399048:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145600 00000100:00100000:2.0:1787397552.399059:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145600 00000100:00100000:2.0:1787397552.399133:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145472 00000100:00100000:2.0:1787397552.399137:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145472 00000100:00100000:2.0:1787397552.399157:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1163 00000100:00100000:2.0:1787397552.399167:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681145600:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397552.399256:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681145600:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397552.399265:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1163 00000100:00100000:2.0:1787397552.399284:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1176 00000100:00100000:2.0:1787397552.399290:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681145472:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397552.399578:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397552.399610:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681145472:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 318us (947us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397552.399618:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1176 00000100:00100000:0.0:1787397552.399809:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145728 00000100:00100000:0.0:1787397552.399815:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145728 00000100:00100000:0.0:1787397552.399862:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2441 00000100:00100000:0.0:1787397552.399871:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145728:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397552.399914:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681145728:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 45us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397552.399922:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2441 00000100:00080000:1.0:1787397552.401299:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397552.401978:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397552.407438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397552.408855:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145856 00000100:00100000:3.0:1787397552.408869:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145856 00000100:00080000:0.0:1787397552.409099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397552.409199:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2442 00000100:00100000:3.0:1787397552.409212:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681145856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397552.409300:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681145856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397552.409312:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2442 00010000:00010000:1.0:1787397552.932745:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397553.957028:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397554.980676:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397555.173034:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397545/real 1787397545] req@ffff89a70698c380 x1874218700954496/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397555.173094:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a70698c380 x1874218700954496/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397555.173115:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397555.173146:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787397555.173157:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700954496:0@lo:250:kworker.0 00000100:00080000:1.0:1787397555.173704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397555.173719:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787397555.173722:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397555.173728:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3425 00000100:00080000:1.0:1787397555.173734:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397555.173741:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 10000000:01000000:2.0:1787397555.173758:0:88984:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:1.0:1787397555.173770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a703508380 x1874218700957184/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1787397555.173774:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.173784:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.173790:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:1.0:1787397555.173801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:2.0:1787397555.173802:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1787397555.173804:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397555.173806:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397555.173809:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3430 00010000:00010000:2.0:1787397555.173811:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18faec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18faf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397555.173811:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397555.173815:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397555.173828:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350b800 x1874218700957312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1787397555.173842:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.173848:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.173852:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.173858:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.173862:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55a00/0x274786fe0d18fa52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa59 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397555.173863:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397555.173866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397555.173868:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1787397555.173870:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397555.173872:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3430 00000100:00080000:1.0:1787397555.173874:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 10000000:00010000:2.0:1787397555.173877:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397555.173878:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 10000000:01000000:2.0:1787397555.173896:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787397555.173905:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350ad80 x1874218700957568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397555.173921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1787397555.173923:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700957440:0@lo:400:kworker.0 00000100:00080000:1.0:1787397555.173925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397555.173926:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397555.173931:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3430 00000100:00080000:1.0:1787397555.173933:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397555.173937:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397555.173946:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700957696:0@lo:400:kworker.0 00000100:00100000:1.0:1787397555.173951:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70538a680 x1874218700957824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397555.173997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787397555.174001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397555.174002:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1787397555.174002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397555.174005:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1787397555.174008:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d18fa6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa75 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397555.174010:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3430 00000100:00080000:1.0:1787397555.174012:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397555.174016:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00010000:00010000:2.0:1787397555.174018:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174024:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397555.174027:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70538b480 x1874218700958208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1787397555.174030:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787397555.174050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.174060:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957696 00000100:00100000:1.0:1787397555.174066:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957696 00000100:00100000:0.0:1787397555.174074:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700957952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397555.174088:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957440 00000100:00100000:2.0:1787397555.174093:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957440 00000100:00100000:0.0:1787397555.174113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.174117:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1787397555.174122:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1787397555.174127:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397555.174127:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397555.174140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397555.174148:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700958080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397555.174182:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700957440:12345-0@lo:400:kworker.0 Request processed in 54us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.174182:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218700957696:12345-0@lo:400:kworker.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.174184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.174194:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1787397555.174236:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700957440:0@lo:400:kworker.0 00000100:00020000:3.0:1787397555.174246:0:3647:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff89a703508380 x1874218700957184/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787397555.174265:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174271:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55e00/0x274786fe0d18fa98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174281:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174287:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174302:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174318:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174323:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d18faa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18faad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174332:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174337:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174341:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174352:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174356:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d18fac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fac9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174364:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174370:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174375:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174387:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174390:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d18fad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fad7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174399:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174415:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174420:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174433:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174437:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d18fafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fb01 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174455:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174461:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174466:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174472:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174475:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d18fa60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa67 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174493:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174500:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174505:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397555.174511:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174515:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d18fa7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa83 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174591:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174599:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174604:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397555.174611:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174615:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d18fa8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fa91 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174624:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174629:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174633:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397555.174647:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174650:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18fab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fabb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.174658:0:88984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397555.174663:0:88984:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.174668:0:88984:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397555.174691:0:88984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397555.174697:0:88984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18fade lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d18fae5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397555.174708:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957952 00000100:00100000:0.0:1787397555.174714:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957952 00000100:00100000:0.0:1787397555.174746:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958080 00000100:00100000:0.0:1787397555.174749:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958080 00000100:00100000:0.0:1787397555.174773:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1787397555.174780:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700957952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397555.174834:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700957952:12345-0@lo:400:kworker.0 Request processed in 55us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.174840:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1787397555.174853:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1787397555.174859:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700958080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397555.174899:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700958080:12345-0@lo:400:kworker.0 Request processed in 39us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.174911:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1787397555.174950:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700958080:0@lo:400:kworker.0 00000100:00100000:0.0:1787397555.174960:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700957952:0@lo:400:kworker.0 00000100:00080000:0.0:1787397555.174990:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397555.174994:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397555.174997:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397555.175021:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218700957696:0@lo:400:kworker.0 00000100:00100000:1.0:1787397555.179643:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00080000:2.0:1787397555.199330:0:88984:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 63, was 0): CONNECTING 00000100:00080000:3.0:1787397555.199341:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397555.199351:0:88984:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397555.199359:0:88984:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3434 00000100:00080000:2.0:1787397555.199366:0:88984:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397555.199374:0:88984:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00080000:3.0:1787397555.199425:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1787397555.199432:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:0:1874218700957184:0@lo:250:kworker.0 00000100:00100000:3.0:1787397555.199444:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700957312:0@lo:38:kworker.0 00000100:00100000:2.0:1787397555.199498:0:88984:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828411f80 x1874218700958336/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397555.199514:0:88984:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1787397555.199565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.199602:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700957568:0@lo:38:kworker.0 00000100:00100000:3.0:1787397555.199626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.199675:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957312 00000100:00100000:2.0:1787397555.199682:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957312 00000100:00100000:2.0:1787397555.199715:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957568 00000100:00100000:2.0:1787397555.199718:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957568 00000100:00100000:2.0:1787397555.199800:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1787397555.199807:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700957312:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397555.199829:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397555.199931:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1787397555.199938:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700957568:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397555.199950:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397555.200003:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700957824:0@lo:38:kworker.0 00000100:00100000:3.0:1787397555.200036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.200057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700958208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397555.200098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.200130:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700958336:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787397555.200156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.200202:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958208 00000100:00100000:3.0:1787397555.200206:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958208 00000100:00100000:3.0:1787397555.200229:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1787397555.200249:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700958208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397555.200262:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397555.200297:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218700958208:12345-0@lo:38:kworker.0 Request processed in 46us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397555.200304:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1787397555.200327:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700957824 00000100:00100000:3.0:1787397555.200331:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700957824 00000100:00100000:3.0:1787397555.200348:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1787397555.200352:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700957824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397555.200363:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397555.200389:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700957824:12345-0@lo:38:kworker.0 Request processed in 36us (353us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397555.200394:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00080000:3.0:1787397555.200423:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397555.200428:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397555.200430:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700957824:0@lo:38:kworker.0 00000100:00080000:3.0:1787397555.200439:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397555.200442:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397555.200445:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700958208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397555.200501:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958336 00000100:00100000:3.0:1787397555.200505:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958336 00000100:00100000:3.0:1787397555.200560:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787397555.200565:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3647:x1874218700958336:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787397555.200583:0:88991:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3434 last 0 00000020:00000080:3.0:1787397555.200610:0:88991:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d18fece 00000100:00080000:3.0:1787397555.200735:0:88991:0:(import.c:65:import_set_state_nolock()) ffff89a829b1e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397555.200780:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218700958336:12345-0@lo:250:mount.lustre.0 Request processed in 213us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.200787:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787397555.200822:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 25 00000100:00080000:3.0:1787397555.200829:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:3.0:1787397555.200838:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787397555.200843:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787397555.200846:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787397555.200849:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:0.0:1787397555.201739:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700957568:12345-0@lo:38:kworker.0 Request processed in 1795us (2106us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397555.201750:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1787397555.202030:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397555.202044:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700958464:0@lo:400:kworker.0 00000100:00100000:1.0:1787397555.202081:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.202145:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958464 00000100:00100000:1.0:1787397555.202151:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958464 00000100:00100000:1.0:1787397555.202185:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787397555.202193:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+5:3651:x1874218700958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397555.202231:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+5:3651:x1874218700958464:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.202238:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787397555.202269:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700958464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397555.203471:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700957312:12345-0@lo:38:kworker.0 Request processed in 3592us (3834us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397555.203485:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:2.0:1787397555.204256:0:88984:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1787397555.204272:0:88984:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787397555.204315:0:88984:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787397555.204321:0:88984:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397555.204674:0:88984:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397555.204717:0:88984:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787397555.204790:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397555.204845:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397555.204847:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397555.204848:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397555.204849:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397555.204851:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397555.204852:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397555.204853:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397555.204855:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397555.204857:0:88984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397555.204859:0:88984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787397555.204861:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397555.204862:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397555.204863:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397555.204864:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397555.204865:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397555.204866:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397555.204867:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397555.204868:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397555.204868:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397555.204869:0:88984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397555.204952:0:88984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787397555.204971:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700958592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397555.205130:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.205215:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83459e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.205263:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958592 00000100:00100000:0.0:1787397555.205270:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958592 00000100:00100000:0.0:1787397555.205343:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397555.205352:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:88984:x1874218700958592:12345-0@lo:253:mount.lustre.0 00000100:00080000:3.0:1787397555.205372:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787397555.205384:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700958336:0@lo:250:mount.lustre.0 20000000:01000000:0.0:1787397555.205389:0:88990:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787397555.205393:0:88990:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787397555.205397:0:88990:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00080000:0.0:1787397555.205513:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397555.205518:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397555.205534:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700957312:0@lo:38:kworker.0 00000100:00080000:0.0:1787397555.205546:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397555.205556:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397555.205559:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700957568:0@lo:38:kworker.0 00000020:01000000:1.0:1787397555.205767:0:8:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:1.0:1787397555.205782:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1787397555.205785:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397555.205786:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397555.205788:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397555.205789:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397555.205790:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397555.205791:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397555.205793:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397555.205795:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397555.205801:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397555.205878:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700958720:0@lo:253:kworker.0 00000100:00100000:0.0:1787397555.205934:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787397555.206045:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787397555.206054:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1787397555.206056:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397555.206057:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787397555.206058:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397555.206059:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397555.206060:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397555.206062:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397555.206063:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397555.206064:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397555.206066:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787397555.206095:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787397555.206101:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1787397555.206104:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397555.206105:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:2.0:1787397555.206106:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958720 00000020:01000004:1.0:1787397555.206107:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397555.206109:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397555.206112:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1787397555.206113:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958720 00000020:01000004:1.0:1787397555.206114:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397555.206117:0:8:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397555.206118:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397555.206120:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787397555.206137:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1787397555.206159:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700958848:0@lo:253:kworker.0 00000100:00100000:2.0:1787397555.206167:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787397555.206168:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700958976:0@lo:253:kworker.0 00000100:00100000:2.0:1787397555.206178:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:3651:x1874218700958720:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787397555.206200:0:88991:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1787397555.206207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.206225:0:88992:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1787397555.206232:0:88992:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787397555.206237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787397555.206356:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787397555.206738:0:88990:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 108 00000100:00100000:3.0:1787397555.211353:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958848 00000100:00100000:3.0:1787397555.211366:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958848 00000100:00100000:3.0:1787397555.211420:0:88992:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1787397555.211428:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700958976 00000100:00100000:3.0:1787397555.211432:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700958976 00000100:00100000:3.0:1787397555.211598:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787397555.211609:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218700958848:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397555.211670:0:88994:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787397555.212623:0:88995:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787397555.212630:0:88995:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787397555.212633:0:88995:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787397555.212636:0:88995:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787397555.212941:0:88995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787397555.213201:0:88990:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787397555.213272:0:88991:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787397555.215877:0:88990:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787397555.216559:0:88991:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397555.216576:0:88991:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787397555.216710:0:88993:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397555.216715:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397555.216742:0:88993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216759:0:88993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397555.216768:0:88993:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054497s 00010000:00010000:1.0:1787397555.216781:0:88993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216789:0:88993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216796:0:88993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216804:0:88993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216811:0:88993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397555.216816:0:88993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216825:0:88993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216838:0:88993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216846:0:88993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.216851:0:88993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096aa00/0x274786fe0d18fed5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397555.217203:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:88984:x1874218700958592:12345-0@lo:253:mount.lustre.0 Request processed in 11847us (12068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.217215:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397555.217257:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787397555.217268:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3649:x1874218700958976:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397555.217295:0:88990:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787397555.217308:0:88990:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397555.217893:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700958592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397555.217909:0:88984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787397555.217912:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397555.217914:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397555.217915:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397555.217916:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397555.217918:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397555.217919:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397555.217920:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397555.217922:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397555.217924:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397555.217925:0:88984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397555.217950:0:88984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a703748000 from lustre-MDT0000 10000000:01000000:2.0:1787397555.217982:0:88984:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787397555.217985:0:88984:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397555.217994:0:88984:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a703748000 10000000:01000000:2.0:1787397555.217997:0:88984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787397555.218002:0:88984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a703748000 10000000:01000000:2.0:1787397555.218005:0:88984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787397555.218008:0:88984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a703748000 from 1 10000000:01000000:2.0:1787397555.218012:0:88984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397555.218042:0:88984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.218050:0:88984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.218059:0:88984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.218078:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397555.218120:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.218198:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092eca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.218701:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:3651:x1874218700958720:12345-0@lo:253:kworker.0 Request processed in 12524us (12764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.218711:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397555.218743:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959104 00000100:00100000:0.0:1787397555.218750:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959104 00000020:01000004:2.0:1787397555.218819:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787397555.218821:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397555.218822:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397555.218823:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397555.218824:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397555.218826:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397555.218827:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397555.218829:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397555.218830:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787397555.218833:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700958720:0@lo:253:kworker.0 00000100:00100000:1.0:1787397555.221020:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397555.221044:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:88984:x1874218700959104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397555.221065:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397555.221102:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b000/0x274786fe0d18fee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fedc expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.221134:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b000/0x274786fe0d18fee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fedc expref: 8 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.221146:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b000/0x274786fe0d18fee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fedc expref: 8 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.221155:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b000, rc 0) 00000100:00100000:1.0:1787397555.222590:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:88984:x1874218700959104:12345-0@lo:101:mount.lustre.0 Request processed in 1551us (4462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.222603:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787397555.223584:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397555.223662:0:88984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.223674:0:88984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.223693:0:88984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787397555.223703:0:88984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.223710:0:88984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.223718:0:88984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787397555.224068:0:88984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397555.224076:0:88984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a703748000 10000000:01000000:3.0:1787397555.224080:0:88984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787397555.224084:0:88984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787397555.224086:0:88984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397555.224121:0:88984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.224129:0:88984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.224139:0:88984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.224159:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397555.224222:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.224276:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959232 00000100:00100000:1.0:1787397555.224283:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959232 00000100:00100000:3.0:1787397555.224294:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397555.224316:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787397555.224324:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:88984:x1874218700959232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397555.224338:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397555.224351:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096ba00/0x274786fe0d18fef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18feea expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.224371:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096ba00/0x274786fe0d18fef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18feea expref: 9 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.224380:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096ba00/0x274786fe0d18fef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18feea expref: 9 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.224388:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096ba00, rc 0) 00000100:00100000:1.0:1787397555.224587:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700959232:12345-0@lo:101:mount.lustre.0 Request processed in 262us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.224620:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397555.224631:0:88984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.224639:0:88984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.224702:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397555.224728:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.224753:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397555.224801:0:88991:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:2.0:1787397555.224810:0:88991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1787397555.224864:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787397555.224903:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959360 00000100:00100000:1.0:1787397555.224907:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959360 00000100:00100000:1.0:1787397555.224923:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787397555.224928:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700959360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397555.225064:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700959360:12345-0@lo:501:mount.lustre.0 Request processed in 135us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.225071:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:0.0:1787397555.226084:0:88990:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:3.0:1787397555.226096:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959360:0@lo:501:mount.lustre.0 20000000:01000000:0.0:1787397555.226098:0:88990:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787397555.226145:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397555.226196:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.226219:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.226289:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:3649:x1874218700958976:12345-0@lo:253:kworker.0 Request processed in 9023us (20052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.226297:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1787397555.226331:0:3649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397555.226340:0:3649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397555.226341:0:3649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397555.226343:0:3649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397555.226344:0:3649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397555.226345:0:3649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397555.226347:0:3649:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397555.226349:0:3649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397555.226350:0:3649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397555.226353:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700958976:0@lo:253:kworker.0 00000100:00100000:0.0:1787397555.226386:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959488 00000100:00100000:0.0:1787397555.226391:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959488 00000100:00100000:0.0:1787397555.226422:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787397555.226430:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700959488:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1787397555.226583:0:88993:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397555.226588:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397555.226607:0:88993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226620:0:88993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397555.226628:0:88993:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054497s 00010000:00010000:1.0:1787397555.226632:0:88993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226638:0:88993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226645:0:88993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226651:0:88993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226657:0:88993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397555.226667:0:88993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226676:0:88993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226689:0:88993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226696:0:88993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.226703:0:88993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096ac00/0x274786fe0d18fef8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397555.226804:0:88994:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787397555.228454:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700959488:12345-0@lo:503:mount.lustre.0 Request processed in 2016us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.228469:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397555.228654:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700959488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397555.230241:0:88997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:88997:1874218700959616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397555.230307:0:88997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.230383:0:88997:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.230477:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959616 00000100:00100000:3.0:1787397555.230484:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959616 00000100:00100000:3.0:1787397555.230608:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787397555.230618:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+9:88997:x1874218700959616:12345-0@lo:502:llog_process_th.0 20000000:01000000:3.0:1787397555.236617:0:88994:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397555.236637:0:88994:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787397555.236843:0:88993:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397555.236849:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397555.236874:0:88993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236901:0:88993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397555.236910:0:88993:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000061800s 00010000:00010000:0.0:1787397555.236915:0:88993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.236918:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+9:88997:x1874218700959616:12345-0@lo:502:llog_process_th.0 Request processed in 6297us (6607us total) trans 0 rc 0/0 00010000:00010000:0.0:1787397555.236922:0:88993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.236928:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787397555.236929:0:88993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236948:0:88993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236954:0:88993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397555.236959:0:88993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236966:0:88993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236978:0:88993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236985:0:88993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.236991:0:88993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55200/0x274786fe0d18feff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.236998:0:88997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:88997:1874218700959616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787397555.237033:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397555.237045:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.237047:0:88997:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787397555.237052:0:88997:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787397555.237055:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397555.237069:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a828c1cd40) 00000020:00000080:2.0:1787397555.237091:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1787397555.237097:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787397555.237202:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787397555.237211:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff0d 00000020:00000080:2.0:1787397555.237456:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787397555.237461:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397555.237464:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.237466:0:88997:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787397555.237469:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397555.237473:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.237474:0:88997:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787397555.237477:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397555.237485:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a828c18000) 00000020:00000080:2.0:1787397555.237499:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1787397555.237503:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787397555.237505:0:88997:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787397555.237508:0:88997:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787397555.237513:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787397555.237603:0:88997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a703748000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787397555.237615:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a828c199c0) 00000020:00000080:2.0:1787397555.237625:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1787397555.237688:0:88997:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787397555.237695:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ff22 00000020:00000080:2.0:1787397555.237793:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787397555.237801:0:88997:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787397555.237806:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d18ff29 00080000:01000000:2.0:1787397555.237811:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787397555.237815:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff30 00000100:00100000:0.0:1787397555.239415:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218700958848:12345-0@lo:253:kworker.0 Request processed in 27795us (33194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.239428:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1787397555.239571:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787397555.239574:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787397555.239576:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397555.239577:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397555.239578:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397555.239580:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397555.239581:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397555.239583:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397555.239584:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787397555.239588:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700958848:0@lo:253:kworker.0 00010000:00010000:3.0:1787397555.334476:0:88997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1787397555.334653:0:88997:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: e90f04db-6a63-4f01-92c7-7bf813f9f081 idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:3.0:1787397555.334698:0:88997:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:3.0:1787397555.334719:0:88997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:3.0:1787397555.334848:0:88997:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787397555.334912:0:88997:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8345fde40: xid 1874218681137152, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:3.0:1787397555.334927:0:88997:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8345fd840: xid 1874218681137408, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:3.0:1787397555.335355:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a829b93380) 00000020:00000080:3.0:1787397555.335378:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1787397555.335446:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787397555.335453:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff4c 00000020:00000080:1.0:1787397555.339484:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787397555.349346:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d18ff53 00000020:00000080:2.0:1787397555.350209:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787397555.350224:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397555.350232:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.350234:0:88997:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787397555.350237:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787397555.350240:0:88997:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787397555.350242:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397555.350243:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397555.350245:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787397555.350248:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.350249:0:88997:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787397555.350252:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397555.350256:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.350258:0:88997:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787397555.350262:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787397555.350370:0:88997:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787397555.350386:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397555.350390:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.350391:0:88997:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787397555.350393:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397555.350397:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.350398:0:88997:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787397555.350401:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787397555.350406:0:88997:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:2.0:1787397555.350433:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397555.350707:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a702478000) 00000020:00000080:2.0:1787397555.350728:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787397555.350735:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787397555.350862:0:88997:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787397555.350867:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787397555.350874:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff61 00010000:00080000:2.0:1787397555.350919:0:88997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a803e9f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397555.353505:0:88997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1787397555.355766:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397555.355785:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787397555.355825:0:88997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787397555.355848:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ff68 00000100:00080000:3.0:1787397555.355859:0:88997:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397555.355865:0:88997:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a803e9f000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397555.355916:0:88997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8288c1f80 x1874218700959744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397555.355953:0:88997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787397555.356009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700959744:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787397555.356019:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397555.356026:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.356028:0:88997:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787397555.356032:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397555.356034:0:88997:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787397555.356036:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397555.356037:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397555.356039:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397555.356043:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.356045:0:88997:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397555.356047:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397555.356052:0:88997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397555.356056:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.356058:0:88997:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787397555.356061:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397555.356066:0:88997:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000100:00100000:0.0:1787397555.356087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787397555.356088:0:88997:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397555.356093:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397555.356114:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a829b90000) 00000020:00000080:3.0:1787397555.356132:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787397555.356138:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787397555.356153:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959744 00000100:00100000:0.0:1787397555.356160:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959744 00000100:00100000:0.0:1787397555.356201:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:0.0:1787397555.356209:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700959744:12345-0@lo:38:llog_process_th.0 00000004:00080000:3.0:1787397555.356217:0:88997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00010000:00080000:0.0:1787397555.356248:0:23942:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3434 last 0 00080000:01000000:2.0:1787397555.356256:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787397555.356263:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff7d 00000020:00000080:0.0:1787397555.356273:0:23942:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ff76 00000004:00100000:0.0:1787397555.356286:0:23942:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:2.0:1787397555.356293:0:88997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a828a58000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00000100:00080000:0.0:1787397555.356505:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a830a0a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397555.356585:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700959744:12345-0@lo:38:llog_process_th.0 Request processed in 375us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.356592:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00010000:00010000:2.0:1787397555.356654:0:88997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1787397555.358616:0:88997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397555.358646:0:88997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787397555.358725:0:88997:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000100:00100000:3.0:1787397555.359481:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397555.359494:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1787397555.359503:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787397555.359508:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787397555.359513:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a803e9f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787397555.359651:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700959744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397555.360199:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000040:00080000:1.0:1787397555.363371:0:88997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397555.363411:0:88997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000100:00100000:0.0:1787397555.366202:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700959872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397555.366285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.367725:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700959872 00000100:00100000:3.0:1787397555.367738:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700959872 00000100:00100000:3.0:1787397555.367791:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1787397555.367800:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700959872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397555.367836:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397555.367912:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700959872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.367919:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000040:00080000:1.0:1787397555.370320:0:88997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000100:00100000:0.0:1787397555.370420:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700959872:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787397555.372954:0:89003:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1787397555.372964:0:89003:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1787397555.373425:0:89003:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1787397555.373453:0:89003:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787397555.374134:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000040:00080000:3.0:1787397555.374241:0:89003:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1787397555.374246:0:89003:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787397555.374292:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787397555.374336:0:88997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787397555.374358:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ff84 00000100:00080000:2.0:1787397555.374368:0:88997:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787397555.374375:0:88997:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a828a58000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397555.374412:0:88997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828413100 x1874218700960000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397555.374444:0:88997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787397555.374618:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700960000:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787397555.374692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.374755:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960000 00000100:00100000:0.0:1787397555.374764:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960000 00000100:00100000:0.0:1787397555.374806:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941 00000100:00100000:0.0:1787397555.374816:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1874218700960000:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787397555.374846:0:26157:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3434 last 0 00000020:00000080:0.0:1787397555.374872:0:26157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ff8b 00002000:00100000:0.0:1787397555.374896:0:26157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a830a0f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787397555.374901:0:26157:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787397555.374904:0:26157:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397555.374967:0:26157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787397555.374991:0:26157:0:(import.c:65:import_set_state_nolock()) ffff89a830a0e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397555.375052:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700960000:12345-0@lo:8:llog_process_th.0 Request processed in 236us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.375060:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941 00000100:00100000:3.0:1787397555.375079:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397555.375092:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787397555.375099:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787397555.375104:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787397555.375106:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787397555.375132:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787397555.375138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700960000:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787397555.375188:0:89003:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787397555.375229:0:89003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3434665706487ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397555.375237:0:89003:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1787397555.375276:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397555.375283:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.375286:0:88997:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787397555.375291:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787397555.375296:0:88997:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787397555.375297:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397555.375306:0:88997:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397555.375308:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787397555.375311:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.375312:0:88997:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787397555.375315:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787397555.375320:0:88997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787397555.375325:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397555.375327:0:88997:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787397555.375332:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787397555.375337:0:88997:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000100:00100000:2.0:1787397555.375415:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397555.375428:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700960128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397555.375466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787397555.375568:0:88997:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787397555.375573:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397555.375587:0:88997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a83b9d19c0) 00000020:00000080:2.0:1787397555.375604:0:88997:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787397555.375609:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787397555.375696:0:88997:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787397555.375702:0:88997:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787397555.375708:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d18ff99 00010000:00080000:2.0:1787397555.375736:0:88997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a83ae97800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397555.376234:0:88997:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1787397555.376298:0:88997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397555.376310:0:88997:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787397555.376411:0:88997:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000004:00080000:3.0:1787397555.377856:0:88985:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1787397555.381396:0:88997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397555.381431:0:88997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:2.0:1787397555.381566:0:88997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:1.0:1787397555.383202:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960128 00000100:00100000:1.0:1787397555.383216:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960128 00000100:00100000:1.0:1787397555.383300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1787397555.383310:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700960128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397555.383354:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397555.383437:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700960128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (7970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.383445:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1787397555.383762:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700960128:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787397555.383873:0:89005:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1787397555.383890:0:89005:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00080000:0.0:1787397555.383992:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787397555.384101:0:89005:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1787397555.384124:0:89005:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1787397555.384267:0:89005:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1787397555.384270:0:89005:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787397555.386860:0:88997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397555.386876:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787397555.386935:0:88997:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787397555.386970:0:88997:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ffa0 00000100:00080000:0.0:1787397555.386983:0:88997:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397555.386988:0:88997:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a83ae97800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397555.387028:0:88997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705986300 x1874218700960256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397555.387052:0:88997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787397555.387079:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700960256:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787397555.387118:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397555.387124:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397555.387126:0:88997:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787397555.387129:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397555.387134:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397555.387136:0:88997:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787397555.387139:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787397555.387141:0:88997:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787397555.387143:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397555.387145:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397555.387147:0:88997:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787397555.387149:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397555.387153:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397555.387156:0:88997:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000100:00100000:3.0:1787397555.387157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787397555.387163:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787397555.387193:0:88997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:88997:1874218700960384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397555.387245:0:88997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.387269:0:88997:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81aa5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.387293:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960384 00000100:00100000:3.0:1787397555.387300:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960384 00000100:00100000:3.0:1787397555.387347:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787397555.387356:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:88997:x1874218700960384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.387822:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:88997:x1874218700960384:12345-0@lo:502:llog_process_th.0 Request processed in 465us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.387831:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397555.387984:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960256 00000100:00100000:2.0:1787397555.387990:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960256 00000100:00100000:0.0:1787397555.388014:0:88997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:88997:1874218700960384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397555.388023:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:2.0:1787397555.388039:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218700960256:12345-0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787397555.388044:0:88997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397555.388056:0:88997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397555.388058:0:88997:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787397555.388062:0:88997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00010000:00080000:2.0:1787397555.388067:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3434 last 0 00000020:00000080:2.0:1787397555.388098:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d18ffa7 00002000:00100000:2.0:1787397555.388111:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a836714000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787397555.388115:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787397555.388118:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1787397555.388265:0:88984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787397555.388289:0:88984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787397555.388312:0:88984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.388335:0:88984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787397555.388340:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 10000000:01000000:3.0:1787397555.388345:0:88984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a703748000 from 1 10000000:01000000:3.0:1787397555.388349:0:88984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:2.0:1787397555.388368:0:8435:0:(import.c:65:import_set_state_nolock()) ffff89a836711800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1787397555.388378:0:88984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.388388:0:88984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.388396:0:88984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.388412:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397555.388444:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.388467:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397555.388855:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960512 00000100:00100000:1.0:1787397555.388861:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960512 00000100:00100000:1.0:1787397555.388905:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787397555.388914:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:88984:x1874218700960512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397555.388925:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397555.388940:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18ffae expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.388961:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18ffae expref: 9 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.388972:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18ffae expref: 9 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.388981:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096aa00, rc 0) 00000100:00100000:1.0:1787397555.389018:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700960512:12345-0@lo:101:mount.lustre.0 Request processed in 105us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.389024:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787397555.389151:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700960256:12345-0@lo:8:llog_process_th.0 Request processed in 1112us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397555.389159:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:0.0:1787397555.389787:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397555.389798:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397555.389807:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787397555.389812:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787397555.389816:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83ae97800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787397555.389936:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397555.389945:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700960256:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787397555.390027:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397555.390048:0:88984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.390059:0:88984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397555.390169:0:89005:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787397555.390239:0:89005:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3434680716617ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397555.390246:0:89005:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787397555.390952:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960640:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787397555.391020:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.391068:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397555.391364:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960640 00000100:00100000:1.0:1787397555.391371:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960640 00000100:00100000:1.0:1787397555.391422:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787397555.391432:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700960640:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787397555.391460:0:88994:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787397555.391479:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787397555.391488:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787397555.391491:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787397555.391502:0:88994:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:1.0:1787397555.391753:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700960640:12345-0@lo:256:mount.lustre.0 Request processed in 321us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397555.391764:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397555.392515:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700960768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397555.392579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.392642:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960640:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787397555.393294:0:88984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397555.393318:0:88984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393329:0:88984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397555.393338:0:88984:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a703748000 from 1 10000000:01000000:3.0:1787397555.393340:0:88984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397555.393368:0:88984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393375:0:88984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393385:0:88984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.393399:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397555.393434:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.393459:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.393486:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960896 00000100:00100000:3.0:1787397555.393491:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960896 00000100:00100000:3.0:1787397555.393558:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787397555.393566:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:88984:x1874218700960896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397555.393589:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397555.393603:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ee800/0x274786fe0d18ffc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18ffbc expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393625:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ee800/0x274786fe0d18ffc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18ffbc expref: 10 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393636:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ee800/0x274786fe0d18ffc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18ffbc expref: 10 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393644:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ee800, rc 0) 00000100:00100000:3.0:1787397555.393678:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700960896:12345-0@lo:101:mount.lustre.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.393685:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787397555.393738:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700960896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397555.393750:0:88984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.393758:0:88984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.393811:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397555.393841:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.393863:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.393877:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961024 00000100:00100000:3.0:1787397555.393892:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961024 00000100:00100000:3.0:1787397555.393916:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787397555.393923:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700961024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397555.394055:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700961024:12345-0@lo:501:mount.lustre.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.394062:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787397555.394093:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397555.394119:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397555.394159:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.394175:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.394191:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961152 00000100:00100000:3.0:1787397555.394195:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961152 00000100:00100000:3.0:1787397555.394216:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397555.394223:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700961152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397555.394304:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700961152:12345-0@lo:503:mount.lustre.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.394311:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397555.394350:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397555.394592:0:89007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89007:1874218700961280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.394630:0:89007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.394651:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961280 00000100:00100000:3.0:1787397555.394655:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961280 00000100:00100000:3.0:1787397555.394676:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397555.394683:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:89007:x1874218700961280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.394815:0:89007:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397555.395904:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700960768 00000100:00100000:2.0:1787397555.395913:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700960768 00000100:00100000:2.0:1787397555.395962:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1787397555.395971:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700960768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397555.395999:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397555.396070:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700960768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (3490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397555.396078:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00080000:0.0:1787397555.397030:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397555.397218:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700960768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397555.397436:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:89007:x1874218700961280:12345-0@lo:502:llog_process_th.0 Request processed in 2752us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397555.397447:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397555.397817:0:89007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89007:1874218700961280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397555.397852:0:89007:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397555.397871:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.397874:0:89007:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787397555.397894:0:89007:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a703748000 00000020:00000080:3.0:1787397555.397896:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787397555.397904:0:89007:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397555.397907:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.397909:0:89007:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787397555.397911:0:89007:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397555.397913:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.397914:0:89007:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787397555.397917:0:89007:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a703748000 00000020:00000080:3.0:1787397555.397919:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787397555.397996:0:89007:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89007:1874218700961408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.398045:0:89007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.398084:0:89007:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397555.398599:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961408 00000100:00100000:2.0:1787397555.398607:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961408 00000100:00100000:2.0:1787397555.398652:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787397555.398661:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:89007:x1874218700961408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397555.398796:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:89007:x1874218700961408:12345-0@lo:502:llog_process_th.0 Request processed in 136us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397555.398803:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787397555.399981:0:88985:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787397555.400047:0:89007:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89007:1874218700961408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397555.400094:0:89007:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397555.400103:0:89007:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397555.400105:0:89007:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787397555.400109:0:89007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787397555.400857:0:88984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787397555.400894:0:88984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397555.400915:0:88984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.400927:0:88984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397555.400987:0:88984:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787397555.400990:0:88984:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a703748000 10000000:01000000:2.0:1787397555.400993:0:88984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a703748000 10000000:01000000:2.0:1787397555.400997:0:88984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787397555.401002:0:88984:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a703748000 from 1 10000000:01000000:2.0:1787397555.401005:0:88984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397555.401044:0:88984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.401053:0:88984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.401062:0:88984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.401081:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397555.401132:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.403612:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961536 00000100:00100000:0.0:1787397555.403624:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961536 00000100:00100000:2.0:1787397555.403635:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.403679:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787397555.403690:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700961536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397555.403706:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397555.403723:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55200/0x274786fe0d18ffd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18ffca expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.403750:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55200/0x274786fe0d18ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18ffca expref: 11 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.403761:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55200/0x274786fe0d18ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18ffca expref: 11 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.403771:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55200, rc 0) 00000100:00100000:0.0:1787397555.403837:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700961536:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.403846:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397555.403897:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397555.403919:0:88984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397555.403930:0:88984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397555.404005:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397555.404039:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.404063:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.405168:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961664 00000100:00100000:0.0:1787397555.405179:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961664 00000100:00100000:0.0:1787397555.405238:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787397555.405247:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700961664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397555.405393:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80833b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700961664:12345-0@lo:501:mount.lustre.0 Request processed in 146us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.405400:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397555.405852:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397555.405907:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397555.405964:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397555.405998:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.406051:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961792 00000100:00100000:0.0:1787397555.406056:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961792 00000100:00100000:0.0:1787397555.406089:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787397555.406096:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700961792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397555.406198:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80833a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700961792:12345-0@lo:503:mount.lustre.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.406206:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397555.406279:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700961792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397555.407783:0:89009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700961920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.407859:0:89009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.407907:0:89009:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90540 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.407953:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700961920 00000100:00100000:0.0:1787397555.407959:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700961920 00000100:00100000:0.0:1787397555.407997:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787397555.408006:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a808338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700961920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397555.408122:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a808338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700961920:12345-0@lo:502:llog_process_th.0 Request processed in 116us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.408130:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787397555.408397:0:89009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700961920:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787397555.408471:0:89009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787397555.408487:0:89009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a829b94d40) 00000020:00000080:3.0:1787397555.408937:0:89009:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787397555.409119:0:89009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a703748000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787397555.409124:0:89009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a703748000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787397555.409127:0:89009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a703748000 4 00010000:00080000:3.0:1787397555.409170:0:89009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a807dfe000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397555.412854:0:89009:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1787397555.412982:0:89009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787397555.413033:0:89009:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787397555.413047:0:89009:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d18ffdf 00000100:00080000:3.0:1787397555.413058:0:89009:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397555.413063:0:89009:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a807dfe000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397555.413098:0:89009:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8288c2a00 x1874218700962048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397555.413122:0:89009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787397555.417651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700962048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397555.417731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.418972:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962048 00000100:00100000:3.0:1787397555.418984:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962048 00000100:00100000:3.0:1787397555.419034:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1787397555.419041:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700962048:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397555.420394:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700962048:12345-0@lo:38:llog_process_th.0 Request processed in 1346us (2657us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397555.420407:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1787397555.420785:0:89009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700962176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.420853:0:89009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.420862:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397555.420872:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397555.420889:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397555.420895:0:89009:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90540 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.420921:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700962048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397555.423201:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962176 00000100:00100000:3.0:1787397555.423216:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962176 00000100:00100000:3.0:1787397555.423278:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787397555.423288:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a808339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700962176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.423454:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a808339c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700962176:12345-0@lo:502:llog_process_th.0 Request processed in 167us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.423462:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787397555.423552:0:89009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700962176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.423607:0:89009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700962304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.423650:0:89009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.423676:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962304 00000100:00100000:3.0:1787397555.423680:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962304 00000100:00100000:3.0:1787397555.423704:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397555.423709:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a808339050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700962304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397555.423784:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a808339050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:89009:x1874218700962304:12345-0@lo:502:llog_process_th.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.423791:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397555.423894:0:89009:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.423907:0:89009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:89009:1874218700962304:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787397555.423923:0:89009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787397555.425682:0:88984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787397555.425721:0:88984:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397555.425744:0:88984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397555.425756:0:88984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397555.425810:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787397555.425812:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397555.425814:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397555.425815:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397555.425816:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397555.425817:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397555.425818:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397555.425820:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397555.425821:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397555.425823:0:88984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397555.425826:0:88984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787397555.425829:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397555.425831:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397555.425832:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397555.425832:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397555.425834:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397555.425834:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397555.425835:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397555.425836:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397555.425838:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397555.425839:0:88984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397555.425861:0:88984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787397555.425889:0:88984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700962432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397555.425947:0:88984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.425987:0:88984:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.427080:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962432 00000100:00100000:3.0:1787397555.427094:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962432 00000100:00100000:3.0:1787397555.427150:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397555.427159:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a808338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:88984:x1874218700962432:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787397555.427188:0:88996:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787397555.427202:0:88996:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787397555.439761:0:88996:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397555.439780:0:88996:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787397555.439910:0:88993:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397555.439916:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397555.439939:0:88993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.439961:0:88993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18ffae expref: 11 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.439969:0:88993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.440010:0:88993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 11 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.440024:0:88993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 11 pid: 88990 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397555.440039:0:88993:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88993:1874218700962560:0@lo:104: 00000100:00100000:1.0:1787397555.440243:0:88993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.440296:0:88993:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.440297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962560 00000100:00100000:3.0:1787397555.440304:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962560 00000100:00100000:3.0:1787397555.440367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787397555.440386:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:88993:x1874218700962560:12345-0@lo:104: 00010000:00010000:3.0:1787397555.440400:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440448:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787397555.440454:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:88993:x1874218700962560:12345-0@lo:104: Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.440461:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:3.0:1787397555.440484:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397555.440489:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440508:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efe00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397555.440512:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440544:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397555.440553:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397555.440559:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397555.440586:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397555.440669:0:88993:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88993:1874218700962560:0@lo:104: 00010000:00010000:1.0:1787397555.440687:0:88993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440778:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397555.440805:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440822:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052efe00/0x274786fe0d18ffae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d18ffb5 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.440837:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397555.440839:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397555.440841:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397555.440849:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397555.440859:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700962688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397555.440900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397555.440935:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962688 00000100:00100000:3.0:1787397555.440939:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962688 00010000:00010000:3.0:1787397555.440956:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 12 pid: 88990 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397555.440978:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1787397555.440984:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+12:3648:x1874218700962688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397555.440994:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397555.441000:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 12 pid: 88990 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441009:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 12 pid: 88990 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441022:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096aa00/0x274786fe0d18ffb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d18ffae expref: 12 pid: 88990 timeout: 3534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441034:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441050:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397555.441061:0:19654:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001147135s 00010000:00010000:3.0:1787397555.441066:0:19654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441072:0:19654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441078:0:19654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441085:0:19654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441090:0:19654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397555.441094:0:19654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441102:0:19654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441113:0:19654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397555.441120:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397555.441147:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218700962688:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.441154:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1787397555.441193:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700962688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397555.442073:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a808338050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:88984:x1874218700962432:12345-0@lo:253:mount.lustre.0 Request processed in 14910us (16120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397555.442085:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787397555.442087:0:88993:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.442095:0:88993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397555.442102:0:88993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a000/0x274786fe0d18ffe6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397555.442196:0:88984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:88984:1874218700962432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397555.442217:0:88984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787397555.442220:0:88984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397555.442221:0:88984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397555.442222:0:88984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397555.442224:0:88984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397555.442224:0:88984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397555.442225:0:88984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397555.442227:0:88984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397555.442228:0:88984:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397555.442230:0:88984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397555.442231:0:88984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787397555.442244:0:88984:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1787397555.458776:0:88984:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:1.0:1787397555.459353:0:88984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787397555.459810:0:89016:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787397555.459829:0:88984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787397555.460195:0:89016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787397555.461340:0:89015:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:3.0:1787397555.461348:0:89015:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:00080000:1.0:1787397555.461909:0:89016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787397555.461982:0:89016:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787397555.464130:0:89017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700962816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397555.464217:0:89017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.464257:0:89017:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397555.467093:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962816 00000100:00100000:3.0:1787397555.467110:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962816 00000100:00100000:3.0:1787397555.467177:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1787397555.467189:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700962816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397555.467326:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700962816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 140us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397555.467334:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1787397555.467502:0:89017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700962816:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787397555.467572:0:89017:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787397555.467616:0:89017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700962944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397555.467658:0:89017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397555.467690:0:89017:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8192969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.468057:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700962944 00000100:00100000:0.0:1787397555.468064:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700962944 00000100:00100000:0.0:1787397555.468097:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:0.0:1787397555.468104:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700962944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397555.468263:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700962944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 158us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.468272:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1787397555.468283:0:89017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700962944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397555.468356:0:89017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700963072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397555.468386:0:89017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397555.468424:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963072 00000100:00100000:1.0:1787397555.468427:0:89017:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8192969c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397555.468430:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963072 00000100:00100000:0.0:1787397555.468452:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:0.0:1787397555.468457:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700963072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397555.468541:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89017:x1874218700963072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397555.468549:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:1.0:1787397555.468616:0:89017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89017:1874218700963072:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787397555.468658:0:89017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787397555.469587:0:88984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787397555.469630:0:88984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787397555.471931:0:88984:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787397555.471958:0:88984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787397555.472132:0:88984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397555.473694:0:89017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787397555.473769:0:89017:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787397555.473775:0:89017:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1787397555.473933:0:88984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787397555.474592:0:88984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787397555.475048:0:88984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787397555.475320:0:88984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787397555.476838:0:88984:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:1.0:1787397555.479446:0:88984:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:3.0:1787397555.482309:0:89018:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89018 00010000:02000000:3.0:1787397555.482384:0:89018:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1787397555.482388:0:89018:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1787397555.482392:0:89018:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1787397555.482787:0:88984:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787397555.482806:0:88984:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787397555.482828:0:88984:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787397555.482848:0:88984:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787397555.484041:0:88984:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397555.486663:0:88984:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397556.013465:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787397556.902641:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397556.902648:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a703748000 from 112 10000000:01000000:0.0:1787397556.902653:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397556.903151:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.903164:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.903175:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.903200:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.903259:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.903374:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.907129:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963200 00000100:00100000:1.0:1787397556.907145:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963200 00000100:00100000:1.0:1787397556.907333:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397556.907344:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80833ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218700963200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.907370:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.909668:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096a200/0x274786fe0d18fff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18ffed expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.910075:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a200/0x274786fe0d18fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18ffed expref: 11 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.910089:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096a200/0x274786fe0d18fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18ffed expref: 11 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.910113:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a200, rc 0) 00000100:00100000:1.0:1787397556.910191:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80833ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700963200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2849us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.910200:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397556.910633:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397556.910655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.910664:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.910806:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.910861:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.910892:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.911321:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963328 00000100:00100000:1.0:1787397556.911328:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963328 00000100:00100000:1.0:1787397556.911503:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397556.911512:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a808339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700963328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397556.911767:0:88991:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397556.911783:0:88991:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397556.911786:0:88991:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:1.0:1787397556.912137:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a808339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700963328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 625us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.912146:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787397556.912541:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787397556.912670:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397556.912678:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.912688:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397556.913096:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397556.913099:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:0.0:1787397556.913102:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397556.913131:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.913139:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.913149:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.913165:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.913202:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.913241:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397556.913313:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963456 00000100:00100000:2.0:1787397556.913320:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963456 00000100:00100000:2.0:1787397556.913369:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787397556.913378:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700963456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397556.913839:0:88996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397556.913867:0:88996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a600/0x274786fe0d190002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d18fffb expref: -99 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.913905:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a600/0x274786fe0d190002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d18fffb expref: 12 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.913917:0:88996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a600/0x274786fe0d190002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d18fffb expref: 12 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.913925:0:88996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:2.0:1787397556.914470:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80833b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1091us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397556.914479:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787397556.914654:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397556.914670:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.914680:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.914822:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.914867:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.914899:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.915105:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963584 00000100:00100000:1.0:1787397556.915110:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963584 00000100:00100000:1.0:1787397556.915147:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787397556.915155:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80833a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397556.915277:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80833a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.915284:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787397556.915483:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.915511:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.916100:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.916131:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.916191:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963712 00000100:00100000:1.0:1787397556.916196:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963712 00000100:00100000:1.0:1787397556.916232:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397556.916239:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397556.918559:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2300us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.918582:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787397556.921274:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397556.931461:0:89079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1787397556.932221:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1787397556.932252:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397556.932265:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.932277:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397556.932286:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397556.932289:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 109 10000000:01000000:2.0:1787397556.932291:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397556.932327:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.932335:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.932368:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397556.932400:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.932463:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397556.932505:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.932608:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963840 00000100:00100000:1.0:1787397556.932615:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963840 00000100:00100000:1.0:1787397556.932666:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787397556.932676:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700963840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.932698:0:88996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.932712:0:88996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096a400/0x274786fe0d190010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190009 expref: -99 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.932736:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a400/0x274786fe0d190010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190009 expref: 13 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.932747:0:88996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096a400/0x274786fe0d190010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190009 expref: 13 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.932755:0:88996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a400, rc 0) 00000100:00100000:1.0:1787397556.932792:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700963840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.932799:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787397556.933122:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397556.933137:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.933146:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397556.933198:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.933231:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397556.933264:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.933323:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700963968 00000100:00100000:1.0:1787397556.933327:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700963968 00000100:00100000:1.0:1787397556.933367:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787397556.933375:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700963968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397556.933395:0:88994:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397556.933410:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397556.933413:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787397556.933416:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787397556.933418:0:88994:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787397556.933425:0:88994:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:1.0:1787397556.933496:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700963968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.933504:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787397556.933860:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700963968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787397556.933937:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397556.933944:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.933953:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397556.933960:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397556.933962:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1787397556.933970:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397556.933991:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.933999:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.934006:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397556.934019:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.934050:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397556.934083:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.934671:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964096 00000100:00100000:1.0:1787397556.934678:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964096 00000100:00100000:1.0:1787397556.934733:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787397556.934742:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700964096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.934753:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.934767:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b800/0x274786fe0d19001e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190017 expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.934787:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b800/0x274786fe0d19001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190017 expref: 14 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.934797:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b800/0x274786fe0d19001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190017 expref: 14 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.934805:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b800, rc 0) 00000100:00100000:1.0:1787397556.934842:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.934860:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787397556.935003:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397556.935016:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.935025:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397556.935087:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.935116:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397556.935146:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.935336:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964224 00000100:00100000:1.0:1787397556.935341:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964224 00000100:00100000:1.0:1787397556.935558:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787397556.935566:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397556.935739:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.935762:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397556.935827:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.935872:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.935913:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.940445:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397556.943782:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964352 00000100:00100000:2.0:1787397556.943797:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964352 00000100:00100000:2.0:1787397556.943878:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787397556.943890:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.949674:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5778us (13750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397556.949709:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787397556.950114:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397556.951754:0:89080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1787397556.952652:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1787397556.952689:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787397556.952701:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.952714:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397556.952724:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1787397556.952726:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:2.0:1787397556.952730:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397556.952766:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.952774:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397556.952784:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397556.952808:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.952880:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397556.952923:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.953581:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964480 00000100:00100000:1.0:1787397556.953591:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964480 00000100:00100000:1.0:1787397556.953638:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787397556.953647:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218700964480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.953662:0:88996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.953677:0:88996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096b600/0x274786fe0d19002c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190025 expref: -99 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.953714:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096b600/0x274786fe0d19002c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190025 expref: 15 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.953724:0:88996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096b600/0x274786fe0d19002c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190025 expref: 15 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.953732:0:88996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096b600, rc 0) 00000100:00100000:1.0:1787397556.953785:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700964480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.953791:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787397556.956928:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397556.956955:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.956968:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397556.956988:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787397556.956993:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.957001:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397556.957027:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397556.957029:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:3.0:1787397556.957032:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397556.957065:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.957072:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.957081:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397556.957101:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.957157:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.957197:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.958962:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964608 00000100:00100000:1.0:1787397556.958989:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964608 00000100:00100000:1.0:1787397556.959050:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787397556.959060:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218700964608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.959077:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.959096:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096a800/0x274786fe0d19003a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190033 expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.959135:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a800/0x274786fe0d19003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190033 expref: 16 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.959147:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096a800/0x274786fe0d19003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190033 expref: 16 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.959155:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a800, rc 0) 00000100:00100000:1.0:1787397556.959223:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.959230:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787397556.959253:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397556.959270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.959280:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397556.959348:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.959380:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.959416:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397556.959463:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964736 00000100:00100000:2.0:1787397556.959468:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964736 00000100:00100000:2.0:1787397556.959506:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787397556.959512:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8351cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.959660:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8351cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397556.959674:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397556.959803:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.959833:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.959884:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.959900:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397556.959955:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964864 00000100:00100000:2.0:1787397556.959959:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964864 00000100:00100000:2.0:1787397556.959987:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787397556.959994:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8351cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.960077:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8351cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397556.960084:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787397556.960410:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397556.965147:0:89082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397556.965402:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397556.965425:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397556.965437:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.965449:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397556.965457:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397556.965460:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:0.0:1787397556.965474:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397556.965540:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.965549:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.965561:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.965585:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.965651:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.965703:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397556.969238:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700964992 00000100:00100000:3.0:1787397556.969252:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700964992 00000100:00100000:3.0:1787397556.969331:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397556.969342:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218700964992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397556.969357:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397556.969375:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052efe00/0x274786fe0d190048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190041 expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.969401:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052efe00/0x274786fe0d190048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190041 expref: 17 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.969414:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052efe00/0x274786fe0d190048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190041 expref: 17 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.969424:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052efe00, rc 0) 00000100:00100000:3.0:1787397556.969494:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700964992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (3843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397556.969501:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787397556.969607:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700964992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397556.969626:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397556.969635:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397556.969723:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.969755:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.969793:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397556.969809:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965120 00000100:00100000:0.0:1787397556.969813:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965120 00000100:00100000:0.0:1787397556.969843:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787397556.969859:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700965120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.969983:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700965120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397556.970006:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787397556.970037:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.970061:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.970098:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397556.970110:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397556.970715:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965248 00000100:00100000:2.0:1787397556.970722:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965248 00000100:00100000:2.0:1787397556.970759:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787397556.970766:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700965248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397556.970879:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700965248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397556.970886:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787397556.971312:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397556.987645:0:89083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787397556.988078:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787397556.988104:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397556.988115:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.988128:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397556.988150:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787397556.988153:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787397556.988156:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397556.988193:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.988201:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.988212:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397556.988240:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.988312:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.988361:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397556.991599:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965376 00000100:00100000:1.0:1787397556.991612:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965376 00000100:00100000:1.0:1787397556.991679:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397556.991700:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218700965376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397556.991716:0:88991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397556.991733:0:88991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096a000/0x274786fe0d190056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19004f expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.991758:0:88991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096a000/0x274786fe0d190056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19004f expref: 18 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.991768:0:88991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096a000/0x274786fe0d190056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19004f expref: 18 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397556.991776:0:88991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a000, rc 0) 00000100:00100000:1.0:1787397556.991841:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397556.991868:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397556.993749:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397556.993780:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397556.993794:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397556.993890:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.993945:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.993990:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397556.994065:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965504 00000100:00100000:0.0:1787397556.994071:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965504 00000100:00100000:0.0:1787397556.994121:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787397556.994130:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.994284:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397556.994293:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787397556.994468:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.994499:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397556.994670:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397556.994693:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397556.994788:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965632 00000100:00100000:0.0:1787397556.994793:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965632 00000100:00100000:0.0:1787397556.994826:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787397556.994833:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397556.995994:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1155us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397556.996007:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397556.997596:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397556.999680:0:89086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1787397557.009785:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787397557.009832:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787397557.009846:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.009870:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397557.009882:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397557.009885:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:3.0:1787397557.009888:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397557.010882:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.010898:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.010909:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397557.010951:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.011032:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397557.011080:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.011260:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965760 00000100:00100000:0.0:1787397557.011269:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965760 00000100:00100000:0.0:1787397557.011343:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787397557.011355:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218700965760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397557.011382:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397557.011396:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55c00/0x274786fe0d190064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19005d expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.011422:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55c00/0x274786fe0d190064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19005d expref: 19 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.011434:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55c00/0x274786fe0d190064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19005d expref: 19 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.011444:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55c00, rc 0) 00000100:00100000:0.0:1787397557.011510:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700965760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397557.011519:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397557.012010:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397557.012027:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.012038:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397557.012116:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.012152:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.012179:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397557.013084:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700965888 00000100:00100000:3.0:1787397557.013092:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700965888 00000100:00100000:3.0:1787397557.013144:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397557.013166:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700965888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.013297:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700965888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.013305:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397557.013812:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700965888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.013874:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.013936:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.013986:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397557.014234:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966016 00000100:00100000:3.0:1787397557.014239:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966016 00000100:00100000:3.0:1787397557.014282:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397557.014290:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700966016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.014380:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700966016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.014387:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397557.014723:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397557.016609:0:89087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397557.021118:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397557.021161:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397557.021172:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021185:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397557.021196:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397557.021198:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:3.0:1787397557.021201:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397557.021237:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021244:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021255:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397557.021297:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.021365:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397557.021401:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966144 00000100:00100000:3.0:1787397557.021407:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966144 00000100:00100000:3.0:1787397557.021461:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397557.021470:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218700966144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397557.021483:0:88996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397557.021495:0:88996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052eee00/0x274786fe0d190072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19006b expref: -99 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021518:0:88996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052eee00/0x274786fe0d190072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19006b expref: 20 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021547:0:88996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052eee00/0x274786fe0d190072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19006b expref: 20 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021555:0:88996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052eee00, rc 0) 00000100:00100000:3.0:1787397557.021588:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.021595:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397557.021632:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787397557.021651:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397557.021664:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.021673:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397557.021746:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.021768:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397557.021788:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.022412:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966272 00000100:00100000:0.0:1787397557.022421:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966272 00000100:00100000:0.0:1787397557.022472:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787397557.022482:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397557.022646:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397557.022654:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397557.023074:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.023121:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.023169:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.023206:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.023264:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966400 00000100:00100000:0.0:1787397557.023269:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966400 00000100:00100000:0.0:1787397557.023314:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787397557.023321:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397557.023414:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397557.023429:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787397557.023632:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397557.024768:0:89089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787397557.025121:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787397557.025147:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397557.025158:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.025170:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397557.025178:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787397557.025181:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1787397557.025184:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397557.025218:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.025227:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.025238:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397557.025259:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.025325:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.025355:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.026394:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966528 00000100:00100000:0.0:1787397557.026406:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966528 00000100:00100000:0.0:1787397557.026480:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397557.026491:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218700966528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397557.026505:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397557.026554:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54000/0x274786fe0d190080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190079 expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.026580:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54000/0x274786fe0d190080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190079 expref: 21 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.026592:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54000/0x274786fe0d190080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190079 expref: 21 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.026601:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54000, rc 0) 00000100:00100000:0.0:1787397557.026663:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397557.026670:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397557.026885:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397557.026902:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.026911:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397557.026993:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.027026:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.027062:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397557.027102:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966656 00000100:00100000:2.0:1787397557.027107:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966656 00000100:00100000:2.0:1787397557.027148:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397557.027156:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.027302:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397557.027310:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397557.027374:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.027404:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.027446:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.027553:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00010000:00010000:1.0:1787397557.033604:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397557.034683:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966784 00000100:00100000:2.0:1787397557.034698:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966784 00000100:00100000:2.0:1787397557.034778:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787397557.034788:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.046585:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 11791us (19130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397557.046600:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397557.046608:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397557.049024:0:89090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1787397557.049232:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787397557.049259:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787397557.049271:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.049293:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397557.049303:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787397557.049305:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:2.0:1787397557.049308:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397557.049352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.049360:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.049371:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397557.049397:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.049459:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397557.049578:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397557.050433:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700966912 00000100:00100000:1.0:1787397557.050445:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700966912 00000100:00100000:1.0:1787397557.050514:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397557.050541:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218700966912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397557.050557:0:88994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397557.050572:0:88994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096be00/0x274786fe0d19008e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190087 expref: -99 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.050596:0:88994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096be00/0x274786fe0d19008e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190087 expref: 22 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.050607:0:88994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096be00/0x274786fe0d19008e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190087 expref: 22 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397557.050616:0:88994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096be00, rc 0) 00000100:00100000:1.0:1787397557.050691:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700966912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397557.050699:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397557.050713:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700966912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397557.050732:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.050744:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397557.050808:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.050837:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397557.050876:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397557.051408:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967040 00000100:00100000:2.0:1787397557.051415:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967040 00000100:00100000:2.0:1787397557.051451:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397557.051480:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700967040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.051630:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700967040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.059174:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.059234:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397557.059305:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397557.059349:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397557.059369:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967168 00000100:00100000:1.0:1787397557.059377:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967168 00000100:00100000:1.0:1787397557.059424:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397557.059433:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700967168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397557.059577:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700967168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397557.059586:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787397557.059963:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.060192:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:3.0:1787397557.067411:0:89091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787397557.068702:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787397557.068732:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397557.068749:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.068761:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397557.068771:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1787397557.068774:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397557.068776:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787397557.068821:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.068829:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.068839:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397557.068876:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.068952:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397557.068999:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397557.069060:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967296 00000100:00100000:3.0:1787397557.069068:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967296 00000100:00100000:3.0:1787397557.069167:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397557.069177:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218700967296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397557.069192:0:88990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397557.069240:0:88990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ef000/0x274786fe0d19009c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190095 expref: -99 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.069263:0:88990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ef000/0x274786fe0d19009c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190095 expref: 23 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.069276:0:88990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ef000/0x274786fe0d19009c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190095 expref: 23 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.069284:0:88990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ef000, rc 0) 00000100:00100000:3.0:1787397557.069333:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700967296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.069341:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787397557.075626:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397557.075658:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.075686:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397557.075714:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787397557.075720:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.075728:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397557.075737:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787397557.075740:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397557.075744:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787397557.075777:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.075786:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.075795:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397557.075818:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.075892:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397557.075930:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.077184:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967424 00000100:00100000:0.0:1787397557.077197:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967424 00000100:00100000:0.0:1787397557.077253:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397557.077264:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218700967424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397557.077282:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397557.077301:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55400/0x274786fe0d1900aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1900a3 expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.077345:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55400/0x274786fe0d1900aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1900a3 expref: 24 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.077356:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55400/0x274786fe0d1900aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1900a3 expref: 24 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397557.077366:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55400, rc 0) 00000100:00100000:0.0:1787397557.077424:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700967424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397557.077432:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787397557.079579:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397557.079611:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397557.079650:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397557.079737:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397557.079805:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397557.079843:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397557.080089:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967552 00000100:00100000:0.0:1787397557.080098:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967552 00000100:00100000:0.0:1787397557.080145:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787397557.080155:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700967552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397557.080263:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218700967552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (458us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397557.080272:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397557.080346:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700967552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787397557.080382:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787397557.080391:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397557.080399:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397557.223052:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397557.223076:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700967680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397557.223146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397557.223193:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967680 00000100:00100000:1.0:1787397557.223200:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967680 00000100:00100000:1.0:1787397557.223256:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:1.0:1787397557.223268:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700967680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397557.223296:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397557.223341:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700967680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397557.223348:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:1.0:1787397557.223411:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700967680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397557.224896:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700967808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397557.224953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397557.227869:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397557.228445:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967808 00000100:00100000:3.0:1787397557.228458:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967808 00000100:00100000:3.0:1787397557.228551:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1787397557.228563:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700967808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397557.228598:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397557.228710:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700967808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (3755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.228717:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1787397557.228780:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700967808:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397557.229115:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397557.513153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397557.513195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397557.513231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397557.513266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397557.513288:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146112 00000100:00100000:3.0:1787397557.513300:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146112 00000100:00100000:2.0:1787397557.513346:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397557.513360:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681145984 00000100:00100000:3.0:1787397557.513365:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681145984 00000100:00100000:2.0:1787397557.513380:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146240 00000100:00100000:2.0:1787397557.513385:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146240 00000100:00100000:3.0:1787397557.513393:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1166 00000100:00100000:3.0:1787397557.513405:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681146112:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397557.513424:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146368 00000100:00100000:2.0:1787397557.513429:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146368 00000100:00100000:2.0:1787397557.513465:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4943 00000100:00100000:2.0:1787397557.513477:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681146240:12345-192.168.204.60@tcp:9:kworker.0 00000100:00100000:3.0:1787397557.513498:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681146112:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000020:00000080:2.0:1787397557.513501:0:26161:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fd5b 00000100:00080000:2.0:1787397557.513511:0:26161:0:(import.c:65:import_set_state_nolock()) ffff89a83879c000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787397557.513552:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1166 00000100:00100000:3.0:1787397557.513578:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1181 00000100:00100000:3.0:1787397557.513584:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681145984:12345-192.168.204.60@tcp:38:kworker.0 00000001:00000004:2.0:1787397557.513593:0:26161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968726 00010000:00080000:3.0:1787397557.513610:0:66177:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e90f04db-6a63-4f01-92c7-7bf813f9f081' at ffff89a829b1b800, cookie 0x274786fe0d18ff37 00010000:00080000:3.0:1787397557.513617:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp recovering/t103079215111 exp ffff89a829b1b800 cur 3436 last 1787397555 00010000:02000400:3.0:1787397557.513625:0:66177:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1787397557.513631:0:66177:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787397557.513657:0:66177:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787397557.513720:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681146240:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 246us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397557.513729:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4943 00000100:00100000:2.0:1787397557.513746:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4944 00000100:00100000:2.0:1787397557.513754:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681146368:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787397557.513785:0:26161:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fd62 00000100:00080000:2.0:1787397557.513790:0:26161:0:(import.c:65:import_set_state_nolock()) ffff89a83879d800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787397557.513804:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from RECOVER to FULL 00000001:00000004:2.0:1787397557.513815:0:26161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968723 00000100:00100000:3.0:1787397557.513855:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681145984:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 268us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397557.513862:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1181 00000100:00080000:3.0:1787397557.513886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397557.513897:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397557.513900:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397557.513908:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+2:2401:x1874218681146368:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 155us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397557.513916:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4944 00000100:00100000:2.0:1787397557.513939:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146496 00000100:00100000:2.0:1787397557.513945:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146496 00010000:00010000:3.0:1787397557.514002:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397557.514102:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397557.514286:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787397557.514296:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874218681146496:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:2.0:1787397557.514313:0:88992:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 367372d5-1a70-4e8f-8f10-c0f943f3662d@192.168.204.60@tcp t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:2.0:1787397557.514338:0:88992:0:(genops.c:1406:class_connect()) connect: client 367372d5-1a70-4e8f-8f10-c0f943f3662d, cookie 0x274786fe0d1900b1 00000100:00080000:2.0:1787397557.514454:0:88992:0:(import.c:65:import_set_state_nolock()) ffff89a836712800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397557.514491:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:2401:x1874218681146496:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 194us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397557.520055:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787397557.520544:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397557.521143:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138304 00000100:00100000:3.0:1787397557.521154:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138304 00000100:00100000:3.0:1787397557.521204:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1182 00000100:00100000:3.0:1787397557.521215:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681138304:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:3.0:1787397557.521235:0:74374:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1787397557.521299:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681138304:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 86us (755us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397557.521307:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1182 00010000:00080000:2.0:1787397557.521883:0:89018:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1787397558.056044:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397559.080761:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397559.306115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397559.307825:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146624 00000100:00100000:3.0:1787397559.307840:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146624 00000100:00100000:3.0:1787397559.307914:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:3.0:1787397559.307924:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:42362:x1874218681146624:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397559.307941:0:88994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397559.307959:0:88994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7052ef400/0x274786fe0d1900b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f03 expref: -99 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397559.307988:0:88994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7052ef400/0x274786fe0d1900b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f03 expref: 6 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397559.308000:0:88994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7052ef400/0x274786fe0d1900b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f03 expref: 6 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397559.308010:0:88994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7052ef400, rc 0) 00000100:00100000:3.0:1787397559.308069:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681146624:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397559.308083:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:3.0:1787397559.319514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397559.320096:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146752 00000100:00100000:0.0:1787397559.320108:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146752 00000100:00100000:0.0:1787397559.320160:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787397559.320170:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681146752:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397559.320196:0:88996:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1787397559.320218:0:88996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397559.320222:0:88996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1787397559.320225:0:88996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1787397559.320227:0:88996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1787397559.320235:0:88996:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:2.0:1787397559.322144:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681146752:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 1965us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397559.322159:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:0.0:1787397559.324434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397559.324580:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681146880 00000100:00100000:2.0:1787397559.324591:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681146880 00000100:00100000:2.0:1787397559.324648:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:2.0:1787397559.324657:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681146880:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397559.324682:0:88992:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397559.324699:0:88992:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a400/0x274786fe0d1900bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f0a expref: -99 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.324744:0:88992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a400/0x274786fe0d1900bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f0a expref: 7 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.324756:0:88992:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a400/0x274786fe0d1900bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f0a expref: 7 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.324765:0:88992:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a400, rc 0) 00000100:00100000:2.0:1787397559.324829:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681146880:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397559.324836:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:0.0:1787397559.335477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397559.336012:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147008 00000100:00100000:2.0:1787397559.336024:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147008 00000100:00100000:2.0:1787397559.336084:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:2.0:1787397559.336094:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681147008:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397559.336253:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681147008:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 160us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397559.336261:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:0.0:1787397559.338385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397559.338504:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147136 00000100:00100000:2.0:1787397559.338514:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147136 00000100:00100000:2.0:1787397559.338591:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:2.0:1787397559.338600:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681147136:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397559.338852:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681147136:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 251us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397559.338867:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:3.0:1787397559.354854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397559.354959:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147264 00000100:00100000:1.0:1787397559.354969:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147264 00000100:00100000:1.0:1787397559.355041:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:1.0:1787397559.355051:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681147264:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397559.355070:0:88994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397559.355088:0:88994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a83096bc00/0x274786fe0d1900c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f11 expref: -99 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397559.355119:0:88994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a83096bc00/0x274786fe0d1900c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f11 expref: 9 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397559.355130:0:88994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a83096bc00/0x274786fe0d1900c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f11 expref: 9 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397559.355139:0:88994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096bc00, rc 0) 00000100:00100000:1.0:1787397559.355211:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147264:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 161us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397559.355218:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:3.0:1787397559.357363:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397559.357683:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147392 00000100:00100000:1.0:1787397559.357692:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147392 00000100:00100000:1.0:1787397559.357760:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:1.0:1787397559.357769:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147392:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397559.357918:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147392:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 149us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397559.357926:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:1.0:1787397559.360010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397559.360166:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147520 00000100:00100000:3.0:1787397559.360177:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147520 00000100:00100000:3.0:1787397559.360229:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787397559.360238:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147520:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397559.360379:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147520:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 141us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397559.360387:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:0.0:1787397559.372216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397559.372965:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147648 00000100:00100000:2.0:1787397559.372978:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147648 00000100:00100000:2.0:1787397559.373048:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:2.0:1787397559.373059:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681147648:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397559.373078:0:88991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397559.373096:0:88991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b400/0x274786fe0d1900cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f18 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.373125:0:88991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b400/0x274786fe0d1900cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f18 expref: 10 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.373136:0:88991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b400/0x274786fe0d1900cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f18 expref: 10 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397559.373145:0:88991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b400, rc 0) 00000100:00100000:2.0:1787397559.373218:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681147648:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 160us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397559.373225:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:1.0:1787397559.376291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397559.376474:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147776 00000100:00100000:2.0:1787397559.376484:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147776 00000100:00100000:2.0:1787397559.376568:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:2.0:1787397559.376579:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681147776:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397559.376689:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681147776:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 112us (407us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397559.376696:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000001:02000400:2.0:1787397559.978468:0:89269:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787397560.107829:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397560.805842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397560.805848:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397560.805851:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397560.805858:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3434 00000100:00080000:0.0:1787397560.805862:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397560.805868:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397560.805887:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705986a00 x1874218700968064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397560.805907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397560.805911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397560.805913:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397560.805916:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3434 00000100:00080000:0.0:1787397560.805918:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397560.805922:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397560.805930:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705987480 x1874218700968320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397560.805949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397560.805952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397560.805954:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397560.805957:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3434 00000100:00080000:0.0:1787397560.805965:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397560.805969:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397560.805980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705986d80 x1874218700968576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397560.805999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397560.806002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397560.806004:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397560.806007:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3434 00000100:00080000:0.0:1787397560.806009:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397560.806012:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397560.806019:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705984000 x1874218700968960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397560.806044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787397560.806046:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397560.806048:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397560.806051:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a807dfe000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397560.806059:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83af26a00 x1874218700969472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397560.806219:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700968192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.806280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806307:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700969088:0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.806327:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806347:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787397560.806352:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700967936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.806383:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806406:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700968832:0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.806424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806447:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700968064:0@lo:38:kworker.0 00000100:00100000:0.0:1787397560.806466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806493:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700968320:0@lo:38:kworker.0 00000100:00100000:0.0:1787397560.806511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806547:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700968576:0@lo:38:kworker.0 00000100:00100000:0.0:1787397560.806564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806576:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700968960:0@lo:38:kworker.0 00000100:00100000:0.0:1787397560.806593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806611:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700969472:0@lo:38:kworker.0 00000100:00100000:0.0:1787397560.806682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806710:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700968448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.806733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397560.806743:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968192 00000100:00100000:0.0:1787397560.806750:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700969216:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.806759:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968192 00000100:00100000:0.0:1787397560.806788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.806809:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397560.806815:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700968704:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.806826:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968064 00000100:00100000:1.0:1787397560.806831:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968064 00000100:00100000:0.0:1787397560.806839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397560.806844:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968320 00000100:00100000:1.0:1787397560.806849:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968320 00000100:00100000:0.0:1787397560.806854:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700969344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.806860:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968960 00000100:00100000:1.0:1787397560.806863:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968960 00000100:00100000:1.0:1787397560.806875:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969472 00000100:00100000:0.0:1787397560.806879:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397560.806880:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969472 00000100:00100000:1.0:1787397560.806893:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968448 00000100:00100000:1.0:1787397560.806895:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968448 00000100:00100000:0.0:1787397560.806913:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1787397560.806999:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1787397560.807009:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700968448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.807070:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700968448:12345-0@lo:400:kworker.0 Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.807077:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1787397560.807097:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1787397560.807102:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700968064:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397560.807125:0:66176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3440 last 0 00000020:00000080:1.0:1787397560.807160:0:66176:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d1900d4 00000004:00100000:1.0:1787397560.807176:0:66176:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787397560.807185:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700968192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.807230:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700968192:12345-0@lo:400:kworker.0 Request processed in 308us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.807237:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1787397560.807256:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1787397560.807261:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700968320:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397560.807276:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3440 last 0 00000020:00000080:0.0:1787397560.807311:0:66177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d1900db 00000004:00100000:0.0:1787397560.807318:0:66177:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397560.807332:0:66176:0:(import.c:65:import_set_state_nolock()) ffff89a7050a3800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787397560.807339:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a817ef9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397560.807434:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218700968064:12345-0@lo:38:kworker.0 Request processed in 330us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.807441:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1787397560.807455:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1787397560.807459:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700968960:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397560.807472:0:66176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3440 last 0 00000020:00000080:1.0:1787397560.807498:0:66176:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d1900e2 00000004:00100000:1.0:1787397560.807504:0:66176:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397560.807519:0:66176:0:(import.c:65:import_set_state_nolock()) ffff89a7050a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397560.807555:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218700968320:12345-0@lo:38:kworker.0 Request processed in 291us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.807564:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1787397560.807571:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218700968960:12345-0@lo:38:kworker.0 Request processed in 109us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.807578:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1787397560.807583:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1787397560.807589:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700969472:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397560.807604:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3440 last 0 00000020:00000080:0.0:1787397560.807626:0:66177:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d1900e9 00000004:00100000:0.0:1787397560.807633:0:66177:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397560.807647:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a817efa000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787397560.807663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397560.807678:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700969472:12345-0@lo:38:kworker.0 Request processed in 88us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.807685:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1787397560.807712:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969088 00000100:00100000:0.0:1787397560.807717:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969088 00000100:00100000:0.0:1787397560.807749:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968576 00000100:00100000:0.0:1787397560.807753:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968576 00000100:00100000:0.0:1787397560.807767:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1787397560.807795:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700969088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.807833:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700969088:12345-0@lo:400:kworker.0 Request processed in 42us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.807840:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:0.0:1787397560.807854:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1787397560.807857:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700968576:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397560.807873:0:8445:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a829b1f000, cookie 0x274786fe0d18ff3e 00010000:00080000:0.0:1787397560.807877:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff89a829b1f000 cur 3440 last 1787397555 00000004:00100000:0.0:1787397560.807887:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397560.807902:0:8445:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397560.807938:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700968576:12345-0@lo:38:kworker.0 Request processed in 79us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.807944:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1787397560.807964:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700967936 00000100:00100000:0.0:1787397560.807969:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700967936 00000100:00100000:0.0:1787397560.807996:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787397560.808002:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700967936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.808035:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218700967936:12345-0@lo:400:kworker.0 Request processed in 33us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.808041:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787397560.808071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968832 00000100:00100000:0.0:1787397560.808076:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968832 00000100:00100000:0.0:1787397560.808108:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969216 00000100:00100000:0.0:1787397560.808111:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969216 00000100:00100000:0.0:1787397560.808132:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700968704 00000100:00100000:0.0:1787397560.808135:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700968704 00000100:00100000:0.0:1787397560.808157:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969344 00000100:00100000:0.0:1787397560.808168:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969344 00000100:00100000:0.0:1787397560.808197:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1787397560.808206:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700968832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.808244:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700968832:12345-0@lo:400:kworker.0 Request processed in 40us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.808252:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1787397560.808265:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1787397560.808271:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700969216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.808300:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700969216:12345-0@lo:400:kworker.0 Request processed in 30us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.808306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1787397560.808317:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:0.0:1787397560.808323:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700968704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.808353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700968704:12345-0@lo:400:kworker.0 Request processed in 29us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.808359:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:0.0:1787397560.808370:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:0.0:1787397560.808394:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700969344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397560.808424:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700969344:12345-0@lo:400:kworker.0 Request processed in 48us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397560.808431:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00010000:00080000:0.0:1787397560.808718:0:89018:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787397560.808724:0:89018:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:0.0:1787397560.808729:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397560.808732:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:0.0:1787397560.808736:0:89018:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:0.0:1787397560.808745:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397560.808757:0:89018:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681138304 t103079215111 from 192.168.204.60@tcp req@ffff89a70350ad80 x1874218681138304/t0(103079215111) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:753/0 lens 528/0 e 0 to 0 dl 1787397568 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397560.808786:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700968704:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808804:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700969344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808816:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700968448:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808828:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700969216:0@lo:400:kworker.0 00000100:00080000:0.0:1787397560.808843:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397560.808849:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397560.808930:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700967936:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808944:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700968832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808958:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700968192:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808970:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700969088:0@lo:400:kworker.0 00000100:00100000:1.0:1787397560.808989:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397560.808998:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700969600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397560.809039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397560.809074:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969600 00000100:00100000:1.0:1787397560.809079:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969600 00000100:00100000:1.0:1787397560.809109:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1787397560.809116:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700969600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397560.809138:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397560.809178:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700969600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.809184:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1787397560.809225:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700969600:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787397560.809939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705986a00 x1874218700968064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397560.809956:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000004:00080000:0.0:1787397560.810063:0:89018:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1242us 00000100:00080000:2.0:1787397560.810799:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a705986a00 x1874218700968064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397560.810810:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787397560.810815:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397560.810819:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397560.810823:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700968064:0@lo:38:kworker.0 00010000:00080000:2.0:1787397560.810845:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705987480 x1874218700968320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397560.810856:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:2.0:1787397560.811684:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a705987480 x1874218700968320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397560.811694:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787397560.811698:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397560.811702:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397560.811706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700968320:0@lo:38:kworker.0 00000100:00080000:2.0:1787397560.811731:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1787397560.811740:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787397560.811744:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1787397560.811747:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:2.0:1787397560.811750:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:2.0:1787397560.811762:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00100000:0.0:1787397560.813898:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:0.0:1787397560.813906:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a83879b000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:0.0:1787397560.813925:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397560.813949:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83879b000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0001 00000020:00000080:0.0:1787397560.813997:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879d800 for lustre-OST0001 00000001:00100000:2.0:1787397560.814659:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787397560.815029:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:2.0:1787397560.815034:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a838799000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:2.0:1787397560.815049:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787397560.815187:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700968576:0@lo:38:kworker.0 00010000:00080000:0.0:1787397560.815231:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705984000 x1874218700968960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397560.815249:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00010000:00080000:2.0:1787397560.817059:0:89316:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1787397560.817067:0:89316:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1787397560.817072:0:89316:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1787397560.817600:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a705984000 x1874218700968960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397585 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397560.817613:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397560.817619:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397560.817623:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397560.817628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700968960:0@lo:38:kworker.0 00010000:00080000:0.0:1787397560.817663:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83af26a00 x1874218700969472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397560.817678:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1787397560.817694:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787397560.817697:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397560.817700:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397560.817706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700969472:0@lo:38:kworker.0 00000020:00000080:0.0:1787397560.817842:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838799000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0000 00000020:00000080:0.0:1787397560.817881:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879c000 for lustre-OST0000 00000100:00080000:2.0:1787397560.818085:0:89316:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787397560.818155:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700969728:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397560.818222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.818546:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969728 00000100:00100000:0.0:1787397560.818554:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969728 00000100:00100000:0.0:1787397560.818598:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1787397560.818607:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700969728:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787397560.818625:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a829b40380 x1874218700969728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:1/0 lens 224/0 e 0 to 0 dl 1787397571 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397560.818638:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218700969728:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (417us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397560.818644:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00010000:00010000:2.0:1787397560.833163:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.833188:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.833206:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.833221:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.833229:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.833238:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835596:0:89018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835627:0:89018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835634:0:89018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835641:0:89018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397560.835646:0:89018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835654:0:89018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835671:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817898600) 00010000:00010000:2.0:1787397560.835674:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397560.835679:0:89018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835686:0:89018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1900f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397560.835708:0:89018:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb11ee90 reply state 0000000064eb793a transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835730:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.835739:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817898e00) 00010000:00010000:2.0:1787397560.835741:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397560.835745:0:89018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787397560.835880:0:89018:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397560.835909:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.835913:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1787397560.835918:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.835921:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:1.0:1787397560.839758:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397560.839999:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681138816 00000100:00100000:3.0:1787397560.840009:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681138816 00000100:00100000:3.0:1787397560.840076:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1187 00000100:00100000:3.0:1787397560.840087:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681138816:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:3.0:1787397560.840106:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:3.0:1787397560.840120:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681138816:12345-192.168.204.60@tcp:36:rm.0 Request processed in 36us (371us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397560.840127:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1187 00000020:00080000:3.0:1787397560.840144:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.840148:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:3.0:1787397560.840153:0:89018:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:3.0:1787397560.840157:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.840167:0:89018:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681138816 t103079215112 from 192.168.204.60@tcp req@ffff89a70538aa00 x1874218681138816/t0(103079215112) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 512/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397560.840281:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840297:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840310:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840322:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840330:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840336:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840436:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840445:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840452:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840717:0:89018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840725:0:89018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840739:0:89018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840746:0:89018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397560.840750:0:89018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840760:0:89018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840782:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff89a817be7100) 00010000:00010000:3.0:1787397560.840786:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397560.840791:0:89018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840799:0:89018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052efc00/0x274786fe0d19010c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840820:0:89018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840827:0:89018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840833:0:89018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840838:0:89018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397560.840842:0:89018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840858:0:89018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840867:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:3.0:1787397560.840870:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397560.840872:0:89018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840878:0:89018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee200/0x274786fe0d1900fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397560.840891:0:89018:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e885e2a3 reply state 000000005e923e40 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840912:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.840919:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817898e00) 00010000:00010000:3.0:1787397560.840921:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397560.840924:0:89018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397560.840998:0:89018:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397560.841016:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.841019:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:3.0:1787397560.841023:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.841025:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000001:00080000:2.0:1787397560.850439:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215111 is committed 00010000:00010000:0.0:1787397560.850549:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850561:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850570:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850576:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397560.850589:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850597:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850631:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817898e00) 00010000:00010000:0.0:1787397560.850635:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397560.850640:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.850647:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1900f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397560.856681:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397560.856716:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681140864 00000100:00100000:0.0:1787397560.856727:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681140864 00000100:00100000:0.0:1787397560.856843:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1188 00000100:00100000:0.0:1787397560.856856:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681140864:12345-192.168.204.60@tcp:36:dd.0 00010000:00080000:0.0:1787397560.856878:0:66178:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:0.0:1787397560.856901:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681140864:12345-192.168.204.60@tcp:36:dd.0 Request processed in 48us (233us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397560.856908:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1188 00000020:00080000:3.0:1787397560.856925:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.856930:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:3.0:1787397560.856934:0:89018:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215111) 00000020:00080000:3.0:1787397560.856946:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.856957:0:89018:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681140864 t103079215114 from 192.168.204.60@tcp req@ffff89a703508380 x1874218681140864/t0(103079215114) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 488/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397560.857191:0:89018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.857209:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.857222:0:89018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397560.857335:0:89018:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003834ae0b reply state 0000000040374454 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.857348:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.857356:0:89018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:3.0:1787397560.857360:0:89018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397560.857363:0:89018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397560.857479:0:89018:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397560.857495:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.857498:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:3.0:1787397560.857516:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397560.857518:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:3.0:1787397560.861359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397560.862957:0:66201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681141120 00000100:00100000:1.0:1787397560.862976:0:66201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681141120 00000100:00100000:1.0:1787397560.863057:0:66201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787397560.863070:0:66201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681141120:12345-192.168.204.60@tcp:10:dd.0 00010000:00080000:1.0:1787397560.863095:0:66201:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:1.0:1787397560.863207:0:66201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681141120:12345-192.168.204.60@tcp:10:dd.0 Request processed in 139us (1857us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397560.863216:0:66201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000020:00000004:1.0:1787397560.865388:0:89323:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397560.865656:0:89323:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00080000:2.0:1787397560.870239:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.870251:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:2.0:1787397560.870257:0:89018:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:2.0:1787397560.870260:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.870276:0:89018:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681141120 t103079215115 from 192.168.204.60@tcp req@ffff89a704ee5f80 x1874218681141120/t0(103079215115) o10->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 440/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1787397560.872641:0:89018:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397560.872670:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.872673:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:2.0:1787397560.872677:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397560.872679:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:1.0:1787397560.876714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397560.876860:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681147904 00000100:00100000:2.0:1787397560.876869:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681147904 00000100:00100000:2.0:1787397560.876936:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1189 00000100:00100000:2.0:1787397560.876947:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681147904:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397560.876973:0:67264:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a705389880 x1874218681147904/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 328/0 e 0 to 0 dl 1787397571 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397560.877001:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681147904:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 56us (295us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397560.877008:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1189 00000020:00080000:1.0:1787397560.877111:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397560.877115:0:89018:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:1.0:1787397560.877119:0:89018:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1787397560.877121:0:89018:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397560.877127:0:89018:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397560.877130:0:89018:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397560.877136:0:89018:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a705389880 x1874218681147904/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 328/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397560.877153:0:89018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397560.877178:0:89018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ef5 expref: -99 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.877216:0:89018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 12 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.877229:0:89018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 12 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.877239:0:89018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a83096a600, rc 0) 00010000:00080000:1.0:1787397560.877294:0:89018:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397560.877304:0:89018:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1787397560.883892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397560.884309:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148032 00000100:00100000:1.0:1787397560.884320:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148032 00000100:00100000:1.0:1787397560.884387:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1169 00000100:00100000:1.0:1787397560.884397:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681148032:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787397560.884419:0:66176:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a829b41880 x1874218681148032/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 224/0 e 0 to 0 dl 1787397571 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397560.884438:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2401:x1874218681148032:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 Request processed in 44us (726us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397560.884445:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1169 00010000:00080000:1.0:1787397560.884465:0:89018:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787397560.884598:0:89018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:2.0:1787397560.887167:0:88985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:2.0:1787397560.887179:0:88985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1787397560.887219:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00000001:00080000:3.0:1787397560.887410:0:89018:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787397560.887488:0:89018:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1787397560.887513:0:89018:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a829b40380 x1874218700969728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:1/0 lens 224/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787397560.887667:0:89018:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a829b41880 x1874218681148032/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 224/0 e 0 to 0 dl 1787397571 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787397560.887731:0:89018:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1787397560.887897:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787397560.887906:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a70350b800 x1874218700969728/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397576 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397560.887916:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a70350b800 x1874218700969728/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397576 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397560.887922:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397560.887942:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397560.887948:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700969728:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397560.889882:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397560.889915:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700969856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397560.889994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397560.891046:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891061:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891083:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891088:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397560.891093:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891101:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891117:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817898e00) 00010000:00010000:1.0:1787397560.891120:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397560.891125:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891131:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ef200/0x274786fe0d190105 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891156:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891163:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891168:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891174:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397560.891177:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891194:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891204:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:1.0:1787397560.891207:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397560.891210:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.891216:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7052ee600/0x274786fe0d190113 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397560.891247:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969856 00000100:00100000:1.0:1787397560.891257:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969856 00000100:00100000:1.0:1787397560.891311:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1787397560.891327:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700969856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397560.891364:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445117952 avail 1298878464 00000100:00100000:1.0:1787397560.891440:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700969856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397560.891536:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700969856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397560.898608:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1787397560.903753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397560.903807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397560.903850:0:66203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142272 00000100:00100000:0.0:1787397560.903862:0:66203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142272 00002000:00100000:0.0:1787397560.903912:0:66203:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff89a829b40700 x1874218681142272/t0(0) o4->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 496/0 e 0 to 0 dl 1787397571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397560.903923:0:66203:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a829b40700 with x1874218681142272 00002000:00010000:0.0:1787397560.903936:0:66203:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 7 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397560.903971:0:66203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787397560.903982:0:66203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:0:x1874218681142272:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:2.0:1787397560.904004:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681142400 00000100:00100000:2.0:1787397560.904010:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681142400 00000100:00100000:2.0:1787397560.904049:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1190 00000100:00100000:2.0:1787397560.904057:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:0:x1874218681142400:12345-192.168.204.60@tcp:16:kworker.0 00000100:00100000:2.0:1787397560.904175:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:0:x1874218681142400:12345-192.168.204.60@tcp:16:kworker.0 Request processed in 119us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397560.904184:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1190 00000100:00100000:0.0:1787397560.904766:0:66203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:0:x1874218681142272:12345-192.168.204.60@tcp:4:dd.0 Request processed in 784us (1023us total) trans 107374182401 rc 0/0 00000100:00100000:0.0:1787397560.904784:0:66203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00002000:00100000:0.0:1787397560.904791:0:66203:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff89a829b40700 x1874218681142272/t107374182401(0) o4->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:1/0 lens 496/448 e 0 to 0 dl 1787397571 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397560.904799:0:66203:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a829b40700 with x1874218681142272 00002000:00010000:0.0:1787397560.904805:0:66203:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 9 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1787397560.932954:0:89018:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe4869fe10 00100000:10000000:2.0:1787397560.932970:0:89018:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1787397560.933447:0:89004:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x682:0x0] 00000100:00100000:2.0:1787397560.933492:0:89004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89004:1874218700969984:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397560.933586:0:89004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397560.933615:0:89004:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787397560.933627:0:89006:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x45c:0x0] 00000100:00100000:2.0:1787397560.933645:0:89006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89006:1874218700970112:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787397560.933670:0:89006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397560.933687:0:89006:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397560.933705:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700969984 00000100:00100000:2.0:1787397560.933710:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700969984 00000100:00100000:2.0:1787397560.934205:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970112 00000100:00100000:2.0:1787397560.934210:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970112 00000100:00100000:2.0:1787397560.934235:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:2.0:1787397560.934243:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:89004:x1874218700969984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787397560.934281:0:26167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -127 00002000:02000040:2.0:1787397560.934287:0:26167:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1667 to 0x280000401:1793) 00000100:00100000:3.0:1787397560.935945:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946 00000100:00100000:3.0:1787397560.935963:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:89006:x1874218700970112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787397560.935990:0:26160:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -677 00002000:02000040:3.0:1787397560.935995:0:26160:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1117 to 0x2c0000401:1793) 00002000:00010000:1.0:1787397560.948623:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.948636:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948654:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.948658:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.948664:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948696:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948707:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948715:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948736:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397560.948861:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.948867:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948876:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.948879:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.948883:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948892:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948899:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948917:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948933:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397560.948943:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397560.948949:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948956:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.948960:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948968:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948984:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.948991:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b43870f/0x274786fe0d190121 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949011:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.949015:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949032:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949036:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949043:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949054:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949062:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e9daf7/0x274786fe0d190128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949075:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949077:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949079:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.949129:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.949134:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949142:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.949146:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.949150:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949158:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949173:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949179:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949201:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397560.949246:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.949252:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949259:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.949262:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.949265:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949273:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949281:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949287:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949313:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397560.949321:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397560.949326:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949333:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949336:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949344:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949354:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949361:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2046c1/0x274786fe0d19012f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949388:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.949392:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949399:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949403:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949422:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949433:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949440:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d190136 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949452:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949454:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949456:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.949506:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.949511:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949518:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.949545:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.949549:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949557:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949565:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949577:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949591:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.949600:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.949604:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949626:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949629:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949637:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949648:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a52c549/0x274786fe0d19013d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949668:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949670:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949671:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.949716:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.949727:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949735:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.949738:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.949742:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949750:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949757:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949764:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949787:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.949794:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.949798:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949804:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949807:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949815:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949832:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949844:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d190144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949858:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949860:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.949862:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.949906:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.949912:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949920:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.949923:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.949926:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949935:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949943:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949950:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949975:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.949982:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.949985:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.949992:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.949996:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950004:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950015:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950022:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d19014b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950035:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950037:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950039:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950080:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950086:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950093:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.950102:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.950107:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950116:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950124:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950131:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950143:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.950150:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.950154:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950161:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.950164:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950172:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950182:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950202:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d190152 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950216:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950218:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950220:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950261:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950267:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950275:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.950278:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.950282:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950291:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950299:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950307:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950319:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.950333:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.950337:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950344:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.950347:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950354:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950365:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950373:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056fa93e2/0x274786fe0d190159 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950386:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950388:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950389:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950430:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950436:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950443:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.950446:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.950451:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950471:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950479:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950487:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950500:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.950507:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.950510:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950517:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.950537:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950546:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950557:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950564:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004409d76/0x274786fe0d190160 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950584:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950586:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950587:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950629:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950634:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950642:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.950644:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.950648:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950657:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950665:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950671:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950683:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.950690:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.950693:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950710:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.950714:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950722:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950733:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950739:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190167 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950812:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950817:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950825:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.950828:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.950831:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950839:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950853:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950859:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950872:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.950880:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.950883:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950889:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.950892:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950899:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950910:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950917:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d19016e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950930:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950938:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.950940:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.950985:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.950990:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.950997:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.951000:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.951003:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951010:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951017:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951022:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951033:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.951039:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.951042:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951048:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.951051:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951070:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951082:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951089:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190175 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951102:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.951103:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.951105:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.951146:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.951152:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951159:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.951162:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.951166:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951174:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951181:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951195:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951208:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.951214:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.951218:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951224:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.951228:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951235:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951246:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951253:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d19017c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.951270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.951272:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.951312:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.951323:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951331:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.951333:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.951337:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951346:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951353:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951360:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951372:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.951378:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.951381:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.951388:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.951391:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.954878:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.954923:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.954931:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190183 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.954965:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.954968:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.954971:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.955104:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.955112:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955124:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.955128:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.955134:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955146:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955155:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955162:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955198:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.955208:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.955214:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955221:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.955226:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955234:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955245:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955253:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d19018a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.955266:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.955268:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.955269:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.960596:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.960608:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.960636:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.960647:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960664:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.960668:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.960675:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960690:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960700:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960723:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960745:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.960758:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.960763:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960780:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.960785:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960794:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960810:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.960817:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086be529/0x274786fe0d190198 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.961273:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.961276:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.961278:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.961422:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.961432:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961443:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.961454:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.961460:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961471:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961481:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961489:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961604:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.961614:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.961618:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961626:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.961630:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961639:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961652:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961671:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190191 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961692:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.961694:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.961695:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.961757:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.961763:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961785:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.961789:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.961794:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961804:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961812:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961820:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961833:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.961850:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.961854:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961862:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.961865:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961874:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961885:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961893:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d19019f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961906:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.961908:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.961909:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.961959:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.961966:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.961974:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.961977:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.961981:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962001:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962011:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962018:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962039:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397560.962086:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.962092:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962100:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962103:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.962107:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962116:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962124:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962142:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962157:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397560.962192:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.962197:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962205:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962207:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.962211:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962219:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962227:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962234:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962247:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787397560.962297:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.962302:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962316:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962319:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.962323:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962332:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962340:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962348:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962360:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787397560.962368:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787397560.962372:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962379:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.962382:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962390:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962414:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962421:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d1901a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962437:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397560.962440:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962446:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.962449:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962456:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962465:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962471:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1901ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962484:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397560.962487:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962500:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.962504:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962511:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962542:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962550:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1901b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962565:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.962568:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962576:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.962576:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.962580:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962591:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962593:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.962606:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962622:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d1901bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962628:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.962637:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.962640:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.962642:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.962648:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.962655:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962664:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.962667:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.962671:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962681:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962688:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.962691:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.962703:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962703:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962725:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962728:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.962732:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397560.962733:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962742:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.962746:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962748:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962766:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962767:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052efc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.962781:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962800:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962817:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397560.962867:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.962872:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962881:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962883:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.962887:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962895:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962903:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962909:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962922:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397560.962946:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962958:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.962959:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.962969:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.962971:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3dcb85/0x274786fe0d1901c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.962990:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.962995:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.962999:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963000:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397560.963006:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963013:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.963019:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963031:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963032:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963057:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963060:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963075:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963077:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1901c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963105:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397560.963122:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397560.963127:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963136:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.963140:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963148:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.963151:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.963162:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963164:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963178:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.963180:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7c0981a/0x274786fe0d1901d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963183:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.963192:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963199:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.963205:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963205:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963229:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.963231:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963234:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963262:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963271:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963281:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.963286:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963291:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.963298:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1901d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963298:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963319:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.963323:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963326:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963329:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963333:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.963333:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963340:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963346:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.963347:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963350:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.963357:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1901de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963373:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.963375:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.963377:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.963421:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.963432:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963440:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.963442:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.963445:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963453:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963460:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963467:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.963486:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.963491:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.963497:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963511:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.963514:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963554:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963579:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963586:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1901e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963601:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963603:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963604:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.963620:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.963625:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963633:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.963636:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.963640:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963649:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963656:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963664:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963687:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.963694:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.963698:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963706:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ee600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.963709:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963716:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963726:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963733:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40a7387/0x274786fe0d1901ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963745:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963747:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.963749:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.963804:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.963810:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963818:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.963836:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.963841:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963979:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963987:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.963993:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964007:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.964015:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.964018:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964025:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.964028:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964036:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964046:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964063:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca3d8433/0x274786fe0d1901f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964076:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964077:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964079:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.964129:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.964134:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964142:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.964145:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.964149:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964158:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964165:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964171:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964182:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.964195:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.964198:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964205:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.964209:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964216:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964227:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964234:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090208088/0x274786fe0d1901fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964248:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964250:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964252:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.964299:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.964303:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964310:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.964312:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.964316:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964336:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964343:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964349:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964362:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.964369:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.964372:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964378:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.964381:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964463:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964474:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964482:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb9f889/0x274786fe0d190201 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964500:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964501:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964503:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.964567:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.964572:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964579:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.964582:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.964585:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964592:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964600:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964607:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964620:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.964626:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.964630:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964649:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.964653:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964661:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964672:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964678:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026222758/0x274786fe0d190208 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964691:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964692:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.964693:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.964734:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.964739:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964747:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.964749:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.964753:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964762:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964790:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964797:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964811:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.964819:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.964832:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964839:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.964843:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964981:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964992:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.964998:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a8b29aa/0x274786fe0d19020f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965011:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965019:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965021:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.965071:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.965076:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965083:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.965086:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.965089:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965099:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965106:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965112:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965125:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.965132:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.965135:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965143:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.965146:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965166:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965178:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965185:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014a50268/0x274786fe0d190216 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965204:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965206:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965208:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.965257:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.965262:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965269:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.965271:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.965275:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965283:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965291:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965303:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965317:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.965326:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.965330:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965337:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.965340:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965347:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965358:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965365:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1de3d1e/0x274786fe0d19021d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965377:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965379:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.965508:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.965542:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965551:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.965554:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.965558:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965567:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965574:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965581:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965595:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.965602:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.965607:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965614:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.965617:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965624:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965641:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965648:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c9b84ea/0x274786fe0d190224 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965660:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965663:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.965664:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.965716:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.965722:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965730:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.965733:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.965738:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965747:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965754:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965761:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965800:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.965807:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.965811:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965818:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.965831:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965841:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965988:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.965996:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdfdab2/0x274786fe0d19022b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966011:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966013:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966015:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.966064:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.966069:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966077:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.966088:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.966092:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966102:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966109:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966116:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966142:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.966183:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.966189:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966196:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.966199:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.966202:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966211:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966219:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966233:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966247:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397560.966255:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397560.966259:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966265:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.966268:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966275:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966285:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966291:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f5932c/0x274786fe0d190232 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966317:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.966321:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966338:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.966341:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966349:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966361:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966369:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190239 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966443:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966452:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966455:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966457:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.966502:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.966507:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966515:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.966518:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.966552:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966563:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966579:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966585:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966605:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.966645:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.966650:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966658:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:2.0:1787397560.966659:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.966664:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397560.966668:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966670:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966689:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.966693:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966694:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966719:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966719:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966728:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966753:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966762:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397560.966762:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190240 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966784:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.966790:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.966792:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.966795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.966798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966802:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.966806:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966813:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966824:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966840:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190247 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.966982:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966984:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.966986:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.967036:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.967042:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967051:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.967060:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.967064:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967074:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967082:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967089:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967108:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.967146:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.967152:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967159:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:0.0:1787397560.967162:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.967163:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.967172:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.967173:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967192:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.967193:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397560.967199:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967205:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.967212:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967231:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967242:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.967283:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.967289:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967296:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.967298:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.967302:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967311:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967319:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967326:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967341:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397560.967348:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397560.967352:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967364:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.967367:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967374:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967450:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967459:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190255 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967472:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.967475:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967481:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.967484:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967491:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967501:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967514:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d19025c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967550:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.967552:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.967554:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397560.967558:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.967567:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967577:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.967580:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.967585:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967595:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397560.967600:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.967609:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967616:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967621:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.967629:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.967631:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967635:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967651:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967654:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.967663:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967670:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967685:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397560.967699:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397560.967703:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.967709:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.967710:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.967718:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967719:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967739:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967740:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.967749:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.967757:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967763:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967779:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967784:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d190263 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967797:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967806:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967809:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.967816:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967834:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.967836:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.967838:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.967883:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397560.967888:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967897:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.967899:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.967903:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967912:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967919:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967927:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.967934:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.967936:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397560.967940:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.967958:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.967964:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.967969:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.967971:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397560.967976:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967980:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.967991:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:2.0:1787397560.967995:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968004:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397560.968009:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d190271 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968010:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968013:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968025:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397560.968025:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968027:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d19026a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968030:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968043:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397560.968044:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968046:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968053:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968054:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968061:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397560.968063:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d190278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968087:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.968090:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397560.968096:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397560.968097:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.968101:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968101:0:26167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968109:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968109:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:1.0:1787397560.968112:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397560.968116:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968120:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968124:0:26167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968127:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dedfa282/0x274786fe0d19027f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968132:0:26167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968138:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397560.968146:0:26167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397560.968157:0:26167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397560.968341:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.968346:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968360:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.968363:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968370:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968381:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968388:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d190286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968402:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968403:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968405:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968459:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968462:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968464:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968471:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.968547:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.968553:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968561:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.968563:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.968568:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968577:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968590:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968601:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.968601:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.968626:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d19024e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968630:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397560.968635:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.968640:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968646:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397560.968648:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968650:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.968651:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.968653:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968668:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397560.968680:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397560.968681:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968691:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968693:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d19028d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968711:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.968716:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.968720:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968720:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968730:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968738:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968745:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968766:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.968817:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.968834:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968842:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:2.0:1787397560.968850:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.968854:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968862:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.968865:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968872:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968884:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968890:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190294 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.968958:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968960:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.968962:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.968983:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.968988:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.968999:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969007:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969014:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969027:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.969036:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.969040:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969047:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.969050:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969058:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969069:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969089:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d19029b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969104:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.969106:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.969108:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.969153:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.969160:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.969161:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.969170:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.969174:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.969178:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969186:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969195:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969202:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969226:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.969284:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.969289:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969297:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.969299:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.969303:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969312:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969319:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969327:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969339:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397560.969365:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1787397560.969382:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397560.969450:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969465:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.969466:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.969476:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:0.0:1787397560.969478:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969481:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.969490:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.969494:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.969509:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969518:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969549:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969557:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969577:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397560.969584:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397560.969589:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969597:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.969601:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969609:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969621:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397560.969629:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397560.969630:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d1902a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969641:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969651:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:2.0:1787397560.969653:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.969655:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397560.969659:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969661:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969678:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.969683:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969690:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969697:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969705:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.969717:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969723:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969739:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.969748:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.969753:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969761:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.969764:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969784:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969798:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969807:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1902b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.969835:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.969840:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.969842:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.970033:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.970045:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970054:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.970057:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.970063:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970073:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970084:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970093:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787397560.970110:0:26167:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1666 00010000:00010000:3.0:1787397560.970113:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.970122:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.970127:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970135:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.970138:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970144:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970162:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970179:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1902be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970196:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970198:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970200:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397560.970210:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:89004:x1874218700969984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 35963us (36619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.970221:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00002000:00010000:3.0:1787397560.970252:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.970258:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970267:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.970270:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.970274:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970283:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970290:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970296:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970317:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.970326:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397560.970329:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970335:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.970337:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970344:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970353:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970359:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1902c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970373:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970375:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970377:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.970401:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d1902a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.970418:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.970419:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.970421:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.970428:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.970496:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.970502:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970511:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.970519:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.970544:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970554:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970563:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970569:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970584:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397560.970626:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.970631:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970645:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d1902b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970646:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.970653:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.970661:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970673:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970673:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.970680:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970686:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970690:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397560.970696:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970711:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970714:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970732:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397560.970743:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397560.970747:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970748:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970779:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d1902cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970781:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397560.970786:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970807:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397560.970813:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.970816:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397560.970819:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970829:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970838:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1902d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.970988:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970990:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397560.970992:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397560.971040:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397560.971053:0:26160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.971061:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=3440s v=(0 0) 00010000:00010000:3.0:1787397560.971064:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397560.971068:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.971076:0:26160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.971083:0:26160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.971089:0:26160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397560.971101:0:26160:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787397560.972645:0:89004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89004:1874218700969984:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787397560.972667:0:89004:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x682:0x0] 00000100:00100000:3.0:1787397560.972742:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397560.972754:0:89004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89004:1874218700970368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787397560.972759:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700970240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787397560.972859:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397560.972867:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.972876:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397560.972880:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.972890:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.972905:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397560.972921:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1902da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397560.972930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397560.972949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.972952:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.972954:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397560.972963:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397560.972989:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970240 00000100:00100000:3.0:1787397560.972997:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970240 00000100:00100000:3.0:1787397560.973100:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1787397560.973108:0:89004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397560.973113:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700970240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397560.973130:0:89004:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014e40 going to sleep for 11 seconds 00002000:00000024:3.0:1787397560.973143:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397560.973195:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700970240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397560.973209:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1787397560.973342:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970368 00000100:00100000:0.0:1787397560.973347:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970368 00000100:00100000:0.0:1787397560.973375:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947 00000100:00100000:0.0:1787397560.973382:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:89004:x1874218700970368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787397560.973415:0:26157:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:3.0:1787397560.975055:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397560.977659:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:89004:x1874218700970368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4270us (4545us total) trans 4294968727 rc 0/0 00000100:00100000:0.0:1787397560.977674:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947 00000100:00100000:1.0:1787397560.977878:0:89004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89004:1874218700970368:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787397560.977895:0:89004:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00002000:00080000:3.0:1787397560.980646:0:26160:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1116 00000100:00100000:3.0:1787397560.980750:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:89006:x1874218700970112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44790us (47075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397560.980761:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946 00000100:00100000:0.0:1787397560.980970:0:89006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89006:1874218700970112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787397560.980985:0:89006:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x45c:0x0] 00000100:00100000:0.0:1787397560.981067:0:89006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89006:1874218700970624:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397560.981071:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397560.981088:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700970496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397560.981108:0:89006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397560.981133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397560.981136:0:89006:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397560.981158:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970624 00000100:00100000:0.0:1787397560.981164:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970624 00000100:00100000:1.0:1787397560.981177:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970496 00000100:00100000:1.0:1787397560.981183:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970496 00000100:00100000:1.0:1787397560.981229:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:0.0:1787397560.981230:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1787397560.981246:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700970496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397560.981246:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:89006:x1874218700970624:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:1.0:1787397560.981278:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00002000:00080000:0.0:1787397560.981289:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00000100:00100000:1.0:1787397560.981341:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218700970496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397560.981350:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1787397560.981604:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700970496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397560.984509:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:89006:x1874218700970624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3262us (3395us total) trans 4294968724 rc 0/0 00000100:00100000:0.0:1787397560.984552:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1787397560.986975:0:89006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89006:1874218700970624:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787397560.986996:0:89006:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00010000:00010000:1.0:1787397561.124782:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787397561.815465:0:89374:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787397561.816052:0:89374:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397562.148773:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397562.341759:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397562.341832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397562.342781:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397562.342800:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700970880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397562.342842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397562.344343:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970752 00000100:00100000:3.0:1787397562.344357:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970752 00000100:00100000:3.0:1787397562.344428:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700970880 00000100:00100000:3.0:1787397562.344432:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700970880 00000100:00100000:3.0:1787397562.344453:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1787397562.344463:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700970752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397562.344488:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787397562.344625:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397562.344630:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397562.344670:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397562.344957:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700970752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397562.344968:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1787397562.344989:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1787397562.344996:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700970880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397562.345008:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397562.345053:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700970880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397562.345060:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1787397562.346057:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700970880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397562.632479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397562.632619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397562.632713:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148288 00000100:00100000:2.0:1787397562.632723:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148288 00000100:00080000:0.0:1787397562.632869:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397562.632909:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1170 00000100:00100000:2.0:1787397562.632920:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2402:x1874218681148288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397562.633005:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2402:x1874218681148288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397562.633013:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1170 00000100:00100000:1.0:1787397562.633563:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148160 00000100:00100000:1.0:1787397562.633570:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148160 00000100:00100000:1.0:1787397562.633617:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:1.0:1787397562.633626:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681148160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397562.633666:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681148160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397562.633673:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787397562.635255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397562.635767:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148416 00000100:00100000:1.0:1787397562.635780:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148416 00000100:00100000:1.0:1787397562.635869:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1171 00000100:00100000:1.0:1787397562.635882:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681148416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397562.635993:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681148416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 113us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397562.636002:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1171 00000100:00080000:0.0:1787397562.636127:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787397563.172775:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397563.658757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397563.658828:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148544 00000100:00100000:2.0:1787397563.658838:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148544 00000100:00100000:2.0:1787397563.658918:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1191 00000100:00100000:2.0:1787397563.658932:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:68143:x1874218681148544:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397563.658975:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397563.659013:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1902e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f1f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659091:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659105:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659116:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397563.659165:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397563.659170:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397563.659229:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659254:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1902e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f1f expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659274:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f1f expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397563.659282:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:2.0:1787397563.659285:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397563.659289:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b800, rc 0) 00000100:00100000:2.0:1787397563.659356:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:68143:x1874218681148544:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 427us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397563.659369:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1191 00000100:00100000:3.0:1787397563.665582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397563.665933:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148672 00000100:00100000:0.0:1787397563.665946:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148672 00000100:00100000:0.0:1787397563.666471:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1192 00000100:00100000:0.0:1787397563.666485:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:68143:x1874218681148672:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397563.666563:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787397563.666651:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:68143:x1874218681148672:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 170us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397563.666660:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1192 00000100:00100000:3.0:1787397563.671179:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397563.671701:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148800 00000100:00100000:1.0:1787397563.671712:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148800 00000100:00100000:1.0:1787397563.671801:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1193 00000100:00100000:1.0:1787397563.671811:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681148800:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787397563.671851:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397563.672365:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681148800:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 551us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397563.672375:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1193 00000100:00100000:1.0:1787397563.687268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397563.687384:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681148928 00000100:00100000:2.0:1787397563.687395:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681148928 00000100:00100000:2.0:1787397563.687441:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4949 00000100:00100000:2.0:1787397563.687451:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681148928:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:2.0:1787397563.687483:0:8501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3442 last 0 00000020:00000080:2.0:1787397563.687516:0:8501:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d1902ef 00002000:00100000:2.0:1787397563.687556:0:8501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a828851000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787397563.687574:0:8501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787397563.687740:0:8501:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787397563.687796:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a7025d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397563.687868:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681148928:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 417us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397563.687877:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4949 00000100:00100000:3.0:1787397563.691985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397563.692107:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149056 00000100:00100000:1.0:1787397563.692119:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149056 00000100:00100000:1.0:1787397563.692195:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1953 00000100:00100000:1.0:1787397563.692205:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681149056:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397563.692294:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397563.692376:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681149056:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 171us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397563.692384:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1953 00000100:00080000:0.0:1787397563.692924:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397563.695234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397563.695426:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149184 00000100:00100000:1.0:1787397563.695448:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149184 00000100:00100000:1.0:1787397563.695494:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4950 00000100:00100000:1.0:1787397563.695502:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1874218681149184:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:1.0:1787397563.695572:0:26158:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp t0 exp 0000000000000000 cur 3442 last 0 00000020:00000080:1.0:1787397563.695606:0:26158:0:(genops.c:1406:class_connect()) connect: client e90f04db-6a63-4f01-92c7-7bf813f9f081, cookie 0x274786fe0d1902f6 00002000:00100000:1.0:1787397563.695617:0:26158:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f04db-6a63-4f01-92c7-7bf813f9f081/ffff89a705064800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787397563.695808:0:26158:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787397563.695882:0:26158:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787397563.695914:0:26158:0:(import.c:65:import_set_state_nolock()) ffff89a705067800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397563.696000:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681149184:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 497us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397563.696008:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4950 00000100:00100000:3.0:1787397563.699001:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397563.705603:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149312 00000100:00100000:0.0:1787397563.705618:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149312 00000100:00100000:0.0:1787397563.705799:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1954 00000100:00100000:0.0:1787397563.705812:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681149312:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397563.705841:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397563.705919:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68143:x1874218681149312:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 111us (6928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397563.705927:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1954 00000100:00080000:2.0:1787397563.706000:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397564.198907:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397565.223559:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397565.925154:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700971008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397565.925225:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397565.925560:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971008 00000100:00100000:3.0:1787397565.925568:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971008 00000100:00100000:3.0:1787397565.925612:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:3.0:1787397565.925620:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700971008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397565.926370:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700971136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397565.926417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397565.926459:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971136 00000100:00100000:0.0:1787397565.926464:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971136 00000100:00100000:0.0:1787397565.926487:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1787397565.926494:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700971136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397565.926513:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787397565.926571:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218700971136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.926578:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1787397565.927033:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700971136:0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397565.927100:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397565.927140:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700971008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1520us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.927145:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700971264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.927179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397565.927259:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1787397565.927371:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397565.927378:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700971392:0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.927404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397565.927429:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971264 00000100:00100000:0.0:1787397565.927433:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971264 00000100:00100000:0.0:1787397565.927462:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787397565.927468:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.927498:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700971264:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.927505:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787397565.927565:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700971264:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.927756:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700971904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.927787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.927809:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700972416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.927829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.927860:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787397565.927868:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700971776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.927939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.927984:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700972288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928008:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397565.928049:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971392 00000100:00100000:0.0:1787397565.928053:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971392 00000100:00100000:0.0:1787397565.928090:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971776 00000100:00100000:0.0:1787397565.928093:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971776 00000100:00100000:0.0:1787397565.928112:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1787397565.928118:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700971392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.928154:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700971392:12345-0@lo:400:kworker.0 Request processed in 36us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.928160:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1787397565.928173:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1787397565.928179:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700971776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928266:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971904 00000100:00100000:2.0:1787397565.928270:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971904 00000100:00100000:2.0:1787397565.928366:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972416 00000100:00100000:2.0:1787397565.928375:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972416 00000100:00100000:2.0:1787397565.928397:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972288 00000100:00100000:2.0:1787397565.928400:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972288 00000100:00100000:2.0:1787397565.928419:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:2.0:1787397565.928425:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700971904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928458:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700971904:12345-0@lo:400:kworker.0 Request processed in 33us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397565.928464:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1787397565.928513:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700971776:12345-0@lo:400:kworker.0 Request processed in 335us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.928539:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1787397565.928572:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700971392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928695:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1787397565.928702:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700972416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928733:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700972416:12345-0@lo:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397565.928739:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1787397565.928750:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:2.0:1787397565.928756:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700972288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.928780:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700972288:12345-0@lo:400:kworker.0 Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397565.928787:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00080000:2.0:1787397565.929000:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397565.929005:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397565.929007:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397565.929009:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397565.929037:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700971520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929065:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.929129:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700972032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.929169:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700972544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.929413:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700971008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397565.929427:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397565.929433:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700971648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929455:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397565.929471:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971520 00000100:00100000:0.0:1787397565.929476:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971520 00000100:00100000:0.0:1787397565.929509:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972544 00000100:00100000:0.0:1787397565.929512:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972544 00000100:00100000:0.0:1787397565.929546:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1787397565.929553:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700971520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.929595:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700971520:12345-0@lo:400:kworker.0 Request processed in 43us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.929602:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1787397565.929614:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1787397565.929620:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700972544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.929652:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700972544:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.929658:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1787397565.929833:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700972160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929857:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397565.929909:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700971520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929919:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700972544:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.929943:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972032 00000100:00100000:2.0:1787397565.929946:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972032 00000100:00100000:2.0:1787397565.929971:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:2.0:1787397565.929976:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700972032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.930006:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700972032:12345-0@lo:400:kworker.0 Request processed in 30us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397565.930011:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1787397565.930041:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700971648 00000100:00100000:0.0:1787397565.930044:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700971648 00000100:00100000:0.0:1787397565.930070:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972160 00000100:00100000:0.0:1787397565.930073:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972160 00000100:00100000:0.0:1787397565.930088:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1787397565.930093:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700971648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.930122:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700971648:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.930127:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1787397565.930137:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1787397565.930142:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700972160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397565.930164:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700972160:12345-0@lo:400:kworker.0 Request processed in 22us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397565.930170:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:2.0:1787397565.930282:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397565.930420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397565.930423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397565.930453:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700971776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.930465:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700972288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.930475:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700971904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.930486:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700972416:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.931042:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700971648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.931055:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700972160:0@lo:400:kworker.0 00000100:00100000:2.0:1787397565.931064:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700972032:0@lo:400:kworker.0 00010000:00010000:1.0:1787397566.251677:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397566.438508:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397566.438618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397566.439626:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972672 00000100:00100000:1.0:1787397566.439638:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972672 00000100:00100000:1.0:1787397566.439722:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:1.0:1787397566.439733:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700972672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397566.439844:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397566.439915:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700972672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397566.439923:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1787397566.442123:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397566.450071:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700972800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397566.450157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397566.450219:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972800 00000100:00100000:3.0:1787397566.450227:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972800 00000100:00100000:3.0:1787397566.450338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1787397566.450348:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700972800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397566.450386:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397566.450439:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218700972800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397566.450447:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1787397566.450508:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700972800:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787397566.452009:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:3.0:1787397566.452026:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968724 is committed 00000001:00100000:2.0:1787397566.453456:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:2.0:1787397566.453469:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968727 is committed 00000001:00080000:3.0:1787397566.457011:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00010000:00010000:2.0:1787397567.270551:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397567.460781:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700972928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397567.460812:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700973056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397567.464408:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397567.464614:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973056 00000100:00100000:1.0:1787397567.464623:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973056 00000100:00100000:1.0:1787397567.464707:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1787397567.464718:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700973056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397567.464747:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397567.464814:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700973056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397567.464822:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00080000:3.0:1787397567.464944:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397567.465598:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700973056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397567.467880:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397567.470679:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700972928 00000100:00100000:3.0:1787397567.470696:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700972928 00000100:00100000:3.0:1787397567.470845:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1787397567.470858:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700972928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397567.470885:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397567.470986:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700972928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397567.470994:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:1.0:1787397567.471799:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700972928:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787397567.471881:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397567.752466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397567.754633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397567.754688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397567.754714:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149696 00000100:00100000:1.0:1787397567.754725:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149696 00000100:00100000:3.0:1787397567.754789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397567.754805:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1178 00000100:00100000:1.0:1787397567.754818:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681149696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397567.754826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397567.754851:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149568 00000100:00100000:3.0:1787397567.754856:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149568 00000100:00100000:3.0:1787397567.754897:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1179 00000100:00100000:3.0:1787397567.754906:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681149568:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397567.754913:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681149696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397567.754940:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1178 00000100:00100000:3.0:1787397567.754952:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681149568:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397567.754959:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1179 00000100:00100000:1.0:1787397567.754985:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149952 00000100:00100000:1.0:1787397567.754991:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149952 00000100:00100000:1.0:1787397567.755026:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149824 00000100:00100000:1.0:1787397567.755029:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149824 00000100:00100000:1.0:1787397567.755053:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2453 00000100:00100000:1.0:1787397567.755062:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681149952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397567.755093:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681149952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397567.755101:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2453 00000100:00100000:1.0:1787397567.755113:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2454 00000100:00100000:1.0:1787397567.755120:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681149824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397567.755147:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2403:x1874218681149824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00080000:2.0:1787397567.755200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397567.755204:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397567.755207:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397567.755208:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397567.755275:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2454 00000100:00100000:0.0:1787397567.755557:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681149440 00000100:00100000:0.0:1787397567.755563:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681149440 00000100:00100000:0.0:1787397567.759040:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:0.0:1787397567.759064:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681149440:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397567.759154:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2403:x1874218681149440:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 101us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397567.759161:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00010000:00010000:0.0:1787397568.293369:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397568.962411:0:89567:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1787397569.316939:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397570.340998:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397570.543421:0:89615:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1787397571.044760:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397571.044786:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700973184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397571.044884:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700973312:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.044901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397571.045044:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700973696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397571.046234:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973184 00000100:00100000:3.0:1787397571.046248:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973184 00000100:00100000:3.0:1787397571.046311:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1787397571.046321:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700973184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397571.046358:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1787397571.050738:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700973568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.050768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.050819:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700973824:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.050838:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.051002:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973312 00000100:00100000:0.0:1787397571.051010:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973312 00000100:00100000:0.0:1787397571.051065:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397571.051074:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700973312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.051207:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700973312:12345-0@lo:400:kworker.0 Request processed in 133us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.051215:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397571.051479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700973440:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.051636:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973568 00000100:00100000:0.0:1787397571.051642:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973568 00000100:00100000:0.0:1787397571.051824:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1787397571.051832:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700973568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.052161:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700973568:12345-0@lo:400:kworker.0 Request processed in 328us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.052169:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:0.0:1787397571.052203:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397571.052342:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700973568:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052351:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700974080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052412:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700974592:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052491:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.052496:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974080 00000100:00100000:0.0:1787397571.052502:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974080 00000100:00100000:2.0:1787397571.052538:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700973952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052596:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700974464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.052641:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974592 00000100:00100000:2.0:1787397571.052645:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700974976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397571.052667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052712:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700974336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.052755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700974848:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.052766:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974592 00000100:00100000:2.0:1787397571.052778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.052803:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1787397571.052812:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700973312:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.052814:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700974080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.052841:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973440 00000100:00100000:2.0:1787397571.052845:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973440 00000100:00100000:2.0:1787397571.052886:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973824 00000100:00100000:2.0:1787397571.052889:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973824 00000100:00100000:2.0:1787397571.052908:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974336 00000100:00100000:2.0:1787397571.052911:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974336 00000100:00100000:2.0:1787397571.052933:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974848 00000100:00100000:2.0:1787397571.052936:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974848 00000100:00100000:2.0:1787397571.052949:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1787397571.052956:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700973440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.053000:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218700973440:12345-0@lo:400:kworker.0 Request processed in 44us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397571.053008:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1787397571.053015:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700974080:12345-0@lo:400:kworker.0 Request processed in 203us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.053024:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:2.0:1787397571.053028:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1787397571.053037:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700973824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.053043:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:0.0:1787397571.053053:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700974592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.053081:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700973824:12345-0@lo:400:kworker.0 Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397571.053088:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1787397571.053099:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1787397571.053105:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700974336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054313:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700974336:12345-0@lo:400:kworker.0 Request processed in 1203us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397571.054325:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1787397571.054347:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1787397571.054354:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700974848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054386:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218700974848:12345-0@lo:400:kworker.0 Request processed in 33us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397571.054391:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1787397571.054446:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218700973440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054478:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700974080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054489:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968727 gen 2 00000100:00100000:0.0:1787397571.054498:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700974592:12345-0@lo:400:kworker.0 Request processed in 1446us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397571.054517:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700974592:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054563:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700973824:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054584:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700974336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397571.054597:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218700974848:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.054602:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:0.0:1787397571.054636:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973952 00000100:00100000:0.0:1787397571.054641:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973952 00000100:00100000:0.0:1787397571.054777:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974464 00000100:00100000:0.0:1787397571.054781:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974464 00000100:00100000:0.0:1787397571.054791:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974976 00000100:00100000:0.0:1787397571.054794:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974976 00000100:00100000:0.0:1787397571.054805:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1787397571.054811:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218700973952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.055021:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218700973952:12345-0@lo:400:kworker.0 Request processed in 208us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.055029:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1787397571.055042:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1787397571.055049:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700974464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.055141:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700974464:12345-0@lo:400:kworker.0 Request processed in 30us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.055150:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1787397571.055162:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1787397571.055168:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700974976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397571.055201:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397571.055232:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700974976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.055239:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00080000:0.0:1787397571.055255:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397571.055260:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397571.055264:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397571.055405:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700973952:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.055420:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700974464:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.055436:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700974976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397571.055483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397571.055554:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700974208:0@lo:400:kworker.0 00000100:00100000:3.0:1787397571.055556:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218700973184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9233us (10651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397571.055586:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1787397571.055603:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397571.055645:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700973184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397571.055757:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700973696 00000100:00100000:0.0:1787397571.055762:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700973696 00000100:00100000:0.0:1787397571.055812:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00080000:3.0:1787397571.055814:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397571.055814:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974208 00000100:00100000:0.0:1787397571.055820:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700973696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397571.055821:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974208 00000100:00100000:0.0:1787397571.055876:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218700973696:12345-0@lo:400:kworker.0 Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397571.055883:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:0.0:1787397571.055887:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1787397571.055894:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700974208:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397571.055911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397571.055924:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700974720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397571.055939:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700974208:12345-0@lo:400:kworker.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397571.055953:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:0.0:1787397571.055958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.055989:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218700973696:0@lo:400:kworker.0 00000100:00100000:0.0:1787397571.055999:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700974208:0@lo:400:kworker.0 00000100:00100000:1.0:1787397571.056151:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700974720 00000100:00100000:1.0:1787397571.056156:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700974720 00000100:00100000:1.0:1787397571.056189:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00080000:3.0:1787397571.056196:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397571.056197:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700974720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397571.056236:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700974720:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397571.056243:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:3.0:1787397571.056267:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968724 gen 2 00000100:00100000:3.0:1787397571.056280:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700974720:0@lo:400:kworker.0 00010000:00010000:1.0:1787397571.365516:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397571.562036:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700975104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397571.562122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397571.564657:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700975232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397571.564744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397571.564768:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975104 00000100:00100000:0.0:1787397571.564791:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975104 00000100:00100000:0.0:1787397571.564852:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975232 00000100:00100000:0.0:1787397571.564856:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975232 00000100:00100000:0.0:1787397571.564873:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1787397571.564882:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700975104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397571.564923:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:1.0:1787397571.564936:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700975232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397571.564956:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787397571.564994:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397571.565012:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700975232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397571.565020:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1787397571.565044:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700975104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397571.565164:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1787397571.565489:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700975104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397571.568581:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700975232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397572.280039:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.280233:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150080 00000100:00100000:0.0:1787397572.280243:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150080 00000100:00100000:0.0:1787397572.280319:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1194 00000100:00100000:0.0:1787397572.280328:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:68610:x1874218681150080:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397572.280369:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787397572.280444:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:68610:x1874218681150080:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397572.280450:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1194 00000100:00080000:3.0:1787397572.280711:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397572.283208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397572.283307:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150208 00000100:00100000:2.0:1787397572.283316:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150208 00000100:00100000:2.0:1787397572.283394:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1195 00000100:00100000:2.0:1787397572.283406:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68610:x1874218681150208:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397572.283444:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397572.283575:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:68610:x1874218681150208:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.283582:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1195 00000100:00080000:3.0:1787397572.284043:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397572.288064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397572.288207:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150336 00000100:00100000:1.0:1787397572.288218:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150336 00000100:00080000:3.0:1787397572.288342:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397572.288383:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1961 00000100:00100000:1.0:1787397572.288395:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:68610:x1874218681150336:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397572.288422:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397572.288491:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:68610:x1874218681150336:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 99us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397572.288500:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1961 00000100:00100000:1.0:1787397572.290746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397572.291118:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150464 00000100:00100000:2.0:1787397572.291128:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150464 00000100:00100000:2.0:1787397572.291292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1962 00000100:00100000:2.0:1787397572.291304:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:68610:x1874218681150464:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397572.291330:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397572.291407:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:68610:x1874218681150464:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 105us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.291414:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1962 00000100:00080000:3.0:1787397572.292472:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397572.324974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.326016:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150720 00000100:00100000:0.0:1787397572.326029:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150720 00000100:00100000:0.0:1787397572.326103:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1196 00000100:00100000:0.0:1787397572.326114:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:68627:x1874218681150720:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787397572.326138:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397572.326174:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d1902fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f26 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326504:0:66176:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 9 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326561:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326575:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326589:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326929:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326938:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326944:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326950:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397572.326953:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326961:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326974:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:0.0:1787397572.326977:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397572.326990:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.326997:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d190304 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.327058:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d1902fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f26 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.327069:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:0.0:1787397572.327071:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397572.327075:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d1902fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f26 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.327084:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54600, rc 0) 00000100:00100000:0.0:1787397572.327486:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:68627:x1874218681150720:12345-192.168.204.60@tcp:101:cat.0 Request processed in 1373us (2519us total) trans 107374182402 rc 301/301 00000100:00100000:0.0:1787397572.327495:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1196 00000100:00100000:1.0:1787397572.331926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.331985:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150848 00000100:00100000:0.0:1787397572.331996:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150848 00000100:00100000:0.0:1787397572.332064:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1197 00000100:00100000:0.0:1787397572.332075:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:68627:x1874218681150848:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:0.0:1787397572.332099:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397572.332124:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f2d expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.332204:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.332236:0:66177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.332246:0:66177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.332282:0:66177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 89018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.332298:0:66177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 10 pid: 89018 timeout: 3551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397572.332314:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66177:1874218700975360:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397572.332414:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397572.339641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.339789:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66177:1874218700975360:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397572.339818:0:66177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397572.340082:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681150976 00000100:00100000:2.0:1787397572.340090:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681150976 00010000:00010000:2.0:1787397572.340131:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 89018 timeout: 3551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397572.340413:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2587 00000100:00100000:2.0:1787397572.340424:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2404:x1874218681150976:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397572.340441:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:2.0:1787397572.340462:0:19659:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:2.0:1787397572.340465:0:19659:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1787397526 00000004:00010000:2.0:1787397572.340467:0:19659:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1787397517 00000004:00010000:2.0:1787397572.340469:0:19659:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1787397526 00010000:00010000:2.0:1787397572.340475:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 89018 timeout: 3551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340487:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 89018 timeout: 3551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340508:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a83096a600/0x274786fe0d19011a lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ef5 expref: 11 pid: 89018 timeout: 3551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340561:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:2.0:1787397572.340567:0:19659:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340577:0:19659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340585:0:19659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.340667:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397572.340728:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2404:x1874218681150976:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 304us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.340736:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2587 00010000:00010000:0.0:1787397572.345070:0:66177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.345088:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397572.345158:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397572.345185:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.345248:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f2d expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.345270:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f2d expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397572.345278:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:0.0:1787397572.345281:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397572.345285:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55800, rc 0) 00000100:00100000:0.0:1787397572.345489:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:68627:x1874218681150848:12345-192.168.204.60@tcp:101:cat.0 Request processed in 13414us (13583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397572.345498:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1197 00000100:00100000:1.0:1787397572.349815:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397572.349922:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151104 00000100:00100000:2.0:1787397572.349932:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151104 00000100:00100000:2.0:1787397572.349998:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1198 00000100:00100000:2.0:1787397572.350009:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:68627:x1874218681151104:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:2.0:1787397572.350033:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397572.350056:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d190320 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f34 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.350116:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d190320 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f34 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.350131:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d190320 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f34 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.350152:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:2.0:1787397572.350155:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397572.350159:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ac00, rc 0) 00000100:00100000:2.0:1787397572.350222:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:68627:x1874218681151104:12345-192.168.204.60@tcp:101:cat.0 Request processed in 215us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.350230:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1198 00000100:00100000:3.0:1787397572.353371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397572.353489:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151232 00000100:00100000:2.0:1787397572.353499:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151232 00000100:00100000:2.0:1787397572.353625:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1199 00000100:00100000:2.0:1787397572.353639:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2405:x1874218681151232:12345-192.168.204.60@tcp:101:cat.0 00010000:00010000:2.0:1787397572.353659:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397572.353681:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d190327 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f3b expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.353714:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d190327 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f3b expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397572.353746:0:66178:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:2.0:1787397572.353749:0:66178:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1787397526 -> 1787397526 00000004:00010000:2.0:1787397572.353751:0:66178:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1787397517 -> 1787397517 00000004:00010000:2.0:1787397572.353754:0:66178:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1787397526 -> 1787397526 00000004:00010000:2.0:1787397572.353756:0:66178:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:2.0:1787397572.353760:0:66178:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:2.0:1787397572.353768:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d190327 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f3b expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397572.353781:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:2.0:1787397572.353784:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787397572.353787:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00000100:00100000:2.0:1787397572.353858:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2405:x1874218681151232:12345-192.168.204.60@tcp:101:cat.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.353866:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1199 00000100:00100000:1.0:1787397572.364091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.364214:0:66202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151360 00000100:00100000:0.0:1787397572.364228:0:66202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151360 00002000:00100000:0.0:1787397572.364277:0:66202:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff89a705985180 x1874218681151360/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:13/0 lens 488/0 e 0 to 0 dl 1787397583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397572.364288:0:66202:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a705985180 with x1874218681151360 00000100:00100000:0.0:1787397572.364336:0:66202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787397572.364345:0:66202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2404:x1874218681151360:12345-192.168.204.60@tcp:3:cat.0 00000100:00100000:0.0:1787397572.364798:0:66202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2404:x1874218681151360:12345-192.168.204.60@tcp:3:cat.0 Request processed in 451us (715us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787397572.364808:0:66202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00002000:00100000:0.0:1787397572.364816:0:66202:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff89a705985180 x1874218681151360/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:13/0 lens 488/4536 e 0 to 0 dl 1787397583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397572.364824:0:66202:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff89a705985180 with x1874218681151360 00000100:00100000:1.0:1787397572.370610:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397572.370884:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151616 00000100:00100000:2.0:1787397572.370894:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151616 00000100:00100000:2.0:1787397572.370954:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 221 00000100:00100000:2.0:1787397572.370964:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:68627:x1874218681151616:12345-192.168.204.60@tcp:35:cat.0 00000100:00100000:2.0:1787397572.371433:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:68627:x1874218681151616:12345-192.168.204.60@tcp:35:cat.0 Request processed in 469us (831us total) trans 107374182403 rc 0/0 00000100:00100000:2.0:1787397572.371442:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 221 00010000:00010000:2.0:1787397572.389513:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397572.581167:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397572.581194:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700975488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397572.581276:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397572.581452:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975488 00000100:00100000:3.0:1787397572.581461:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975488 00000100:00100000:3.0:1787397572.581539:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:3.0:1787397572.581559:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700975488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397572.581588:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397572.581635:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700975488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397572.581641:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1787397572.581880:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700975488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397572.582232:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397572.582245:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700975616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397572.582300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397572.582680:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975616 00000100:00100000:2.0:1787397572.582688:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975616 00000100:00100000:2.0:1787397572.582733:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1787397572.582742:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700975616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397572.582758:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397572.582811:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700975616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397572.582818:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1787397572.582988:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700975616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397572.869847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397572.869949:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151744 00000100:00100000:0.0:1787397572.869959:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151744 00000100:00100000:0.0:1787397572.870017:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787397572.870026:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681151744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397572.870117:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681151744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397572.870125:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00010000:00010000:0.0:1787397573.412728:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397574.441411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397575.460836:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397576.165303:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700975744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397576.165478:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.165549:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700976256:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.165588:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397576.165702:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700976000:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.165925:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700976768:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.165958:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.165978:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700977280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.166007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.166052:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787397576.166060:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700975872:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.166109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.166144:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700976384:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.166175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397576.166254:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975744 00000100:00100000:2.0:1787397576.166267:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975744 00000100:00100000:2.0:1787397576.166359:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1787397576.166371:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700975744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397576.166424:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397576.166505:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700975744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.166519:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1787397576.166583:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976768 00000100:00100000:2.0:1787397576.166588:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976768 00000100:00100000:2.0:1787397576.166655:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977280 00000100:00100000:2.0:1787397576.166659:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977280 00000100:00100000:2.0:1787397576.166681:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1787397576.166687:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700976768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.166733:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700976768:12345-0@lo:400:kworker.0 Request processed in 39us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.166749:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1787397576.166767:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1787397576.166773:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700977280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.166813:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700977280:12345-0@lo:400:kworker.0 Request processed in 41us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.166819:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00080000:2.0:1787397576.166838:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397576.167485:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700976896:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.167560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397576.167679:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976256 00000100:00100000:3.0:1787397576.167685:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976256 00000100:00100000:2.0:1787397576.167761:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976384 00000100:00100000:2.0:1787397576.167770:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976384 00000100:00100000:2.0:1787397576.167803:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1787397576.167811:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700976256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.167864:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700976256:12345-0@lo:400:kworker.0 Request processed in 54us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.167871:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1787397576.167890:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1787397576.167896:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700976384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.167924:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700976384:12345-0@lo:400:kworker.0 Request processed in 28us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.167930:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:2.0:1787397576.167954:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397576.167957:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397576.168032:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700977408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397576.168167:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976896 00000100:00100000:2.0:1787397576.168177:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976896 00000100:00100000:2.0:1787397576.168201:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977408 00000100:00100000:2.0:1787397576.168203:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977408 00000100:00100000:2.0:1787397576.168217:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1787397576.168221:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700976896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397576.168303:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1787397576.168320:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700977408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.168439:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218700976896:12345-0@lo:400:kworker.0 Request processed in 207us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.168446:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1787397576.168731:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700975744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397576.168746:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700976256:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168758:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700976768:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168770:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700977280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168802:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700976384:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168811:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218700976896:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168837:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700976128:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.168887:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700976640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.168930:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700977152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.168948:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.168981:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976640 00000100:00100000:0.0:1787397576.168985:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976640 00000100:00100000:0.0:1787397576.169025:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977152 00000100:00100000:0.0:1787397576.169027:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977152 00000100:00100000:0.0:1787397576.169050:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1787397576.169057:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700976640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.169218:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976128 00000100:00100000:2.0:1787397576.169222:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976128 00000100:00100000:2.0:1787397576.169264:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1787397576.169271:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700976128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.169316:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700976128:12345-0@lo:400:kworker.0 Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.169397:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1787397576.169657:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700977408:12345-0@lo:400:kworker.0 Request processed in 1213us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397576.169667:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1787397576.169993:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:3.0:1787397576.170007:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700977152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397576.170051:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700977152:12345-0@lo:400:kworker.0 Request processed in 49us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397576.170057:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1787397576.170252:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700977408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397576.170317:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700975872 00000100:00100000:3.0:1787397576.170323:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700975872 00000100:00100000:3.0:1787397576.170457:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787397576.170465:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700975872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397576.170557:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700975872:12345-0@lo:400:kworker.0 Request processed in 88us (4443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397576.170564:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397576.170663:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700976640:12345-0@lo:400:kworker.0 Request processed in 1605us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397576.170677:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00080000:0.0:1787397576.170716:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397576.170722:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397576.170747:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700976128:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170763:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700976640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170772:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700977152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170824:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700975872:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.170906:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700976512:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.170968:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700977024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.170997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.171016:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700977536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397576.171045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.171101:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976512 00000100:00100000:0.0:1787397576.171112:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976512 00000100:00100000:0.0:1787397576.171137:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977024 00000100:00100000:0.0:1787397576.171146:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977024 00000100:00100000:0.0:1787397576.171158:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977536 00000100:00100000:0.0:1787397576.171160:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977536 00000100:00100000:0.0:1787397576.171176:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1787397576.171183:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218700976512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.171233:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218700976512:12345-0@lo:400:kworker.0 Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397576.171254:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1787397576.171266:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1787397576.171272:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700977024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.171304:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700977024:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397576.171310:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1787397576.171321:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1787397576.171328:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700977536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397576.171364:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787397576.171396:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700977536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397576.171402:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1787397576.171430:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700976512:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.171439:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700977024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397576.171453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700977536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397576.173863:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700976000 00000100:00100000:2.0:1787397576.173886:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700976000 00000100:00100000:2.0:1787397576.174072:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1787397576.174089:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700976000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397576.174218:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700976000:12345-0@lo:400:kworker.0 Request processed in 134us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397576.174226:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:0.0:1787397576.174324:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397576.174617:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700976000:0@lo:400:kworker.0 00010000:00010000:1.0:1787397576.485794:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397576.676828:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397576.676854:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397576.676932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397576.676977:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977664 00000100:00100000:0.0:1787397576.676985:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977664 00000100:00100000:0.0:1787397576.677037:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1787397576.677046:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700977664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397576.677076:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397576.677137:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700977664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397576.677144:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1787397576.677192:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397576.680574:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397576.680990:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700977792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397576.681087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397576.681216:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977792 00000100:00100000:3.0:1787397576.681227:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977792 00000100:00100000:3.0:1787397576.681318:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:3.0:1787397576.681328:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700977792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397576.681378:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397576.681514:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700977792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397576.681552:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1787397576.681724:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700977792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787397577.509960:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397577.701182:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700977920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397577.701274:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397577.701327:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700977920 00000100:00100000:0.0:1787397577.701346:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700977920 00000100:00100000:2.0:1787397577.701704:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1787397577.701721:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700977920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397577.701778:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397577.701883:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700977920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397577.701892:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1787397577.701998:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700978048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397577.702037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397577.702166:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978048 00000100:00100000:3.0:1787397577.702171:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978048 00000100:00100000:3.0:1787397577.702210:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1787397577.702218:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700978048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397577.702231:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397577.702271:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700978048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397577.702277:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1787397577.702325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700978048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397577.703807:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700977920:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1787397577.705617:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00000100:00100000:0.0:1787397577.999375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397577.999466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397577.999507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397577.999556:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397577.999582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397577.999621:0:88992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681151872 00000100:00100000:0.0:1787397577.999633:0:88992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681151872 00000100:00100000:0.0:1787397577.999695:0:88992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:0.0:1787397577.999709:0:88992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681151872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397577.999799:0:88992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681151872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397577.999808:0:88992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:0.0:1787397577.999849:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152256 00000100:00100000:0.0:1787397577.999854:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152256 00000100:00100000:0.0:1787397577.999893:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152384 00000100:00100000:0.0:1787397577.999896:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152384 00000100:00100000:0.0:1787397577.999923:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2463 00000100:00100000:0.0:1787397577.999930:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681152256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397577.999961:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681152256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397577.999988:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2463 00000100:00100000:0.0:1787397577.999999:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2464 00000100:00100000:0.0:1787397578.000005:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681152384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397578.000031:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681152384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397578.000037:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2464 00000100:00100000:3.0:1787397578.000671:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152000 00000100:00100000:3.0:1787397578.000678:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152000 00000100:00100000:3.0:1787397578.000728:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152128 00000100:00100000:3.0:1787397578.000731:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152128 00000100:00100000:3.0:1787397578.000758:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1192 00000100:00100000:3.0:1787397578.000766:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2402:x1874218681152000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397578.000816:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2402:x1874218681152000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 51us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397578.000823:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1192 00000100:00100000:3.0:1787397578.000838:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1193 00000100:00100000:3.0:1787397578.000844:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681152128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397578.000882:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681152128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397578.000889:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1193 00000100:00080000:3.0:1787397578.002703:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397578.002714:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397578.002718:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397578.002720:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787397578.430484:0:89810:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:0.0:1787397578.532766:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397579.564753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397580.163308:0:89859:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 07:19:37 (1787397577) 00000100:00100000:3.0:1787397580.255042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397580.255123:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152512 00000100:00100000:1.0:1787397580.255140:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152512 00000100:00100000:1.0:1787397580.255252:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1200 00000100:00100000:1.0:1787397580.255263:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69357:x1874218681152512:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397580.255293:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397580.255324:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d19032e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f42 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255432:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255450:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255468:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255487:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255495:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255512:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255602:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255611:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255619:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255628:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255635:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc1a774f0) 00000100:00080000:3.0:1787397580.255639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787397580.255880:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255892:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255907:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:1.0:1787397580.255911:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397580.255917:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255933:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d190335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255950:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255964:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255971:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255976:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397580.255979:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255985:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.255992:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8421f3400) 00010000:00010000:1.0:1787397580.255995:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397580.255998:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.256003:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d19033c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.256044:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d19032e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f42 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.256057:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:1.0:1787397580.256059:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397580.256063:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d19032e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f42 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.256085:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75800, rc 0) 00000100:00100000:1.0:1787397580.256243:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69357:x1874218681152512:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 980us (1209us total) trans 0 rc 301/301 00000100:00100000:1.0:1787397580.256254:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1200 00000100:00100000:3.0:1787397580.260473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397580.260970:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681152768 00000100:00100000:0.0:1787397580.260989:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681152768 00000100:00100000:0.0:1787397580.261083:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1201 00000100:00100000:0.0:1787397580.261097:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69357:x1874218681152768:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397580.261491:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397580.261498:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787397580.261568:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1902e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f1f expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261591:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:0.0:1787397580.261609:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397580.261634:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190343 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f49 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261806:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261823:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261846:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261864:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261872:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.261878:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266034:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266067:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266082:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397580.266096:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787397580.266135:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266143:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266149:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266156:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266162:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397580.266167:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266191:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266206:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1600) 00010000:00010000:1.0:1787397580.266210:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397580.266217:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266224:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d19034a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397580.266242:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b07d41ad reply state 000000004530b9bd transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266255:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266260:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a82ebb1e00) 00010000:00010000:1.0:1787397580.266263:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397580.266266:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397580.266313:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190343 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266336:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397580.266344:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a8421f3000) 00010000:00010000:1.0:1787397580.266346:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397580.266349:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74000, rc 0) 00000100:00100000:1.0:1787397580.266465:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69357:x1874218681152768:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 5370us (6002us total) trans 107374182404 rc 0/0 00000100:00100000:1.0:1787397580.266476:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1201 00000100:00100000:3.0:1787397580.269785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397580.273335:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153024 00000100:00100000:0.0:1787397580.273439:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153024 00000100:00100000:0.0:1787397580.273715:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1202 00000100:00100000:0.0:1787397580.273729:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69357:x1874218681153024:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397580.273764:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397580.273795:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d190366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f50 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.273942:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.273972:0:66178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 13 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.273982:0:66178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.274029:0:66178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 13 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397580.274060:0:66178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 13 pid: 67264 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397580.274076:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66178:1874218700978176:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397580.274209:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83b286c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397580.278851:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66178:1874218700978176:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397580.278907:0:66178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397580.279106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397580.279193:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153152 00000100:00100000:2.0:1787397580.279203:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153152 00010000:00010000:2.0:1787397580.279251:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 14 pid: 67264 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397580.279304:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2588 00000100:00100000:2.0:1787397580.279316:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:2404:x1874218681153152:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397580.279336:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397580.279344:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 14 pid: 67264 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279358:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 14 pid: 67264 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279478:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d190358 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f49 expref: 14 pid: 67264 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279497:0:19662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a8421f3000) 00010000:00010000:2.0:1787397580.279503:0:19662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279788:0:19662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279797:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397580.279830:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397580.279896:0:66178:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397580.279918:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2404:x1874218681153152:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 598us (808us total) trans 0 rc 0/0 00010000:00010000:3.0:1787397580.279925:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397580.279935:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2588 00000004:00200000:3.0:1787397580.279968:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000004:00080000:3.0:1787397580.280698:0:66178:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x683:0x0], count =127 00000004:00080000:3.0:1787397580.280711:0:66178:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x683:0x0]+127 in llog 00000004:00080000:3.0:1787397580.280757:0:66178:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00010000:00010000:3.0:1787397580.280898:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280923:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280933:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280941:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397580.280946:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280955:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280973:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a8421f3000) 00010000:00010000:3.0:1787397580.280977:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397580.280983:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.280989:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19036d lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.281075:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d190366 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f50 expref: 13 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.281087:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:3.0:1787397580.281089:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397580.281093:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d190366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f50 expref: 13 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397580.281111:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55000, rc 0) 00000100:00100000:3.0:1787397580.281198:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69357:x1874218681153024:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 7471us (11423us total) trans 107374182405 rc 301/301 00000100:00100000:3.0:1787397580.281208:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1202 00000100:00100000:0.0:1787397580.286035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397580.286105:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153408 00000100:00100000:3.0:1787397580.286119:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153408 00000100:00100000:3.0:1787397580.286181:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00100000:3.0:1787397580.286310:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69357:x1874218681153408:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397580.287140:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:69357:x1874218681153408:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 833us (1117us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1787397580.287150:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00100000:0.0:1787397580.291758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397580.292192:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153664 00000100:00100000:3.0:1787397580.292211:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153664 00000100:00100000:3.0:1787397580.292319:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 223 00000100:00100000:3.0:1787397580.292334:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:69357:x1874218681153664:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397580.292732:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:69357:x1874218681153664:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 400us (988us total) trans 107374182407 rc 0/0 00000100:00100000:3.0:1787397580.292742:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 223 00010000:00010000:1.0:1787397580.581786:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787397581.207109:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:0.0:1787397581.207230:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207248:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207257:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207263:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397581.207270:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207279:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207305:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397581.207308:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397581.207313:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.207345:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190351 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397581.279784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397581.280073:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153792 00000100:00100000:3.0:1787397581.280085:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153792 00000100:00100000:3.0:1787397581.280184:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1203 00000100:00100000:3.0:1787397581.280196:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:69366:x1874218681153792:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397581.280235:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397581.280259:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d19037b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f57 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280360:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280387:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280401:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397581.280458:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397581.280462:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397581.280485:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280513:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d19037b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f57 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280559:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f57 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397581.280569:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70a1c4600) 00010000:00010000:3.0:1787397581.280572:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397581.280576:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30400, rc 0) 00000100:00100000:3.0:1787397581.280646:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69366:x1874218681153792:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 452us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.280654:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1203 00000100:00100000:1.0:1787397581.284678:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700978304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397581.284758:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397581.284816:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978304 00000100:00100000:1.0:1787397581.284823:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978304 00000100:00100000:1.0:1787397581.284879:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1787397581.284887:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700978304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397581.284930:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1787397581.284975:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700978304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397581.284982:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1787397581.285030:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700978304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397581.285570:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700978816:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285571:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700978432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397581.285605:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285639:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700978944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285680:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700979456:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285699:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285718:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787397581.285723:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700978560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285740:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285754:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700979072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285784:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700979584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.285823:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979456 00000100:00100000:0.0:1787397581.285828:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979456 00000100:00100000:0.0:1787397581.285858:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1787397581.285864:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700979456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.285897:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700979456:12345-0@lo:400:kworker.0 Request processed in 33us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.285903:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1787397581.285931:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979072 00000100:00100000:0.0:1787397581.285934:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979072 00000100:00100000:0.0:1787397581.285962:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979584 00000100:00100000:0.0:1787397581.285964:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979584 00000100:00100000:0.0:1787397581.285979:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1787397581.285984:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700979072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286009:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700979072:12345-0@lo:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.286015:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1787397581.286023:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1787397581.286027:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700979584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286048:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700979584:12345-0@lo:400:kworker.0 Request processed in 21us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.286053:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1787397581.286081:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700979072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286089:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700979584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286097:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700979456:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.286287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700978688:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.286318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397581.286345:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700979200:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.286366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397581.286394:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700979712:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.286414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397581.286446:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397581.286454:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700979968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397581.286475:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397581.286498:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397581.286510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979200 00000100:00100000:3.0:1787397581.286514:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979200 00000100:00100000:3.0:1787397581.286557:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979712 00000100:00100000:3.0:1787397581.286561:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979712 00000100:00100000:0.0:1787397581.286567:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:0.0:1787397581.286574:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700979200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.286590:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:3.0:1787397581.286596:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700979712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286610:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700979200:12345-0@lo:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.286616:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1787397581.286621:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700979712:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.286626:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:3.0:1787397581.286641:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978816 00000100:00100000:3.0:1787397581.286644:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978816 00000100:00100000:3.0:1787397581.286676:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978944 00000100:00100000:3.0:1787397581.286679:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978944 00000100:00100000:0.0:1787397581.286689:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978560 00000100:00100000:0.0:1787397581.286692:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978560 00000100:00100000:3.0:1787397581.286697:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978688 00000100:00100000:3.0:1787397581.286699:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978688 00000100:00100000:0.0:1787397581.286712:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1787397581.286717:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700978816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.286761:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218700978816:12345-0@lo:400:kworker.0 Request processed in 43us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.287261:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1787397581.287273:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700978944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287308:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700978944:12345-0@lo:400:kworker.0 Request processed in 40us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.287314:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1787397581.287337:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1787397581.287343:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700978560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287385:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218700978560:12345-0@lo:400:kworker.0 Request processed in 28us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.287391:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1787397581.287405:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1787397581.287412:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700978688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287437:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700978688:12345-0@lo:400:kworker.0 Request processed in 26us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.287442:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00080000:3.0:1787397581.287464:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397581.287468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397581.287469:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397581.287499:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700978688:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287509:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700979200:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287518:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700979712:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287576:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700978560:0@lo:400:kworker.0 00000100:00100000:3.0:1787397581.287588:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700978944:0@lo:400:kworker.0 00000100:00100000:2.0:1787397581.288645:0:88990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700978432 00000100:00100000:2.0:1787397581.288656:0:88990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700978432 00000100:00100000:2.0:1787397581.288719:0:88990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787397581.288728:0:88990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397581.288791:0:88990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700978432:12345-0@lo:400:kworker.0 Request processed in 65us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397581.288799:0:88990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787397581.288831:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979968 00000100:00100000:2.0:1787397581.288836:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979968 00000100:00100000:2.0:1787397581.288862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1787397581.288868:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700979968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397581.288892:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397581.288927:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700979968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397581.288934:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1787397581.292034:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700979968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397581.292208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397581.292368:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681153920 00000100:00100000:3.0:1787397581.292384:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681153920 00000100:00100000:3.0:1787397581.292441:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1204 00000100:00100000:3.0:1787397581.292451:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69366:x1874218681153920:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397581.292486:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397581.292574:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69366:x1874218681153920:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 123us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.292582:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1204 00000100:00100000:3.0:1787397581.292734:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700978432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397581.293307:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218700978816:0@lo:400:kworker.0 00000100:00100000:1.0:1787397581.293321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700979328:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.294180:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1787397581.295186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397581.296554:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700979840:0@lo:400:kworker.0 00000100:00100000:1.0:1787397581.296630:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397581.299077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397581.299970:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979328 00000100:00100000:0.0:1787397581.299983:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979328 00000100:00100000:0.0:1787397581.300054:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700979840 00000100:00100000:0.0:1787397581.300058:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700979840 00000100:00100000:0.0:1787397581.300089:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1787397581.300099:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700979328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.300459:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218700979328:12345-0@lo:400:kworker.0 Request processed in 361us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.300468:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1787397581.300490:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1787397581.300498:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700979840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.300551:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218700979840:12345-0@lo:400:kworker.0 Request processed in 54us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.300557:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1787397581.302725:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218700979328:0@lo:400:kworker.0 00000100:00100000:0.0:1787397581.302762:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218700979840:0@lo:400:kworker.0 00000100:00100000:2.0:1787397581.317072:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154048 00000100:00100000:2.0:1787397581.317089:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154048 00000100:00100000:2.0:1787397581.317249:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1205 00000100:00100000:2.0:1787397581.317262:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69366:x1874218681154048:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397581.317295:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397581.317389:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69366:x1874218681154048:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 130us (18322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397581.317397:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1205 00000100:00080000:0.0:1787397581.319299:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397581.326330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397581.327518:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154176 00000100:00100000:1.0:1787397581.327543:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154176 00000100:00100000:1.0:1787397581.327643:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1969 00000100:00080000:2.0:1787397581.327752:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397581.327806:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69366:x1874218681154176:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397581.327841:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397581.327955:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69366:x1874218681154176:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 154us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397581.327964:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1969 00000100:00100000:1.0:1787397581.332902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397581.332953:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154304 00000100:00100000:3.0:1787397581.332964:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154304 00000100:00100000:3.0:1787397581.333114:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1970 00000100:00100000:3.0:1787397581.333127:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69366:x1874218681154304:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397581.333166:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397581.333313:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69366:x1874218681154304:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 188us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397581.333322:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1970 00000100:00080000:0.0:1787397581.334084:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397581.411805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397581.412495:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154560 00000100:00100000:2.0:1787397581.412508:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154560 00000100:00100000:2.0:1787397581.412621:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1206 00000100:00100000:2.0:1787397581.412633:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69373:x1874218681154560:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:2.0:1787397581.412710:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397581.412740:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30400/0x274786fe0d190382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f57 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412762:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70a1c4600) 00010000:00010000:2.0:1787397581.412774:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397581.412841:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412854:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412865:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412877:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412905:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.412913:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413329:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413340:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413345:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413352:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413358:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397581.413363:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413382:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413392:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32900) 00010000:00010000:2.0:1787397581.413395:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397581.413399:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413404:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190389 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397581.413426:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003760967d reply state 000000003d6bd5d2 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413437:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.413442:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32100) 00010000:00010000:2.0:1787397581.413444:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397581.413447:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397581.413553:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:69373:x1874218681154560:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 921us (1760us total) trans 107374182408 rc 0/0 00000100:00100000:2.0:1787397581.413561:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1206 00000100:00100000:3.0:1787397581.437614:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397581.437753:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154688 00000100:00100000:2.0:1787397581.437764:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154688 00000100:00100000:2.0:1787397581.437842:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1207 00000100:00100000:2.0:1787397581.437852:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:69376:x1874218681154688:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397581.437880:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397581.437906:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f5e expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.437997:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.438012:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.438026:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397581.438098:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397581.438101:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397581.438125:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.438153:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d190397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f5e expref: 13 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.438175:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f5e expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.438186:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32900) 00010000:00010000:2.0:1787397581.438190:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397581.438193:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa200, rc 0) 00000100:00100000:2.0:1787397581.438263:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69376:x1874218681154688:12345-192.168.204.60@tcp:101:rm.0 Request processed in 412us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397581.438273:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1207 00000100:00100000:1.0:1787397581.443459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397581.443592:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154816 00000100:00100000:0.0:1787397581.443611:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154816 00000100:00100000:0.0:1787397581.443815:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1208 00000100:00100000:0.0:1787397581.443852:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69376:x1874218681154816:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397581.443876:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397581.443900:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1903a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f65 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444282:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444418:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444433:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444460:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444469:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444476:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444607:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444616:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.444623:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397581.445140:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:0.0:1787397581.445146:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397581.445176:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445189:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445198:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445277:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445283:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445289:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445297:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397581.445301:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445308:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445322:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32900) 00010000:00010000:0.0:1787397581.445325:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397581.445331:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445348:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d1903ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445364:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445381:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445386:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445391:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397581.445394:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445400:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445408:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32100) 00010000:00010000:0.0:1787397581.445410:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397581.445413:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445418:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d1903b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445448:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1903a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f65 expref: 14 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445476:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f65 expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397581.445484:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:0.0:1787397581.445486:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397581.445488:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54200, rc 0) 00000100:00100000:0.0:1787397581.445703:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:69376:x1874218681154816:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1853us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.445713:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1208 00000100:00100000:0.0:1787397581.453683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397581.454460:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155072 00000100:00100000:2.0:1787397581.454473:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155072 00000100:00100000:2.0:1787397581.454752:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1209 00000100:00100000:2.0:1787397581.454767:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:69376:x1874218681155072:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397581.454854:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787397581.454886:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d1903ba lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f65 expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.454908:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397581.454960:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19039e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f5e expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.454976:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32900) 00010000:00010000:2.0:1787397581.454983:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397581.455013:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455028:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455040:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455052:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455059:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455067:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455178:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455187:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455194:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455443:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455459:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455467:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455475:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455482:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455487:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455515:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397581.455562:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397581.455573:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.455573:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455592:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.455598:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.456226:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397581.456235:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.456246:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.456261:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff89a82df32200) 00010000:00010000:1.0:1787397581.456264:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397581.456268:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.456274:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1903d6 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456277:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397581.456285:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456293:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397581.456295:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397581.456298:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397581.456301:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397581.456323:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff89a82df32200) 00010000:00010000:2.0:1787397581.456326:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397581.456329:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456335:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d1903cf lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456361:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456381:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456388:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456394:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456399:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397581.456402:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456407:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456415:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32300) 00010000:00010000:2.0:1787397581.456418:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397581.456422:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456439:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1903c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397581.456455:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a0712c1 reply state 00000000621ebebf transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456469:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397581.456476:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32100) 00010000:00010000:2.0:1787397581.456479:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397581.456482:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397581.456632:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:69376:x1874218681155072:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1866us (2958us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1787397581.456640:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1209 00010000:00010000:0.0:1787397581.614196:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397581.796738:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397581.796813:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397581.796880:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980224 00000100:00100000:2.0:1787397581.796888:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980224 00000100:00100000:2.0:1787397581.796943:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1787397581.796952:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700980224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397581.796974:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397581.797029:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700980224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397581.797038:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1787397581.797179:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397581.797255:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397581.797306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397581.797394:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980096 00000100:00100000:0.0:1787397581.797400:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980096 00000100:00100000:0.0:1787397581.797448:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1787397581.797455:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700980096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397581.797469:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397581.797516:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700980096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397581.797555:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1787397581.798443:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700980096:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787397582.298642:0:89958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd500e1140 00000020:00000080:1.0:1787397582.298664:0:89958:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:1.0:1787397582.298675:0:89958:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:0.0:1787397582.628727:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397582.821511:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700980352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397582.821615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397582.821957:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700980480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397582.821988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397582.822055:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980352 00000100:00100000:3.0:1787397582.822063:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980352 00000100:00100000:3.0:1787397582.822116:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980480 00000100:00100000:3.0:1787397582.822120:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980480 00000100:00100000:3.0:1787397582.822138:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1787397582.822148:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700980352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397582.822178:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397582.822229:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700980352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397582.822255:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1787397582.822274:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1787397582.822281:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700980480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397582.822301:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397582.825335:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700980480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3045us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397582.825362:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1787397582.825456:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700980480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397582.825509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700980352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397583.110938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397583.111042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397583.111076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397583.111101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397583.111125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397583.111154:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155712 00000100:00100000:3.0:1787397583.111163:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155712 00000100:00100000:3.0:1787397583.111214:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155584 00000100:00100000:3.0:1787397583.111230:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155584 00000100:00100000:2.0:1787397583.111391:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155456 00000100:00100000:2.0:1787397583.111403:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155456 00000100:00100000:2.0:1787397583.111606:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155328 00000100:00100000:2.0:1787397583.111610:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155328 00000100:00100000:2.0:1787397583.111643:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1200 00000100:00100000:2.0:1787397583.111654:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681155456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397583.111800:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2469 00000100:00100000:3.0:1787397583.111814:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681155712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397583.111867:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681155712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 59us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397583.111874:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2469 00000100:00100000:3.0:1787397583.111890:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2470 00000100:00100000:3.0:1787397583.111897:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681155584:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397583.111921:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2402:x1874218681155584:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397583.111938:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2470 00000100:00100000:3.0:1787397583.111972:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1201 00000100:00100000:3.0:1787397583.111979:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2402:x1874218681155328:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:3.0:1787397583.111998:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828836d80 x1874218681155328/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:24/0 lens 224/224 e 0 to 0 dl 1787397594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397583.112024:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2402:x1874218681155328:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397583.112030:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1201 00000100:00080000:3.0:1787397583.112053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397583.112058:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397583.112060:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397583.112062:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397583.112380:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681155456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 727us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397583.112389:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1200 00000100:00100000:0.0:1787397583.120439:0:88991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155200 00000100:00100000:0.0:1787397583.120454:0:88991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155200 00000100:00100000:0.0:1787397583.120536:0:88991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:0.0:1787397583.120547:0:88991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681155200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397583.120658:0:88991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681155200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 99us (9715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397583.120667:0:88991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00010000:00010000:0.0:1787397583.655830:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397584.676792:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397585.703319:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397586.404861:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700980608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397586.404969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397586.405041:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980608 00000100:00100000:3.0:1787397586.405051:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980608 00000100:00100000:2.0:1787397586.405209:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1787397586.405223:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700980608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397586.405279:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397586.405340:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218700980608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.405347:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1787397586.405409:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700980608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397586.406860:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700980736:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.406933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.406973:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700981248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407000:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.407018:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700981760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.407058:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397586.407063:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700980864:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.407098:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700981376:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.407182:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700981888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.407245:0:88994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980736 00000100:00100000:2.0:1787397586.407253:0:88994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980736 00000100:00100000:2.0:1787397586.407319:0:88994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397586.407330:0:88994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407385:0:88994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700980736:12345-0@lo:400:kworker.0 Request processed in 56us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.407393:0:88994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397586.407431:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981248 00000100:00100000:2.0:1787397586.407435:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981248 00000100:00100000:2.0:1787397586.407471:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981760 00000100:00100000:2.0:1787397586.407474:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981760 00000100:00100000:2.0:1787397586.407489:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980864 00000100:00100000:2.0:1787397586.407491:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980864 00000100:00100000:2.0:1787397586.407510:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1787397586.407516:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700981248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.407824:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700981248:12345-0@lo:400:kworker.0 Request processed in 306us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.407831:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1787397586.407845:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1787397586.407852:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700981760:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397586.407868:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70691f100 x1874218700981760/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:27/0 lens 224/224 e 0 to 0 dl 1787397597 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.407892:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218700981760:12345-0@lo:400:kworker.0 Request processed in 41us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.407903:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1787397586.407914:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1787397586.407919:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700980864:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397586.407929:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70691dc00 x1874218700980864/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:27/0 lens 224/224 e 0 to 0 dl 1787397597 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.407952:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218700980864:12345-0@lo:400:kworker.0 Request processed in 34us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.407958:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1787397586.407981:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981376 00000100:00100000:2.0:1787397586.407985:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981376 00000100:00100000:2.0:1787397586.408009:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1787397586.408015:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700981376:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397586.408030:0:8445:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bb9880 x1874218700981376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:27/0 lens 224/224 e 0 to 0 dl 1787397597 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.408055:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218700981376:12345-0@lo:400:kworker.0 Request processed in 40us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.408061:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1787397586.408078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981888 00000100:00100000:2.0:1787397586.408081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981888 00000100:00100000:2.0:1787397586.408109:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1787397586.408115:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700981888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.408211:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218700981888:12345-0@lo:400:kworker.0 Request processed in 95us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.408218:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:2.0:1787397586.408255:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700980992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.408307:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.408329:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700981504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.408353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.408372:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700982016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.408394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.408417:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397586.408423:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700981120:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.408447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.409247:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700981632:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.409316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.409345:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700982144:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.409370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.409416:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981504 00000100:00100000:2.0:1787397586.409424:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981504 00000100:00100000:2.0:1787397586.409467:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982016 00000100:00100000:2.0:1787397586.409470:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982016 00000100:00100000:2.0:1787397586.409492:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981632 00000100:00100000:2.0:1787397586.409495:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981632 00000100:00100000:2.0:1787397586.410255:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1787397586.410283:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700981504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.410375:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700981504:12345-0@lo:400:kworker.0 Request processed in 109us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.410382:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1787397586.410400:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1787397586.410405:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700982016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.410430:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700982016:12345-0@lo:400:kworker.0 Request processed in 25us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.410447:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1787397586.410457:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1787397586.410462:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700981632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.410487:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700981632:12345-0@lo:400:kworker.0 Request processed in 26us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.410492:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1787397586.411639:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700980992 00000100:00100000:2.0:1787397586.411656:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700980992 00000100:00100000:2.0:1787397586.411718:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700981120 00000100:00100000:2.0:1787397586.411722:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700981120 00000100:00100000:2.0:1787397586.411740:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982144 00000100:00100000:2.0:1787397586.411742:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982144 00000100:00100000:2.0:1787397586.411759:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1787397586.411769:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700980992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.411836:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700980992:12345-0@lo:400:kworker.0 Request processed in 68us (3527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.411843:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1787397586.411859:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1787397586.411865:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700981120:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397586.411881:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bb9f80 x1874218700981120/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:27/0 lens 224/224 e 0 to 0 dl 1787397597 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.411912:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218700981120:12345-0@lo:400:kworker.0 Request processed in 47us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.411918:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1787397586.411929:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1787397586.411935:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700982144:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397586.411954:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bbb100 x1874218700982144/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:27/0 lens 224/224 e 0 to 0 dl 1787397597 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.411981:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218700982144:12345-0@lo:400:kworker.0 Request processed in 47us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.411988:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1787397586.412092:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218700980864:0@lo:400:kworker.0 00000100:00100000:1.0:1787397586.412099:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397586.412114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700981376:0@lo:400:kworker.0 00000100:00100000:1.0:1787397586.412123:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700982272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397586.412133:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218700981888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412147:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700980736:0@lo:400:kworker.0 00000100:00100000:1.0:1787397586.412177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397586.412262:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700981248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700981760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412356:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218700981120:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412369:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700981632:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412381:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218700982144:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700980992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412409:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700981504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397586.412424:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700982016:0@lo:400:kworker.0 00000100:00080000:2.0:1787397586.416765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397586.416777:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397586.416781:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397586.416793:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397586.423780:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982272 00000100:00100000:2.0:1787397586.423798:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982272 00000100:00100000:2.0:1787397586.423879:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1787397586.423893:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700982272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397586.423949:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445113856 avail 1298874368 00010000:00000080:2.0:1787397586.423970:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836691f80 x1874218700982272/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:27/0 lens 224/368 e 0 to 0 dl 1787397597 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397586.424074:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218700982272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (11897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397586.424082:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1787397586.424729:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700982272:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397586.724868:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397586.917921:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700982400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397586.918044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397586.918328:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982400 00000100:00100000:1.0:1787397586.918341:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982400 00000100:00100000:1.0:1787397586.918422:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1787397586.918435:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700982400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397586.918482:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397586.918576:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218700982400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397586.918586:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1787397586.918683:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700982400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397586.921171:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700982528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397586.921292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397586.921378:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982528 00000100:00100000:3.0:1787397586.921391:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982528 00000100:00100000:3.0:1787397586.921478:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1787397586.921490:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700982528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397586.921571:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397586.922304:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218700982528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 813us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397586.922315:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:2.0:1787397586.922393:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218700982528:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787397587.429500:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182409 is committed 00010000:00010000:2.0:1787397587.430018:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430036:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430044:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430051:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397587.430057:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430065:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430111:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32100) 00010000:00010000:2.0:1787397587.430115:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397587.430120:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430127:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d190390 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430152:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430158:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430164:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430169:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397587.430171:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430177:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430184:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a82df32100) 00010000:00010000:2.0:1787397587.430186:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397587.430189:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397587.430195:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab400/0x274786fe0d1903c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397587.750677:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397587.940769:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700982656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397587.941002:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397587.941022:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700982784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397587.946792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397587.946885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982784 00000100:00100000:2.0:1787397587.946900:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982784 00000100:00100000:2.0:1787397587.946967:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:2.0:1787397587.946979:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700982784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397587.947014:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397587.947074:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700982784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397587.947082:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:2.0:1787397587.947148:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700982784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397587.947266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397587.947988:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982656 00000100:00100000:2.0:1787397587.947997:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982656 00000100:00100000:2.0:1787397587.948040:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1787397587.948048:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700982656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397587.948067:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397587.948125:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700982656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397587.948132:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:0.0:1787397587.949413:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700982656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397588.233512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.233594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.233701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.233734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156352 00000100:00100000:0.0:1787397588.233747:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156352 00000100:00100000:0.0:1787397588.233826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2475 00000100:00100000:0.0:1787397588.233838:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681156352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397588.233947:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681156352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 111us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397588.233955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2475 00000100:00100000:2.0:1787397588.234171:0:88996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155840 00000100:00100000:2.0:1787397588.234178:0:88996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155840 00000100:00100000:2.0:1787397588.234217:0:88996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:2.0:1787397588.234224:0:88996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681155840:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397588.234278:0:88996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681155840:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397588.234292:0:88996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00080000:2.0:1787397588.234339:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397588.242057:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156096 00000100:00100000:1.0:1787397588.242084:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156096 00000100:00100000:1.0:1787397588.242416:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1208 00000100:00100000:1.0:1787397588.242452:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681156096:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397588.242656:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681156096:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 207us (9060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397588.242744:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1208 00000100:00100000:1.0:1787397588.242834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.243012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.243044:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156224 00000100:00100000:1.0:1787397588.243050:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156224 00000100:00100000:1.0:1787397588.243096:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2476 00000100:00100000:1.0:1787397588.243116:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681156224:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397588.243164:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2404:x1874218681156224:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397588.243170:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2476 00000100:00080000:3.0:1787397588.243176:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397588.243192:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397588.243277:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155968 00000100:00100000:1.0:1787397588.243282:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155968 00000100:00100000:1.0:1787397588.243379:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1209 00000100:00100000:1.0:1787397588.243388:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2404:x1874218681155968:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787397588.243409:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836692a00 x1874218681155968/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 224/224 e 0 to 0 dl 1787397599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397588.243452:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2404:x1874218681155968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 65us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397588.243460:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1209 00000100:00080000:3.0:1787397588.244003:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787397588.445098:0:90254:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1787397588.526471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.526608:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156480 00000100:00100000:1.0:1787397588.526618:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156480 00000100:00100000:1.0:1787397588.526683:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1210 00000100:00100000:1.0:1787397588.526771:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:69444:x1874218681156480:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397588.526795:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397588.526822:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1903dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f6c expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.526966:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.526982:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.526994:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397588.527044:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397588.527048:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397588.527076:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.527104:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1903dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f6c expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.527122:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f6c expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.527132:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a803ec8800) 00010000:00010000:1.0:1787397588.527135:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397588.527138:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00010000:00000080:1.0:1787397588.527146:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bb9500 x1874218681156480/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 576/688 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397588.527239:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69444:x1874218681156480:12345-192.168.204.60@tcp:101:dd.0 Request processed in 460us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397588.527247:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1210 00000100:00100000:0.0:1787397588.534297:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.534382:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156736 00000100:00100000:1.0:1787397588.534393:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156736 00000100:00100000:1.0:1787397588.534469:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1211 00000100:00100000:1.0:1787397588.534479:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:69444:x1874218681156736:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397588.534501:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397588.534504:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787397588.534564:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d1903e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f6c expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534584:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a803ec8800) 00010000:00010000:1.0:1787397588.534597:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397588.534615:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d1903eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f73 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534818:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534830:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534907:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534925:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534953:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.534960:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535030:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d190400 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535038:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d190400 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535045:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d190400 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397588.535055:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787397588.535153:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535160:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535166:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535172:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397588.535176:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535183:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535202:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a803ec8d00) 00010000:00010000:1.0:1787397588.535205:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397588.535208:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535214:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d1903f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535225:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535241:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535247:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535253:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397588.535255:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535261:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535269:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a803ec8e00) 00010000:00010000:1.0:1787397588.535272:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397588.535274:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535279:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1903f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535329:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d1903eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f73 expref: 12 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535343:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d190400 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f73 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.535349:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:1.0:1787397588.535351:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397588.535354:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75000, rc 0) 00010000:00000080:1.0:1787397588.535361:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a80fe50a80 x1874218681156736/t107374182410(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 776/848 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397588.535437:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:69444:x1874218681156736:12345-192.168.204.60@tcp:101:dd.0 Request processed in 959us (1151us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1787397588.535444:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1211 00000100:00100000:1.0:1787397588.543947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.545285:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681156864 00000100:00100000:0.0:1787397588.545306:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681156864 00000100:00100000:0.0:1787397588.546817:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1212 00000100:00100000:0.0:1787397588.546836:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:69444:x1874218681156864:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397588.546870:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397588.546893:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d19040e lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f7a expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.546931:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190415 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.546945:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190415 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.546956:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190415 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.547089:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d19040e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f7a expref: 13 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.547106:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190415 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f7a expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.547115:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:0.0:1787397588.547119:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397588.547123:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55e00, rc 0) 00010000:00000080:0.0:1787397588.547132:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836690e00 x1874218681156864/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 568/1344 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397588.547211:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69444:x1874218681156864:12345-192.168.204.60@tcp:101:dd.0 Request processed in 381us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397588.547238:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1212 00000100:00100000:2.0:1787397588.562267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.566544:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157120 00000100:00100000:1.0:1787397588.566560:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157120 00000100:00100000:1.0:1787397588.566625:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1213 00000100:00100000:1.0:1787397588.566638:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:69444:x1874218681157120:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:1.0:1787397588.566713:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397588.566753:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d190400 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f73 expref: 12 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.566770:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:1.0:1787397588.566776:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397588.566976:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.567005:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.567015:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397588.567066:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:1.0:1787397588.567090:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcc5c7af reply state 0000000044a27d11 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.567102:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.567109:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:1.0:1787397588.567112:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397588.567114:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1787397588.567152:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bba680 x1874218681157120/t107374182412(0) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 488/456 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397588.567255:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:69444:x1874218681157120:12345-192.168.204.60@tcp:36:dd.0 Request processed in 621us (4996us total) trans 107374182412 rc 0/0 00000100:00100000:1.0:1787397588.567264:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1213 00000020:00080000:1.0:1787397588.567269:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397588.572486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397588.572682:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157248 00000100:00100000:2.0:1787397588.572693:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157248 00000100:00100000:2.0:1787397588.572756:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1214 00000100:00100000:2.0:1787397588.572766:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+14:69444:x1874218681157248:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397588.572793:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397588.572814:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d190423 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f81 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.572889:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d190423 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f81 expref: 15 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.572908:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d190423 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f81 expref: 15 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.572930:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:2.0:1787397588.572934:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397588.572938:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aae00, rc 0) 00010000:00000080:2.0:1787397588.572946:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836692d80 x1874218681157248/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 376/584 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397588.573028:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+15:69444:x1874218681157248:12345-192.168.204.60@tcp:101:dd.0 Request processed in 263us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397588.573035:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1214 00000100:00100000:1.0:1787397588.587955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.588036:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157504 00000100:00100000:3.0:1787397588.588937:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157504 00000100:00100000:3.0:1787397588.589081:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1215 00000100:00100000:3.0:1787397588.589092:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+15:69444:x1874218681157504:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397588.589114:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397588.589117:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787397588.589155:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d190423 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f81 expref: 15 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589176:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:3.0:1787397588.589182:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397588.589353:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d19042a lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f88 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589407:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589422:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589433:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397588.589577:0:66177:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x45d:0x0], count =677 00000004:00080000:3.0:1787397588.589587:0:66177:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x45d:0x0]+677 in llog 00000004:00080000:3.0:1787397588.589616:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00000004:00080000:3.0:1787397588.589625:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x703:0x0], index 0: 0 00010000:00010000:3.0:1787397588.589744:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 17 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589752:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:3.0:1787397588.589755:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787397588.589765:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d19042a lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 17 pid: 66177 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589779:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 16 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.589811:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:3.0:1787397588.589814:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787397588.589816:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31e00, rc 0) 00010000:00000080:3.0:1787397588.589826:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836691180 x1874218681157504/t107374182413(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 376/608 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397588.592711:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+16:69444:x1874218681157504:12345-192.168.204.60@tcp:101:dd.0 Request processed in 3608us (4860us total) trans 107374182413 rc 0/0 00000100:00100000:3.0:1787397588.592725:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1215 00000100:00100000:1.0:1787397588.607635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.607731:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157632 00000100:00100000:3.0:1787397588.607742:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157632 00000100:00100000:3.0:1787397588.607814:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4951 00000100:00100000:3.0:1787397588.607824:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69444:x1874218681157632:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397588.607842:0:26169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397588.607957:0:26169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190438 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f8f expref: -99 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397588.607995:0:26169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397588.608019:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=3467s v=(0 0) 00010000:00010000:3.0:1787397588.608024:0:26169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397588.608034:0:26169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f8f expref: 6 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.608134:0:26169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f8f expref: 6 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.608221:0:26169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30a00, rc 0) 00000100:00100000:3.0:1787397588.608300:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69444:x1874218681157632:12345-192.168.204.60@tcp:101:dd.0 Request processed in 477us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397588.608308:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4951 00000100:00100000:1.0:1787397588.611127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.611292:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157760 00000100:00100000:3.0:1787397588.611303:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157760 00000100:00100000:3.0:1787397588.611402:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4952 00000100:00100000:3.0:1787397588.611413:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:69444:x1874218681157760:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397588.611432:0:25908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397588.611455:0:25908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19043f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f96 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397588.611482:0:25908:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397588.611506:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=3467s v=(0 0) 00010000:00010000:3.0:1787397588.611511:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397588.611557:0:25908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19043f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f96 expref: 6 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.611577:0:25908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19043f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f96 expref: 6 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.611590:0:25908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31a00, rc 0) 00000100:00100000:3.0:1787397588.611647:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69444:x1874218681157760:12345-192.168.204.60@tcp:101:dd.0 Request processed in 236us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397588.611655:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4952 00000100:00100000:3.0:1787397588.618362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.618401:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157888 00000100:00100000:3.0:1787397588.618411:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157888 00000100:00100000:3.0:1787397588.618464:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4953 00000100:00100000:3.0:1787397588.618474:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69444:x1874218681157888:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397588.618494:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397588.618536:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190446 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f9d expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397588.618565:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397588.618590:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=3467s v=(0 0) 00010000:00010000:3.0:1787397588.618595:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397588.618604:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f9d expref: 7 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.618620:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f9d expref: 7 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.618646:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30000, rc 0) 00000100:00100000:3.0:1787397588.618700:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:69444:x1874218681157888:12345-192.168.204.60@tcp:101:dd.0 Request processed in 228us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397588.618708:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4953 00000100:00100000:1.0:1787397588.630484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.630541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.631651:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158016 00000100:00100000:3.0:1787397588.631665:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158016 00002000:00010000:3.0:1787397588.631723:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1794 (1048576->18446744073709551615) 00002000:00100000:3.0:1787397588.631728:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763bb80 with x1874218681158016 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1787397588.631741:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a80763bb80. 00000100:00100000:3.0:1787397588.631771:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158144 00000100:00100000:3.0:1787397588.631774:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158144 00002000:00010000:3.0:1787397588.631789:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1795 (0->18446744073709551615) 00002000:00100000:3.0:1787397588.631792:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763b480 with x1874218681158144 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397588.631798:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80763b480. 00000100:00100000:3.0:1787397588.631817:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 546 00000100:00100000:3.0:1787397588.631827:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681158016:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:2.0:1787397588.632177:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 547 00000100:00100000:2.0:1787397588.632186:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681158144:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:3.0:1787397588.632212:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1787397588.632216:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb mtime from disk: 0 -> 1787397587 00002000:00010000:3.0:1787397588.632218:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787397588.632220:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb ctime from disk: 0 -> 1787397587 00002000:00010000:3.0:1787397588.632222:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1787397588.632296:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1787397588.632299:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681158016:12345-192.168.204.60@tcp:10:dd.0 Request processed in 473us (1826us total) trans 4294968725 rc 0/0 00002000:00010000:2.0:1787397588.632299:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb mtime from disk: 0 -> 1787397587 00002000:00010000:2.0:1787397588.632301:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787397588.632304:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb ctime from disk: 0 -> 1787397587 00002000:00010000:2.0:1787397588.632305:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787397588.632307:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 546 00002000:00010000:3.0:1787397588.632322:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1794 (1048576->18446744073709551615) 00002000:00100000:3.0:1787397588.632324:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763bb80 with x1874218681158016 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1787397588.632329:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a80763bb80. 00000100:00100000:2.0:1787397588.634076:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681158144:12345-192.168.204.60@tcp:10:dd.0 Request processed in 1879us (3542us total) trans 4294968728 rc 0/0 00000100:00100000:2.0:1787397588.634089:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 547 00002000:00010000:2.0:1787397588.634095:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1795 (0->18446744073709551615) 00002000:00100000:2.0:1787397588.634098:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763b480 with x1874218681158144 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397588.634108:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80763b480. 00000100:00100000:3.0:1787397588.705221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.705382:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158400 00000100:00100000:0.0:1787397588.705393:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158400 00000100:00100000:0.0:1787397588.705455:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:0.0:1787397588.705465:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+16:69444:x1874218681158400:12345-192.168.204.60@tcp:35:dd.0 00010000:00000080:0.0:1787397588.705794:0:80567:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828410000 x1874218681158400/t107374182414(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 392/456 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397588.706067:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+17:69444:x1874218681158400:12345-192.168.204.60@tcp:35:dd.0 Request processed in 600us (852us total) trans 107374182414 rc 0/0 00000100:00100000:2.0:1787397588.706076:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:3.0:1787397588.725570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397588.725713:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158528 00000100:00100000:2.0:1787397588.725724:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158528 00000100:00100000:2.0:1787397588.725792:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1216 00000100:00100000:2.0:1787397588.725801:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+17:69445:x1874218681158528:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397588.725828:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397588.725863:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19044d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fa4 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.725927:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.725953:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.725966:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397588.726013:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397588.726017:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397588.726037:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.726062:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19044d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fa4 expref: 19 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.726081:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fa4 expref: 18 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.726089:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:2.0:1787397588.726092:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397588.726095:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00010000:00000080:2.0:1787397588.726103:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfa300 x1874218681158528/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 576/688 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397588.726314:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69445:x1874218681158528:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 512us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397588.726321:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1216 00000100:00100000:1.0:1787397588.729483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397588.729806:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158784 00000100:00100000:3.0:1787397588.729819:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158784 00000100:00100000:3.0:1787397588.729934:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1217 00000100:00100000:3.0:1787397588.729947:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69445:x1874218681158784:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397588.729966:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397588.729987:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30800/0x274786fe0d19045b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fab expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730062:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730077:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730088:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730103:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730110:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730117:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730251:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730258:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730264:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730269:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730275:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397588.730280:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730287:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730299:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:3.0:1787397588.730302:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397588.730306:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730313:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31800/0x274786fe0d190462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730327:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730334:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730347:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730352:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397588.730355:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730361:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730369:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a70a1c4b00) 00010000:00010000:3.0:1787397588.730372:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397588.730374:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730380:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31c00/0x274786fe0d190469 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730416:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30800/0x274786fe0d19045b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fab expref: 19 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730437:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:3.0:1787397588.730440:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397588.730443:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30800/0x274786fe0d19045b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fab expref: 19 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397588.730452:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30800, rc 0) 00010000:00000080:3.0:1787397588.730460:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a807639880 x1874218681158784/t0(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 800/608 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397588.731998:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69445:x1874218681158784:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 2046us (2515us total) trans 0 rc 301/301 00000100:00100000:3.0:1787397588.732012:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1217 00000100:00100000:3.0:1787397588.740608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.740759:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681158912 00000100:00100000:0.0:1787397588.740772:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681158912 00000100:00100000:0.0:1787397588.740848:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1218 00000100:00100000:0.0:1787397588.740859:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69445:x1874218681158912:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:0.0:1787397588.740933:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.740950:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.740961:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.740976:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.740982:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.740989:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741086:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741096:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741103:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397588.741144:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1787397588.741159:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397588.741172:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741187:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741195:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741201:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741208:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741213:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397588.741217:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741232:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741252:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:0.0:1787397588.741256:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397588.741261:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741268:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d190470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741282:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741288:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741292:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741297:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397588.741299:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741304:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741311:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a82ebb1700) 00010000:00010000:0.0:1787397588.741313:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397588.741316:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741321:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d190477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741346:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741351:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741357:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741362:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397588.741364:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741370:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741378:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:0.0:1787397588.741380:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397588.741383:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397588.741388:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d19047e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1787397588.741410:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf9180 x1874218681158912/t0(0) o34->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 472/728 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397588.741498:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69445:x1874218681158912:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 640us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397588.741507:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1218 00010000:00010000:0.0:1787397588.773174:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397588.792626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397588.792741:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159168 00000100:00100000:1.0:1787397588.792751:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159168 00000100:00100000:1.0:1787397588.792817:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1219 00000100:00100000:1.0:1787397588.792827:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+18:69447:x1874218681159168:12345-192.168.204.60@tcp:101:md5sum.0 00010000:00010000:1.0:1787397588.792856:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397588.792882:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d190485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fb2 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.792953:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.792968:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.792979:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.792994:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793001:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793007:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793131:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d19049a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793140:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d19049a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793163:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d19049a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397588.793175:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:1.0:1787397588.793281:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793290:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793297:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793302:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397588.793307:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793313:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793326:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:1.0:1787397588.793329:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397588.793333:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793339:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d19048c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793352:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793369:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793374:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793379:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397588.793382:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793388:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793396:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a803ec8d00) 00010000:00010000:1.0:1787397588.793398:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397588.793401:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793406:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d190493 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793673:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d190485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb2 expref: 21 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793688:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d19049a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb2 expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397588.793696:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:1.0:1787397588.793698:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397588.793708:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00010000:00000080:1.0:1787397588.793717:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829b40a80 x1874218681159168/t107374182415(0) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 800/872 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397588.793836:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+20:69447:x1874218681159168:12345-192.168.204.60@tcp:101:md5sum.0 Request processed in 1010us (1220us total) trans 107374182415 rc 0/0 00000100:00100000:1.0:1787397588.793844:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1219 00000100:00100000:1.0:1787397588.813887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.814002:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159296 00000100:00100000:0.0:1787397588.814014:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159296 00002000:00100000:0.0:1787397588.814075:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff89a807638a80 x1874218681159296/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 488/0 e 0 to 0 dl 1787397599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397588.814086:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a807638a80 with x1874218681159296 ext(0->32767) 00002000:00010000:0.0:1787397588.814093:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a807638a80 00000100:00100000:0.0:1787397588.814140:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 548 00000100:00100000:0.0:1787397588.814151:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681159296:12345-192.168.204.60@tcp:3:md5sum.0 00000100:00100000:2.0:1787397588.817765:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681159296:12345-192.168.204.60@tcp:3:md5sum.0 Request processed in 3603us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397588.817780:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 548 00002000:00100000:2.0:1787397588.817811:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff89a807638a80 x1874218681159296/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 488/440 e 0 to 0 dl 1787397599 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397588.817822:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a807638a80 with x1874218681159296 ext(0->32767) 00002000:00010000:2.0:1787397588.817829:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a807638a80 00000100:00100000:3.0:1787397588.825908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397588.826084:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159424 00000100:00100000:0.0:1787397588.826095:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159424 00002000:00100000:0.0:1787397588.826157:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff89a828cfb800 x1874218681159424/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 488/0 e 0 to 0 dl 1787397599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397588.826167:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a828cfb800 with x1874218681159424 ext(32768->1048575) 00002000:00010000:0.0:1787397588.826172:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a828cfb800 00000100:00100000:0.0:1787397588.826207:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 549 00000100:00100000:0.0:1787397588.826216:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2405:x1874218681159424:12345-192.168.204.60@tcp:3:md5sum.0 00000100:00100000:0.0:1787397588.831357:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2405:x1874218681159424:12345-192.168.204.60@tcp:3:md5sum.0 Request processed in 5129us (5449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397588.831371:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 549 00002000:00100000:0.0:1787397588.831384:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff89a828cfb800 x1874218681159424/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 488/440 e 0 to 0 dl 1787397599 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397588.831395:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a828cfb800 with x1874218681159424 ext(32768->1048575) 00002000:00010000:0.0:1787397588.831403:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a828cfb800 00000100:00100000:3.0:1787397588.846904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397588.847022:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159680 00000100:00100000:2.0:1787397588.847035:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159680 00000100:00100000:2.0:1787397588.847113:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 225 00000100:00100000:2.0:1787397588.847124:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+20:69447:x1874218681159680:12345-192.168.204.60@tcp:35:md5sum.0 00010000:00000080:2.0:1787397588.847416:0:66179:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfad80 x1874218681159680/t107374182416(0) o35->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 392/456 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397588.847596:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+21:69447:x1874218681159680:12345-192.168.204.60@tcp:35:md5sum.0 Request processed in 472us (702us total) trans 107374182416 rc 0/0 00000100:00100000:2.0:1787397588.847604:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 225 00000100:00100000:3.0:1787397588.889495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397588.889901:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159808 00000100:00100000:2.0:1787397588.889912:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159808 00000100:00100000:2.0:1787397588.890051:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1220 00000100:00100000:2.0:1787397588.890062:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+21:69449:x1874218681159808:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:2.0:1787397588.890151:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890170:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890306:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890324:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890346:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890353:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890439:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890449:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890456:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397588.890498:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1787397588.890503:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397588.890517:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890562:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890569:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890575:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890580:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397588.890584:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890598:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890611:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82df32200) 00010000:00010000:2.0:1787397588.890613:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397588.890619:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890625:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1904a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890640:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890646:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890651:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890656:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397588.890659:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890665:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890672:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a82df32900) 00010000:00010000:2.0:1787397588.890674:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397588.890677:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890826:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1904af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890914:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890922:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890927:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890931:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397588.890934:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890940:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890949:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:2.0:1787397588.890952:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397588.890955:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397588.890960:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1904b6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1787397588.890983:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfbb80 x1874218681159808/t0(0) o34->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:29/0 lens 472/728 e 0 to 0 dl 1787397599 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397588.891452:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+21:69449:x1874218681159808:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 1390us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397588.891470:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1220 00010000:00010000:1.0:1787397589.796754:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397590.823317:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787397590.965696:0:90351:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787397590.965756:0:90351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.965773:0:90351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.965781:0:90351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.965788:0:90351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.965811:0:90351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787397590.965817:0:90351:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787397590.965854:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787397590.965860:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787397590.965866:0:90351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787397590.965895:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787397590.966151:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397590.966158:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966167:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397590.966171:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966191:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397590.966199:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397590.966205:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397590.966207:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397590.966210:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397590.966238:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966244:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397590.966277:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966285:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b600/0x274786fe0d18ffca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffd1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966298:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397590.966300:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397590.966301:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397590.966318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700982912:0@lo:39:umount.0 00000100:00100000:0.0:1787397590.966403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397590.966450:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397590.966458:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700983040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397590.966486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397590.966548:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700982912 00000100:00100000:0.0:1787397590.966556:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700982912 00000100:00100000:0.0:1787397590.966605:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1787397590.966614:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218700982912:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787397590.966640:0:66178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1900e9 00000100:00080000:0.0:1787397590.966656:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a817efa000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1787397590.966684:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a703509c00 x1874218700982912/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:31/0 lens 224/224 e 0 to 0 dl 1787397601 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397590.966726:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218700982912:12345-0@lo:39:umount.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397590.966733:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000020:00000080:0.0:1787397590.966744:0:66178:0:(genops.c:906:class_export_put()) final put ffff89a817eff000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1787397590.966771:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983040 00000100:00100000:0.0:1787397590.966775:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983040 00000100:00100000:0.0:1787397590.966806:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1787397590.966812:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218700983040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397590.966823:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397590.966838:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55200/0x274786fe0d18ffd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ffca expref: 24 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.966850:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397590.966877:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218700983040:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397590.966894:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00010000:00010000:0.0:1787397590.966937:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397590.966946:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817eff000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787397590.967133:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efa000 for lustre-MDT0000 00000100:00100000:0.0:1787397590.967167:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700983040:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787397590.967211:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a807dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397590.967266:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700982912:0@lo:39:umount.0 00000100:00080000:3.0:1787397590.972293:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787397590.972303:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787397590.972328:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787397590.977075:0:90351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977096:0:90351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977104:0:90351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977110:0:90351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977232:0:90351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397590.977240:0:90351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977248:0:90351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977253:0:90351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977258:0:90351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.977714:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397590.977723:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.977731:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397590.977735:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397590.977744:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397590.977751:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397590.977757:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397590.977760:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787397590.977883:0:90351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397590.977892:0:90351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977899:0:90351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977914:0:90351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977920:0:90351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977943:0:90351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397590.977949:0:90351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977956:0:90351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977961:0:90351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977975:0:90351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397590.977988:0:90351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787397590.977992:0:90351:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787397590.977999:0:90351:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787397590.978034:0:90351:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787397590.978039:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1787397590.978044:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1787397590.978050:0:90351:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1787397590.978894:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397590.978903:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.978912:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397590.978915:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.978924:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397590.978932:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397590.978937:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397590.978940:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787397590.978942:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787397590.978977:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.978983:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397590.979010:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979017:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d18ffed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fff4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979032:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397590.979036:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979053:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7052ef600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397590.979056:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979063:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397590.979069:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397590.979073:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787397590.979075:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787397590.979078:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787397590.979093:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979099:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397590.979106:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979112:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ef600/0x274786fe0d18ffbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18ffc3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979121:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397590.979124:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979129:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397590.979132:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979145:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397590.979151:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397590.979156:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397590.979158:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787397590.979159:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787397590.979172:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979178:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397590.979207:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979214:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d18fedc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fee3 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979225:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397590.979226:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397590.979228:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397590.979248:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700983168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.979323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397590.979376:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397590.979382:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700983296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.979402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397590.979428:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397590.979436:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700983424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.979473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397590.979501:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983168 00000100:00100000:2.0:1787397590.979508:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983168 00000100:00100000:2.0:1787397590.979575:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983296 00000100:00100000:2.0:1787397590.979579:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983296 00000100:00100000:2.0:1787397590.979597:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983424 00000100:00100000:2.0:1787397590.979600:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983424 00000100:00100000:2.0:1787397590.979623:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1787397590.979632:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+25:3650:x1874218700983168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397590.979646:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397590.979661:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a200/0x274786fe0d18fff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ffed expref: 25 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979675:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397590.979711:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218700983168:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397590.979718:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1787397590.979735:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1787397590.979741:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218700983296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397590.979748:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397590.979756:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ee800/0x274786fe0d18ffc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18ffbc expref: 23 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979765:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397590.979786:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218700983296:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397590.979792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1787397590.979804:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1787397590.979817:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838246850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218700983424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397590.979826:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397590.979836:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b000/0x274786fe0d18fee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fedc expref: 21 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397590.979845:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397590.979871:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838246850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+20:3649:x1874218700983424:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397590.979877:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1787397590.979954:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700983424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.979980:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700983296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.979988:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700983168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397590.980140:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397590.980159:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397590.981232:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.981244:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397590.981297:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700983552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397590.981354:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397590.981413:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.981425:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ef800/0x274786fe0d18feea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d18fef1 expref: -99 pid: 88984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.981442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397590.981444:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397590.981445:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1787397590.982362:0:90351:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1787397590.982766:0:88985:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00000020:00000080:3.0:1787397590.982844:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1787397590.982867:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7050a4000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397590.982875:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a817efb800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397590.982879:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7050a6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397590.982885:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1f000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397590.982893:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1b800 e90f04db-6a63-4f01-92c7-7bf813f9f081 192.168.204.60@tcp 13 (0 0 7) 0 0 0 1: ffff89a8354a7000 107374182416 stale:0 00000020:00080000:3.0:1787397590.982899:0:90351:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a828c18000) has exports, disconnecting them 00000020:00080000:3.0:1787397590.982904:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7050a4000), last request at 1787397560 00000020:00000080:3.0:1787397590.982912:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1900e2 00000100:00080000:3.0:1787397590.982921:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a7050a2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397590.983358:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7050a4000): rc 0 00000020:00000080:3.0:1787397590.983361:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a7050a4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787397590.983384:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a817efb800), last request at 1787397586 00000020:00000080:3.0:1787397590.983388:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1900db 00000100:00080000:3.0:1787397590.983394:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a817ef9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397590.983404:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817efb800): rc 0 00000020:00000080:3.0:1787397590.983406:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a817efb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787397590.983410:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7050a6000), last request at 1787397586 00000020:00000080:3.0:1787397590.983413:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1900d4 00000100:00080000:3.0:1787397590.983420:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a7050a3800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787397590.983457:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1787397590.983604:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983616:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983624:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983644:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397590.983649:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983658:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983678:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a803ec8700) 00010000:00010000:1.0:1787397590.983681:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397590.983686:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.983692:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19041c lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397590.983841:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983552 00000100:00100000:0.0:1787397590.983852:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983552 00000020:00080000:3.0:1787397590.984010:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7050a6000): rc 0 00000020:00000080:3.0:1787397590.984013:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a7050a6000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1787397590.984064:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397590.984123:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1787397590.984133:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+20:3649:x1874218700983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397590.984149:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397590.984164:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096ba00/0x274786fe0d18fef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18feea expref: 20 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.984176:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397590.984258:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218700983552:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397590.984266:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1787397590.984313:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700983552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397590.984470:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787397590.984508:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b1f000), last request at 1787397555 00000020:00000080:3.0:1787397590.984548:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff3e 00000100:00080000:3.0:1787397590.984561:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397590.984615:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1f000): rc 0 00000020:00000080:3.0:1787397590.984618:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1787397590.984633:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a829b1b800), last request at 1787397588 00000020:00000080:3.0:1787397590.984637:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff37 00000020:00010000:3.0:1787397590.984644:0:90351:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a829b1b800: total 3 00000100:00080000:3.0:1787397590.984648:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397590.984658:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a829b1b800): rc 0 00000004:00000080:3.0:1787397590.984666:0:90351:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41cabae0 00000100:00080000:3.0:1787397590.984690:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397590.984693:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787397590.985572:0:90351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787397590.985596:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a803e9f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00010000:1.0:1787397590.985773:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a829b1b800: total 3 00010000:00010000:1.0:1787397590.985860:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a829b1b800, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1787397590.985898:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d190327 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f3b expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985918:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d190415 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f7a expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985931:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d190431 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 6 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985945:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d190454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fa4 expref: 5 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985964:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d190320 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f34 expref: 4 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985975:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d19049a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb2 expref: 3 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.985993:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d190319 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f2d expref: 2 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397590.986007:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a829b1b800, canceled 7 locks, left on hash table 0. 00000020:00000080:2.0:1787397590.989025:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397590.989089:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7050a2000 for lustre-MDT0000 00000020:00000080:2.0:1787397590.989094:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397590.989118:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397590.989139:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ef9000 for lustre-MDT0000 00000020:00000080:2.0:1787397590.989143:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7050a3800 for lustre-MDT0000 00000020:00000080:2.0:1787397590.989145:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efe800 for lustre-MDT0000 00010000:00010000:2.0:1787397590.989245:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397590.989344:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397590.989349:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968727 gen 3 00000004:00080000:3.0:1787397590.989370:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787397590.989434:0:90351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787397590.989462:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787397590.989472:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397590.989474:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968724 gen 3 00000004:00080000:3.0:1787397590.989486:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787397590.989658:0:90351:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787397590.989668:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a83ae97800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787397590.989713:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a828c18000) has no exports 00000020:00080000:3.0:1787397590.990032:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a828c18000) has no exports 00000100:00100000:0.0:1787397590.990949:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983680:0@lo:39:umount.0 00000100:00100000:0.0:1787397590.991024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397590.991055:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983808:0@lo:9:umount.0 00000100:00100000:0.0:1787397590.991077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397590.991091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983936:0@lo:9:umount.0 00000100:00100000:0.0:1787397590.991106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397590.991139:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983680 00000100:00100000:0.0:1787397590.991146:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983680 00000100:00100000:0.0:1787397590.991198:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1787397590.991206:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700983680:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787397590.991233:0:23942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff76 00000100:00080000:0.0:1787397590.991239:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a830a0a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397590.991258:0:23942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378732 00000100:00100000:0.0:1787397590.991391:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218700983680:12345-0@lo:39:umount.0 Request processed in 185us (367us total) trans 81604378733 rc 0/0 00000100:00100000:0.0:1787397590.991400:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1787397590.991425:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983808 00000100:00100000:0.0:1787397590.991428:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983808 00000100:00100000:0.0:1787397590.991459:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700983936 00000100:00100000:0.0:1787397590.991462:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700983936 00000100:00100000:0.0:1787397590.991480:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4954 00000100:00100000:0.0:1787397590.991486:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700983808:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787397590.991501:0:26166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff8b 00000100:00080000:0.0:1787397590.991506:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a830a0e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397590.991557:0:26166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968728 00000100:00100000:0.0:1787397590.991642:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700983808:12345-0@lo:9:umount.0 Request processed in 155us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397590.991665:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4954 00000100:00100000:0.0:1787397590.991677:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955 00000100:00100000:0.0:1787397590.991682:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218700983936:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787397590.991693:0:26166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ffa7 00000100:00080000:0.0:1787397590.991698:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a836711800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397590.991723:0:26166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968725 00000100:00100000:0.0:1787397590.991964:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218700983936:12345-0@lo:9:umount.0 Request processed in 111us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397590.991971:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955 00000100:00080000:0.0:1787397590.991994:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397590.991998:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787397590.992011:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397590.992016:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397590.992045:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a803e9f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397590.992051:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983680:0@lo:39:umount.0 00000100:00080000:0.0:1787397590.992062:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397590.992107:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:2.0:1787397590.999598:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787397591.003912:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397591.003930:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983808:0@lo:9:umount.0 00000100:00080000:0.0:1787397591.003984:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83ae97800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397591.004001:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397591.004003:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397591.004006:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700983936:0@lo:9:umount.0 00010000:00010000:0.0:1787397591.004619:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397591.019985:0:6510:0:(genops.c:906:class_export_put()) final put ffff89a829b1b800/e90f04db-6a63-4f01-92c7-7bf813f9f081 00010000:00010000:1.0:1787397591.020064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397591.020068:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397591.020070:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397591.022907:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1b800/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0000 00000020:00000080:0.0:1787397591.027956:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a81912e000 for lustre-MDT0000 00000020:00000080:3.0:1787397591.039386:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff53 00000020:00000080:3.0:1787397591.039405:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a7090fb000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787397591.039483:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787397591.039676:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397591.039710:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397591.039715:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a829b93380) has no exports 00000020:00000080:2.0:1787397591.040096:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff4c 00000020:00000080:2.0:1787397591.040104:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a8364ef800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397591.040142:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787397591.040268:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397591.040334:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.040344:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787397591.040347:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a8364ec000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787397591.040350:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364ec000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787397591.040358:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787397591.040515:0:90351:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70441c540 - data ffff89a827d79e58/ffff89a80ff7a000 00000020:01000000:0.0:1787397591.041073:0:90351:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a811418b40 - data ffff89a701ed2af8/ffff89a8067fa000 00000100:00080000:3.0:1787397591.102195:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397591.102205:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787397591.102224:0:90351:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a828cf9880 x1874218700983680/t81604378733(81604378733) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397600 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397591.102276:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787397591.115157:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397591.115166:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968727 gen 4 00000004:00080000:3.0:1787397591.115198:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397591.115201:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787397591.117038:0:89003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787397591.117047:0:89003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1787397591.117066:0:89003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:3.0:1787397591.118641:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397591.118649:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968724 gen 4 00000004:00080000:3.0:1787397591.118666:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397591.118668:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787397591.120292:0:89005:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787397591.120299:0:89005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:0.0:1787397591.120323:0:89005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:3.0:1787397591.130329:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff0d 00000020:00000080:3.0:1787397591.130343:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a706d34800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397591.130598:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787397591.131301:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff22 00000020:00000080:3.0:1787397591.131889:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a803e9f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397591.131944:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787397591.131953:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397591.131975:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787397591.131980:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a828c1cd40) has no exports 00000004:01000000:3.0:1787397591.132161:0:90351:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787397591.132171:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ffa0 00000020:00000080:3.0:1787397591.132187:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a7025d0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397591.136427:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787397591.136544:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397591.136558:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397591.136576:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397591.136581:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a83b9d19c0) has no exports 00000020:00000080:3.0:1787397591.136591:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff99 00000020:00000080:3.0:1787397591.136600:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a83ae91800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787397591.138654:0:90351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787397591.138662:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397591.138667:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968724 gen 5 00000004:00080000:3.0:1787397591.138674:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397591.138676:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397591.138733:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397591.138747:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397591.138755:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff84 00000020:00000080:3.0:1787397591.138764:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a706ff3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397591.138769:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397591.138774:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397591.138780:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397591.138783:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a829b90000) has no exports 00000020:00000080:3.0:1787397591.138789:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff7d 00000020:00000080:3.0:1787397591.138793:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a828a5b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397591.138846:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787397591.138855:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397591.138861:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae97800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787397591.138866:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a7025d4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397591.138868:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787397591.138873:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397591.138961:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787397591.138965:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787397591.139097:0:90351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787397591.139100:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397591.139102:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968727 gen 5 00000004:00080000:3.0:1787397591.139106:0:90351:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397591.139107:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397591.139141:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397591.139146:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787397591.139158:0:90351:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787397591.139162:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff68 00000020:00000080:3.0:1787397591.139167:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a83ae92000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787397591.139170:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787397591.139173:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397591.139186:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787397591.139189:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a702478000) has no exports 00000020:00000080:3.0:1787397591.139192:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff61 00000020:00000080:3.0:1787397591.139195:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a803e9b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397591.139942:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a58000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787397591.139951:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a83ae94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397591.139953:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787397591.139971:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397591.140029:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae92000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787397591.140033:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787397591.141049:0:90351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787397591.141055:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397591.141059:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397591.141066:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397591.141122:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.141135:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397591.141162:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.141166:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397591.141171:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a706ff5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397591.141186:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397591.141197:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397591.141290:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff29 00000020:00000080:2.0:1787397591.141296:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a803e9c000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787397591.141301:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787397591.141304:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397591.141310:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397591.141313:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a828c199c0) has no exports 00000020:00000080:2.0:1787397591.141331:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.141348:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787397591.141352:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ff30 00000020:00000080:2.0:1787397591.141356:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a803e9d800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787397591.141363:0:90351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a703748000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787397591.141367:0:90351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a703748000 3 00000020:01000004:2.0:1787397591.141370:0:90351:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a703748000 from lustre-MDT0000 00000020:00000080:2.0:1787397591.141397:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.141401:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787397591.141404:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a706d32000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787397591.141406:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d32000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787397591.141414:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787397591.141447:0:90351:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787397591.141452:0:90351:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787397591.141454:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787397591.141456:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397591.141459:0:90351:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787397591.141470:0:90351:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a836710000 367372d5-1a70-4e8f-8f10-c0f943f3662d 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397591.141476:0:90351:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a829b19800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397591.141480:0:90351:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a703c8cd40) has exports, disconnecting them 00000020:00080000:2.0:1787397591.141485:0:90351:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a836710000), last request at 1787397557 00000020:00000080:2.0:1787397591.141506:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1900b1 00000020:00010000:2.0:1787397591.141511:0:90351:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a836710000: total 2 00000100:00080000:2.0:1787397591.141514:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a836712800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397591.141543:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a836710000): rc 0 00000020:00080000:2.0:1787397591.141547:0:90351:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a829b19800), last request at 1787397555 00000020:00000080:2.0:1787397591.141589:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fece 00000020:00010000:2.0:1787397591.141592:0:90351:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a829b19800: total 2 00000100:00080000:2.0:1787397591.141595:0:90351:0:(import.c:65:import_set_state_nolock()) ffff89a829b1e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397591.141602:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b19800): rc 0 00000020:00080000:2.0:1787397591.141606:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a703c8cd40) has no exports 00000100:00100000:2.0:1787397591.141678:0:88994:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a8365dda00:88994] 3 exiting: rc = 0 00000100:00100000:2.0:1787397591.141777:0:88990:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a704867c00:88990] 0 exiting: rc = 1 00000100:00100000:2.0:1787397591.142309:0:88996:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff89a82e66f400:88996] 4 exiting: rc = 0 00000020:00010000:0.0:1787397591.142434:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a836710000: total 2 00010000:00010000:0.0:1787397591.142439:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397591.142487:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a836710000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787397591.142547:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a400/0x274786fe0d1900bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f0a expref: 5 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142582:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b400/0x274786fe0d1900cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f18 expref: 4 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142595:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096bc00/0x274786fe0d1900c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f11 expref: 3 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142607:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ef400/0x274786fe0d1900b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f03 expref: 2 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142616:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a836710000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1787397591.142637:0:56852:0:(genops.c:906:class_export_put()) final put ffff89a836710000/367372d5-1a70-4e8f-8f10-c0f943f3662d 00000020:00010000:0.0:1787397591.142643:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a829b19800: total 3 00010000:00010000:0.0:1787397591.142660:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a829b19800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787397591.142675:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55c00/0x274786fe0d190064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19005d expref: 14 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142686:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a000/0x274786fe0d190056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19004f expref: 13 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142696:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54000/0x274786fe0d190080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190079 expref: 12 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142707:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a400/0x274786fe0d190010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190009 expref: 11 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142733:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052eee00/0x274786fe0d190072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19006b expref: 10 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142743:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a600/0x274786fe0d190002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d18fffb expref: 9 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142762:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096be00/0x274786fe0d19008e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190087 expref: 8 pid: 88994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142773:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b800/0x274786fe0d19001e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190017 expref: 7 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142783:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052ef000/0x274786fe0d19009c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190095 expref: 6 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142926:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096b600/0x274786fe0d19002c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190025 expref: 5 pid: 88996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142939:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55400/0x274786fe0d1900aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1900a3 expref: 4 pid: 88992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142949:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a83096a800/0x274786fe0d19003a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190033 expref: 3 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142961:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7052efe00/0x274786fe0d190048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190041 expref: 2 pid: 88990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397591.142970:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a829b19800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787397591.142984:0:56852:0:(genops.c:906:class_export_put()) final put ffff89a829b19800/99b57a74-e5dc-42df-b087-b10fad741506 00010000:00010000:0.0:1787397591.142989:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397591.142991:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397591.142993:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397591.143001:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397591.143030:0:88991:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a704866400:88991] 1 exiting: rc = 0 00000020:00000080:0.0:1787397591.143083:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a803e9f000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787397591.143095:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a706d36800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397591.143098:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d36800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787397591.143103:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397591.143149:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787397591.143153:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a706ff4800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787397591.143154:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787397591.143157:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787397591.143352:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397591.143359:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836710000/367372d5-1a70-4e8f-8f10-c0f943f3662d for MGS 00000020:00000080:0.0:1787397591.143390:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b19800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:0.0:1787397591.143402:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836712800 for MGS 00000020:00000080:0.0:1787397591.143405:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1e800 for MGS 00000100:00100000:0.0:1787397591.145042:0:88992:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a828c69800:88992] 2 exiting: rc = 0 00000100:00100000:2.0:1787397591.145200:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145209:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145216:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145221:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145228:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145234:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145241:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145248:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145254:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145260:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145267:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145273:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145279:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145285:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145290:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145296:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145301:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145306:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145311:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145316:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145322:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145327:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145332:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145339:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145345:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145350:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145356:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145361:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145366:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145372:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145377:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145399:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145404:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145410:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145416:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145421:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145426:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145432:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145437:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145442:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145447:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145453:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145458:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145462:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145468:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145473:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145479:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145484:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145489:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145494:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145499:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145505:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145509:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145514:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145518:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145549:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145554:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145560:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145567:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145572:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145578:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145584:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145589:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397591.145595:0:90351:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787397591.147868:0:90351:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a705d4b240 - data ffff89a827fbe438/ffff89a8047fa400 00000020:01000000:2.0:1787397591.148539:0:90351:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14120 - data ffff89a827fd0438/ffff89a704519800 00000020:00000080:2.0:1787397591.149652:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18fec7 00000020:00000080:2.0:1787397591.149663:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a835590800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787397591.149684:0:90351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a703748000 from MGS, refs=2 00000020:01000004:2.0:1787397591.149688:0:90351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a703748000 2 00000020:01000004:2.0:1787397591.149690:0:90351:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a703748000 from MGS 00000020:00000080:2.0:1787397591.149724:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397591.149732:0:90351:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787397591.149735:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a835597000/MGS 00000020:00000080:2.0:1787397591.149738:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835597000/MGS for MGS 00000020:01000000:2.0:1787397591.149744:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1787397591.149744:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835590800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787397591.149888:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787397591.149892:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397591.149902:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787397591.149908:0:90351:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a8364e3800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397591.149914:0:90351:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a829b94d40) has exports, disconnecting them 00000020:00080000:2.0:1787397591.149919:0:90351:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a8364e3800), last request at 1787397555 00000020:00000080:2.0:1787397591.149923:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18ffdf 00000020:00080000:2.0:1787397591.149933:0:90351:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8364e3800): rc 0 00000020:00000080:2.0:1787397591.149937:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a8364e3800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787397591.151398:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e3800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787397591.154587:0:90351:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787397591.154596:0:90351:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397591.154601:0:90351:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397591.154608:0:90351:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397591.154642:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a807dfe000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787397591.154813:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397591.154828:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787397591.154834:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a8364e1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787397591.154838:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787397591.154845:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787397591.154929:0:90351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a703748000 1 00000020:00000080:0.0:1787397591.154937:0:90351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18feb9 00000020:00000080:0.0:1787397591.154943:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a835591000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787397591.154962:0:90351:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787397591.154970:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835591000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397591.154979:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397591.154985:0:90351:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787397591.154989:0:90351:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a703c8b380) has no exports 00000020:00000080:0.0:1787397591.360315:0:90351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397591.360332:0:90351:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787397591.360338:0:90351:0:(genops.c:906:class_export_put()) final put ffff89a70374a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397591.360343:0:90351:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70374a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787397591.360356:0:90351:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787397591.360484:0:90351:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a703749000 00000020:02000400:0.0:1787397591.360589:0:90351:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787397591.525935:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700984064:0@lo:400:kworker.0 00000100:00100000:3.0:1787397591.526036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397591.526083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700984576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397591.526114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397591.526140:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397591.526163:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700984192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397591.526201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397591.526218:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700984704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397591.526242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.526564:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700984320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.526608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.526633:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700984832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.526654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.526676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397591.526682:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700984448:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.526702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.526717:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700984960:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.526733:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.526767:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984704 00000100:00100000:1.0:1787397591.526775:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984704 00000100:00100000:1.0:1787397591.526848:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984832 00000100:00100000:1.0:1787397591.526852:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984832 00000100:00100000:1.0:1787397591.526878:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1787397591.526887:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700984704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.526940:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700984704:12345-0@lo:400:kworker.0 Request processed in 54us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397591.526948:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1787397591.526976:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1787397591.526983:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700984832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527016:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700984832:12345-0@lo:400:kworker.0 Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397591.527022:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:1.0:1787397591.527040:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984064 00000100:00100000:1.0:1787397591.527044:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984064 00000100:00100000:1.0:1787397591.527070:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984192 00000100:00100000:1.0:1787397591.527073:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984192 00000100:00100000:1.0:1787397591.527087:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984320 00000100:00100000:1.0:1787397591.527097:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984320 00000100:00100000:1.0:1787397591.527108:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984448 00000100:00100000:1.0:1787397591.527110:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984448 00000100:00100000:1.0:1787397591.527124:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984960 00000100:00100000:1.0:1787397591.527126:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984960 00000100:00100000:1.0:1787397591.527135:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1787397591.527141:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700984192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527184:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700984192:12345-0@lo:400:kworker.0 Request processed in 43us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397591.527191:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1787397591.527203:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1787397591.527208:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700984448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527235:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700984448:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397591.527241:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1787397591.527253:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1787397591.527257:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1874218700984064:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397591.527263:0:77740:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397591.527288:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3650:x1874218700984064:12345-0@lo:400:kworker.0 Request processed in 30us (1254us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397591.527293:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1787397591.527304:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1787397591.527307:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1874218700984320:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397591.527311:0:77740:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397591.527330:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1874218700984320:12345-0@lo:400:kworker.0 Request processed in 21us (722us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397591.527335:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1787397591.527352:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1787397591.527356:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1874218700984960:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397591.527360:0:77740:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397591.527379:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3648:x1874218700984960:12345-0@lo:400:kworker.0 Request processed in 22us (646us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397591.527384:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:1.0:1787397591.527401:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397591.527405:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397591.527407:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397591.527452:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700984448:0@lo:400:kworker.0 00000100:00080000:1.0:1787397591.527464:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397591.527469:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397591.527472:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397591.527477:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397591.527481:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3440 00000100:00080000:1.0:1787397591.527487:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397591.527512:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a807638000 x1874218700985088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397591.527557:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218700984960:0@lo:400:kworker.0 00000100:00080000:1.0:1787397591.527569:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397591.527571:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397591.527574:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397591.527577:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397591.527580:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3440 00000100:00080000:1.0:1787397591.527591:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397591.527604:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80763b100 x1874218700985216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397591.527615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218700984320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700984832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700985088:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397591.527685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.527702:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700985216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397591.527719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.527741:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985088 00000100:00100000:1.0:1787397591.527745:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985088 00000100:00100000:1.0:1787397591.527762:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985216 00000100:00100000:1.0:1787397591.527765:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985216 00000100:00100000:1.0:1787397591.527773:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1787397591.527778:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985088:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787397591.527796:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397591.527829:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985088:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 50us (143us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397591.527834:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1787397591.527845:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1787397591.527848:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985216:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787397591.527856:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397591.527877:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985216:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (158us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397591.527891:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00080000:1.0:1787397591.527916:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397591.527920:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397591.527923:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700985088:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1787397591.527928:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397591.527931:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397591.527933:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700985216:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397591.527956:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700984192:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.527966:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700984704:0@lo:400:kworker.0 00000100:00080000:1.0:1787397591.527975:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397591.527977:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397591.527980:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397591.527982:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397591.527985:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3440 00000100:00080000:1.0:1787397591.527989:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397591.528003:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80763b100 x1874218700985344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397591.528018:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218700984064:0@lo:400:kworker.0 00000100:00100000:1.0:1787397591.528038:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700985344:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397591.528060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397591.528081:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985344 00000100:00100000:1.0:1787397591.528084:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985344 00000100:00100000:1.0:1787397591.528107:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1787397591.528111:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985344:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787397591.528123:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397591.528149:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218700985344:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 36us (88us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397591.528154:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:1.0:1787397591.528186:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397591.528189:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397591.528192:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700985344:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397591.528426:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700984576 00000100:00100000:2.0:1787397591.528432:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700984576 00000100:00100000:2.0:1787397591.528471:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1787397591.528477:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218700984576:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397591.528483:0:8445:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397591.528540:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218700984576:12345-0@lo:400:kworker.0 Request processed in 43us (2406us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397591.528546:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00080000:2.0:1787397591.528583:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397591.528586:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397591.528588:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397591.528603:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397591.528607:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3440 00000100:00080000:2.0:1787397591.528611:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397591.528628:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828411180 x1874218700985472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397591.528643:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700984576:0@lo:400:kworker.0 00000100:00100000:2.0:1787397591.528661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700985472:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397591.528690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397591.528716:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985472 00000100:00100000:2.0:1787397591.528719:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985472 00000100:00100000:2.0:1787397591.528736:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1787397591.528740:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700985472:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397591.528750:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397591.528776:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700985472:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (86us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397591.528794:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00080000:2.0:1787397591.528813:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397591.528816:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397591.528819:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700985472:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1787397591.847770:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397592.840018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397592.840164:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681159936 00000100:00100000:2.0:1787397592.840174:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681159936 00002000:00100000:2.0:1787397592.840248:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff89a80763b100 x1874218681159936/t0(0) o4->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:33/0 lens 488/0 e 0 to 0 dl 1787397603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397592.840259:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763b100 with x1874218681159936 ext(1048576->2097151) 00002000:00010000:2.0:1787397592.840280:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a80763b100 00000100:00100000:2.0:1787397592.840319:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 550 00000100:00100000:2.0:1787397592.840329:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681159936:12345-192.168.204.60@tcp:4:md5sum.0 00000100:00080000:0.0:1787397592.840476:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397592.842418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397592.842558:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160064 00000100:00100000:2.0:1787397592.842568:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160064 00000100:00100000:2.0:1787397592.842622:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4956 00000100:00100000:2.0:1787397592.842633:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2404:x1874218681160064:12345-192.168.204.60@tcp:16:kworker.0 00000001:00100000:2.0:1787397592.858244:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397592.858254:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a836714000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787397592.858287:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968725 is committed 00000100:00100000:2.0:1787397592.858390:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681160064:12345-192.168.204.60@tcp:16:kworker.0 Request processed in 15753us (15975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397592.858400:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4956 00000020:00000080:0.0:1787397592.862843:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836714000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787397592.862914:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836711800 for lustre-OST0001 00010000:00010000:0.0:1787397592.869394:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397592.871377:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681159936:12345-192.168.204.60@tcp:4:md5sum.0 Request processed in 31037us (31356us total) trans 4294968726 rc 0/0 00000100:00100000:2.0:1787397592.871392:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 550 00002000:00100000:2.0:1787397592.871405:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff89a80763b100 x1874218681159936/t4294968726(0) o4->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:33/0 lens 488/448 e 0 to 0 dl 1787397603 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397592.871415:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80763b100 with x1874218681159936 ext(1048576->2097151) 00002000:00010000:2.0:1787397592.871422:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a80763b100 00000100:00100000:3.0:1787397593.061486:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700985600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397593.061591:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700985728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397593.061597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397593.061793:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397593.061903:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985600 00000100:00100000:2.0:1787397593.061911:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985600 00000100:00100000:2.0:1787397593.061968:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985728 00000100:00100000:2.0:1787397593.061982:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985728 00000100:00100000:2.0:1787397593.062006:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1787397593.062015:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700985600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397593.062047:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397593.062095:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700985600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397593.062102:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1787397593.062119:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1787397593.062126:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700985728:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787397593.062580:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397593.062585:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397593.062689:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700985600:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397593.064037:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397593.064205:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700985728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2074us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397593.064216:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1787397593.067124:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8288c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700985728:0@lo:13:osp-pre-1-1.0 00000400:00000100:2.0:1787397593.350277:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681160192 offset 0 length 224: 4 00000100:00100000:2.0:1787397593.350321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397593.350359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397593.350390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397593.350414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397593.350447:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160704 00000100:00100000:2.0:1787397593.350456:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160704 00000100:00100000:2.0:1787397593.350503:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160576 00000100:00100000:2.0:1787397593.350506:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160576 00000100:00100000:2.0:1787397593.350554:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2479 00000100:00100000:2.0:1787397593.350564:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681160704:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397593.350657:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681160704:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397593.350665:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2479 00000100:00100000:2.0:1787397593.350689:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2480 00000100:00100000:2.0:1787397593.350696:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681160576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397593.350722:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681160576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397593.350728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2480 00000100:00100000:1.0:1787397593.350938:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160448 00000100:00100000:1.0:1787397593.350943:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160448 00000100:00100000:1.0:1787397593.350975:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160320 00000100:00100000:1.0:1787397593.350978:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160320 00000100:00100000:1.0:1787397593.350998:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1212 00000100:00100000:1.0:1787397593.351005:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681160448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397593.351041:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681160448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397593.351047:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1212 00000100:00100000:1.0:1787397593.351063:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1228 00000100:00100000:1.0:1787397593.351068:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874218681160320:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:1.0:1787397593.351073:0:66178:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397593.351093:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1874218681160320:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (703us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397593.351106:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1228 00000100:00080000:1.0:1787397593.351142:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397593.351148:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397593.373042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397593.383479:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681160832 00000100:00100000:2.0:1787397593.383495:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681160832 00000100:00100000:3.0:1787397593.384430:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1229 00000100:00100000:3.0:1787397593.384442:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681160832:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1787397593.384470:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397593.384580:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681160832:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 Request processed in 137us (11551us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397593.384589:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1229 00010000:00010000:1.0:1787397593.892887:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397594.600285:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397594.600295:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a830a0f800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787397594.600343:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968728 is committed 00000020:00000080:1.0:1787397594.600474:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787397594.600569:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830a0e800 for lustre-OST0000 00010000:00010000:0.0:1787397594.917711:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397595.940787:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397596.645183:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397596.645191:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397596.645196:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397596.645206:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3470 00000100:00080000:2.0:1787397596.645212:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397596.645220:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397596.645246:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70691c700 x1874218700985984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397596.645254:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1787397596.645277:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1787397596.645277:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700985856:0@lo:400:kworker.0 00000100:00080000:2.0:1787397596.645286:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397596.645288:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397596.645292:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3470 00000100:00080000:2.0:1787397596.645295:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397596.645299:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397596.645312:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70691fb80 x1874218700986240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1787397596.645342:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700985856 offset 0 length 224: 4 00000100:00080000:2.0:1787397596.645350:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397596.645354:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397596.645357:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397596.645361:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3470 00000100:00080000:2.0:1787397596.645365:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397596.645369:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397596.645387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700986112:0@lo:400:kworker.0 00000100:00100000:0.0:1787397596.645425:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397596.645442:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698df80 x1874218700986496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397596.645465:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986112 00000100:00100000:0.0:1787397596.645475:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986112 00000100:00100000:0.0:1787397596.645564:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1787397596.645576:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700986112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787397596.645588:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397596.645594:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397596.645596:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397596.645612:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3470 00000100:00080000:2.0:1787397596.645616:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397596.645621:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397596.645642:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521f80 x1874218700986880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397596.645642:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700986112:12345-0@lo:400:kworker.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397596.645667:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00080000:0.0:1787397596.645702:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397596.645749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700986112:0@lo:400:kworker.0 00000100:00100000:2.0:1787397596.645758:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700985984:0@lo:38:kworker.0 00000100:00100000:0.0:1787397596.645767:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397596.645777:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700986752:0@lo:400:kworker.0 00000100:00100000:2.0:1787397596.645796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397596.645817:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397596.645823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700986240:0@lo:38:kworker.0 00000100:00100000:2.0:1787397596.645854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397596.645875:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700986496:0@lo:38:kworker.0 00000100:00100000:2.0:1787397596.645903:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397596.645921:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700986880:0@lo:38:kworker.0 00000100:00100000:2.0:1787397596.645958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397596.645999:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986496 00000100:00100000:0.0:1787397596.646004:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986496 00000100:00100000:0.0:1787397596.646034:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1787397596.646040:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700986496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397596.646059:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397596.646107:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700986496:12345-0@lo:38:kworker.0 Request processed in 65us (202us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397596.646114:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1787397596.646263:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700986368:0@lo:400:kworker.0 00000100:00100000:3.0:1787397596.646296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397596.646322:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397596.646328:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700986624:0@lo:400:kworker.0 00000100:00100000:3.0:1787397596.646351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397596.646384:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986752 00000100:00100000:3.0:1787397596.646389:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986752 00000100:00100000:3.0:1787397596.646428:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986624 00000100:00100000:3.0:1787397596.646431:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986624 00000100:00100000:3.0:1787397596.646452:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1787397596.646544:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700985984 00000100:00100000:0.0:1787397596.646550:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700985984 00000100:00100000:0.0:1787397596.646573:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986240 00000100:00100000:3.0:1787397596.646574:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700986752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397596.646577:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986240 00000100:00100000:0.0:1787397596.646593:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986880 00000100:00100000:0.0:1787397596.646597:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986880 00000100:00100000:0.0:1787397596.646610:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700986368 00000100:00100000:0.0:1787397596.646613:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700986368 00000100:00100000:3.0:1787397596.646632:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700986752:12345-0@lo:400:kworker.0 Request processed in 164us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397596.646639:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1787397596.646642:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1787397596.646661:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700986368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397596.646665:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:3.0:1787397596.646677:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700986624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397596.646718:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700986368:12345-0@lo:400:kworker.0 Request processed in 59us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397596.646725:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1787397596.646746:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1787397596.646751:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700985984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397596.646764:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397596.646795:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700985984:12345-0@lo:38:kworker.0 Request processed in 42us (999us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397596.646801:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1787397596.646814:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1787397596.646818:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700986240:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1787397596.646820:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397596.646827:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00020000:0.0:1787397596.646828:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397596.646835:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700985984:0@lo:38:kworker.0 00000100:00080000:2.0:1787397596.646852:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787397596.646857:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700986240:12345-0@lo:38:kworker.0 Request processed in 36us (1001us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787397596.646858:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397596.646866:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700986496:0@lo:38:kworker.0 00000100:00100000:0.0:1787397596.646870:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1787397596.646885:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00080000:2.0:1787397596.646895:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397596.646900:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397596.646902:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700986880:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787397596.646904:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700986240:0@lo:38:kworker.0 00010000:00020000:0.0:1787397596.646916:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787397596.646952:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397596.646953:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700986880:12345-0@lo:38:kworker.0 Request processed in 61us (994us total) trans 0 rc -19/-19 00000100:00080000:2.0:1787397596.646959:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397596.646963:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:2.0:1787397596.646964:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397596.647004:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700986752:0@lo:400:kworker.0 00000100:00080000:0.0:1787397596.647033:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397596.647039:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397596.647044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700986880:0@lo:38:kworker.0 00000100:00100000:2.0:1787397596.647048:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700986368:0@lo:400:kworker.0 00000100:00100000:3.0:1787397596.647149:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700986624:12345-0@lo:400:kworker.0 Request processed in 474us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397596.647156:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1787397596.647655:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700986624:0@lo:400:kworker.0 00000001:00100000:0.0:1787397596.648230:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397596.648242:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378733 is committed 00000020:00000080:0.0:1787397596.648246:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a830a0c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397596.648317:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787397596.648382:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830a0a800 for lustre-MDT0001 00010000:00010000:0.0:1787397596.967843:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397597.989141:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397598.182547:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397598.182572:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700987008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397598.182654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397598.182935:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987008 00000100:00100000:3.0:1787397598.182954:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987008 00000100:00100000:3.0:1787397598.183033:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1787397598.183057:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700987008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397598.183087:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787397598.183112:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397598.183143:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700987136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397598.183152:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700987008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397598.183170:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:0.0:1787397598.183193:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700987008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397598.186581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397598.186716:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987136 00000100:00100000:3.0:1787397598.186726:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987136 00000100:00080000:2.0:1787397598.186888:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397598.186889:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1787397598.186905:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700987136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397598.186950:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397598.187016:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700987136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397598.187023:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1787397598.187114:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700987136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397598.469131:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397598.469180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:0.0:1787397598.469201:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681160960 offset 0 length 224: 4 00000100:00100000:0.0:1787397598.469225:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397598.469337:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161472 00000100:00100000:1.0:1787397598.469348:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161472 00000100:00100000:1.0:1787397598.469419:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161344 00000100:00100000:1.0:1787397598.469422:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161344 00000100:00100000:1.0:1787397598.469447:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2483 00000100:00100000:1.0:1787397598.469455:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681161472:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397598.469576:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681161472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 121us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397598.469583:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2483 00000100:00100000:1.0:1787397598.469604:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2484 00000100:00100000:1.0:1787397598.469611:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681161344:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397598.469638:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681161344:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397598.469655:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2484 00000100:00100000:3.0:1787397598.469974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:0.0:1787397598.470360:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397598.470364:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397598.470377:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161216 00000100:00100000:0.0:1787397598.470381:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161216 00000100:00100000:0.0:1787397598.470430:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161088 00000100:00100000:0.0:1787397598.470433:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161088 00000100:00100000:0.0:1787397598.470453:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1215 00000100:00100000:0.0:1787397598.470462:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681161216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397598.470504:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681161216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397598.470511:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1215 00000100:00100000:0.0:1787397598.470560:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1233 00000100:00100000:0.0:1787397598.470565:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681161088:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397598.470584:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397598.470609:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681161088:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 43us (637us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397598.470616:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1233 00000100:00080000:1.0:1787397598.470803:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:2.0:1787397598.695295:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968726 is committed 00010000:00010000:1.0:1787397599.012871:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397600.036836:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397601.061412:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397601.765550:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397601.765572:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397601.765576:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787397601.765582:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1787397601.765586:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3475 00000100:00080000:2.0:1787397601.765592:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397601.765599:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397601.765607:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700987264:0@lo:400:kworker.0 00000100:00100000:2.0:1787397601.765625:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522a00 x1874218700987392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397601.765654:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397601.765658:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397601.765659:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397601.765662:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3475 00000100:00080000:2.0:1787397601.765665:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397601.765668:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397601.765678:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522300 x1874218700987648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1787397601.765683:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700987264 offset 0 length 224: 4 00000100:00080000:2.0:1787397601.765701:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397601.765705:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397601.765707:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397601.765718:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:2.0:1787397601.765720:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397601.765724:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397601.765735:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523800 x1874218700987904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397601.765755:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397601.765764:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397601.765766:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397601.765769:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:2.0:1787397601.765771:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397601.765774:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397601.765785:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523480 x1874218700988288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397601.765862:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700988032:0@lo:400:kworker.0 00000100:00100000:1.0:1787397601.765901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397601.765943:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700988160:0@lo:400:kworker.0 00000100:00100000:1.0:1787397601.765982:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700987520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397601.766009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397601.766019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397601.766049:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397601.766057:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700987776:0@lo:400:kworker.0 00000100:00100000:0.0:1787397601.766058:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988032 00000100:00100000:0.0:1787397601.766076:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988032 00000100:00100000:1.0:1787397601.766082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397601.766116:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987520 00000100:00100000:1.0:1787397601.766121:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987520 00000100:00100000:0.0:1787397601.766137:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988160 00000100:00100000:0.0:1787397601.766142:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988160 00000100:00100000:1.0:1787397601.766170:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987776 00000100:00100000:0.0:1787397601.766175:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1787397601.766185:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700988032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397601.766232:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700988032:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397601.766244:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1787397601.766263:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1787397601.766271:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700988160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397601.766308:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700988160:12345-0@lo:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397601.766312:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1787397601.766320:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:3.0:1787397601.766332:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700987520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787397601.766340:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397601.766346:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397601.766350:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397601.766384:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700987520:12345-0@lo:400:kworker.0 Request processed in 61us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397601.766391:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700988160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397601.766394:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1787397601.766442:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700988032:0@lo:400:kworker.0 00000100:00100000:3.0:1787397601.766453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700987520:0@lo:400:kworker.0 00000100:00100000:3.0:1787397601.766479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700987392:0@lo:38:kworker.0 00000100:00100000:3.0:1787397601.766508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397601.766555:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700987648:0@lo:38:kworker.0 00000100:00100000:3.0:1787397601.766579:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397601.766596:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700987904:0@lo:38:kworker.0 00000100:00100000:3.0:1787397601.766616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397601.766632:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700988288:0@lo:38:kworker.0 00000100:00100000:3.0:1787397601.766651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397601.766687:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987392 00000100:00100000:3.0:1787397601.766691:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987392 00000100:00100000:3.0:1787397601.766710:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987648 00000100:00100000:3.0:1787397601.766712:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987648 00000100:00100000:3.0:1787397601.766733:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988288 00000100:00100000:3.0:1787397601.766736:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988288 00000100:00100000:3.0:1787397601.766745:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1787397601.766750:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700987392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397601.766768:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397601.766800:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700987392:12345-0@lo:38:kworker.0 Request processed in 48us (291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397601.766806:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1787397601.766829:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1787397601.766833:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700987648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397601.766842:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397601.766865:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700987648:12345-0@lo:38:kworker.0 Request processed in 30us (284us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397601.766871:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1787397601.766881:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1787397601.766885:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700988288:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397601.766894:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397601.766914:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700988288:12345-0@lo:38:kworker.0 Request processed in 28us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397601.766920:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1787397601.766941:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700987904 00000100:00100000:3.0:1787397601.766944:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987904 00000100:00100000:3.0:1787397601.766962:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1787397601.766987:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700987904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397601.766997:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397601.767033:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700987904:12345-0@lo:38:kworker.0 Request processed in 64us (415us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397601.767040:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00080000:3.0:1787397601.767067:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397601.767071:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397601.767074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700987392:0@lo:38:kworker.0 00000100:00080000:3.0:1787397601.767083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397601.767085:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397601.767095:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700987648:0@lo:38:kworker.0 00000100:00080000:3.0:1787397601.767105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397601.767108:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397601.767112:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700987904:0@lo:38:kworker.0 00000100:00080000:3.0:1787397601.767121:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397601.767124:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397601.767127:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700988288:0@lo:38:kworker.0 00000100:00100000:1.0:1787397601.768090:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700987776 00000100:00100000:1.0:1787397601.768211:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1787397601.768221:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397601.768298:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700987776:12345-0@lo:400:kworker.0 Request processed in 79us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397601.768305:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1787397601.768628:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700987776:0@lo:400:kworker.0 00000100:00080000:0.0:1787397601.776575:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397602.085062:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397603.109396:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397603.300715:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787397603.300737:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700988416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397603.300814:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397603.300854:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700988544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397603.300896:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397603.300996:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988416 00000100:00100000:1.0:1787397603.301005:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988416 00000100:00100000:2.0:1787397603.301031:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988544 00000100:00100000:2.0:1787397603.301038:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988544 00000100:00100000:2.0:1787397603.301082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1787397603.301092:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700988544:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787397603.301109:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397603.301116:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787397603.301121:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397603.301166:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700988544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397603.301173:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1787397603.301190:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1787397603.301194:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700988544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397603.301195:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700988416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397603.301212:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397603.301252:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700988416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397603.301257:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1787397603.301319:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700988416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397603.595963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397603.596061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:3.0:1787397603.596104:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681161600 offset 0 length 224: 4 00000100:00100000:3.0:1787397603.596125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397603.596161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397603.596222:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681162112 00000100:00100000:3.0:1787397603.596235:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681162112 00000100:00100000:3.0:1787397603.596321:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161984 00000100:00100000:3.0:1787397603.596325:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161984 00000100:00100000:3.0:1787397603.596353:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2487 00000100:00100000:3.0:1787397603.596367:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681162112:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397603.596481:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681162112:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397603.596490:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2487 00000100:00100000:3.0:1787397603.596511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2488 00000100:00100000:3.0:1787397603.596571:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681161984:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397603.596601:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681161984:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397603.596608:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2488 00000100:00100000:1.0:1787397603.596715:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161856 00000100:00100000:1.0:1787397603.596733:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161856 00000100:00100000:1.0:1787397603.596829:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681161728 00000100:00100000:1.0:1787397603.596834:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681161728 00000100:00100000:2.0:1787397603.597036:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1218 00000100:00100000:2.0:1787397603.597051:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681161856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397603.597103:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681161856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 57us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397603.597110:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1218 00000100:00080000:0.0:1787397603.597242:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397603.597250:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397603.597252:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397603.597287:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1237 00000100:00100000:1.0:1787397603.597316:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681161728:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397603.597353:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397603.597427:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681161728:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 112us (1265us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397603.597436:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1237 00010000:00010000:1.0:1787397604.132826:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397605.158443:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397606.190778:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397606.885857:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397606.885864:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397606.885879:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397606.885887:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1787397606.885893:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397606.885900:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397606.885923:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8187a3800 x1874218700988800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397606.885958:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397606.885962:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397606.885964:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397606.885968:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1787397606.885970:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397606.885974:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397606.885984:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8187a3b80 x1874218700989056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397606.886001:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397606.886005:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397606.886007:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397606.886011:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1787397606.886026:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397606.886031:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397606.886044:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8187a1880 x1874218700989312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397606.886066:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397606.886069:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397606.886070:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397606.886074:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3481 00000100:00080000:3.0:1787397606.886077:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787397606.886080:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397606.886090:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8187a0700 x1874218700989696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397606.886150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700988672:0@lo:400:kworker.0 00000400:00000100:3.0:1787397606.886208:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700988672 offset 0 length 224: 4 00000100:00100000:3.0:1787397606.886250:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700989568:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886312:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397606.886318:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700989440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886367:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700988800:0@lo:38:kworker.0 00000100:00100000:3.0:1787397606.886396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886413:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700989056:0@lo:38:kworker.0 00000100:00100000:3.0:1787397606.886434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700989312:0@lo:38:kworker.0 00000100:00100000:3.0:1787397606.886483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886502:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700989696:0@lo:38:kworker.0 00000100:00100000:3.0:1787397606.886546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886577:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700988928:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886616:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886637:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397606.886642:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700989184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397606.886699:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989568 00000100:00100000:3.0:1787397606.886706:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989568 00000100:00100000:3.0:1787397606.886759:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989440 00000100:00100000:3.0:1787397606.886763:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989440 00000100:00100000:3.0:1787397606.886785:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:3.0:1787397606.886795:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700989568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886846:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700989568:12345-0@lo:400:kworker.0 Request processed in 53us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397606.886853:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:3.0:1787397606.886885:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:3.0:1787397606.886892:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700989440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.886923:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700989440:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397606.886929:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:3.0:1787397606.886952:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988800 00000100:00100000:3.0:1787397606.886955:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988800 00000100:00100000:3.0:1787397606.886977:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989056 00000100:00100000:3.0:1787397606.886980:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989056 00000100:00100000:3.0:1787397606.886987:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989696 00000100:00100000:3.0:1787397606.886996:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989696 00000100:00100000:3.0:1787397606.887008:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700988928 00000100:00100000:3.0:1787397606.887010:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700988928 00000100:00100000:3.0:1787397606.887027:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989184 00000100:00100000:3.0:1787397606.887030:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989184 00000100:00100000:3.0:1787397606.887045:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1787397606.887051:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.887087:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700988928:12345-0@lo:400:kworker.0 Request processed in 36us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397606.887094:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1787397606.887109:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1787397606.887113:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700989184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.887139:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700989184:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397606.887144:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1787397606.887154:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1787397606.887158:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700988800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397606.887179:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397606.887213:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700988800:12345-0@lo:38:kworker.0 Request processed in 54us (818us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397606.887220:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1787397606.887231:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1787397606.887234:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700989056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397606.887244:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397606.887267:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700989056:12345-0@lo:38:kworker.0 Request processed in 30us (832us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397606.887282:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1787397606.887296:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1787397606.887300:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700989696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397606.887310:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397606.887335:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218700989696:12345-0@lo:38:kworker.0 Request processed in 33us (811us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397606.887340:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1787397606.887364:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989312 00000100:00100000:3.0:1787397606.887367:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989312 00000100:00100000:3.0:1787397606.887387:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1787397606.887391:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700989312:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397606.887400:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397606.887428:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700989312:12345-0@lo:38:kworker.0 Request processed in 36us (945us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397606.887435:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00080000:3.0:1787397606.887456:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397606.887460:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397606.887462:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397606.887501:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700989184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.887512:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700988928:0@lo:400:kworker.0 00000100:00080000:3.0:1787397606.887574:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397606.887579:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397606.887582:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700988800:0@lo:38:kworker.0 00000100:00080000:3.0:1787397606.887591:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397606.887600:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397606.887603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700989056:0@lo:38:kworker.0 00000100:00080000:3.0:1787397606.887614:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397606.887617:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397606.887620:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700989312:0@lo:38:kworker.0 00000100:00080000:3.0:1787397606.887628:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397606.887632:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397606.887634:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700989696:0@lo:38:kworker.0 00000100:00100000:3.0:1787397606.887663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700989440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397606.887674:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700989568:0@lo:400:kworker.0 00010000:00010000:0.0:1787397607.214425:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397608.229999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397608.421640:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700989824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397608.421732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397608.421775:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397608.421780:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700989952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397608.421801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397608.421864:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989824 00000100:00100000:2.0:1787397608.421871:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989824 00000100:00100000:2.0:1787397608.421924:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700989952 00000100:00100000:2.0:1787397608.421927:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700989952 00000100:00100000:2.0:1787397608.421943:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1787397608.421951:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700989824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397608.421980:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397608.422024:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700989824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397608.422031:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1787397608.422048:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:2.0:1787397608.422054:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700989952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397608.422068:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397608.422092:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700989952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397608.422098:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00080000:2.0:1787397608.422111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397608.422122:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397608.422156:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700989952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397608.422170:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700989824:0@lo:13:osp-pre-1-1.0 00000400:00000100:3.0:1787397608.714260:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681162240 offset 0 length 224: 4 00000100:00100000:3.0:1787397608.714307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397608.714357:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397608.714365:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681162624 00000100:00100000:1.0:1787397608.714376:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681162624 00000100:00100000:3.0:1787397608.714402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397608.714434:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681162496 00000100:00100000:3.0:1787397608.714438:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681162496 00000100:00100000:1.0:1787397608.714443:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681162752 00000100:00100000:1.0:1787397608.714448:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681162752 00000100:00100000:1.0:1787397608.714483:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2491 00000100:00100000:1.0:1787397608.714497:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681162624:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397608.714592:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1221 00000100:00100000:3.0:1787397608.714604:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681162496:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397608.714614:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681162624:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397608.714622:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2491 00000100:00100000:3.0:1787397608.714645:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681162496:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397608.714652:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1221 00000100:00100000:1.0:1787397608.714687:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2492 00000100:00100000:1.0:1787397608.714701:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681162752:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397608.714731:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681162752:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397608.714737:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2492 00000100:00100000:3.0:1787397608.714746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:1.0:1787397608.714756:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397608.714762:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397608.714764:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397608.715120:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681162368 00000100:00100000:3.0:1787397608.715126:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681162368 00000100:00100000:3.0:1787397608.715213:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1241 00000100:00100000:3.0:1787397608.715221:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681162368:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397608.715243:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397608.715287:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681162368:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 64us (541us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397608.715294:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1241 00010000:00010000:3.0:1787397609.263483:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397609.810657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397609.810715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397609.810748:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163264 00000100:00100000:0.0:1787397609.810753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397609.810760:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163264 00000400:00000100:0.0:1787397609.810780:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681162880 offset 0 length 520: 4 00000100:00100000:0.0:1787397609.810807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397609.810848:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163392 00000100:00100000:3.0:1787397609.810852:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163392 00000100:00100000:3.0:1787397609.810879:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2493 00000100:00100000:3.0:1787397609.810890:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681163264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397609.810985:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681163264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397609.810993:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2493 00000100:00100000:3.0:1787397609.811012:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2494 00000100:00100000:3.0:1787397609.811020:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681163392:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397609.811051:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681163392:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397609.811058:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2494 00000100:00100000:0.0:1787397609.815841:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163136 00000100:00100000:2.0:1787397609.815857:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163008 00000100:00100000:0.0:1787397609.815857:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163136 00000100:00100000:2.0:1787397609.815864:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163008 00000100:00100000:2.0:1787397609.815926:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1222 00000100:00100000:0.0:1787397609.815935:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1242 00000100:00100000:2.0:1787397609.815947:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681163136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397609.815949:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681163008:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397609.816037:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397609.816049:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681163136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 112us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397609.816057:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1222 00000100:00100000:0.0:1787397609.816072:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681163008:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 127us (5262us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397609.816080:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1242 00010000:00010000:1.0:1787397610.280910:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397611.310888:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787397612.005937:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397596/real 1787397596] req@ffff89a70691ea00 x1874218700985856/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397612 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397612.006005:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a70691ea00 x1874218700985856/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397612.006029:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787397612.006034:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787397612.006038:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787397612.006040:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787397612.006044:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a70691ea00 x1874218700985856/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397612 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397612.006055:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83b520700 x1874218700987264/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397612.006069:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a8187a1180 x1874218700988672/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397622 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787397612.006078:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787397612.006082:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787397612.006084:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787397612.006085:0:3649:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:0.0:1787397612.006583:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397612.006589:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787397612.006593:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397612.006600:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3434 00000100:00080000:0.0:1787397612.006612:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397612.006656:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa11500 x1874218700990080/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397612.006690:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397612.006694:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397612.006695:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397612.006699:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3486 00000100:00080000:0.0:1787397612.006703:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397612.006707:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397612.006726:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12a00 x1874218700990208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397612.006752:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397612.006756:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397612.006758:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397612.006761:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3486 00000100:00080000:0.0:1787397612.006764:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397612.006780:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397612.006795:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12300 x1874218700990464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397612.006809:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397612.006813:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397612.006814:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397612.006818:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:0.0:1787397612.006820:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397612.006824:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397612.006837:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa13800 x1874218700990720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397612.006877:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397612.006881:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397612.006883:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397612.006887:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:0.0:1787397612.006889:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397612.006894:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397612.006907:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa13480 x1874218700991104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397612.007170:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700990080:0@lo:250:kworker.0 00000400:00000100:3.0:1787397612.007237:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218700990080 offset 0 length 520: 4 00000100:00100000:3.0:1787397612.007281:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700990208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397612.007346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397612.007629:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990208 00000100:00100000:0.0:1787397612.007641:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990208 00000100:00100000:0.0:1787397612.007695:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1787397612.007705:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700990208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397612.007729:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397612.007793:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700990208:12345-0@lo:38:kworker.0 Request processed in 88us (447us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397612.007801:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1787397612.007894:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700990592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.007930:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397612.007963:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700988672:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.007970:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218700985856:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008001:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397612.008008:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700990336:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397612.008078:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990592 00000100:00100000:1.0:1787397612.008082:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990592 00000100:00100000:1.0:1787397612.008143:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990336 00000100:00100000:1.0:1787397612.008147:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990336 00000100:00100000:1.0:1787397612.008171:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1787397612.008178:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700990592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008232:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218700990592:12345-0@lo:400:kworker.0 Request processed in 54us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397612.008239:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1787397612.008256:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1787397612.008261:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700990336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008284:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218700990336:12345-0@lo:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397612.008290:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:1.0:1787397612.008325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397612.008366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218700990336:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218700990592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700990976:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.008981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397612.009607:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397612.009622:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700990848:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.009659:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397612.009710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700987264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.009743:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990976 00000100:00100000:1.0:1787397612.009751:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990976 00000100:00100000:1.0:1787397612.009819:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990848 00000100:00100000:1.0:1787397612.009822:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990848 00000100:00100000:1.0:1787397612.009847:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1787397612.009873:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700990976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.009925:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700990976:12345-0@lo:400:kworker.0 Request processed in 54us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397612.009933:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1787397612.009952:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1787397612.009959:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.009990:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700990848:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397612.009996:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1787397612.010125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700990464:0@lo:38:kworker.0 00000100:00100000:3.0:1787397612.010170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397612.010191:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700990720:0@lo:38:kworker.0 00000100:00100000:3.0:1787397612.010217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397612.010235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700991104:0@lo:38:kworker.0 00000100:00100000:3.0:1787397612.010258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397612.010699:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397612.010706:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397612.010710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700990208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397612.010741:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990720 00000100:00100000:3.0:1787397612.010745:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990720 00000100:00100000:3.0:1787397612.010785:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1787397612.010791:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700990720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397612.010814:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397612.010858:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700990720:12345-0@lo:38:kworker.0 Request processed in 61us (634us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397612.010865:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00080000:3.0:1787397612.010893:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397612.010897:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397612.010900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700990720:0@lo:38:kworker.0 00000100:00080000:1.0:1787397612.011058:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397612.011063:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397612.011101:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700990848:0@lo:400:kworker.0 00000100:00100000:1.0:1787397612.011115:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700990976:0@lo:400:kworker.0 00000100:00100000:0.0:1787397612.011175:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700990464 00000100:00100000:0.0:1787397612.011179:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700990464 00000100:00100000:0.0:1787397612.011216:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991104 00000100:00100000:0.0:1787397612.011219:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991104 00000100:00100000:0.0:1787397612.011239:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1787397612.011244:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700990464:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397612.011255:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397612.011290:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700990464:12345-0@lo:38:kworker.0 Request processed in 45us (1120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397612.011322:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1787397612.011335:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1787397612.011340:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700991104:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397612.011350:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397612.011376:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218700991104:12345-0@lo:38:kworker.0 Request processed in 34us (1118us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397612.011394:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00080000:3.0:1787397612.016126:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397612.016147:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397612.016154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700990464:0@lo:38:kworker.0 00000100:00080000:3.0:1787397612.016199:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397612.016204:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397612.016207:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700991104:0@lo:38:kworker.0 00010000:00010000:0.0:1787397612.325217:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397613.357074:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397613.549695:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700991232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397613.549779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397613.550461:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991232 00000100:00100000:2.0:1787397613.550468:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991232 00000100:00100000:2.0:1787397613.550518:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1787397613.550549:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700991232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397613.550577:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397613.550618:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700991232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397613.550625:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1787397613.550731:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700991232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397613.550755:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397613.550761:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700991360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397613.550787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397613.550811:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991360 00000100:00100000:2.0:1787397613.550814:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991360 00000100:00100000:2.0:1787397613.550834:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1787397613.550841:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700991360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397613.550923:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397613.550959:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218700991360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397613.550965:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1787397613.551087:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218700991360:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787397614.374010:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397614.855887:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397614.855934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397614.855963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397614.855993:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163648 00000100:00100000:2.0:1787397614.856004:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163648 00000100:00100000:1.0:1787397614.856048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397614.856060:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163520 00000100:00100000:2.0:1787397614.856063:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163520 00000100:00100000:1.0:1787397614.856077:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1225 00000100:00100000:1.0:1787397614.857433:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681163648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397614.857549:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681163648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1460us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397614.857677:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163904 00000100:00100000:3.0:1787397614.857684:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163904 00000100:00100000:3.0:1787397614.857751:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681163776 00000100:00100000:3.0:1787397614.857754:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681163776 00000100:00100000:3.0:1787397614.857780:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2497 00000100:00100000:3.0:1787397614.857790:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681163904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397614.857822:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681163904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397614.857830:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2497 00000100:00100000:3.0:1787397614.857848:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2498 00000100:00100000:3.0:1787397614.857855:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681163776:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397614.857878:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681163776:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397614.857884:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2498 00000100:00100000:2.0:1787397614.860685:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1246 00000100:00100000:2.0:1787397614.860701:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681163520:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397614.860739:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397614.861006:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681163520:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 306us (4955us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397614.861016:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1246 00000100:00080000:2.0:1787397614.861062:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397614.861067:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397614.861070:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397614.864044:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1225 00010000:00010000:1.0:1787397615.410295:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397616.420670:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787397616.734354:0:90970:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397616.734361:0:90970:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787397616.734363:0:90970:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787397616.734483:0:90970:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a70ad2e800 00000020:01000004:3.0:1787397616.734499:0:90970:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787397616.734770:0:90970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397616.734785:0:90970:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a829b919c0) 00000020:00000080:3.0:1787397616.734804:0:90970:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787397616.913465:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397616.915357:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.939956:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.940517:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.941056:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.941352:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.941658:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.941860:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.942113:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.942421:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.942770:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.943014:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.943846:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.944048:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787397616.946108:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.948170:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.948545:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.948874:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.949217:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.949408:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.949774:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.950075:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.950425:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.950722:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.950958:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.951342:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.951640:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.952020:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.952271:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.952557:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.952941:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.953327:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.953607:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.953904:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.954142:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.954348:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.954559:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.954843:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.955344:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.956332:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.959703:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.961055:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.961400:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.961930:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.962314:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.962588:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787397616.962895:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787397616.964125:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.965238:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.966056:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.966748:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.967000:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787397616.967313:0:90970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787397616.968710:0:90970:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787397616.968946:0:90970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787397616.968969:0:90970:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787397616.968980:0:90970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1904c4 00000020:01000004:3.0:1787397616.968986:0:90970:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787397616.968998:0:90970:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787397616.969003:0:90970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70ad2e800 from MGS 00000020:01000004:3.0:1787397616.969007:0:90970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787397616.969016:0:90970:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a829b94d40) 00000020:00000080:3.0:1787397616.969029:0:90970:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1787397616.969090:0:90970:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad2e800 from MGS, refs=2 00080000:01000000:3.0:1787397616.969095:0:90970:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787397616.969101:0:90970:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1904d2 00010000:00010000:3.0:1787397616.970107:0:90970:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1787397616.985960:0:90970:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787397616.990065:0:90974:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787397616.990493:0:90970:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787397616.990605:0:90970:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787397616.992055:0:90970:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787397616.992567:0:90970:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787397616.992819:0:90970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787397616.992824:0:90970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787397617.000601:0:90970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787397617.000618:0:90970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787397617.001164:0:90970:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787397617.001171:0:90970:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787397617.002073:0:90970:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787397617.002099:0:90970:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1787397617.002100:0:90970:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1787397617.002104:0:90970:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1787397617.002109:0:90970:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 65, was 0): CONNECTING 00000100:00100000:0.0:1787397617.002115:0:90970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:2.0:1787397617.124978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397617.124988:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397617.124991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397617.125013:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397617.125018:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397617.125027:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1787397617.125033:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397617.125042:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397617.125081:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521880 x1874218700991488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397617.125139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397617.125152:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397617.125154:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397617.125157:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1787397617.125159:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397617.125163:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397617.125173:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523480 x1874218700991744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397617.125188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397617.125191:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397617.125193:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397617.125196:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1787397617.125198:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397617.125201:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397617.125211:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522300 x1874218700992000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397617.125242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397617.125251:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397617.125252:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397617.125256:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1787397617.125258:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397617.125262:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397617.125274:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522d80 x1874218700992384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397617.125375:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700991616:0@lo:400:kworker.0 00000100:00100000:0.0:1787397617.125456:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397617.125492:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397617.125497:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700991872:0@lo:400:kworker.0 00000100:00100000:0.0:1787397617.125550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397617.125725:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991616 00000100:00100000:0.0:1787397617.125733:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991616 00000100:00100000:0.0:1787397617.125785:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991872 00000100:00100000:0.0:1787397617.125788:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991872 00000100:00100000:0.0:1787397617.125810:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1787397617.125825:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700991616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397617.125874:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218700991616:12345-0@lo:400:kworker.0 Request processed in 50us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397617.125881:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1787397617.125895:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1787397617.125900:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700991872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397617.125920:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218700991872:12345-0@lo:400:kworker.0 Request processed in 20us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397617.125925:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1787397617.125960:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218700991872:0@lo:400:kworker.0 00000100:00100000:0.0:1787397617.125969:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218700991616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397617.126186:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700992256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397617.126224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397617.126253:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397617.126259:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700992128:0@lo:400:kworker.0 00000100:00100000:1.0:1787397617.126369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397617.126421:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397617.126504:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992256 00000100:00100000:3.0:1787397617.126509:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992256 00000100:00100000:3.0:1787397617.126713:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992128 00000100:00100000:3.0:1787397617.126717:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992128 00000100:00100000:3.0:1787397617.126745:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:3.0:1787397617.126752:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700992256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397617.126797:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700992256:12345-0@lo:400:kworker.0 Request processed in 45us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397617.126803:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:3.0:1787397617.126817:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:3.0:1787397617.126823:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700992128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397617.126849:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700992128:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397617.126855:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:3.0:1787397617.126883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700991488:0@lo:38:kworker.0 00000100:00100000:3.0:1787397617.126913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397617.126932:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700991744:0@lo:38:kworker.0 00000100:00100000:3.0:1787397617.126965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397617.126983:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700992000:0@lo:38:kworker.0 00000100:00100000:3.0:1787397617.127009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397617.127041:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991488 00000100:00100000:3.0:1787397617.127045:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991488 00000100:00100000:3.0:1787397617.127066:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700991744 00000100:00100000:3.0:1787397617.127068:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700991744 00000100:00100000:3.0:1787397617.127082:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:3.0:1787397617.127087:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700991488:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397617.127108:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397617.127141:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700991488:12345-0@lo:38:kworker.0 Request processed in 52us (228us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397617.127147:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:3.0:1787397617.127159:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1787397617.127162:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700991744:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397617.127172:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397617.127194:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700991744:12345-0@lo:38:kworker.0 Request processed in 30us (227us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397617.127200:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1787397617.127218:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992000 00000100:00100000:3.0:1787397617.127222:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992000 00000100:00100000:3.0:1787397617.127240:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1787397617.127244:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700992000:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397617.127253:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397617.127275:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700992000:12345-0@lo:38:kworker.0 Request processed in 30us (265us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787397617.127399:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397617.127403:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397617.127456:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700992128:0@lo:400:kworker.0 00000100:00100000:1.0:1787397617.127468:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700992256:0@lo:400:kworker.0 00000100:00100000:2.0:1787397617.128764:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700992384:0@lo:38:kworker.0 00000100:00100000:2.0:1787397617.128819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397617.128865:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397617.128870:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397617.128873:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700991488:0@lo:38:kworker.0 00000100:00080000:2.0:1787397617.128882:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397617.128884:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397617.128887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700991744:0@lo:38:kworker.0 00000100:00080000:2.0:1787397617.128895:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397617.128898:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397617.128900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700992000:0@lo:38:kworker.0 00000100:00100000:1.0:1787397617.130006:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992384 00000100:00100000:1.0:1787397617.130018:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992384 00000100:00100000:1.0:1787397617.130072:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1787397617.130081:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700992384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397617.130103:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397617.130191:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218700992384:12345-0@lo:38:kworker.0 Request processed in 110us (1371us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397617.130199:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1787397617.130293:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00080000:0.0:1787397617.131587:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397617.131596:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397617.131600:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700992384:0@lo:38:kworker.0 00010000:00010000:0.0:1787397617.448029:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397618.468828:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397618.664841:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700992512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397618.664919:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397618.664968:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397618.664975:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700992640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397618.664996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397618.665078:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992512 00000100:00100000:2.0:1787397618.665087:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992512 00000100:00100000:2.0:1787397618.665145:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992640 00000100:00100000:2.0:1787397618.665148:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992640 00000100:00100000:2.0:1787397618.665163:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1787397618.665171:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700992512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397618.665200:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397618.665282:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700992512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397618.665289:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1787397618.665317:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1787397618.665325:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700992640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397618.665352:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397618.665383:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700992640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397618.665387:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1787397618.665438:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700992640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397618.665452:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700992512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397618.950747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397618.950796:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397618.950826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397618.950875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397618.950916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397618.951085:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164544 00000100:00100000:1.0:1787397618.951095:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164544 00000100:00100000:1.0:1787397618.951165:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164416 00000100:00100000:1.0:1787397618.951175:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164416 00000100:00100000:1.0:1787397618.951203:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2501 00000100:00100000:1.0:1787397618.951213:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681164544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397618.951301:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681164544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397618.951309:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2501 00000100:00100000:1.0:1787397618.951329:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2502 00000100:00100000:1.0:1787397618.951335:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681164416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397618.951361:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681164416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397618.951367:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2502 00000100:00100000:1.0:1787397618.951390:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164032 00000100:00100000:1.0:1787397618.951393:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164032 00000100:00100000:1.0:1787397618.951425:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787397618.951431:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874218681164032:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:1.0:1787397618.951453:0:90975:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 367372d5-1a70-4e8f-8f10-c0f943f3662d@192.168.204.60@tcp t0 exp 0000000000000000 cur 3498 last 0 00000020:00000080:1.0:1787397618.951480:0:90975:0:(genops.c:1406:class_connect()) connect: client 367372d5-1a70-4e8f-8f10-c0f943f3662d, cookie 0x274786fe0d1904d9 00000100:00080000:1.0:1787397618.951668:0:90975:0:(import.c:65:import_set_state_nolock()) ffff89a817ec8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397618.951698:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:2401:x1874218681164032:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 266us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397618.951705:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00080000:0.0:1787397618.952772:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397618.952779:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397618.952825:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164288 00000100:00100000:0.0:1787397618.952833:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164288 00000100:00100000:0.0:1787397618.952893:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164160 00000100:00100000:0.0:1787397618.952897:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164160 00000100:00100000:0.0:1787397618.952919:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1228 00000100:00100000:0.0:1787397618.952929:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681164288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397618.952997:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2405:x1874218681164288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 69us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397618.953005:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1228 00000100:00100000:0.0:1787397618.953022:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1250 00000100:00100000:0.0:1787397618.953026:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681164160:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397618.953044:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397618.953069:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681164160:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 41us (2152us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397618.953076:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1250 00000100:00080000:0.0:1787397618.953093:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397619.492714:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397620.518040:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397620.869677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397620.871010:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164672 00000100:00100000:1.0:1787397620.871026:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164672 00000100:00100000:1.0:1787397620.871689:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787397620.871703:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+5:42362:x1874218681164672:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397620.871736:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397620.871762:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fb9 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.872120:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 6 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.872137:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 6 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.872145:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75600, rc 0) 00000100:00100000:1.0:1787397620.872224:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681164672:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 525us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397620.872232:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787397620.875839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397620.876066:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164800 00000100:00100000:0.0:1787397620.876080:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164800 00000100:00100000:0.0:1787397620.876273:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787397620.876288:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681164800:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397620.876406:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681164800:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 120us (581us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397620.876448:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787397620.891750:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397620.892397:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681164928 00000100:00100000:1.0:1787397620.892412:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681164928 00000100:00100000:1.0:1787397620.892490:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:1.0:1787397620.892513:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+6:42362:x1874218681164928:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397620.892570:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397620.892613:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74a00/0x274786fe0d1904e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fc0 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.892663:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74a00/0x274786fe0d1904e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc0 expref: 7 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.892677:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74a00/0x274786fe0d1904e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc0 expref: 7 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397620.892713:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74a00, rc 0) 00000100:00100000:1.0:1787397620.892809:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681164928:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 308us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397620.892817:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:3.0:1787397620.905037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397620.905710:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165056 00000100:00100000:0.0:1787397620.905726:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165056 00000100:00100000:0.0:1787397620.905818:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:0.0:1787397620.905830:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:42362:x1874218681165056:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787397620.906467:0:90979:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787397620.906636:0:90976:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 112 20000000:01000000:0.0:1787397620.914625:0:90980:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787397620.914638:0:90980:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787397620.914641:0:90980:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787397620.914644:0:90980:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787397620.916930:0:90980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787397620.917409:0:90976:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787397620.917519:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681165056:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 11682us (12487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.917602:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:3.0:1787397620.921740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397620.922261:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165184 00000100:00100000:2.0:1787397620.922276:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165184 00000100:00100000:2.0:1787397620.922354:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787397620.922365:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681165184:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397620.923261:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681165184:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 891us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.923339:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:0.0:1787397620.935612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397620.936100:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165312 00000100:00100000:2.0:1787397620.936114:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165312 00000100:00100000:2.0:1787397620.936217:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787397620.936230:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:42362:x1874218681165312:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397620.936274:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397620.936308:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1904ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fc7 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.936346:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1904ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc7 expref: 9 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.936360:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1904ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc7 expref: 9 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.936370:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00000100:00100000:2.0:1787397620.937461:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165312:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 1224us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.937476:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787397620.944091:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397620.944236:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165440 00000100:00100000:2.0:1787397620.944249:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165440 00000100:00100000:2.0:1787397620.944331:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787397620.944344:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165440:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397620.944629:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165440:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 288us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.944639:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787397620.950828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397620.951567:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165568 00000100:00100000:2.0:1787397620.951584:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165568 00000100:00100000:2.0:1787397620.951697:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787397620.951711:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165568:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397620.951905:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165568:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 198us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.951921:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:1.0:1787397620.959390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397620.960393:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165696 00000100:00100000:2.0:1787397620.960411:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165696 00000100:00100000:2.0:1787397620.960561:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787397620.960575:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681165696:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397620.960610:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397620.960638:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa600/0x274786fe0d1904f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fce expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.960821:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa600/0x274786fe0d1904f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fce expref: 10 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.960836:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa600/0x274786fe0d1904f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fce expref: 10 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397620.960847:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:2.0:1787397620.960932:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681165696:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 361us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397620.960940:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787397620.968177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397620.969599:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165824 00000100:00100000:1.0:1787397620.969619:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165824 00000100:00100000:1.0:1787397620.969720:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787397620.969732:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681165824:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397620.969913:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681165824:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 183us (1749us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397620.969921:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00010000:00010000:3.0:1787397621.543002:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397622.244725:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397612/real 1787397612] req@ffff89a83fa11500 x1874218700990080/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397622.244762:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a83fa11500 x1874218700990080/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397622.244783:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397622.244796:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787397622.244827:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700990080:0@lo:250:kworker.0 10000000:01000000:1.0:1787397622.244983:0:90970:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1787397622.245002:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.245013:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.245019:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787397622.245152:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.245163:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720aa00/0x274786fe0d190095 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19009c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.245182:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.245213:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.245218:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1787397622.245371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397622.245381:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787397622.245385:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397622.245395:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3491 00000100:00080000:2.0:1787397622.245401:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397622.245411:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.245460:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522300 x1874218700992768/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397622.245503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397622.245508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397622.245510:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397622.245514:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1787397622.245517:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397622.245546:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.245579:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523480 x1874218700992896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397622.245617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397622.245621:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397622.245623:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397622.245627:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1787397622.245629:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397622.245633:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.245647:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521f80 x1874218700993152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397622.245663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397622.245666:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397622.245668:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397622.245671:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1787397622.245674:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397622.245678:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.245690:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522680 x1874218700993408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397622.245744:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700993536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397622.245837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.245916:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993536 00000100:00100000:2.0:1787397622.245926:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993536 00000100:00100000:2.0:1787397622.246001:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:2.0:1787397622.246024:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700993536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397622.246084:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218700993536:12345-0@lo:400:kworker.0 Request processed in 72us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.246092:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00080000:2.0:1787397622.246116:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00020000:2.0:1787397622.246135:0:3647:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff89a83b522300 x1874218700992768/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397622.249106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397622.249114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397622.249118:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397622.249126:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3496 00000100:00080000:3.0:1787397622.249131:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397622.249138:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397622.249151:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700993664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397622.249998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397622.250144:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704579500 x1874218700993792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397622.250234:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218700993536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397622.250978:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700993024:0@lo:400:kworker.0 00010000:00010000:1.0:1787397622.251235:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.251259:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d18fffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190002 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.251278:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.251285:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.251291:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.251296:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.251299:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19001e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.251448:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993664 00000100:00100000:0.0:1787397622.251464:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993664 00010000:00010000:1.0:1787397622.251599:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.251605:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 10000000:00010000:1.0:1787397622.251615:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.251625:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700993664:12345-0@lo:400:kworker.0 10000000:01000000:1.0:1787397622.251628:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.251643:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.251649:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54400/0x274786fe0d190041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190048 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.251694:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397622.251746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787397622.253574:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253590:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253600:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253610:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052ee400/0x274786fe0d19004f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253624:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253631:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253635:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253639:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253642:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052eec00/0x274786fe0d19006b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253650:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253656:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253661:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253679:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253683:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a83096aa00/0x274786fe0d190079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190080 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253692:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253699:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253704:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253707:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253710:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1900a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1900aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253726:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253731:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253736:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253739:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253741:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253752:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253758:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253771:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.253775:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253778:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19002c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253789:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253795:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.253799:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397622.253802:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.253806:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052efa00/0x274786fe0d190033 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19003a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.253815:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.253995:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.254000:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397622.254004:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.254009:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7052eea00/0x274786fe0d19005d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.254018:0:90970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.254042:0:90970:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.254048:0:90970:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397622.254051:0:90970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397622.254054:0:90970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a800/0x274786fe0d190087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19008e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397622.257287:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397622.257584:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700993280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397622.257658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397622.257942:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993024 00000100:00100000:3.0:1787397622.257951:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993024 00000100:00100000:3.0:1787397622.258011:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993280 00000100:00100000:3.0:1787397622.258015:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993280 00000100:00100000:0.0:1787397622.258692:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700993664:12345-0@lo:400:kworker.0 Request processed in 7063us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.258726:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1787397622.259678:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1787397622.259697:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700993024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397622.259788:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218700993024:12345-0@lo:400:kworker.0 Request processed in 98us (8041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.259795:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1787397622.259817:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1787397622.259823:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700993280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397622.259851:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218700993280:12345-0@lo:400:kworker.0 Request processed in 29us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.259857:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1787397622.260872:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700993664:0@lo:400:kworker.0 00000100:00080000:0.0:1787397622.260936:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397622.260944:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397622.261139:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218700993280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397622.261155:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218700993024:0@lo:400:kworker.0 00000100:00080000:1.0:1787397622.261744:0:90970:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 66, was 0): CONNECTING 00000100:00080000:1.0:1787397622.261755:0:90970:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1787397622.261782:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397622.261812:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:1.0:1787397622.261884:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397622.261889:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787397622.261892:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397622.261896:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3501 00000100:00080000:1.0:1787397622.261902:0:65702:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397622.261909:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397622.261941:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1aa300 x1874218700993920/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397622.262074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:0:1874218700992768:0@lo:250:kworker.0 00000100:00100000:2.0:1787397622.264210:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700992896:0@lo:38:kworker.0 00000100:00100000:2.0:1787397622.264302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.264336:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700993152:0@lo:38:kworker.0 00000100:00100000:2.0:1787397622.264358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.264476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700993408:0@lo:38:kworker.0 00000100:00100000:2.0:1787397622.264503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.264557:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993408 00000100:00100000:2.0:1787397622.264577:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993408 00000100:00100000:2.0:1787397622.264615:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1787397622.264623:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700993408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397622.264660:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397622.264696:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700993408:12345-0@lo:38:kworker.0 Request processed in 72us (191us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397622.264703:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00080000:2.0:1787397622.264739:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397622.264744:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397622.264748:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218700993408:0@lo:38:kworker.0 00000100:00100000:2.0:1787397622.264771:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700993792:0@lo:38:kworker.0 00000100:00100000:2.0:1787397622.264791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.265271:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700993920:0@lo:250:kworker.0 00000100:00100000:2.0:1787397622.265302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.265322:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993920 00000100:00100000:2.0:1787397622.265325:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993920 00000100:00100000:2.0:1787397622.265345:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397622.265350:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1874218700993920:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1787397622.265367:0:90975:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3501 last 0 00000020:00000080:2.0:1787397622.265397:0:90975:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d1904fc 00000100:00080000:2.0:1787397622.265559:0:90975:0:(import.c:65:import_set_state_nolock()) ffff89a8034da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397622.265605:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218700993920:12345-0@lo:250:kworker.0 Request processed in 253us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.265613:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397622.265653:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 26 00000100:00080000:2.0:1787397622.265660:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1787397622.265668:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787397622.265672:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787397622.265683:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787397622.265685:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787397622.265703:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787397622.265711:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218700993920:0@lo:250:kworker.0 00000100:00080000:2.0:1787397622.265722:0:90970:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1787397622.265732:0:90970:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787397622.265761:0:90970:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787397622.265766:0:90970:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397622.265863:0:90970:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397622.265892:0:90970:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787397622.265896:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397622.265898:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397622.265899:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397622.265901:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397622.265902:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397622.265903:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397622.265904:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397622.265905:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397622.265907:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397622.265909:0:90970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397622.265911:0:90970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787397622.265913:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397622.265914:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397622.265916:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397622.265917:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397622.265918:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397622.265919:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397622.265920:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397622.265921:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397622.265922:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397622.265923:0:90970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397622.265939:0:90970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787397622.265951:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397622.265982:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.266003:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994048 00000100:00100000:2.0:1787397622.266011:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994048 00000100:00100000:2.0:1787397622.266042:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787397622.266049:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+5:90970:x1874218700994048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787397622.266077:0:90976:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787397622.266080:0:90976:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787397622.266082:0:90976:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1787397622.266088:0:90976:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787397622.266772:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.268086:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+5:90970:x1874218700994048:12345-0@lo:253:mount.lustre.0 Request processed in 2031us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.268097:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787397622.268150:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397622.268162:0:90970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787397622.268164:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397622.268166:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397622.268167:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397622.268169:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397622.268170:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397622.268172:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397622.268183:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397622.268185:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397622.268187:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397622.268188:0:90970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397622.268217:0:90970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70ad2e800 from lustre-MDT0000 10000000:01000000:2.0:1787397622.268245:0:90970:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787397622.268247:0:90970:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397622.268256:0:90970:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a70ad2e800 10000000:01000000:2.0:1787397622.268259:0:90970:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787397622.268263:0:90970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a70ad2e800 10000000:01000000:2.0:1787397622.268266:0:90970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787397622.268269:0:90970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a70ad2e800 from 1 10000000:01000000:2.0:1787397622.268272:0:90970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397622.268318:0:90970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268331:0:90970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268340:0:90970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.268357:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397622.268389:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.268414:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994176 00000100:00100000:2.0:1787397622.268430:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994176 00000100:00100000:2.0:1787397622.268462:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787397622.268470:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:90970:x1874218700994176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397622.268481:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397622.268493:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050abe00/0x274786fe0d19050a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190503 expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268513:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050abe00/0x274786fe0d19050a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190503 expref: 6 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268552:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050abe00/0x274786fe0d19050a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190503 expref: 6 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268562:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abe00, rc 0) 00000100:00100000:2.0:1787397622.268594:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+6:90970:x1874218700994176:12345-0@lo:101:mount.lustre.0 Request processed in 125us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.268599:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787397622.268635:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.268646:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397622.268656:0:90970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268665:0:90970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397622.268676:0:90970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787397622.268684:0:90970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268692:0:90970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397622.268699:0:90970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397622.268713:0:90970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787397622.268717:0:90970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a70ad2e800 10000000:01000000:2.0:1787397622.268719:0:90970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787397622.268722:0:90970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787397622.268724:0:90970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787397622.268736:0:90970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268743:0:90970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268751:0:90970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.268773:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397622.268794:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.268810:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994304 00000100:00100000:2.0:1787397622.268813:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994304 00000100:00100000:2.0:1787397622.268832:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787397622.268838:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:90970:x1874218700994304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397622.268845:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397622.268853:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d190518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190511 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268866:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d190518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190511 expref: 7 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268875:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab200/0x274786fe0d190518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190511 expref: 7 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268881:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:2.0:1787397622.268900:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:90970:x1874218700994304:12345-0@lo:101:mount.lustre.0 Request processed in 62us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.268905:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787397622.268926:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.268935:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397622.268943:0:90970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.268952:0:90970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.268997:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397622.269017:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.269032:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994432 00000100:00100000:2.0:1787397622.269035:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994432 00000100:00100000:2.0:1787397622.269052:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397622.269058:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:90970:x1874218700994432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397622.269163:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:90970:x1874218700994432:12345-0@lo:501:mount.lustre.0 Request processed in 105us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.269169:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397622.269189:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.269199:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397622.269221:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397622.269254:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.269269:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994560 00000100:00100000:2.0:1787397622.269273:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994560 00000100:00100000:2.0:1787397622.269289:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787397622.269295:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:90970:x1874218700994560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397622.269410:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.270927:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700992896 00000100:00100000:1.0:1787397622.270940:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700992896 00000100:00100000:1.0:1787397622.270989:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993152 00000100:00100000:1.0:1787397622.270991:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993152 00000100:00100000:1.0:1787397622.271007:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700993792 00000100:00100000:1.0:1787397622.271010:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700993792 00000100:00100000:1.0:1787397622.271030:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1787397622.271037:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700992896:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397622.271061:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397622.271143:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700992896:12345-0@lo:38:kworker.0 Request processed in 105us (6841us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397622.271150:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1787397622.271166:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1787397622.271169:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700993152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397622.271191:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397622.271215:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700993152:12345-0@lo:38:kworker.0 Request processed in 44us (6856us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397622.271222:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1787397622.271233:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1787397622.271237:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700993792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397622.271246:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397622.271265:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700993792:12345-0@lo:38:kworker.0 Request processed in 27us (6473us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397622.271270:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000020:01000000:1.0:1787397622.271313:0:65702:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:1.0:1787397622.271328:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1787397622.271331:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397622.271333:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397622.271335:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.271336:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.271338:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.271339:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.271340:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397622.271342:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.271343:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787397622.271383:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787397622.271389:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1787397622.271391:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397622.271397:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787397622.271398:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.271399:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.271400:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.271402:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.271403:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397622.271404:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.271405:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787397622.271416:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1787397622.271420:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1787397622.271421:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1787397622.271423:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787397622.271424:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.271425:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.271427:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.271428:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.271429:0:65702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397622.271430:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.271431:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1787397622.271447:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1787397622.271467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397622.271481:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700994944:0@lo:253:kworker.0 00000100:00100000:1.0:1787397622.271541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.271592:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994944 00000100:00100000:1.0:1787397622.271596:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994944 00000100:00100000:1.0:1787397622.271621:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787397622.271627:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:3651:x1874218700994944:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787397622.271648:0:90975:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787397622.271661:0:90975:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1787397622.271796:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397622.271801:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397622.271805:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218700993792:0@lo:38:kworker.0 00000100:00080000:1.0:1787397622.271816:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397622.271818:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397622.271827:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218700992896:0@lo:38:kworker.0 00000100:00080000:1.0:1787397622.271838:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397622.271840:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397622.271843:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218700993152:0@lo:38:kworker.0 00000100:00100000:1.0:1787397622.271892:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700994688:0@lo:253:kworker.0 00000100:00100000:1.0:1787397622.271920:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.271933:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397622.271938:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700994816:0@lo:253:kworker.0 00000100:00100000:1.0:1787397622.271959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.271973:0:90977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787397622.271979:0:90977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787397622.272119:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994688 00000100:00100000:1.0:1787397622.272123:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994688 00000100:00100000:1.0:1787397622.272137:0:90977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787397622.272142:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700994816 00000100:00100000:1.0:1787397622.272144:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700994816 00000100:00100000:1.0:1787397622.272208:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787397622.272214:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218700994688:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1787397622.272231:0:90982:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1787397622.273722:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700994560:12345-0@lo:503:mount.lustre.0 Request processed in 4420us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.273735:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787397622.273781:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397622.273790:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:3648:x1874218700994816:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397622.273848:0:90976:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1787397622.274256:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700994560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397622.274892:0:90983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90983:1874218700995072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397622.274970:0:90983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.275005:0:90983:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.275178:0:90977:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1787397622.275188:0:90977:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1787397622.275764:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995072 00000100:00100000:1.0:1787397622.275778:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995072 00000100:00100000:3.0:1787397622.275885:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397622.275894:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:90983:x1874218700995072:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1787397622.276311:0:90982:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787397622.276548:0:90975:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397622.276629:0:90975:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787397622.276710:0:90979:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787397622.276714:0:90979:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787397622.276734:0:90979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.276762:0:90979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 9 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.276770:0:90979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.276801:0:90979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 9 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.276815:0:90979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 9 pid: 90977 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.276833:0:90979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700995200:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397622.276951:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:90983:x1874218700995072:12345-0@lo:502:llog_process_th.0 Request processed in 1055us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.276951:0:90979:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70305ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397622.276963:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787397622.277018:0:90983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90983:1874218700995072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397622.277050:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397622.277060:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.277062:0:90983:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787397622.277067:0:90983:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787397622.277070:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397622.277084:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a703c8b380) 00000020:00000080:0.0:1787397622.277114:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1787397622.277120:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787397622.277200:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787397622.277206:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d19052d 00000020:00000080:0.0:1787397622.277427:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787397622.277431:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397622.277435:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.277436:0:90983:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787397622.277439:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397622.277442:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.277448:0:90983:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787397622.277453:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397622.277468:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a703c8cd40) 00000020:00000080:0.0:1787397622.277480:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1787397622.277484:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787397622.277486:0:90983:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787397622.277489:0:90983:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787397622.277494:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787397622.277576:0:90983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad2e800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787397622.277588:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a703c899c0) 00000020:00000080:0.0:1787397622.277598:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1787397622.277647:0:90983:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787397622.277651:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190542 00000020:00000080:0.0:1787397622.277757:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787397622.277763:0:90983:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787397622.277767:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d190549 00080000:01000000:0.0:1787397622.277771:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787397622.277774:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190550 20000000:01000000:3.0:1787397622.284737:0:90982:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397622.284746:0:90982:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787397622.284954:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:3651:x1874218700994944:12345-0@lo:253:kworker.0 Request processed in 13321us (13427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.284964:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:3648:x1874218700994688:12345-0@lo:253:kworker.0 Request processed in 12746us (13040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.284972:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000004:1.0:1787397622.285048:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397622.285051:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787397622.285052:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.285054:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.285055:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.285056:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.285058:0:3651:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397622.285059:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.285061:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397622.285064:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218700994944:0@lo:253:kworker.0 00000020:01000004:1.0:1787397622.285097:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397622.285098:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397622.285099:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.285101:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.285102:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.285103:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.285104:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397622.285106:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.285107:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397622.285109:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700994688:0@lo:253:kworker.0 20000000:01000000:2.0:1787397622.285205:0:90976:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787397622.287640:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787397622.291834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397622.292722:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681165952 00000100:00100000:3.0:1787397622.292724:0:90979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700995200:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397622.292777:0:90979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397622.295065:0:90976:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397622.295074:0:90976:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787397622.295895:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218700994816:12345-0@lo:253:kworker.0 Request processed in 22099us (23928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.295908:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000020:01000004:0.0:1787397622.295977:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397622.295980:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397622.295982:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397622.295983:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397622.295985:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397622.295986:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397622.295988:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397622.295990:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397622.295992:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397622.295995:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218700994816:0@lo:253:kworker.0 00000100:00100000:1.0:1787397622.301793:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681165952 00010000:00010000:1.0:1787397622.301848:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 10 pid: 90977 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.301897:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2589 00000100:00100000:1.0:1787397622.301907:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681165952:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397622.301921:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397622.301936:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 10 pid: 90977 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.301949:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 10 pid: 90977 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.301967:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75600/0x274786fe0d1904e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fb9 expref: 10 pid: 90977 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.301985:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.301993:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397622.302010:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025296022s 00010000:00010000:1.0:1787397622.302014:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302020:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302027:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302033:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302039:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397622.302043:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302062:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302082:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302094:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397622.302154:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:2405:x1874218681165952:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 248us (10329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.302162:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2589 00010000:00010000:1.0:1787397622.302298:0:90979:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302307:0:90979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.302312:0:90979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab400/0x274786fe0d19051f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.394023:0:90983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1787397622.394190:0:90983:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: e90f04db-6a63-4f01-92c7-7bf813f9f081 idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:3.0:1787397622.394239:0:90983:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:3.0:1787397622.394258:0:90983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:3.0:1787397622.395026:0:90983:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787397622.395106:0:90983:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a83662da80: xid 1874218681153664, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:3.0:1787397622.395119:0:90983:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a828d83480: xid 1874218681153408, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:3.0:1787397622.395754:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a829b90000) 00000020:00000080:3.0:1787397622.395778:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1787397622.395854:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787397622.395862:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d19056c 00000020:00000080:3.0:1787397622.399087:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787397622.416031:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d190573 00000020:00000080:0.0:1787397622.417071:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787397622.417085:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397622.417093:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.417096:0:90983:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787397622.417098:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397622.417101:0:90983:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787397622.417103:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397622.417104:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397622.417106:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397622.417108:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.417110:0:90983:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397622.417112:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397622.417117:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.417118:0:90983:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787397622.417123:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787397622.417175:0:90983:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787397622.417191:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397622.417194:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.417195:0:90983:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787397622.417198:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397622.417201:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397622.417202:0:90983:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787397622.417205:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397622.417211:0:90983:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:0.0:1787397622.417238:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397622.417255:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a703c88000) 00000020:00000080:0.0:1787397622.417275:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1787397622.417280:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397622.417338:0:90983:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787397622.417344:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787397622.417350:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190581 00010000:00080000:0.0:1787397622.417393:0:90983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7037c2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397622.423906:0:90983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1787397622.429925:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397622.429945:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787397622.429997:0:90983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787397622.430368:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190588 00000100:00080000:1.0:1787397622.430382:0:90983:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397622.430388:0:90983:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a7037c2000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397622.430425:0:90983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a9180 x1874218700995328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397622.430458:0:90983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787397622.430659:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397622.430664:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.430666:0:90983:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787397622.430669:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397622.430671:0:90983:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787397622.430673:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397622.430674:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397622.430676:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397622.430694:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.430696:0:90983:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787397622.430699:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787397622.430704:0:90983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787397622.430708:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.430709:0:90983:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787397622.430712:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787397622.430715:0:90983:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787397622.430739:0:90983:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787397622.430742:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397622.430755:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a7033a3380) 00000020:00000080:1.0:1787397622.430772:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1787397622.430777:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787397622.430842:0:90983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787397622.430849:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787397622.430854:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190596 00010000:00080000:1.0:1787397622.430888:0:90983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a705060800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397622.431112:0:90983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1787397622.431916:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397622.431997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.432085:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995328 00000100:00100000:2.0:1787397622.432093:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995328 00000100:00100000:2.0:1787397622.432125:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1787397622.432132:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218700995328:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787397622.432158:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3501 last 0 00000020:00000080:2.0:1787397622.432193:0:8445:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d19059d 00000004:00100000:2.0:1787397622.432205:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397622.432293:0:8445:0:(import.c:65:import_set_state_nolock()) ffff89a8034da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397622.432345:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700995328:12345-0@lo:38:llog_process_th.0 Request processed in 212us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.432363:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:1.0:1787397622.432961:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397622.432971:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1787397622.432979:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787397622.432985:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787397622.432988:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7037c2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787397622.433007:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995328:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1787397622.433234:0:90983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397622.433263:0:90983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787397622.433336:0:90983:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1787397622.433828:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700995456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397622.433884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397622.434199:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995456 00000100:00100000:3.0:1787397622.434206:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995456 00000100:00100000:3.0:1787397622.434252:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1787397622.434262:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700995456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397622.434293:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397622.434339:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218700995456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.434346:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:1.0:1787397622.434419:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218700995456:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787397622.435508:0:90983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397622.440803:0:90983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:1.0:1787397622.441632:0:90983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1787397622.446874:0:90990:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1787397622.446883:0:90990:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1787397622.447259:0:90990:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1787397622.447284:0:90990:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1787397622.447424:0:90990:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1787397622.447454:0:90990:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787397622.453288:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397622.453307:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787397622.453358:0:90983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787397622.453383:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1905a4 00000100:00080000:2.0:1787397622.453393:0:90983:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787397622.453399:0:90983:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a705060800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.453439:0:90983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521f80 x1874218700995584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397622.453469:0:90983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787397622.453579:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995584:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1787397622.454247:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397622.454256:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397622.454258:0:90983:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787397622.454261:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787397622.454264:0:90983:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787397622.454265:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397622.454267:0:90983:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397622.454269:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787397622.454271:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397622.454273:0:90983:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787397622.454275:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787397622.454279:0:90983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787397622.454283:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397622.454284:0:90983:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787397622.454287:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787397622.454292:0:90983:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:2.0:1787397622.454319:0:90983:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787397622.454336:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397622.454349:0:90983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a83b9d0000) 00000020:00000080:2.0:1787397622.454368:0:90983:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787397622.454374:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1787397622.454424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.454506:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995584 00000100:00100000:0.0:1787397622.454515:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995584 00000100:00100000:0.0:1787397622.454605:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:0.0:1787397622.454613:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3647:x1874218700995584:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787397622.454642:0:26157:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3501 last 0 00000020:00000080:0.0:1787397622.454662:0:26157:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1905b2 00002000:00100000:0.0:1787397622.454675:0:26157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a8037d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787397622.454679:0:26157:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787397622.454682:0:26157:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397622.454759:0:26157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787397622.454786:0:26157:0:(import.c:65:import_set_state_nolock()) ffff89a8037da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397622.454875:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700995584:12345-0@lo:8:llog_process_th.0 Request processed in 260us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.454883:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00000004:00080000:2.0:1787397622.456398:0:90983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787397622.456409:0:90983:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787397622.456425:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1905b9 00010000:00080000:2.0:1787397622.456464:0:90983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a837bc4800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00000100:00100000:1.0:1787397622.456880:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397622.456898:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787397622.456910:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787397622.456917:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787397622.456922:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a705060800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787397622.456957:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787397622.456968:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995584:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787397622.457020:0:90990:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787397622.457083:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397622.457099:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700995712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397622.457180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.457250:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995712 00000100:00100000:1.0:1787397622.457259:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995712 00000100:00080000:0.0:1787397622.457338:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397622.457347:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1787397622.457363:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700995712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397622.457402:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397622.457460:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700995712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.457487:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000004:00080000:1.0:1787397622.457611:0:90990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3501748088458ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397622.457621:0:90990:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1787397622.457898:0:90983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1787397622.458085:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700995712:0@lo:13:osp-pre-0-0.0 00000040:01000000:2.0:1787397622.458690:0:90983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397622.458709:0:90983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787397622.459731:0:90983:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1787397622.461913:0:90983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397622.461950:0:90983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:3.0:1787397622.463655:0:90983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:0.0:1787397622.466907:0:90992:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1787397622.466918:0:90992:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787397622.467339:0:90992:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1787397622.467373:0:90992:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1787397622.467518:0:90971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1787397622.467655:0:90992:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1787397622.467661:0:90992:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787397622.476920:0:90983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397622.476944:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787397622.477017:0:90983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787397622.477056:0:90983:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1905c0 00000100:00080000:1.0:1787397622.477072:0:90983:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397622.477081:0:90983:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a837bc4800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397622.477132:0:90983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1ab480 x1874218700995840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397622.477175:0:90983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787397622.477255:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397622.477260:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.477263:0:90983:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787397622.477268:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397622.477275:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.477277:0:90983:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787397622.477281:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787397622.477283:0:90983:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787397622.477285:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397622.477288:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.477289:0:90983:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787397622.477293:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397622.477296:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.477306:0:90983:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787397622.477312:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787397622.477354:0:90983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90983:1874218700995968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397622.477463:0:90983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.477571:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995968 00000100:00100000:0.0:1787397622.477588:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995968 00000100:00100000:0.0:1787397622.477659:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787397622.477670:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:90983:x1874218700995968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397622.477813:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995840:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787397622.478007:0:90983:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.484302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.484887:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700995840 00000100:00100000:1.0:1787397622.484902:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700995840 00000100:00100000:1.0:1787397622.484944:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958 00000100:00100000:1.0:1787397622.484954:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218700995840:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787397622.485002:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3501 last 0 00000020:00000080:1.0:1787397622.485043:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1905c7 00002000:00100000:1.0:1787397622.485062:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a807dfc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787397622.485067:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787397622.485070:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787397622.485186:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787397622.485226:0:8435:0:(import.c:65:import_set_state_nolock()) ffff89a7037c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397622.485311:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218700995840:12345-0@lo:8:llog_process_th.0 Request processed in 358us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.485321:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958 00000100:00100000:2.0:1787397622.486043:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397622.486057:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787397622.486070:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787397622.486077:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787397622.486081:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787397622.486108:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787397622.486116:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218700995840:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787397622.486209:0:90992:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787397622.486247:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:90983:x1874218700995968:12345-0@lo:502:llog_process_th.0 Request processed in 8569us (8774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.486282:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00080000:1.0:1787397622.486293:0:90992:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3501776769696ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397622.486304:0:90992:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787397622.486824:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700996096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397622.486900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.487059:0:90983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90983:1874218700995968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787397622.487114:0:90983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397622.487125:0:90983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397622.487128:0:90983:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787397622.487135:0:90983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787397622.488272:0:90970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787397622.488319:0:90970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787397622.488346:0:90970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.488362:0:90970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397622.488373:0:90970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70ad2e800 from 1 10000000:01000000:3.0:1787397622.488377:0:90970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397622.488441:0:90970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.488450:0:90970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.488474:0:90970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397622.488508:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397622.488890:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397622.488941:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aacc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397622.490004:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996096 00000100:00100000:2.0:1787397622.490017:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996096 00000100:00100000:2.0:1787397622.490126:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1787397622.490137:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700996096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397622.490191:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1787397622.491274:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397622.491432:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996224 00000100:00100000:0.0:1787397622.491450:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996224 00000100:00100000:0.0:1787397622.491510:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787397622.491551:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:90970:x1874218700996224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397622.491578:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397622.491603:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1905ce expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.491631:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1905ce expref: 9 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.491643:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1905ce expref: 9 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.491651:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55200, rc 0) 00000100:00100000:0.0:1787397622.491734:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:90970:x1874218700996224:12345-0@lo:101:mount.lustre.0 Request processed in 214us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.491742:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787397622.491950:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397622.491969:0:90970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.491979:0:90970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.493266:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996352:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787397622.493356:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.493399:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111000 going to sleep for 11 seconds 00000100:00100000:0.0:1787397622.493477:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996352 00000100:00100000:0.0:1787397622.493483:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996352 00000100:00100000:0.0:1787397622.493728:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787397622.493738:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:90970:x1874218700996352:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787397622.493758:0:90976:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787397622.493776:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787397622.493780:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787397622.493783:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787397622.493785:0:90976:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:0.0:1787397622.493882:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:90970:x1874218700996352:12345-0@lo:256:mount.lustre.0 Request processed in 145us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.493889:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787397622.494209:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218700996096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4065us (7300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.494224:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1787397622.496389:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996352:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787397622.497914:0:90970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397622.497950:0:90970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.497966:0:90970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397622.497978:0:90970:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a70ad2e800 from 1 10000000:01000000:2.0:1787397622.497982:0:90970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397622.498044:0:90970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.498053:0:90970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.498065:0:90970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.498097:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996480:0@lo:101:mount.lustre.0 00000004:00080000:0.0:1787397622.500260:0:90971:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787397622.500873:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218700996096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397622.502903:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.503070:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70305ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397622.511669:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996480 00000100:00100000:3.0:1787397622.511692:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996480 00000100:00100000:3.0:1787397622.511875:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397622.511889:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:90970:x1874218700996480:12345-0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397622.512174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787397622.512326:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397622.512357:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31800/0x274786fe0d1905e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1905dc expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.512396:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31800/0x274786fe0d1905e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1905dc expref: 10 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.512411:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31800/0x274786fe0d1905e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1905dc expref: 10 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.512423:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31800, rc 0) 00000100:00100000:3.0:1787397622.512496:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:90970:x1874218700996480:12345-0@lo:101:mount.lustre.0 Request processed in 610us (9604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.512505:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787397622.512813:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397622.512840:0:90970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.512852:0:90970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.512890:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166080 00000100:00100000:0.0:1787397622.512905:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166080 00000100:00100000:0.0:1787397622.512977:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:2.0:1787397622.512984:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397622.512995:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681166080:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397622.513011:0:90984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397622.513032:0:90984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fd5 expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.513049:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397622.513079:0:90984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.513100:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70305ccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787397622.513109:0:90984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.513140:0:90984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54a00, rc 0) 00000100:00100000:0.0:1787397622.513232:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681166080:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 242us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.513240:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:0.0:1787397622.513282:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996608 00000100:00100000:0.0:1787397622.513287:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996608 00000100:00100000:0.0:1787397622.513317:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397622.513325:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700996608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397622.513771:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:90970:x1874218700996608:12345-0@lo:501:mount.lustre.0 Request processed in 446us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.513780:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787397622.514855:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397622.514951:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397622.515035:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397622.515082:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.515137:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996736 00000100:00100000:1.0:1787397622.515165:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996736 00000100:00100000:1.0:1787397622.515358:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397622.515370:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:90970:x1874218700996736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397622.516033:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:90970:x1874218700996736:12345-0@lo:503:mount.lustre.0 Request processed in 664us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.516045:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397622.516134:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700996736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397622.518462:0:90994:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90994:1874218700996864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397622.519018:0:90994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.519061:0:90994:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.519166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397622.519250:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996864 00000100:00100000:0.0:1787397622.519257:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996864 00000100:00100000:0.0:1787397622.519304:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166208 00000100:00100000:0.0:1787397622.519308:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166208 00000100:00100000:0.0:1787397622.519338:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787397622.519346:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:90994:x1874218700996864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397622.519403:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:2.0:1787397622.519578:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681166208:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397622.519608:0:90976:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787397622.519756:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397622.519762:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1787397622.519765:0:90976:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1787397622.519768:0:90976:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:0.0:1787397622.521037:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+10:90994:x1874218700996864:12345-0@lo:502:llog_process_th.0 Request processed in 1686us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.521052:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397622.521247:0:90994:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90994:1874218700996864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397622.521282:0:90994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397622.521292:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.521294:0:90994:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787397622.521302:0:90994:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70ad2e800 00000020:00000080:1.0:1787397622.521304:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787397622.521314:0:90994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397622.521316:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.521317:0:90994:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787397622.521319:0:90994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397622.521321:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397622.521323:0:90994:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787397622.521325:0:90994:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70ad2e800 00000020:00000080:1.0:1787397622.521327:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787397622.521430:0:90994:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90994:1874218700996992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397622.521490:0:90994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.521575:0:90994:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787397622.522062:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700996992 00000100:00100000:0.0:1787397622.522068:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700996992 00000100:00100000:0.0:1787397622.522122:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787397622.522131:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:90994:x1874218700996992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397622.522248:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:90994:x1874218700996992:12345-0@lo:502:llog_process_th.0 Request processed in 116us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.522256:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787397622.522345:0:90994:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90994:1874218700996992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397622.522369:0:90994:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397622.522375:0:90994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397622.522376:0:90994:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787397622.522383:0:90994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787397622.522726:0:90970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787397622.522758:0:90970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397622.522779:0:90970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.522790:0:90970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397622.522847:0:90970:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787397622.522850:0:90970:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a70ad2e800 10000000:01000000:0.0:1787397622.522853:0:90970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a70ad2e800 10000000:01000000:0.0:1787397622.522857:0:90970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787397622.522862:0:90970:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70ad2e800 from 1 10000000:01000000:0.0:1787397622.522865:0:90970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397622.522896:0:90970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.522905:0:90970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.522914:0:90970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.522930:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397622.522976:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.523000:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397622.523156:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997120 00000100:00100000:3.0:1787397622.523161:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997120 00000100:00100000:3.0:1787397622.523197:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397622.523205:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:90970:x1874218700997120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397622.523224:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397622.523237:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31400/0x274786fe0d1905f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1905f1 expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.523261:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31400/0x274786fe0d1905f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1905f1 expref: 11 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.523272:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31400/0x274786fe0d1905f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1905f1 expref: 11 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.523281:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31400, rc 0) 00000100:00100000:3.0:1787397622.523315:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700997120:12345-0@lo:101:mount.lustre.0 Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.523322:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397622.523723:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397622.523737:0:90970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397622.523746:0:90970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397622.523797:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397622.523829:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.523859:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.523980:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997248 00000100:00100000:1.0:1787397622.523984:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997248 00000100:00100000:1.0:1787397622.524018:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787397622.524026:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700997248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397622.524175:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700997248:12345-0@lo:501:mount.lustre.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.524183:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397622.524295:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397622.524323:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397622.524362:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397622.524383:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.524750:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997376 00000100:00100000:1.0:1787397622.524755:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997376 00000100:00100000:1.0:1787397622.524825:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787397622.524832:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700997376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397622.524922:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700997376:12345-0@lo:503:mount.lustre.0 Request processed in 89us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.524929:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397622.525055:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700997376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397622.525483:0:90995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397622.525588:0:90995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.525627:0:90995:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397622.525767:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997504 00000100:00100000:0.0:1787397622.525772:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997504 00000100:00100000:0.0:1787397622.525811:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397622.525819:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397622.525926:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997504:12345-0@lo:502:llog_process_th.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.525934:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787397622.526853:0:90995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997504:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787397622.527052:0:90995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787397622.527072:0:90995:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a83b9d4d40) 00000020:00000080:2.0:1787397622.527108:0:90995:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787397622.527331:0:90995:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad2e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787397622.527336:0:90995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad2e800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787397622.527338:0:90995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad2e800 4 00010000:00080000:2.0:1787397622.527373:0:90995:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a703748000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397622.536055:0:90995:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1787397622.536200:0:90995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787397622.536275:0:90995:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787397622.536295:0:90995:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d190606 00000100:00080000:2.0:1787397622.536309:0:90995:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787397622.536318:0:90995:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a703748000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397622.536367:0:90995:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522300 x1874218700997632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397622.536429:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700997632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397622.536575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397622.536874:0:90995:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787397622.538303:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681166208:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 18876us (19127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.538321:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:1.0:1787397622.538365:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997632 00000100:00100000:1.0:1787397622.538381:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997632 00000100:00100000:1.0:1787397622.538506:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1787397622.538514:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700997632:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397622.538755:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218700997632:12345-0@lo:38:llog_process_th.0 Request processed in 240us (2179us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397622.538763:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1787397622.538828:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397622.538838:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397622.538842:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787397622.538846:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218700997632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397622.544420:0:90995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397622.545076:0:90995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.545165:0:90995:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70305ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.545166:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997760 00000100:00100000:1.0:1787397622.545191:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997760 00000100:00100000:1.0:1787397622.545259:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787397622.545269:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397622.545441:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997760:12345-0@lo:502:llog_process_th.0 Request processed in 173us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.545449:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787397622.547232:0:90995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397622.547352:0:90995:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397622.547823:0:90995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.547898:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700997888 00000100:00100000:2.0:1787397622.547910:0:90995:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.547912:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700997888 00000100:00100000:1.0:1787397622.547965:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787397622.547974:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397622.548141:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:90995:x1874218700997888:12345-0@lo:502:llog_process_th.0 Request processed in 167us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.548151:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787397622.548364:0:90995:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:90995:1874218700997888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397622.548398:0:90995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787397622.548808:0:90970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787397622.548840:0:90970:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397622.548863:0:90970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.548875:0:90970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787397622.548927:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787397622.548930:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787397622.548931:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.548933:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.548934:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.548936:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.548937:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397622.548939:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787397622.548941:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.548946:0:90970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787397622.548950:0:90970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787397622.548952:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787397622.548954:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787397622.548955:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.548956:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397622.548957:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.548958:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.548959:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397622.548960:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787397622.548961:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.548962:0:90970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787397622.548985:0:90970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787397622.549001:0:90970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700998016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787397622.549045:0:90970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.549069:0:90970:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.549090:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998016 00000100:00100000:1.0:1787397622.549095:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998016 00000100:00100000:1.0:1787397622.549129:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787397622.549136:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700998016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397622.549157:0:90976:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397622.549171:0:90976:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787397622.554075:0:90976:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397622.554102:0:90976:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787397622.554210:0:90979:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397622.554220:0:90979:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397622.554246:0:90979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554266:0:90979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554277:0:90979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 9 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554285:0:90979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554354:0:90979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 9 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554370:0:90979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 9 pid: 90984 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.554386:0:90979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700998144:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787397622.554819:0:90979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.554829:0:90979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.554839:0:90979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700998272:0@lo:104: 00000100:00100000:1.0:1787397622.554879:0:90979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.554903:0:90979:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397622.554933:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998272 00000100:00100000:1.0:1787397622.554939:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998272 00000100:00100000:1.0:1787397622.554984:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787397622.554991:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:90979:x1874218700998272:12345-0@lo:104: 00010000:00010000:1.0:1787397622.555006:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555079:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397622.555088:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:90979:x1874218700998272:12345-0@lo:104: Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.555104:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:1.0:1787397622.555143:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397622.555149:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555156:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397622.555160:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555168:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397622.555175:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397622.555181:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397622.555210:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555217:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397622.555239:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555246:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee30800/0x274786fe0d1905ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1905d5 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.555271:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397622.555273:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397622.555278:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397622.555294:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700998400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397622.555352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397622.555383:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:90970:x1874218700998016:12345-0@lo:253:mount.lustre.0 Request processed in 6239us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.555416:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787397622.557675:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998400 00000100:00100000:1.0:1787397622.558353:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998400 00010000:00010000:1.0:1787397622.558410:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.558453:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1787397622.558472:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+11:3650:x1874218700998400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397622.558486:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397622.558491:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.558501:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 11 pid: 90975 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397622.558567:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397622.558651:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+11:3650:x1874218700998400:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397622.558659:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00010000:00010000:1.0:1787397622.558726:0:90979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55200/0x274786fe0d1905d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1905ce expref: 10 pid: 90975 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.558738:0:90979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700998272:0@lo:104: 00000100:00100000:1.0:1787397622.558785:0:90970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:90970:1874218700998016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787397622.558803:0:90970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787397622.558806:0:90970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787397622.558808:0:90970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787397622.558810:0:90970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397622.558815:0:90970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:2.0:1787397622.558819:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218700998400:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1787397622.558819:0:90970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397622.558823:0:90970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397622.558838:0:90970:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397622.558839:0:90970:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787397622.558842:0:90970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397622.558843:0:90970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787397622.558865:0:90970:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787397622.570576:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397622.572455:0:90979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90979:1874218700998144:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397622.572505:0:90979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397622.582383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397622.583509:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166336 00000100:00100000:2.0:1787397622.583552:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166336 00010000:00010000:2.0:1787397622.583635:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.583694:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2591 00000100:00100000:2.0:1787397622.583707:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2405:x1874218681166336:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397622.583728:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397622.583737:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583753:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583777:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54a00/0x274786fe0d1905ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fd5 expref: 10 pid: 90984 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583801:0:19662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583811:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397622.583832:0:19662:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.029611976s 00010000:00010000:2.0:1787397622.583837:0:19662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583881:0:19662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583888:0:19662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583895:0:19662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583902:0:19662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397622.583908:0:19662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583917:0:19662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583940:0:19662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397622.583953:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397622.583979:0:90979:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.583999:0:90979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397622.584006:0:90979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74c00/0x274786fe0d19060d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397622.584038:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:2405:x1874218681166336:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 330us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397622.584048:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2591 00000020:00080000:2.0:1787397622.603387:0:90970:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:1.0:1787397622.604198:0:90970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787397622.604317:0:91002:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:0.0:1787397622.604335:0:91002:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:01000000:0.0:1787397622.610928:0:91003:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787397622.611038:0:90970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787397622.611453:0:91003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397622.615302:0:91003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787397622.615474:0:91003:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787397622.615702:0:91004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397622.615811:0:91004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.615871:0:91004:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568600 going to sleep for 11 seconds 00000040:01000000:2.0:1787397622.616067:0:90970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787397622.616111:0:90970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787397622.616573:0:90970:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787397622.616582:0:90970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787397622.616620:0:90970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787397622.619337:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998528 00000100:00100000:3.0:1787397622.619352:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998528 00000100:00100000:3.0:1787397622.619422:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1787397622.619432:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998528:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397622.619593:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 162us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397622.619771:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1787397622.620512:0:91004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998528:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787397622.620608:0:91004:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787397622.620934:0:91004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397622.621017:0:91004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.621058:0:91004:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397622.621817:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998656 00000100:00100000:0.0:1787397622.621828:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998656 00000100:00100000:0.0:1787397622.621881:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1787397622.621890:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998656:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787397622.623369:0:90970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787397622.623939:0:90970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787397622.623978:0:90970:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:0.0:1787397622.624133:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2239us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.624144:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000040:00080000:2.0:1787397622.625076:0:90970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787397622.625939:0:90970:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00000100:00100000:1.0:1787397622.630619:0:91004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397622.630749:0:91004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998784:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397622.630813:0:91004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397622.631179:0:91004:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397622.631293:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998784 00000100:00100000:0.0:1787397622.631302:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998784 00010000:00080000:2.0:1787397622.631880:0:90970:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:2.0:1787397622.632861:0:91005:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91005 00010000:02000000:2.0:1787397622.632881:0:91005:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1787397622.632884:0:91005:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787397622.632888:0:91005:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1787397622.633054:0:90970:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787397622.633073:0:90970:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787397622.633091:0:90970:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787397622.633119:0:90970:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787397622.635792:0:90970:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:0.0:1787397622.637690:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1787397622.637711:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397622.637839:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91004:x1874218700998784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 137us (7025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397622.637848:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000020:00000004:1.0:1787397622.638103:0:90970:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787397622.639145:0:91004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91004:1874218700998784:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787397622.639220:0:91004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397622.649656:0:91004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787397622.649756:0:91004:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787397622.649761:0:91004:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1787397622.652453:0:91005:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1787397623.591032:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397623.781703:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700998912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397623.781780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.781845:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700998912 00000100:00100000:2.0:1787397623.781852:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700998912 00000100:00100000:2.0:1787397623.781898:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1787397623.781906:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700998912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397623.781935:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397623.781980:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218700998912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.781987:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1787397623.782052:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218700998912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397623.782405:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397623.782416:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700999040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397623.782460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.782690:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999040 00000100:00100000:2.0:1787397623.782695:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999040 00000100:00100000:2.0:1787397623.782730:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1787397623.782738:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700999040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397623.782756:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397623.782794:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218700999040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.782815:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1787397623.782848:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218700999040:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1787397623.856557:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787397623.856566:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70ad2e800 from 116 10000000:01000000:1.0:1787397623.856572:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397623.856630:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.856643:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.856653:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.856680:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.856751:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.856797:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568600 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.859985:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999168 00000100:00100000:0.0:1787397623.860002:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999168 00000100:00100000:0.0:1787397623.860097:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787397623.860106:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218700999168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.860124:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397623.860787:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19061b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190614 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.860822:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19061b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190614 expref: 11 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.860834:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19061b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190614 expref: 11 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.860843:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55e00, rc 0) 00000100:00100000:0.0:1787397623.860927:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700999168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 822us (4175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.860934:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787397623.865488:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.865543:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.865558:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.865639:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.865704:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.865743:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.865767:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999296 00000100:00100000:1.0:1787397623.865774:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999296 00000100:00100000:1.0:1787397623.865820:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787397623.865828:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700999296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397623.865850:0:90982:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397623.865865:0:90982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397623.865872:0:90982:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:1.0:1787397623.865952:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700999296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.865961:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787397623.866003:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787397623.866061:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787397623.866068:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866077:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397623.866086:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397623.866088:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:1.0:1787397623.866091:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397623.866114:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866121:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866130:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.866142:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866164:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.866179:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.866191:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999424 00000100:00100000:1.0:1787397623.866194:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999424 00000100:00100000:1.0:1787397623.866242:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787397623.866248:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a837b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218700999424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.866256:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.866269:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75600/0x274786fe0d190629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190622 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866288:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75600/0x274786fe0d190629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190622 expref: 12 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866297:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75600/0x274786fe0d190629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190622 expref: 12 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866306:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75600, rc 0) 00000100:00100000:1.0:1787397623.866332:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a837b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.866339:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787397623.866370:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.866380:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.866388:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.866435:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866458:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.866472:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.866483:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999552 00000100:00100000:1.0:1787397623.866486:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999552 00000100:00100000:1.0:1787397623.866513:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787397623.866519:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866666:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.866674:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787397623.866703:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866725:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866761:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.866772:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.866783:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999680 00000100:00100000:1.0:1787397623.866786:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999680 00000100:00100000:1.0:1787397623.866805:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787397623.866810:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.866877:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.866883:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787397623.866922:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397623.867595:0:91048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1787397623.867647:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1787397623.867661:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397623.867668:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867678:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397623.867698:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787397623.867699:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 113 10000000:01000000:1.0:1787397623.867701:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397623.867721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867727:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867734:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.867748:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.867777:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.867795:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.867810:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999808 00000100:00100000:1.0:1787397623.867813:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999808 00000100:00100000:1.0:1787397623.867836:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397623.867843:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218700999808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.867850:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.867861:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74400/0x274786fe0d190637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190630 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867878:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74400/0x274786fe0d190637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190630 expref: 13 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867887:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74400/0x274786fe0d190637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190630 expref: 13 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867905:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74400, rc 0) 00000100:00100000:1.0:1787397623.867931:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700999808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.867937:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397623.867971:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.867981:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.867989:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.868025:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.868054:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.868067:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.868079:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218700999936 00000100:00100000:1.0:1787397623.868082:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218700999936 00000100:00100000:1.0:1787397623.868103:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397623.868108:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700999936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397623.868119:0:90982:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397623.868132:0:90982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397623.868136:0:90982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787397623.868139:0:90982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787397623.868141:0:90982:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787397623.868143:0:90982:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1787397623.868222:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218700999936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.868238:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787397623.870159:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218700999936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787397623.870269:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397623.870277:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.870287:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.870296:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787397623.870298:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1787397623.870300:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787397623.870329:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.870347:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.870356:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.870373:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.870418:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.870462:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.873697:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000064 00000100:00100000:3.0:1787397623.873710:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000064 00000100:00100000:3.0:1787397623.873791:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397623.873801:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701000064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.873817:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397623.873837:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee30200/0x274786fe0d190645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19063e expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.873866:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee30200/0x274786fe0d190645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19063e expref: 15 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.873878:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee30200/0x274786fe0d190645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19063e expref: 15 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.873889:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30200, rc 0) 00000100:00100000:3.0:1787397623.873965:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701000064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.873973:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787397623.875723:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.875751:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.875764:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.875846:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.875899:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.876705:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000192 00000100:00100000:2.0:1787397623.876714:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000192 00000100:00100000:2.0:1787397623.876755:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787397623.876763:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701000192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.876920:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701000192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.876927:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397623.882662:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.882705:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.882768:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.882846:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.882879:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397623.882931:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000320 00000100:00100000:2.0:1787397623.882939:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000320 00000100:00100000:2.0:1787397623.882994:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787397623.883003:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701000320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.885490:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701000320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2474us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.885510:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397623.885641:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397623.893398:0:91052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1787397623.893788:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1787397623.893819:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787397623.893831:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.893844:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.893855:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1787397623.893868:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:0.0:1787397623.893871:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787397623.893911:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.893920:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.893930:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.893958:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.894020:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.894068:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.894192:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000448 00000100:00100000:3.0:1787397623.894382:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000448 00000100:00100000:3.0:1787397623.894434:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397623.894452:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701000448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.894465:0:90984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397623.894479:0:90984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31600/0x274786fe0d190653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19064c expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.894501:0:90984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31600/0x274786fe0d190653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19064c expref: 15 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.894512:0:90984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31600/0x274786fe0d190653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19064c expref: 15 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.894553:0:90984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31600, rc 0) 00000100:00100000:3.0:1787397623.894594:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701000448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.894600:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787397623.894752:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.894765:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.894774:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.894789:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787397623.894793:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.894800:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.894807:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787397623.894808:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:0.0:1787397623.894818:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787397623.894832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.894839:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.894847:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.894860:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.894886:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.894918:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.895122:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000576 00000100:00100000:3.0:1787397623.895126:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000576 00000100:00100000:3.0:1787397623.895161:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397623.895168:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701000576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.895177:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397623.895185:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee30600/0x274786fe0d190661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19065a expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.895214:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee30600/0x274786fe0d190661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19065a expref: 16 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.895223:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee30600/0x274786fe0d190661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19065a expref: 16 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.895237:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30600, rc 0) 00000100:00100000:3.0:1787397623.895267:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.895274:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397623.900272:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.900299:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.900313:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.900402:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.900480:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.900518:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.900732:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000704 00000100:00100000:3.0:1787397623.900739:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000704 00000100:00100000:3.0:1787397623.900792:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787397623.900801:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.900947:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.900956:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787397623.901236:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.901272:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.901325:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.901357:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.901449:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000832 00000100:00100000:1.0:1787397623.901455:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000832 00000100:00100000:1.0:1787397623.901493:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787397623.901500:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.901626:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.901633:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787397623.901998:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397623.907111:0:91053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787397623.907463:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787397623.907489:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787397623.907500:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.907512:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397623.907553:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397623.907556:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:1.0:1787397623.907559:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397623.907598:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.907614:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.907625:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.907649:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.907717:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.907752:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.907876:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701000960 00000100:00100000:0.0:1787397623.907884:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701000960 00000100:00100000:0.0:1787397623.907939:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397623.907948:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701000960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.907961:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397623.907974:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55a00/0x274786fe0d19066f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190668 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.907996:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55a00/0x274786fe0d19066f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190668 expref: 17 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.908006:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55a00/0x274786fe0d19066f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190668 expref: 17 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.908014:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55a00, rc 0) 00000100:00100000:0.0:1787397623.908058:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701000960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.908065:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397623.908183:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701000960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.908355:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.908367:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397623.908425:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.908464:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.908492:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.908625:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001088 00000100:00100000:0.0:1787397623.908630:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001088 00000100:00100000:0.0:1787397623.908654:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787397623.908660:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701001088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.908772:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701001088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.908779:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397623.908866:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.908895:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.908939:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.908967:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.909005:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001216 00000100:00100000:0.0:1787397623.909009:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001216 00000100:00100000:0.0:1787397623.909052:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787397623.909058:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701001216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.909126:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701001216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.909132:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397623.910161:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397623.911896:0:91055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1787397623.913516:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1787397623.913574:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397623.913588:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.913602:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.913612:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787397623.913615:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1787397623.913617:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787397623.913656:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.913664:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.913674:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.913698:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.913769:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.913811:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.915350:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001344 00000100:00100000:1.0:1787397623.915369:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001344 00000100:00100000:1.0:1787397623.915469:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397623.915479:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701001344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.915496:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.915514:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75e00/0x274786fe0d19067d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190676 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.915677:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75e00/0x274786fe0d19067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190676 expref: 18 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.915688:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75e00/0x274786fe0d19067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190676 expref: 18 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.915697:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:1.0:1787397623.915767:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.915775:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787397623.915867:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397623.915887:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.915897:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.915972:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.916006:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.916692:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.916741:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001472 00000100:00100000:0.0:1787397623.916747:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001472 00000100:00100000:0.0:1787397623.916820:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787397623.916830:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.916986:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.916994:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397623.917471:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.917510:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.917589:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.917616:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.920625:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001600 00000100:00100000:0.0:1787397623.920639:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001600 00000100:00100000:0.0:1787397623.920709:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787397623.920720:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.923584:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2857us (5985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.923601:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787397623.925186:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397623.929559:0:91057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1787397623.930687:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787397623.930720:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787397623.930732:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.930745:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397623.930755:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397623.930757:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:3.0:1787397623.930761:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397623.930803:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.930824:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.930834:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397623.930860:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.930929:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.930976:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.931116:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001728 00000100:00100000:0.0:1787397623.931124:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001728 00000100:00100000:3.0:1787397623.931664:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397623.931677:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701001728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.931692:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397623.931707:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31200/0x274786fe0d19068b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190684 expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.931734:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31200/0x274786fe0d19068b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190684 expref: 19 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.931746:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31200/0x274786fe0d19068b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190684 expref: 19 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.931756:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31200, rc 0) 00000100:00100000:3.0:1787397623.931807:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701001728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.931814:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397623.931869:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.931884:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.931903:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397623.931966:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.931994:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.932027:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.932269:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001856 00000100:00100000:0.0:1787397623.932274:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001856 00000100:00100000:0.0:1787397623.932303:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397623.932309:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701001856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.932414:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701001856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.932421:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787397623.934420:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.935644:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.935727:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.935773:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.936150:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701001984 00000100:00100000:1.0:1787397623.936158:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701001984 00000100:00100000:1.0:1787397623.936232:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787397623.936242:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701001984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.936365:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701001984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.936373:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787397623.936435:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701001984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397623.939713:0:91059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397623.939986:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397623.940010:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397623.940020:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.940042:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397623.940066:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397623.940068:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:0.0:1787397623.940071:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397623.940113:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.940120:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.940129:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.940155:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.940576:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.940619:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.940761:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002112 00000100:00100000:1.0:1787397623.940768:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002112 00000100:00100000:1.0:1787397623.940819:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787397623.940834:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701002112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.940848:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.940862:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75800/0x274786fe0d190699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190692 expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.940886:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75800/0x274786fe0d190699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190692 expref: 20 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.940896:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75800/0x274786fe0d190699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190692 expref: 20 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.940904:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75800, rc 0) 00000100:00100000:1.0:1787397623.940943:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.940950:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787397623.941644:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397623.941661:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397623.941671:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397623.941740:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.941776:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397623.941811:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.942570:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002240 00000100:00100000:3.0:1787397623.942579:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002240 00000100:00100000:3.0:1787397623.942625:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787397623.942633:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.942779:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.942786:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787397623.947305:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.947368:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.947455:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397623.947495:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.947805:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002368 00000100:00100000:3.0:1787397623.947813:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002368 00000100:00100000:3.0:1787397623.947860:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787397623.947869:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.947997:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.948016:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787397623.948109:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397623.948849:0:91060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787397623.949080:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787397623.949111:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397623.949122:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.949133:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397623.949143:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787397623.949146:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787397623.949149:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397623.949180:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.949189:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.949198:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397623.949219:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.949266:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.949304:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a906300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.951596:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002496 00000100:00100000:1.0:1787397623.951611:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002496 00000100:00100000:1.0:1787397623.951671:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787397623.951681:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701002496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.951697:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.951728:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74000/0x274786fe0d1906a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1906a0 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.951756:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74000/0x274786fe0d1906a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1906a0 expref: 21 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.951766:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74000/0x274786fe0d1906a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1906a0 expref: 21 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.951776:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74000, rc 0) 00000100:00100000:1.0:1787397623.951849:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.951856:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787397623.951973:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.951994:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.952013:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397623.952088:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.952121:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.952148:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a906300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.952194:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002624 00000100:00100000:1.0:1787397623.952198:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002624 00000100:00100000:1.0:1787397623.952227:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787397623.952234:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.952367:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.952373:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787397623.952437:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.952475:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397623.952516:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397623.952564:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a906300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.952683:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002752 00000100:00100000:1.0:1787397623.952688:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002752 00000100:00100000:1.0:1787397623.952723:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787397623.952730:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.960065:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7327us (7539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.960093:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787397623.960214:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397623.961014:0:91061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1787397623.961401:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787397623.961433:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787397623.961455:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.961467:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397623.961476:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787397623.961479:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:2.0:1787397623.961481:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397623.961516:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.961562:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.961571:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.961594:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.961659:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.961697:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.962085:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701002880 00000100:00100000:1.0:1787397623.962093:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701002880 00000100:00100000:1.0:1787397623.962162:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787397623.962172:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701002880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397623.962185:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397623.962210:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75000/0x274786fe0d1906b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1906ae expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.962234:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75000/0x274786fe0d1906b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1906ae expref: 22 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.962245:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75000/0x274786fe0d1906b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1906ae expref: 22 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397623.962254:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75000, rc 0) 00000100:00100000:1.0:1787397623.962293:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701002880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397623.962300:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787397623.962944:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701002880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397623.962960:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.962971:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.963039:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.963074:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.963109:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397623.963125:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003008 00000100:00100000:2.0:1787397623.963130:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003008 00000100:00100000:2.0:1787397623.963177:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787397623.963185:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701003008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.963314:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701003008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.963321:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787397623.963349:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.963373:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.963414:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.963425:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397623.963571:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003136 00000100:00100000:0.0:1787397623.963575:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003136 00000100:00100000:0.0:1787397623.963605:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787397623.963612:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701003136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397623.963687:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701003136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397623.963693:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787397623.965164:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397623.968074:0:91062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787397623.969585:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787397623.969629:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397623.969641:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.969654:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397623.969665:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1787397623.969668:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397623.969670:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787397623.969711:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.969720:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.969731:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.969758:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.969829:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.969873:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397623.971391:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003264 00000100:00100000:3.0:1787397623.971403:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003264 00000100:00100000:3.0:1787397623.971463:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787397623.971472:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701003264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397623.971487:0:90984:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397623.971506:0:90984:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee30800/0x274786fe0d1906c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1906bc expref: -99 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.971558:0:90984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee30800/0x274786fe0d1906c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1906bc expref: 23 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.971569:0:90984:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee30800/0x274786fe0d1906c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1906bc expref: 23 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397623.971579:0:90984:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30800, rc 0) 00000100:00100000:3.0:1787397623.971643:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b987c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701003264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397623.971657:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787397623.975847:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397623.975876:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.975889:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397623.975913:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787397623.975936:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.975943:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397623.975952:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787397623.975955:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397623.975958:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787397623.975987:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.975996:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.976005:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.976024:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.976081:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.976116:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397623.976155:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003392 00000100:00100000:2.0:1787397623.976161:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003392 00000100:00100000:2.0:1787397623.976216:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787397623.976224:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701003392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397623.976237:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397623.976249:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aae00/0x274786fe0d1906d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1906ca expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.976270:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aae00/0x274786fe0d1906d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1906ca expref: 24 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.976286:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aae00/0x274786fe0d1906d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1906ca expref: 24 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.976295:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aae00, rc 0) 00000100:00100000:2.0:1787397623.976332:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701003392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397623.976339:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787397623.976377:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397623.976386:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.976394:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397623.976439:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397623.976459:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397623.976470:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397623.976723:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003520 00000100:00100000:1.0:1787397623.976728:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003520 00000100:00100000:1.0:1787397623.976760:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787397623.976767:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701003520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397623.976840:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701003520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (380us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397623.976847:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787397623.976973:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701003520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787397623.977000:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787397623.977005:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397623.977013:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397624.073977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397624.074027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397624.074065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397624.074110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397624.074156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397624.074192:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166848 00000100:00100000:0.0:1787397624.074209:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166848 00000100:00100000:0.0:1787397624.074263:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166976 00000100:00100000:0.0:1787397624.074267:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166976 00000100:00100000:0.0:1787397624.074294:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2505 00000100:00100000:0.0:1787397624.074305:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681166848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397624.074378:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681166848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397624.074386:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2505 00000100:00100000:0.0:1787397624.074404:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2506 00000100:00100000:0.0:1787397624.074410:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681166976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397624.074437:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681166976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397624.074450:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2506 00000100:00100000:0.0:1787397624.074474:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166592 00000100:00100000:0.0:1787397624.074477:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166592 00000100:00100000:0.0:1787397624.074494:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166720 00000100:00100000:0.0:1787397624.074497:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166720 00000100:00100000:0.0:1787397624.074552:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1231 00000100:00100000:0.0:1787397624.074559:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681166720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397624.074597:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681166720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397624.074603:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1231 00000100:00100000:0.0:1787397624.074615:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1255 00000100:00100000:0.0:1787397624.074619:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681166592:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:0.0:1787397624.074643:0:74374:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e90f04db-6a63-4f01-92c7-7bf813f9f081' at ffff89a83670f000, cookie 0x274786fe0d190557 00010000:00080000:0.0:1787397624.074649:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp recovering/t107374182408 exp ffff89a83670f000 cur 3503 last 1787397622 00010000:02000400:0.0:1787397624.074657:0:74374:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787397624.074662:0:74374:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1787397624.074688:0:74374:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787397624.074814:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a817eff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397624.074840:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681166592:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 219us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397624.074846:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1255 00000100:00080000:3.0:1787397624.075387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397624.075393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397624.075395:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397624.076430:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681166464 00000100:00100000:3.0:1787397624.076441:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681166464 00000100:00100000:3.0:1787397624.076499:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:3.0:1787397624.076507:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:2402:x1874218681166464:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397624.076599:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:2402:x1874218681166464:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397624.076607:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787397624.082878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397624.082953:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681154560 00000100:00100000:3.0:1787397624.082964:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681154560 00000100:00100000:3.0:1787397624.083027:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1256 00000100:00100000:3.0:1787397624.083038:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681154560:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:3.0:1787397624.083059:0:67264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1787397624.083075:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681154560:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 41us (207us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397624.083082:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1256 00010000:00080000:3.0:1787397624.083584:0:91005:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1787397624.263645:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397624.263755:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167104 00000100:00100000:2.0:1787397624.263779:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167104 00000100:00100000:2.0:1787397624.263833:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:2.0:1787397624.263842:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:42362:x1874218681167104:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397624.263860:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397624.263880:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050abc00/0x274786fe0d1906d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fdc expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397624.263916:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050abc00/0x274786fe0d1906d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fdc expref: 10 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397624.263928:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050abc00/0x274786fe0d1906d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fdc expref: 10 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397624.263937:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:2.0:1787397624.263990:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681167104:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397624.263997:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:0.0:1787397624.278907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397624.279006:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167232 00000100:00100000:2.0:1787397624.279016:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167232 00000100:00100000:2.0:1787397624.279083:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787397624.279094:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681167232:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397624.279121:0:90984:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787397624.279140:0:90984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397624.279144:0:90984:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:2.0:1787397624.286336:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:42362:x1874218681167232:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 7234us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397624.286351:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00010000:00010000:1.0:1787397624.617046:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397625.648351:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397626.663206:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397627.684744:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397627.877027:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701003648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397627.877126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397627.877204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397627.877209:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397627.877220:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397627.877225:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3501 00000100:00080000:1.0:1787397627.877229:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397627.877236:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397627.877259:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a9880 x1874218701003776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397627.877294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397627.877297:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397627.877299:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397627.877303:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3501 00000100:00080000:1.0:1787397627.877305:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397627.877309:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397627.877320:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a8000 x1874218701004032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397627.877334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397627.877337:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397627.877338:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397627.877342:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3501 00000100:00080000:1.0:1787397627.877344:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397627.877348:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397627.877390:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc6d80 x1874218701004288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397627.877467:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003648 00000100:00100000:0.0:1787397627.877476:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003648 00000100:00100000:0.0:1787397627.877545:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397627.877565:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701003648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.877912:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701004160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.877950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397627.877981:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397627.877987:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701003904:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878013:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397627.878056:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701004416:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397627.878124:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004160 00000100:00100000:3.0:1787397627.878128:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004160 00000100:00100000:3.0:1787397627.878163:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003904 00000100:00100000:3.0:1787397627.878166:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003904 00000100:00100000:3.0:1787397627.878186:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:3.0:1787397627.878193:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701004160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878232:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701004160:12345-0@lo:400:kworker.0 Request processed in 38us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.878239:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:3.0:1787397627.878258:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1787397627.878265:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701003904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878292:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701003904:12345-0@lo:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.878297:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1787397627.878320:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004416 00000100:00100000:3.0:1787397627.878324:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004416 00000100:00100000:3.0:1787397627.878350:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:3.0:1787397627.878356:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701004416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878391:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701004416:12345-0@lo:400:kworker.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.878397:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00080000:3.0:1787397627.878616:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397627.878621:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397627.878654:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701003904:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878664:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701004160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.878712:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701004416:0@lo:400:kworker.0 00000100:00080000:1.0:1787397627.879862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397627.879868:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397627.879880:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397627.879888:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3501 00000100:00080000:1.0:1787397627.879892:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397627.879898:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397627.879921:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc5880 x1874218701004672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397627.879959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787397627.879962:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397627.879963:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397627.879968:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a703748000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397627.879978:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc5c00 x1874218701005184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397627.880010:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701003776:0@lo:38:kworker.0 00000100:00100000:1.0:1787397627.880064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.880091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701004032:0@lo:38:kworker.0 00000100:00100000:1.0:1787397627.880113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.880134:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701004288:0@lo:38:kworker.0 00000100:00100000:1.0:1787397627.880157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.880174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701004672:0@lo:38:kworker.0 00000100:00100000:1.0:1787397627.880194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.880209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701005184:0@lo:38:kworker.0 00000100:00100000:1.0:1787397627.880227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.880334:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701005056:0@lo:400:kworker.0 00000100:00100000:3.0:1787397627.880515:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701003776 00000100:00100000:3.0:1787397627.880536:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701003776 00000100:00100000:3.0:1787397627.880576:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004032 00000100:00100000:3.0:1787397627.880580:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004032 00000100:00100000:3.0:1787397627.880593:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004672 00000100:00100000:3.0:1787397627.880596:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004672 00000100:00100000:3.0:1787397627.880605:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005184 00000100:00100000:3.0:1787397627.880607:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005184 00000100:00100000:3.0:1787397627.880622:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1787397627.880628:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701003776:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787397627.880658:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1787397627.880704:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d1906df 00000004:00100000:3.0:1787397627.880722:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397627.880862:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a828785800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397627.880921:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701003776:12345-0@lo:38:kworker.0 Request processed in 290us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.880928:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1787397627.880947:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1787397627.880951:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701004032:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787397627.880964:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1787397627.880987:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d1906e6 00000004:00100000:3.0:1787397627.880994:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397627.881014:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a837bc0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397627.881043:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701004032:12345-0@lo:38:kworker.0 Request processed in 90us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.881062:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1787397627.881074:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1787397627.881078:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701004672:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787397627.881090:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1787397627.881113:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d1906ed 00000004:00100000:3.0:1787397627.881119:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397627.881133:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a7090fb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397627.881161:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701004672:12345-0@lo:38:kworker.0 Request processed in 81us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.881166:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1787397627.881180:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1787397627.881185:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701005184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787397627.881198:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1787397627.881217:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d1906f4 00000004:00100000:3.0:1787397627.881223:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397627.881238:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a83ae92800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397627.881266:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701005184:12345-0@lo:38:kworker.0 Request processed in 79us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397627.881272:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1787397627.886312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.886421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397627.886437:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701004544:0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.886514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.886848:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701004800:0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.886885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.886913:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397627.886921:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701004928:0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.886946:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397627.886996:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005056 00000100:00100000:1.0:1787397627.887004:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005056 00000100:00100000:1.0:1787397627.887072:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004544 00000100:00100000:1.0:1787397627.887076:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004544 00000100:00100000:1.0:1787397627.887098:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004928 00000100:00100000:1.0:1787397627.887101:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004928 00000100:00100000:1.0:1787397627.887132:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1787397627.887141:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.887202:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701005056:12345-0@lo:400:kworker.0 Request processed in 61us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397627.887210:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1787397627.887230:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1787397627.887235:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701004544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.887266:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701004544:12345-0@lo:400:kworker.0 Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397627.887271:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1787397627.887282:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:1.0:1787397627.887288:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.887319:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701004928:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397627.887336:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:1.0:1787397627.887489:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004288 00000100:00100000:1.0:1787397627.887494:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004288 00000100:00100000:1.0:1787397627.887518:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701004800 00000100:00100000:1.0:1787397627.887545:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701004800 00000100:00100000:1.0:1787397627.887566:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1787397627.887571:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701004288:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397627.887599:0:8446:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a83670e800, cookie 0x274786fe0d19055e 00010000:00080000:1.0:1787397627.887604:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff89a83670e800 cur 3507 last 1787397622 00000004:00100000:1.0:1787397627.887623:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397627.887660:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a836715000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397627.887709:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701004288:12345-0@lo:38:kworker.0 Request processed in 136us (7550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397627.887717:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1787397627.887730:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1787397627.887736:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701004800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.887769:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701004800:12345-0@lo:400:kworker.0 Request processed in 33us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397627.887776:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00080000:1.0:1787397627.887797:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397627.887801:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397627.887837:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701004928:0@lo:400:kworker.0 00000100:00100000:1.0:1787397627.887848:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701004800:0@lo:400:kworker.0 00010000:00080000:1.0:1787397627.887876:0:91005:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787397627.887882:0:91005:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:1.0:1787397627.887896:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397627.887899:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:1.0:1787397627.887904:0:91005:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:1.0:1787397627.887906:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397627.887918:0:91005:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681154560 t107374182408 from 192.168.204.60@tcp req@ffff89a705a25c00 x1874218681154560/t0(107374182408) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:65/0 lens 528/0 e 0 to 0 dl 1787397635 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397627.888008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70a1a9880 x1874218701003776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397627.888021:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:0.0:1787397627.889565:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701003648:12345-0@lo:400:kworker.0 Request processed in 12004us (12430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397627.889579:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397627.891777:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701004544:0@lo:400:kworker.0 00000100:00100000:0.0:1787397627.891809:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701005056:0@lo:400:kworker.0 00000100:00100000:2.0:1787397627.891951:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701003648:0@lo:400:kworker.0 00000100:00100000:2.0:1787397627.892036:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397627.892046:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701005312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397627.892116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397627.892160:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005312 00000100:00100000:2.0:1787397627.892166:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005312 00000100:00100000:2.0:1787397627.892211:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1787397627.892220:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701005312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397627.892257:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397627.892302:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701005312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397627.892309:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1787397627.892342:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701005312:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1787397627.893084:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a70a1a9880 x1874218701003776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397627.893098:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397627.893103:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397627.893108:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397627.893114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701003776:0@lo:38:kworker.0 00010000:00080000:1.0:1787397627.893140:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70a1a8000 x1874218701004032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397627.893154:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:1.0:1787397627.899817:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a70a1a8000 x1874218701004032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397627.899832:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397627.899838:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397627.899842:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397627.899847:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701004032:0@lo:38:kworker.0 00000100:00080000:1.0:1787397627.899912:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1787397627.899926:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787397627.899930:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787397627.899933:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1787397627.899937:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1787397627.899940:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:1.0:1787397627.901792:0:91005:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13817us 00000100:00100000:0.0:1787397627.911179:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701004288:0@lo:38:kworker.0 00010000:00080000:0.0:1787397627.911232:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70adc5880 x1874218701004672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397627.911254:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1787397627.912056:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a70adc5880 x1874218701004672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397652 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397627.912068:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397627.912072:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397627.912076:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397627.912081:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701004672:0@lo:38:kworker.0 00010000:00080000:0.0:1787397627.912114:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70adc5c00 x1874218701005184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397627.912124:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1787397627.912144:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787397627.912148:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397627.912150:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397627.912155:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701005184:0@lo:38:kworker.0 00010000:00080000:2.0:1787397627.912487:0:91215:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1787397627.912492:0:91215:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1787397627.912498:0:91215:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1787397627.912896:0:91215:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787397627.913447:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701005440:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397627.913568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397627.913629:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005440 00000100:00100000:0.0:1787397627.913637:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005440 00000100:00100000:0.0:1787397627.913689:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:0.0:1787397627.913698:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701005440:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787397627.913720:0:23942:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a705a25f80 x1874218701005440/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:68/0 lens 224/0 e 0 to 0 dl 1787397638 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397627.913732:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701005440:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 35us (165us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397627.913739:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00010000:00010000:0.0:1787397627.948045:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948068:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948082:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948095:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948103:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948117:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948600:0:91005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948610:0:91005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948616:0:91005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948621:0:91005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397627.948626:0:91005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948633:0:91005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948645:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5000) 00010000:00010000:0.0:1787397627.948648:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397627.948652:0:91005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948657:0:91005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d1906fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397627.948675:0:91005:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ce69913 reply state 0000000022c42ef2 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948686:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.948699:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a8132c5300) 00010000:00010000:0.0:1787397627.948702:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397627.948705:0:91005:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787397627.948824:0:91005:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787397627.948850:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.948853:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:0.0:1787397627.948857:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.948859:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:0.0:1787397627.952794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397627.952860:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681155072 00000100:00100000:0.0:1787397627.952869:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681155072 00000100:00100000:0.0:1787397627.952949:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1261 00000100:00100000:0.0:1787397627.952963:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681155072:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:0.0:1787397627.952984:0:77740:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:0.0:1787397627.952997:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681155072:12345-192.168.204.60@tcp:36:rm.0 Request processed in 40us (214us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397627.953004:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1261 00000020:00080000:0.0:1787397627.953024:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.953028:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:0.0:1787397627.953032:0:91005:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:0.0:1787397627.953035:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.953043:0:91005:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681155072 t107374182409 from 192.168.204.60@tcp req@ffff89a705a24000 x1874218681155072/t0(107374182409) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:68/0 lens 512/0 e 0 to 0 dl 1787397638 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397627.953134:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953165:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953177:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953190:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953196:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953202:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953295:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953302:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953309:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953593:0:91005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953601:0:91005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953608:0:91005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953625:0:91005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397627.953631:0:91005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953638:0:91005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953651:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:0.0:1787397627.953654:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397627.953658:0:91005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953664:0:91005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d190717 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953684:0:91005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953690:0:91005:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953695:0:91005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953701:0:91005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397627.953704:0:91005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953710:0:91005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953730:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82ebb1800) 00010000:00010000:0.0:1787397627.953733:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397627.953736:0:91005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953742:0:91005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d190709 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397627.953756:0:91005:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2445cdf reply state 00000000f26e62da transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953767:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.953773:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a8132c5300) 00010000:00010000:0.0:1787397627.953776:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397627.953778:0:91005:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787397627.953855:0:91005:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787397627.953872:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.953874:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:0.0:1787397627.953878:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.953880:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:0.0:1787397627.962353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397627.962428:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157120 00000100:00100000:3.0:1787397627.962438:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157120 00000100:00100000:3.0:1787397627.962808:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1262 00000100:00100000:3.0:1787397627.962820:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681157120:12345-192.168.204.60@tcp:36:dd.0 00010000:00080000:3.0:1787397627.962839:0:66178:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:3.0:1787397627.962861:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681157120:12345-192.168.204.60@tcp:36:dd.0 Request processed in 44us (520us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397627.962869:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1262 00000001:00080000:2.0:1787397627.964312:0:90971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:2.0:1787397627.964348:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964370:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964379:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964400:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397627.964405:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964413:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964434:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a8132c5300) 00010000:00010000:2.0:1787397627.964438:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397627.964442:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.964450:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d190702 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787397627.967306:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.967315:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:0.0:1787397627.967322:0:91005:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:0.0:1787397627.967327:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.967342:0:91005:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681157120 t107374182412 from 192.168.204.60@tcp req@ffff89a705a27100 x1874218681157120/t0(107374182412) o36->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:68/0 lens 488/0 e 0 to 0 dl 1787397638 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397627.967812:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.967828:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.967840:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397627.967887:0:91005:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:0.0:1787397627.975303:0:91005:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025896c69 reply state 00000000e425a34f transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.975330:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397627.975340:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397627.975342:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397627.975346:0:91005:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787397627.975619:0:91005:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787397627.975631:0:91005:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:0.0:1787397627.975647:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.975650:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:0.0:1787397627.975654:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397627.975657:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:0.0:1787397627.988376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397627.991662:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681157504 00000100:00100000:2.0:1787397627.991680:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681157504 00000100:00100000:2.0:1787397627.991768:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1263 00000100:00100000:2.0:1787397627.991779:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681157504:12345-192.168.204.60@tcp:101:dd.0 00010000:00080000:2.0:1787397627.991804:0:74374:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:2.0:1787397627.991823:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681157504:12345-192.168.204.60@tcp:101:dd.0 Request processed in 47us (3470us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397627.991830:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1263 00000020:00080000:2.0:1787397627.991850:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397627.991854:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:2.0:1787397627.991858:0:91005:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:2.0:1787397627.991861:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397627.991885:0:91005:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681157504 t107374182413 from 192.168.204.60@tcp req@ffff89a705a24380 x1874218681157504/t0(107374182413) o101->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:68/0 lens 640/0 e 0 to 0 dl 1787397638 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787397627.991923:0:91005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397627.991946:0:91005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d190725 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7f88 expref: -99 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992002:0:91005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992017:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992028:0:91005:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397627.992172:0:91005:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x45d:0x0], count =677 00000004:00080000:2.0:1787397627.992177:0:91005:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x45d:0x0]+677 in llog 00000004:00080000:2.0:1787397627.992217:0:91005:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00000004:00080000:2.0:1787397627.992224:0:91005:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x703:0x0], index 0: 0 00010000:00010000:2.0:1787397627.992316:0:91005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 14 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992325:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397627.992328:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787397627.992343:0:91005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d190725 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 14 pid: 91005 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992378:0:91005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 13 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397627.992422:0:91005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397627.992425:0:91005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1787397627.992428:0:91005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00010000:00080000:2.0:1787397627.992508:0:91005:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397627.992549:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397627.992552:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:2.0:1787397627.992555:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397627.992557:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:0.0:1787397628.026007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397628.026160:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167360 00000100:00100000:3.0:1787397628.026172:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167360 00000100:00100000:3.0:1787397628.026236:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1234 00000100:00100000:3.0:1787397628.026247:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681167360:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787397628.026273:0:77740:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a705a25500 x1874218681167360/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:69/0 lens 224/0 e 0 to 0 dl 1787397639 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397628.026303:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681167360:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 59us (309us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397628.026311:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1234 00000020:00080000:2.0:1787397628.026404:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397628.026408:0:91005:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:2.0:1787397628.026412:0:91005:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1787397628.026414:0:91005:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397628.026421:0:91005:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787397628.026423:0:91005:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1787397628.026576:0:91005:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:3.0:1787397628.028503:0:90971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:3.0:1787397628.028516:0:90971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1787397628.028560:0:90971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00000001:00080000:2.0:1787397628.028679:0:91005:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1787397628.028738:0:91005:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1787397628.028752:0:91005:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a705a25f80 x1874218701005440/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:68/0 lens 224/0 e 0 to 0 dl 1787397638 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787397628.028876:0:91005:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a705a25500 x1874218681167360/t0(0) o400->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:69/0 lens 224/0 e 0 to 0 dl 1787397639 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1787397628.028961:0:91005:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1787397628.032105:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787397628.032121:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a83b523480 x1874218701005440/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397643 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397628.032132:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a83b523480 x1874218701005440/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397643 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397628.032139:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397628.032169:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397628.032174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701005440:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787397628.036100:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701005568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397628.036197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397628.036412:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005568 00000100:00100000:3.0:1787397628.036420:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005568 00000100:00100000:3.0:1787397628.036491:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1787397628.036500:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701005568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397628.036559:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397628.036622:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701005568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397628.036628:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1787397628.039640:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701005568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397628.049070:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049111:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049119:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049125:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397628.049129:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049137:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049155:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a8132c5300) 00010000:00010000:0.0:1787397628.049157:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397628.049161:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049167:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d190710 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049198:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049204:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049209:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049214:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397628.049225:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049231:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049240:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397628.049242:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397628.049245:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.049251:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19071e lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91005 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1787397628.087684:0:91005:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe47a3fe10 00100000:10000000:2.0:1787397628.087703:0:91005:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1787397628.088788:0:90991:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000100:00100000:0.0:1787397628.088838:0:90991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90991:1874218701005696:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787397628.088921:0:90991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397628.088956:0:90991:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c6c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787397628.089136:0:90993:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:1.0:1787397628.089161:0:90993:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90993:1874218701005824:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397628.089192:0:90993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397628.089212:0:90993:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397628.089230:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005696 00000100:00100000:1.0:1787397628.089237:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005696 00000100:00100000:1.0:1787397628.089287:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005824 00000100:00100000:1.0:1787397628.089290:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005824 00000100:00100000:1.0:1787397628.089316:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959 00000100:00100000:1.0:1787397628.089325:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:90991:x1874218701005696:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787397628.089355:0:26163:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -30 00002000:02000040:1.0:1787397628.089359:0:26163:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1825) 00000100:00100000:2.0:1787397628.091089:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4960 00000100:00100000:2.0:1787397628.091117:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:90993:x1874218701005824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787397628.091147:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -31 00002000:02000040:2.0:1787397628.091151:0:8437:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1825) 00002000:00010000:1.0:1787397628.137172:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397628.137189:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137207:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1787397628.137212:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397628.137219:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137236:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137247:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137255:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137278:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397628.137294:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397628.137300:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137317:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.137322:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137331:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137348:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137357:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d190733 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.137376:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.137378:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.137380:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397628.138352:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397628.138359:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138370:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1787397628.138374:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397628.138379:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138391:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138408:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138416:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138434:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397628.138444:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397628.138459:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138468:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.138472:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138481:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138493:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138720:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d19073a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.138888:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.138897:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.138899:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.141772:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.141787:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.141804:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.141808:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.141815:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.141830:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.141841:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.141849:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.141868:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397628.142258:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1787397628.142259:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.142267:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.142267:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.142277:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1787397628.142277:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:1.0:1787397628.142280:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397628.142284:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.142285:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.142289:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.142294:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.142298:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.142303:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.142306:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.142310:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.142314:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.142324:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787397628.145283:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787397628.145961:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397628.145971:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.145985:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.145992:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146004:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146042:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146050:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d190741 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146132:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397628.146138:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146145:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.146149:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146157:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146168:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146175:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19074f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146191:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.146194:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146207:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.146210:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146217:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146226:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146232:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d61fea7/0x274786fe0d190748 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146245:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.146247:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.146249:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.146698:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.146706:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146718:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.146722:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.146728:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146740:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146757:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146767:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146790:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.146800:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.146805:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146813:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.146816:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146825:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146838:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146845:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d190756 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.146868:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.146871:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.146935:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.146941:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146949:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.146952:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.146956:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146965:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146973:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146981:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.146996:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.147003:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.147008:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147015:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.147018:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147037:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147048:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147054:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19075d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147193:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147196:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147199:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.147246:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.147252:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147260:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.147263:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.147266:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147274:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147281:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147294:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147308:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.147315:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.147318:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147324:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.147327:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147334:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147345:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147351:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d190764 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147378:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147380:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147382:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.147424:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.147434:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147442:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.147445:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.147461:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147470:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147478:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147484:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147495:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.147502:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.147506:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147513:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.147516:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147548:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147567:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147573:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19076b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147586:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147591:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.147635:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.147640:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147648:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.147651:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.147655:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147664:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147671:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147677:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147699:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.147706:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.147709:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147716:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.147719:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147727:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147738:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147745:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d190772 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147756:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147758:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.147760:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.147800:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.147805:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147813:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.147823:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.147828:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147836:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147844:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147851:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147865:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.147872:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.147875:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147881:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.147885:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.147891:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148059:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148088:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d190779 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148101:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148103:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148105:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.148149:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.148155:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148163:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.148165:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.148169:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148178:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148186:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148193:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148206:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.148218:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.148222:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148229:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.148232:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148240:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148250:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148256:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d190780 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148269:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148271:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.148310:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.148314:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148321:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.148323:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.148326:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148344:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148350:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148369:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148381:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.148388:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.148391:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148397:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.148400:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148407:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148417:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148422:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d190787 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148442:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148444:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148445:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.148502:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.148508:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148516:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.148541:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.148545:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148554:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148562:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148569:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148582:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.148588:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.148591:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148609:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.148612:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148619:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148630:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148636:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060580334/0x274786fe0d19078e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148649:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148652:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.148695:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.148701:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148707:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.148710:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.148714:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148722:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148735:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148741:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148753:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.148759:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.148762:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148768:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.148771:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148778:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148787:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148793:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190795 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148812:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.148814:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.148856:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.148860:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148867:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.148870:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.148874:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148882:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148890:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.148897:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149022:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.149030:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.149033:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149040:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.149043:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149061:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149072:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149079:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d19079c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149094:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149096:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149098:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.149139:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.149144:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149151:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.149154:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.149158:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149166:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149174:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149188:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149201:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.149208:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.149214:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.149223:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149230:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149240:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d1907a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149261:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149263:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149265:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.149305:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.149317:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149328:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.149330:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.149334:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149342:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149348:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149367:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149384:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.149390:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.149394:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149400:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.149404:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149410:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149426:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149432:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1907aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149445:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149457:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149460:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.149500:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.149505:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149513:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.149516:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.149541:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149550:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149557:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149565:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149588:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.149595:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.149599:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149605:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.149608:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149616:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149626:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149633:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d1907b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149646:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149648:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.149650:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.149692:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.149697:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149703:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.149713:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.149717:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149726:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149733:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149923:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149939:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.149948:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.149951:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149956:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.149960:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149966:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149976:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.149992:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d1907b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150006:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150010:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.150051:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.150056:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150074:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.150077:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.150082:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150091:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150098:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150105:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150118:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.150133:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.150137:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150144:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.150147:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150154:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150165:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d1907bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150186:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150187:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.150226:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.150230:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150237:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.150239:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.150243:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150264:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150272:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150279:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150291:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.150299:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.150302:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150309:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.150312:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150319:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150329:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150335:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1907c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150617:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150621:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150623:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.150671:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.150676:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150684:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.150687:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.150690:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150699:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150706:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150713:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150727:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.150733:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.150737:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150753:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.150757:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150766:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150777:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150783:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d1907cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150797:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.150800:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.150842:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.150848:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150855:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.150858:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.150861:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150869:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150882:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.150889:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151010:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.151019:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.151023:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151030:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.151033:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151040:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151051:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151118:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1ce42e1/0x274786fe0d1907d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151142:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151144:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.151186:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.151191:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151199:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.151202:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.151206:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151215:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151222:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151228:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151240:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.151246:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.151249:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151256:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.151259:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151275:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151285:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151292:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1907db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.151295:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151304:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151305:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151307:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.151348:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.151353:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151359:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.151363:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.151366:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151375:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151382:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151394:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151405:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.151413:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.151416:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151422:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.151426:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151433:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151445:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151607:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d1907e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151621:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151623:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151625:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.151666:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.151676:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151684:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.151687:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.151691:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151700:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151707:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151714:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151727:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.151734:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.151738:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151745:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.151748:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151756:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151775:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151781:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d1907e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151795:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151797:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.151799:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.151840:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.151845:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151852:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.151855:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.151859:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151868:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151875:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151882:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.151991:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397628.152022:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397628.152028:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397628.152029:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.152034:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.152036:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.152040:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152042:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.152045:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.152049:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.152054:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152057:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.152065:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.152073:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d1907f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.152088:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.152089:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.152091:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152191:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152200:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152215:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.152222:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.152225:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152232:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.152241:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152249:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152259:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152266:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b35500af/0x274786fe0d1907f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152279:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152280:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152282:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.152326:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.152331:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152338:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.152341:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.152345:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152353:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152370:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152378:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152389:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.152396:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.152399:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152406:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.152410:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152418:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152428:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152435:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d1907fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152461:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152467:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.152513:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.152519:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152549:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.152552:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.152556:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152566:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152573:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152580:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152594:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397628.152600:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.152604:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152609:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.152613:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152631:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152640:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152646:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d190805 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152659:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152660:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.152662:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397628.152705:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397628.152709:0:26163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152716:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:0.0:1787397628.152719:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397628.152722:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152730:0:26163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152737:0:26163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152750:0:26163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.152769:0:26163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787397628.152799:0:26163:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00000100:00100000:0.0:1787397628.152891:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:90991:x1874218701005696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 63564us (63966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397628.153032:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959 00000100:00100000:0.0:1787397628.153101:0:90991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90991:1874218701005696:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397628.153116:0:90991:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x703:0x0] 00000100:00100000:0.0:1787397628.153186:0:90991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90991:1874218701006080:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787397628.153225:0:90991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397628.153252:0:90991:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397628.153269:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701005952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397628.153296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397628.153335:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787397628.153335:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006080 00010000:00010000:1.0:1787397628.153340:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397628.153341:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006080 00010000:00010000:1.0:1787397628.153348:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.153351:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.153358:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.153371:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397628.153373:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961 00000100:00100000:0.0:1787397628.153380:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:90991:x1874218701006080:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1787397628.153389:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe8cdfb0/0x274786fe0d19080c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.153402:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.153404:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.153406:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787397628.153415:0:26161:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00010000:00010000:3.0:1787397628.153571:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787397628.157065:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787397628.158874:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:90991:x1874218701006080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5487us (5640us total) trans 4294968729 rc 0/0 00000100:00100000:0.0:1787397628.158888:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961 00002000:00010000:2.0:1787397628.159300:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.159312:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.159327:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.159330:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.159337:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.159350:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397628.159498:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701005952 00000100:00100000:0.0:1787397628.159506:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701005952 00000100:00100000:0.0:1787397628.159608:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1787397628.159617:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701005952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397628.159639:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397628.159683:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701005952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (6386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397628.159689:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1787397628.159743:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701005952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397628.159782:0:90991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90991:1874218701006080:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397628.159795:0:90991:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00010000:00010000:2.0:1787397628.159985:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160001:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160064:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397628.160129:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.160135:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160144:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.160175:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.160180:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160191:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160199:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160207:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787397628.160248:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787397628.160271:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397628.160279:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397628.160290:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160298:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.160303:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160311:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160329:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160335:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d190813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160351:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.160354:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160360:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.160363:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160370:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160389:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160395:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc2f6a2d/0x274786fe0d19081a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.160405:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.160407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.160408:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.160582:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.162051:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.162063:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162076:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.162080:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.162085:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162096:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162104:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162110:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162140:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397628.162223:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.162229:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162236:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.162238:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.162242:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162251:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162259:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162266:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162286:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397628.162296:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397628.162301:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162308:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.162318:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162327:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162341:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162347:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d190821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162365:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.162368:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162374:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.162376:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162382:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162390:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162396:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d190828 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.162415:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.162417:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.162418:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.162542:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.163018:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163025:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163035:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163038:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163042:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163052:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163061:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163068:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163085:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397628.163092:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.163097:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163116:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.163120:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163128:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163139:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163146:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb71bfc/0x274786fe0d19082f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163164:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163166:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163167:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.163219:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163224:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163232:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163235:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163240:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163249:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163262:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163269:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163281:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397628.163288:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.163292:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163299:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.163302:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163309:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163320:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163326:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8c902f/0x274786fe0d190836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163338:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163343:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163345:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.163384:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163389:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163397:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163399:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163402:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163409:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163415:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163421:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163435:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397628.163441:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.163445:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163464:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.163467:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163484:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163493:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163499:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d19083d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163511:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163512:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163514:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.163572:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163577:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163585:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163588:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163592:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163600:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163607:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163618:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163630:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397628.163637:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397628.163640:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163646:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397628.163650:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163657:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163668:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163673:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d190844 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163685:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163686:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.163688:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397628.163728:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163740:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163748:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163751:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163755:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163763:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163771:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163778:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163799:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397628.163840:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397628.163845:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163852:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:2.0:1787397628.163855:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397628.163858:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163866:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163880:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.163887:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.164594:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397628.165493:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397628.165503:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165516:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.165545:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165556:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165571:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165590:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045f05e35/0x274786fe0d19084b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165610:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397628.165613:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165619:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397628.165621:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165629:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165639:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165645:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd933652/0x274786fe0d190852 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397628.165655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.165657:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397628.165658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397628.166695:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.166704:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166723:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.166727:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.166732:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166745:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166755:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166763:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166784:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397628.166824:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.166829:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166837:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.166840:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.166844:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166852:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166870:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166876:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166891:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397628.166944:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.166949:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166956:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.166958:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.166962:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166970:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166977:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.166984:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167007:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397628.167049:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167055:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167063:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167065:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167068:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167077:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167085:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167092:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167115:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787397628.167153:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167157:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167164:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167172:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167177:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167186:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167194:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167202:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167211:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787397628.167252:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167257:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167265:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167267:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167271:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167281:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167289:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167305:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167315:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787397628.167357:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167363:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167371:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167373:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167378:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167387:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167395:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167402:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167410:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787397628.167445:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167462:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167476:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167479:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167483:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167492:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167500:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167508:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167517:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1787397628.167588:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167594:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167601:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167604:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167608:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167616:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167636:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167643:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167653:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1787397628.167692:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167697:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167705:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167709:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167713:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167722:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167729:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167736:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167757:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1787397628.167796:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167801:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167808:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167810:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167815:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167824:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167830:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167836:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167844:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1787397628.167878:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167883:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167890:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167897:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167901:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167910:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167917:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167924:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167932:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1787397628.167969:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.167975:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167983:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.167985:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.167989:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.167998:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168005:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168017:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168025:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1787397628.168063:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168068:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168075:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.168078:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.168081:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168089:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168097:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168104:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168113:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1787397628.168145:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168150:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168163:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.168165:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.168169:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168177:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168184:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168190:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168205:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1787397628.168249:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168254:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168261:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.168263:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.168268:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168276:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168294:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168301:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168309:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1787397628.168350:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168376:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168384:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.168387:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.168390:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168398:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168405:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168411:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168432:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1787397628.168483:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168489:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168496:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.168499:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.168503:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168512:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168551:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168560:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.168568:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1787397628.168602:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397628.168607:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168713:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1787397628.168723:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168742:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.168747:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168756:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168771:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168778:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d190859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168799:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1787397628.168820:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168826:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.168830:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168837:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168847:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168853:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d190860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168868:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1787397628.168872:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168878:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.168881:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168888:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168908:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168915:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d190867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168928:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1787397628.168932:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168938:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.168941:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168949:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168957:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168964:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007136c84/0x274786fe0d19086e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168976:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1787397628.168980:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.168991:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.168995:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169003:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169013:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169020:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a05bc45/0x274786fe0d190875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169032:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1787397628.169035:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169040:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169043:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169049:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169058:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169068:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c66c88e/0x274786fe0d19087c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169082:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1787397628.169085:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169091:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169093:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169100:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169109:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169115:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a38538f5/0x274786fe0d190883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169128:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1787397628.169130:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169150:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169158:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169165:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169175:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169182:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa9f413/0x274786fe0d19088a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169199:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1787397628.169203:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169208:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169211:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169218:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169227:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169234:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ff19b2/0x274786fe0d190891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169251:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1787397628.169255:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169261:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169264:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169272:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169281:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169288:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d9cb438/0x274786fe0d190898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169299:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787397628.169303:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169309:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169311:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169330:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169340:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169346:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3903041/0x274786fe0d19089f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169358:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787397628.169361:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169367:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169369:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169376:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169384:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169391:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7ed2f41/0x274786fe0d1908a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169411:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787397628.169414:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169420:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169423:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169431:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169441:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169461:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f23695d6/0x274786fe0d1908ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169473:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787397628.169476:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169482:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169485:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169499:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169508:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169514:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016fb901d/0x274786fe0d1908b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169545:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787397628.169549:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169567:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169570:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169576:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169584:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169590:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca22e21/0x274786fe0d1908bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169612:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397628.169615:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169621:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169624:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169630:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169638:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169645:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007296609/0x274786fe0d1908c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169653:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397628.169655:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169660:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169662:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169676:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169686:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169692:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045dbc88d/0x274786fe0d1908c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169701:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397628.169704:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169709:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.169711:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169717:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169725:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169730:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceaaa818/0x274786fe0d1908d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.169748:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.169750:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.169752:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.186814:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.186834:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.186839:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397628.186845:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397628.188784:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=3507s v=(0 0) 00010000:00010000:3.0:1787397628.188803:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397628.188812:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.188832:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.188844:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397628.188851:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397628.195619:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397628.195638:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397628.195649:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.195663:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397628.195669:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.195681:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.195701:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397628.195710:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f99557f/0x274786fe0d1908d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787397628.195737:0:8437:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00010000:00010000:1.0:1787397628.195749:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.195752:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397628.195754:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397628.195864:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:90993:x1874218701005824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104748us (106666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397628.195877:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4960 00000100:00100000:2.0:1787397628.195951:0:90993:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90993:1874218701005824:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397628.195965:0:90993:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:2.0:1787397628.196048:0:90993:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90993:1874218701006336:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787397628.196077:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701006208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397628.196123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397628.196269:0:90993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397628.196287:0:90993:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a811014c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397628.196308:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006336 00000100:00100000:2.0:1787397628.196315:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006336 00000100:00100000:1.0:1787397628.196361:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006208 00000100:00100000:1.0:1787397628.196366:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006208 00000100:00100000:2.0:1787397628.196371:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962 00000100:00100000:2.0:1787397628.196384:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:90993:x1874218701006336:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397628.196407:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1787397628.196424:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701006208:12345-0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787397628.196431:0:26159:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00002000:00000024:1.0:1787397628.196438:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 896 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397628.196496:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701006208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397628.196505:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:0.0:1787397628.196552:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701006208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397628.200657:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:90993:x1874218701006336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4260us (4372us total) trans 4294968727 rc 0/0 00000100:00100000:2.0:1787397628.200674:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962 00000100:00100000:3.0:1787397628.200697:0:90993:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90993:1874218701006336:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787397628.200720:0:90993:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00000001:02000400:2.0:1787397628.634414:0:91258:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787397628.709694:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397628.901455:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701006464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397628.901559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397628.901619:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006464 00000100:00100000:2.0:1787397628.901628:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006464 00000100:00100000:2.0:1787397628.901678:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1787397628.901689:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701006464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397628.901714:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397628.901803:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701006464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397628.901811:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1787397628.901877:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701006464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397628.902096:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397628.902108:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701006592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397628.902144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397628.902179:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006592 00000100:00100000:1.0:1787397628.902183:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006592 00000100:00100000:1.0:1787397628.902220:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1787397628.902229:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701006592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397628.902242:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397628.902284:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701006592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397628.902292:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1787397628.902328:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701006592:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1787397628.907676:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787397629.188888:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397629.188926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397629.188952:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397629.188970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397629.189004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397629.189259:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167744 00000100:00100000:3.0:1787397629.189270:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167744 00000100:00100000:3.0:1787397629.189344:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167616 00000100:00100000:3.0:1787397629.189347:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167616 00000100:00100000:3.0:1787397629.189371:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1235 00000100:00100000:3.0:1787397629.189379:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681167744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397629.189483:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681167744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 104us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397629.189490:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1235 00000100:00100000:3.0:1787397629.189509:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1236 00000100:00100000:3.0:1787397629.189553:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681167616:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397629.189579:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681167616:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397629.189585:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1236 00000100:00080000:2.0:1787397629.190230:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397629.190236:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397629.190557:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167488 00000100:00100000:0.0:1787397629.190565:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167488 00000100:00100000:0.0:1787397629.190616:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787397629.190625:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681167488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397629.190664:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a818183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681167488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397629.190671:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:0.0:1787397629.190712:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168000 00000100:00100000:0.0:1787397629.190716:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168000 00000100:00100000:0.0:1787397629.191373:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681167872 00000100:00100000:0.0:1787397629.191379:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681167872 00000100:00100000:2.0:1787397629.200544:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2511 00000100:00100000:2.0:1787397629.200570:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681168000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397629.200666:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681168000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 109us (11712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397629.200674:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2511 00000100:00100000:2.0:1787397629.200703:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2512 00000100:00100000:2.0:1787397629.200710:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681167872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397629.200732:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681167872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (11728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397629.200738:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2512 00000100:00080000:1.0:1787397629.202623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397629.202633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397629.734555:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787397629.984927:0:91311:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397629.985687:0:91311:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397630.756917:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787397631.134101:0:91361:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397631.139387:0:91361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397631.780839:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397632.804841:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397632.997128:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701006848:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701007360:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997304:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701007872:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997378:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787397632.997386:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701006976:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997420:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701007488:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997636:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701008000:0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397632.997691:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007360 00000100:00100000:3.0:1787397632.997698:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007360 00000100:00100000:3.0:1787397632.997736:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007872 00000100:00100000:3.0:1787397632.997738:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007872 00000100:00100000:3.0:1787397632.997753:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:3.0:1787397632.997761:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701007360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397632.997817:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701007360:12345-0@lo:400:kworker.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.997921:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701006720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.997959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.997985:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701007232:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998014:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998049:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701007744:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998088:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701008256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998123:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787397632.998135:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701007104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998174:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701007616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998212:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701008128:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998231:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.998257:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007488 00000100:00100000:1.0:1787397632.998261:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007488 00000100:00100000:1.0:1787397632.998297:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008000 00000100:00100000:1.0:1787397632.998300:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008000 00000100:00100000:3.0:1787397632.998392:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:3.0:1787397632.998411:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:3.0:1787397632.998418:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998555:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007616 00000100:00100000:1.0:1787397632.998558:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007616 00000100:00100000:1.0:1787397632.998574:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008128 00000100:00100000:1.0:1787397632.998576:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008128 00000100:00100000:1.0:1787397632.998592:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:1.0:1787397632.998597:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397632.998709:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006720 00000100:00100000:2.0:1787397632.998714:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006720 00000100:00100000:2.0:1787397632.998746:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787397632.998752:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701006720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998847:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701007488:12345-0@lo:400:kworker.0 Request processed in 248us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.998854:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:1.0:1787397632.998870:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1787397632.998876:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701008000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998904:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701008000:12345-0@lo:400:kworker.0 Request processed in 29us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.998916:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1787397632.998928:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1787397632.998933:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701007616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.998965:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701007616:12345-0@lo:400:kworker.0 Request processed in 31us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.998970:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1787397632.998980:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:1.0:1787397632.998985:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999012:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701008128:12345-0@lo:400:kworker.0 Request processed in 26us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999017:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:1.0:1787397632.999041:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006848 00000100:00100000:1.0:1787397632.999045:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006848 00000100:00100000:1.0:1787397632.999066:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701006976 00000100:00100000:1.0:1787397632.999069:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701006976 00000100:00100000:1.0:1787397632.999080:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007232 00000100:00100000:1.0:1787397632.999083:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007232 00000100:00100000:1.0:1787397632.999094:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007744 00000100:00100000:1.0:1787397632.999097:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007744 00000100:00100000:1.0:1787397632.999106:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008256 00000100:00100000:1.0:1787397632.999109:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008256 00000100:00100000:1.0:1787397632.999120:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701007104 00000100:00100000:1.0:1787397632.999122:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701007104 00000100:00100000:1.0:1787397632.999133:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1787397632.999138:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701006848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999166:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701006848:12345-0@lo:400:kworker.0 Request processed in 28us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999172:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1787397632.999190:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1787397632.999195:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999224:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701006976:12345-0@lo:400:kworker.0 Request processed in 28us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999229:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1787397632.999240:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1787397632.999245:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701007232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999272:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701007232:12345-0@lo:400:kworker.0 Request processed in 26us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999278:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1787397632.999288:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1787397632.999295:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701007744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999339:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701007744:12345-0@lo:400:kworker.0 Request processed in 45us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999345:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1787397632.999368:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1787397632.999374:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701008256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999404:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701008256:12345-0@lo:400:kworker.0 Request processed in 30us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999409:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1787397632.999421:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1787397632.999427:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701007104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999466:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701007104:12345-0@lo:400:kworker.0 Request processed in 40us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999471:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:1.0:1787397632.999509:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397632.999513:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397632.999516:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397632.999517:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397632.999570:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701007104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999581:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701007616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999592:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701008128:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999602:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701007232:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999612:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701007744:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701008256:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701008384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397632.999778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397632.999808:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701006976:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999819:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701007488:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999830:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701008000:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701006848:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999853:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701007360:0@lo:400:kworker.0 00000100:00100000:1.0:1787397632.999883:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008384 00000100:00100000:1.0:1787397632.999887:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008384 00000100:00100000:1.0:1787397632.999907:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1787397632.999914:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701008384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397632.999940:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:1.0:1787397632.999983:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701008384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397632.999989:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1787397633.000019:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701008384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397633.009249:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701006720:12345-0@lo:400:kworker.0 Request processed in 10482us (11274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397633.009269:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787397633.013641:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701006720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397633.017793:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701007872:12345-0@lo:400:kworker.0 Request processed in 19365us (20441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397633.017810:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1787397633.022198:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701007872:0@lo:400:kworker.0 00000100:00100000:3.0:1787397633.458616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397633.459937:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168128 00000100:00100000:0.0:1787397633.459952:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168128 00000100:00100000:0.0:1787397633.460046:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1264 00000100:00080000:1.0:1787397633.460049:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397633.460059:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:69776:x1874218681168128:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397633.460081:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397633.460107:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1908de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fe3 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460178:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460193:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460207:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397633.460287:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397633.460292:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397633.460359:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460387:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1908de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460407:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397633.460416:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397633.460419:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397633.460423:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397633.460498:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:69776:x1874218681168128:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 443us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397633.460505:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1264 00000100:00100000:1.0:1787397633.468791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397633.469198:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168256 00000100:00100000:2.0:1787397633.469210:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168256 00000100:00100000:2.0:1787397633.469283:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1265 00000100:00100000:2.0:1787397633.469293:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:69776:x1874218681168256:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397633.469339:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1787397633.469449:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:69776:x1874218681168256:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 155us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397633.469457:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1265 00000100:00100000:2.0:1787397633.476288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397633.476398:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168384 00000100:00100000:0.0:1787397633.476410:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168384 00000100:00100000:0.0:1787397633.476496:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1266 00000100:00100000:0.0:1787397633.476507:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69776:x1874218681168384:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397633.476571:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397633.476652:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69776:x1874218681168384:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 147us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397633.476660:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1266 00000100:00080000:1.0:1787397633.477510:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397633.479405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397633.479518:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168512 00000100:00100000:2.0:1787397633.479575:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168512 00000100:00100000:2.0:1787397633.479657:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1999 00000100:00100000:2.0:1787397633.479667:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:69776:x1874218681168512:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397633.479702:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397633.479767:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:69776:x1874218681168512:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397633.479775:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1999 00000100:00080000:1.0:1787397633.480211:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397633.491768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397633.492068:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168640 00000100:00100000:1.0:1787397633.492080:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168640 00000100:00100000:1.0:1787397633.492170:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2000 00000100:00100000:1.0:1787397633.492180:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69776:x1874218681168640:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397633.492214:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397633.492292:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:69776:x1874218681168640:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 114us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397633.492300:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2000 00000100:00080000:2.0:1787397633.493780:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397633.510819:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701008512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397633.511048:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701008768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397633.511138:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701008640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397633.516759:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397633.518654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397633.518739:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008512 00000100:00100000:1.0:1787397633.518748:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008512 00000100:00100000:1.0:1787397633.518795:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:1.0:1787397633.518803:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701008512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397633.518830:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397633.518900:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701008512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397633.518907:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:1.0:1787397633.519284:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701008512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397633.519628:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397633.519672:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008640 00000100:00100000:2.0:1787397633.519676:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008640 00000100:00100000:2.0:1787397633.519709:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1787397633.519717:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701008640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397633.519729:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397633.519768:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701008640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397633.519774:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1787397633.519807:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701008640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397633.521918:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008768 00000100:00100000:3.0:1787397633.521932:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008768 00000100:00100000:3.0:1787397633.522176:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1787397633.522187:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701008768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397633.522216:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397633.522311:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701008768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (5559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397633.522319:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:1.0:1787397633.522550:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701008768:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787397633.528416:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968729 is committed 00000001:00080000:1.0:1787397633.529715:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968727 is committed 00010000:00010000:2.0:1787397633.828856:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397634.020897:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701008896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397634.020983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397634.021029:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397634.021036:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701009024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397634.021058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397634.021237:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701008896 00000100:00100000:1.0:1787397634.021248:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701008896 00000100:00100000:1.0:1787397634.021325:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009024 00000100:00100000:1.0:1787397634.021328:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009024 00000100:00100000:1.0:1787397634.021362:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1787397634.021374:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701008896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397634.021410:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397634.021475:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701008896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397634.021483:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1787397634.021504:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1787397634.021509:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701009024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397634.021538:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397634.021566:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701009024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397634.021571:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1787397634.021765:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701009024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397634.021779:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701008896:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397634.021842:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397634.021847:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397634.314126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397634.315802:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168768 00000100:00100000:1.0:1787397634.315818:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168768 00000100:00100000:1.0:1787397634.315893:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:1.0:1787397634.315903:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681168768:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397634.316025:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681168768:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 123us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397634.316034:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397634.325800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397634.326398:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681168896 00000100:00100000:1.0:1787397634.326412:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681168896 00000100:00100000:1.0:1787397634.326730:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1243 00000100:00100000:1.0:1787397634.326746:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681168896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397634.326847:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681168896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 106us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397634.326856:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1243 00000100:00100000:3.0:1787397634.331886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397634.331958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397634.332058:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397634.335280:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169152 00000100:00100000:2.0:1787397634.335298:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169152 00000100:00100000:2.0:1787397634.335388:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169280 00000100:00100000:2.0:1787397634.335392:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169280 00000100:00100000:2.0:1787397634.335433:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2517 00000100:00100000:2.0:1787397634.335460:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681169152:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397634.335582:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681169152:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 124us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397634.335590:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2517 00000100:00100000:2.0:1787397634.335619:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2518 00000100:00100000:2.0:1787397634.335626:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681169280:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397634.335652:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681169280:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (3593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397634.335658:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2518 00000100:00100000:0.0:1787397634.336577:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169024 00000100:00100000:0.0:1787397634.336586:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169024 00000100:00100000:0.0:1787397634.336645:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1244 00000100:00100000:0.0:1787397634.336654:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681169024:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397634.336703:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681169024:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 50us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397634.336710:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1244 00010000:00010000:0.0:1787397634.852793:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397635.876995:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397636.901727:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397637.924863:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397638.116971:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397638.116995:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701009152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397638.117510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118119:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701009664:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118196:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701010176:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118239:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701010688:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118291:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397638.118297:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701009280:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118352:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701009792:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118388:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701010304:0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.118438:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009664 00000100:00100000:2.0:1787397638.118459:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009664 00000100:00100000:2.0:1787397638.118510:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010688 00000100:00100000:2.0:1787397638.118513:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010688 00000100:00100000:2.0:1787397638.118579:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009792 00000100:00100000:2.0:1787397638.118582:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009792 00000100:00100000:2.0:1787397638.118594:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010304 00000100:00100000:2.0:1787397638.118596:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010304 00000100:00100000:2.0:1787397638.118608:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1787397638.118615:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701009664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118668:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701009664:12345-0@lo:400:kworker.0 Request processed in 53us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397638.118676:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1787397638.118691:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1787397638.118697:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701010688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118722:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701010688:12345-0@lo:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397638.118728:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1787397638.118738:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1787397638.118743:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701009792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118766:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701009792:12345-0@lo:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397638.118770:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1787397638.118778:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1787397638.118784:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701010304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.118805:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701010304:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397638.118809:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1787397638.118838:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009280 00000100:00100000:2.0:1787397638.118842:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009280 00000100:00100000:0.0:1787397638.119035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701009408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.119068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397638.119088:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701009920:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.119112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.119133:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787397638.119142:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701009280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.119172:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701009280:12345-0@lo:400:kworker.0 Request processed in 31us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397638.121682:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010432:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.121748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397638.121778:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397638.121786:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701009536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.121830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397638.121854:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701010048:0@lo:400:kworker.0 00000100:00100000:1.0:1787397638.123345:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009408 00000100:00100000:1.0:1787397638.123623:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009408 00000100:00100000:1.0:1787397638.123689:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009536 00000100:00100000:1.0:1787397638.123692:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009536 00000100:00100000:1.0:1787397638.123713:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1787397638.123721:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701009408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397638.123823:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787397638.123948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397638.123984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397638.124038:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701009408:12345-0@lo:400:kworker.0 Request processed in 317us (4968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397638.124047:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1787397638.124065:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1787397638.124072:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701009536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397638.124103:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701009536:12345-0@lo:400:kworker.0 Request processed in 32us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397638.124109:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1787397638.124269:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701009408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124293:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701009536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124330:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010176 00000100:00100000:0.0:1787397638.124333:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010176 00000100:00100000:0.0:1787397638.124360:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010432 00000100:00100000:0.0:1787397638.124363:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010432 00000100:00100000:0.0:1787397638.124381:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010048 00000100:00100000:0.0:1787397638.124383:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010048 00000100:00100000:0.0:1787397638.124406:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010560 00000100:00100000:0.0:1787397638.124409:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010560 00000100:00100000:0.0:1787397638.124431:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1787397638.124437:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124469:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701010176:12345-0@lo:400:kworker.0 Request processed in 32us (6249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397638.124476:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:0.0:1787397638.124487:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1787397638.124492:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124543:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010432:12345-0@lo:400:kworker.0 Request processed in 51us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397638.124549:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1787397638.124559:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1787397638.124573:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124602:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701010048:12345-0@lo:400:kworker.0 Request processed in 31us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397638.124608:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1787397638.124618:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1787397638.124624:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124646:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010560:12345-0@lo:400:kworker.0 Request processed in 23us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397638.124651:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00080000:0.0:1787397638.124670:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397638.124674:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397638.124677:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397638.124678:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397638.124706:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701009280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124720:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701009792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124734:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701010304:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124745:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701009664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124755:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701010176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124766:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701010688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124801:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701010048:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124809:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968727 gen 2 00000100:00100000:0.0:1787397638.124819:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397638.124828:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968729 gen 2 00000100:00100000:0.0:1787397638.124846:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397638.126933:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009152 00000100:00100000:3.0:1787397638.126949:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009152 00000100:00100000:3.0:1787397638.127154:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701009920 00000100:00100000:3.0:1787397638.127158:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701009920 00000100:00100000:3.0:1787397638.127186:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1787397638.127195:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701009152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397638.127231:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397638.127337:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701009152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (9828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397638.127345:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1787397638.127407:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701009152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397638.127437:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1787397638.127444:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397638.127485:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701009920:12345-0@lo:400:kworker.0 Request processed in 42us (8371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397638.127490:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1787397638.127519:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701009920:0@lo:400:kworker.0 00000100:00100000:1.0:1787397638.631394:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701010816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397638.631479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397638.631575:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010816 00000100:00100000:1.0:1787397638.631584:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010816 00000100:00100000:1.0:1787397638.631638:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1787397638.631870:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701010816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397638.631905:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397638.631952:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701010816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397638.631959:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1787397638.632021:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701010816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397638.633325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397638.633389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397638.633450:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701010944 00000100:00100000:2.0:1787397638.633456:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701010944 00000100:00100000:2.0:1787397638.633496:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1787397638.633503:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397638.633550:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397638.633590:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701010944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397638.633597:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1787397638.633634:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701010944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397638.641641:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8187a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701011072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397638.641729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397638.641850:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011072 00000100:00100000:3.0:1787397638.641859:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011072 00000100:00100000:3.0:1787397638.641922:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1787397638.641933:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701011072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397638.641971:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397638.642130:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701011072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 197us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397638.642154:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1787397638.642325:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8187a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701011072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787397638.948785:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397639.141963:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701011200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397639.142048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397639.142178:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011200 00000100:00100000:1.0:1787397639.142188:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011200 00000100:00100000:1.0:1787397639.142259:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1787397639.142270:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701011200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397639.142295:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397639.142344:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701011200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397639.142352:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1787397639.142493:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701011200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397639.143705:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701011328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397639.143764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397639.143847:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011328 00000100:00100000:1.0:1787397639.143853:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011328 00000100:00100000:1.0:1787397639.143907:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:1.0:1787397639.143916:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701011328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397639.143936:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397639.144121:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701011328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397639.144145:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:3.0:1787397639.144332:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701011328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397639.431035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397639.431082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397639.431117:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397639.431136:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397639.431162:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397639.431190:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169664 00000100:00100000:0.0:1787397639.431201:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169664 00000100:00100000:0.0:1787397639.431270:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169536 00000100:00100000:0.0:1787397639.431274:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169536 00000100:00100000:0.0:1787397639.431301:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1251 00000100:00100000:0.0:1787397639.431310:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681169664:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397639.431387:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681169664:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397639.431394:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1251 00000100:00100000:0.0:1787397639.431413:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1252 00000100:00100000:0.0:1787397639.431420:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681169536:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397639.431446:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2404:x1874218681169536:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397639.431452:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1252 00000100:00080000:0.0:1787397639.431470:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397639.431474:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397639.431563:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169408 00000100:00100000:1.0:1787397639.431569:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169408 00000100:00100000:1.0:1787397639.431604:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787397639.431611:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681169408:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397639.431639:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681169408:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397639.431646:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787397639.431693:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169920 00000100:00100000:1.0:1787397639.431698:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169920 00000100:00100000:1.0:1787397639.431726:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681169792 00000100:00100000:1.0:1787397639.431728:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681169792 00000100:00100000:1.0:1787397639.431747:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2523 00000100:00100000:1.0:1787397639.431753:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681169920:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397639.431775:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2404:x1874218681169920:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397639.431781:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2523 00000100:00100000:1.0:1787397639.431790:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2524 00000100:00100000:1.0:1787397639.431795:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681169792:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397639.431812:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2404:x1874218681169792:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 17us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397639.431818:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2524 00000100:00080000:0.0:1787397639.432318:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397639.432322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397639.972814:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397640.230663:0:91555:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1787397640.998055:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397642.020681:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397642.362394:0:91603:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1787397643.045239:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397643.237283:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701011584:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237434:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701012096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237488:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701012608:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237564:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787397643.237571:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701011456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701011968:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237645:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237658:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237673:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.237686:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701012992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.237702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397643.238673:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011584 00000100:00100000:1.0:1787397643.238683:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011584 00000100:00100000:1.0:1787397643.238761:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011968 00000100:00100000:1.0:1787397643.238836:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011968 00000100:00100000:1.0:1787397643.238864:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012480 00000100:00100000:1.0:1787397643.238867:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012480 00000100:00100000:1.0:1787397643.238880:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012992 00000100:00100000:1.0:1787397643.238882:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012992 00000100:00100000:1.0:1787397643.238896:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1787397643.238904:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701011584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.238981:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701011584:12345-0@lo:400:kworker.0 Request processed in 77us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.238988:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1787397643.239007:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1787397643.239012:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701011968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.239040:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701011968:12345-0@lo:400:kworker.0 Request processed in 28us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.239047:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1787397643.239057:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1787397643.239063:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701012480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.239088:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701012480:12345-0@lo:400:kworker.0 Request processed in 26us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.239093:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1787397643.239115:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1787397643.239121:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701012992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.239149:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701012992:12345-0@lo:400:kworker.0 Request processed in 29us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.239179:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1787397643.239203:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012096 00000100:00100000:1.0:1787397643.239206:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012096 00000100:00100000:1.0:1787397643.239233:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012608 00000100:00100000:1.0:1787397643.239236:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012608 00000100:00100000:1.0:1787397643.239249:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:1.0:1787397643.239254:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701012096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.239290:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701012096:12345-0@lo:400:kworker.0 Request processed in 34us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.239295:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:1.0:1787397643.239308:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:1.0:1787397643.239313:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701012608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397643.239339:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701012608:12345-0@lo:400:kworker.0 Request processed in 26us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.239344:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:0.0:1787397643.239693:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011456 00000100:00100000:0.0:1787397643.239699:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011456 00000100:00100000:0.0:1787397643.239748:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787397643.239756:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.239804:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701011456:12345-0@lo:400:kworker.0 Request processed in 49us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397643.239810:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787397643.240020:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701011712:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240097:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701012224:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240168:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701012736:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240211:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787397643.240218:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701011840:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240257:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701012352:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701012864:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397643.240348:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011712 00000100:00100000:3.0:1787397643.240352:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011712 00000100:00100000:3.0:1787397643.240382:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701011840 00000100:00100000:3.0:1787397643.240385:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701011840 00000100:00100000:3.0:1787397643.240404:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1787397643.240410:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8187a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240447:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8187a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701011712:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.240464:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1787397643.240480:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1787397643.240486:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701011840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240514:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701011840:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.240541:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1787397643.240561:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012224 00000100:00100000:3.0:1787397643.240564:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012224 00000100:00100000:3.0:1787397643.240587:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012736 00000100:00100000:3.0:1787397643.240590:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012736 00000100:00100000:3.0:1787397643.240607:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012352 00000100:00100000:3.0:1787397643.240609:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012352 00000100:00100000:3.0:1787397643.240627:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701012864 00000100:00100000:3.0:1787397643.240630:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701012864 00000100:00100000:3.0:1787397643.240648:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1787397643.240655:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240686:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701012224:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.240693:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1787397643.240703:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:3.0:1787397643.240708:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701012736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.240733:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701012736:12345-0@lo:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.240739:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:3.0:1787397643.240749:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1787397643.240754:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701012352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.240902:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1787397643.240909:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701012864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.240940:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701012864:12345-0@lo:400:kworker.0 Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397643.240946:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:0.0:1787397643.240974:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397643.240984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701013120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397643.241012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397643.241039:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013120 00000100:00100000:0.0:1787397643.241042:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013120 00000100:00100000:0.0:1787397643.241068:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1787397643.241075:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701013120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397643.241100:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397643.241135:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701013120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397643.241140:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1787397643.241205:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701013120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397643.241278:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701011840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.241289:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701012864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.241298:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701011712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.241308:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701012224:0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.241316:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701012736:0@lo:400:kworker.0 00000100:00080000:2.0:1787397643.241807:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397643.241812:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397643.241815:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397643.241817:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397643.241849:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701011456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241866:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701011968:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241877:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241888:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701012992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241900:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701011584:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241913:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701012096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397643.241937:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701012608:0@lo:400:kworker.0 00000100:00100000:3.0:1787397643.243317:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701012352:12345-0@lo:400:kworker.0 Request processed in 2558us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.243331:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1787397643.243907:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701012352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397643.748814:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701013248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397643.748909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397643.749018:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013248 00000100:00100000:1.0:1787397643.749027:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013248 00000100:00100000:1.0:1787397643.749091:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:1.0:1787397643.749100:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701013248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397643.749125:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397643.749190:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701013248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.749198:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1787397643.749421:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701013248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397643.749436:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397643.749442:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701013376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397643.749474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397643.749584:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013376 00000100:00100000:1.0:1787397643.749588:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013376 00000100:00100000:1.0:1787397643.749611:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:1.0:1787397643.749617:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701013376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397643.749650:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397643.749685:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701013376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397643.749692:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1787397643.750189:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397643.750203:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701013504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397643.750241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397643.750297:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701013376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397643.750374:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013504 00000100:00100000:3.0:1787397643.750379:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013504 00000100:00100000:3.0:1787397643.750416:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:3.0:1787397643.750425:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701013504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397643.750451:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397643.750501:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701013504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397643.750508:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1787397643.751176:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701013504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787397644.069391:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397644.190477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.190617:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170048 00000100:00100000:0.0:1787397644.190627:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170048 00000100:00100000:0.0:1787397644.190721:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1267 00000100:00100000:0.0:1787397644.190733:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70244:x1874218681170048:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397644.190765:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787397644.190845:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70244:x1874218681170048:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397644.190854:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1267 00000100:00080000:2.0:1787397644.190941:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397644.193593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.193778:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170176 00000100:00100000:0.0:1787397644.193791:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170176 00000100:00100000:0.0:1787397644.193874:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1268 00000100:00100000:0.0:1787397644.193885:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:70244:x1874218681170176:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397644.193923:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:0.0:1787397644.193998:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:70244:x1874218681170176:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 115us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397644.194020:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1268 00000100:00080000:2.0:1787397644.194362:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397644.197101:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397644.197260:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170304 00000100:00100000:2.0:1787397644.197272:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170304 00000100:00100000:2.0:1787397644.197352:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2011 00000100:00100000:2.0:1787397644.197363:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:70244:x1874218681170304:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397644.197391:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397644.197468:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:70244:x1874218681170304:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 107us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397644.197477:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2011 00000100:00080000:0.0:1787397644.198152:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397644.200252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.200364:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170432 00000100:00100000:0.0:1787397644.200374:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170432 00000100:00100000:0.0:1787397644.200458:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2012 00000100:00100000:0.0:1787397644.200470:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:70244:x1874218681170432:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397644.200498:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397644.200614:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:70244:x1874218681170432:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397644.200622:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2012 00000100:00080000:2.0:1787397644.200757:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397644.240647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.240878:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170688 00000100:00100000:0.0:1787397644.240889:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170688 00000100:00100000:0.0:1787397644.240958:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1269 00000100:00100000:0.0:1787397644.240969:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70261:x1874218681170688:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397644.240991:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397644.241011:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d1908ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fea expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241087:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241101:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241112:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241126:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241159:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241166:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241265:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241273:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241279:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241285:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241291:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.241295:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241303:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241316:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.241319:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.241322:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241328:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d1908f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241351:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241357:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241364:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241369:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.241372:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241378:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241388:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8191cd200) 00010000:00010000:0.0:1787397644.241390:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.241392:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241397:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d1908fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241430:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d1908ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fea expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241440:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.241443:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397644.241453:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d1908ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fea expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.241463:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0600, rc 0) 00000100:00100000:0.0:1787397644.241583:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70261:x1874218681170688:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 615us (945us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397644.241591:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1269 00000100:00100000:3.0:1787397644.245858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.246244:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681170816 00000100:00100000:0.0:1787397644.246255:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681170816 00000100:00100000:0.0:1787397644.246322:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1270 00000100:00100000:0.0:1787397644.246332:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70261:x1874218681170816:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:0.0:1787397644.246410:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246426:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246439:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246453:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246461:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246468:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246568:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246594:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246602:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397644.246648:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1787397644.246652:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397644.246664:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246676:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246683:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246689:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246695:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.246699:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246706:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246717:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.246719:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.246723:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246738:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246818:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246825:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246831:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246835:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.246838:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246844:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246852:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8191cd200) 00010000:00010000:0.0:1787397644.246854:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.246857:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246863:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d190908 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246874:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246880:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246891:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246897:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.246900:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246905:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246911:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397644.246913:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.246916:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.246921:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d19090f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397644.247258:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70261:x1874218681170816:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 924us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397644.247266:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1270 00000100:00100000:0.0:1787397644.260998:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397644.261024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701013632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397644.261113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397644.261274:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013632 00000100:00100000:2.0:1787397644.261282:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013632 00000100:00100000:2.0:1787397644.261334:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1787397644.261356:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701013632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397644.261377:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397644.261429:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701013632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397644.261436:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1787397644.261484:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70457b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701013632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397644.261814:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397644.261826:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701013760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397644.261858:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397644.262021:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013760 00000100:00100000:1.0:1787397644.262027:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013760 00000100:00100000:1.0:1787397644.262213:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1787397644.262222:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701013760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397644.262237:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397644.262286:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701013760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397644.262293:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:0.0:1787397644.262372:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701013760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397644.289630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.289866:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171072 00000100:00100000:0.0:1787397644.289877:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171072 00000100:00100000:0.0:1787397644.289938:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1271 00000100:00100000:0.0:1787397644.289948:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70263:x1874218681171072:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397644.289970:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397644.289992:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ff1 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290079:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290094:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290105:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290120:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290127:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290148:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290236:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290244:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290270:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290277:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290283:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.290287:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290295:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290309:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.290312:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.290317:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290321:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1600/0x274786fe0d19091d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290338:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290343:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290348:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290353:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.290363:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290369:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290377:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8191cd200) 00010000:00010000:0.0:1787397644.290380:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.290383:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290389:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d190924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290424:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190916 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ff1 expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290435:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.290437:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397644.290441:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ff1 expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.290450:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1800, rc 0) 00000100:00100000:0.0:1787397644.290880:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70263:x1874218681171072:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 932us (1257us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397644.290889:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1271 00000100:00100000:1.0:1787397644.293892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.293965:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171200 00000100:00100000:0.0:1787397644.293975:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171200 00000100:00100000:0.0:1787397644.294032:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1272 00000100:00100000:0.0:1787397644.294052:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70263:x1874218681171200:12345-192.168.204.60@tcp:34:lfs.0 00010000:00010000:0.0:1787397644.294158:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294175:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294195:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294210:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294216:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294222:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294296:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294303:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294308:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397644.294348:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1787397644.294352:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397644.294365:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294377:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294389:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294394:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294400:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294405:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.294408:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294415:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294426:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.294428:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.294432:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294438:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19092b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294453:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294573:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294580:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294593:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.294597:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294603:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294611:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8191cd600) 00010000:00010000:0.0:1787397644.294614:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.294617:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294622:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294637:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294642:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294648:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294653:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.294656:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294662:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294680:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397644.294683:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.294686:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.294692:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190939 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397644.294787:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70263:x1874218681171200:12345-192.168.204.60@tcp:34:lfs.0 Request processed in 744us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397644.294795:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1272 00000100:00100000:3.0:1787397644.328926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.329091:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171456 00000100:00100000:0.0:1787397644.329102:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171456 00000100:00100000:0.0:1787397644.329181:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1273 00000100:00100000:0.0:1787397644.329203:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70269:x1874218681171456:12345-192.168.204.60@tcp:101:md5sum.0 00010000:00010000:0.0:1787397644.329224:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397644.329247:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7ff8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329325:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329340:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329351:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329365:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329389:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329396:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329515:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190955 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329557:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190955 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329565:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190955 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397644.329575:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1787397644.329679:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329687:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329692:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329697:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329703:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.329707:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329724:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329736:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397644.329739:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.329882:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329891:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329908:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329914:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329920:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329924:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397644.329927:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329933:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329941:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff89a8191cd600) 00010000:00010000:0.0:1787397644.329944:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397644.329947:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.329964:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19094e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.330024:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ff8 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.330176:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190955 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ff8 expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397644.330186:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397644.330188:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397644.330190:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1800, rc 0) 00000100:00100000:0.0:1787397644.330271:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:70269:x1874218681171456:12345-192.168.204.60@tcp:101:md5sum.0 Request processed in 1070us (1354us total) trans 111669149697 rc 0/0 00000100:00100000:0.0:1787397644.330279:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1273 00000100:00100000:3.0:1787397644.348089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397644.348281:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171584 00000100:00100000:2.0:1787397644.348293:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171584 00002000:00100000:2.0:1787397644.348347:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff89a82e4f5f80 x1874218681171584/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/0 e 0 to 0 dl 1787397655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397644.348358:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5f80 with x1874218681171584 ext(0->32767) 00002000:00010000:2.0:1787397644.348364:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5f80 00000100:00100000:2.0:1787397644.348404:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 551 00000100:00100000:2.0:1787397644.348413:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681171584:12345-192.168.204.60@tcp:3:md5sum.0 00000100:00100000:2.0:1787397644.350552:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2405:x1874218681171584:12345-192.168.204.60@tcp:3:md5sum.0 Request processed in 2101us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397644.350566:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 551 00002000:00100000:2.0:1787397644.350578:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff89a82e4f5f80 x1874218681171584/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/440 e 0 to 0 dl 1787397655 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397644.350588:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5f80 with x1874218681171584 ext(0->32767) 00002000:00010000:2.0:1787397644.350595:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5f80 00000100:00100000:3.0:1787397644.364505:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397644.365344:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171712 00000100:00100000:2.0:1787397644.365356:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171712 00002000:00100000:2.0:1787397644.365409:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff89a806914000 x1874218681171712/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/0 e 0 to 0 dl 1787397655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397644.365440:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a806914000 with x1874218681171712 ext(32768->1048575) 00002000:00010000:2.0:1787397644.365447:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a806914000 00000100:00100000:2.0:1787397644.365488:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 552 00000100:00100000:2.0:1787397644.365497:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681171712:12345-192.168.204.60@tcp:3:md5sum.0 00000100:00100000:1.0:1787397644.366407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397644.366491:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681171840 00000100:00100000:0.0:1787397644.366499:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681171840 00002000:00100000:0.0:1787397644.366559:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff89a835bbb480 x1874218681171840/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/0 e 0 to 0 dl 1787397655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397644.366570:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835bbb480 with x1874218681171840 ext(1048576->2097151) 00002000:00010000:0.0:1787397644.366575:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a835bbb480 00000100:00100000:0.0:1787397644.366595:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 553 00000100:00100000:0.0:1787397644.366604:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681171840:12345-192.168.204.60@tcp:3:md5sum.0 00000100:00100000:2.0:1787397644.379537:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2403:x1874218681171712:12345-192.168.204.60@tcp:3:md5sum.0 Request processed in 14013us (15015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397644.379553:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 552 00002000:00100000:2.0:1787397644.379564:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff89a806914000 x1874218681171712/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/440 e 0 to 0 dl 1787397655 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397644.379573:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a806914000 with x1874218681171712 ext(32768->1048575) 00002000:00010000:2.0:1787397644.379581:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a806914000 00000100:00100000:2.0:1787397644.395842:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2403:x1874218681171840:12345-192.168.204.60@tcp:3:md5sum.0 Request processed in 29226us (29425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787397644.395856:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 553 00002000:00100000:2.0:1787397644.395870:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff89a835bbb480 x1874218681171840/t0(0) o3->e90f04db-6a63-4f01-92c7-7bf813f9f081@192.168.204.60@tcp:85/0 lens 488/440 e 0 to 0 dl 1787397655 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397644.395880:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835bbb480 with x1874218681171840 ext(1048576->2097151) 00002000:00010000:2.0:1787397644.395887:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89a835bbb480 00000100:00100000:3.0:1787397644.423113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397644.424807:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172096 00000100:00100000:2.0:1787397644.424823:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172096 00000100:00100000:2.0:1787397644.424969:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 226 00000100:00100000:2.0:1787397644.424981:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:70269:x1874218681172096:12345-192.168.204.60@tcp:35:md5sum.0 00000001:00080000:2.0:1787397644.425296:0:66179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149698 00000100:00100000:2.0:1787397644.425428:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:70269:x1874218681172096:12345-192.168.204.60@tcp:35:md5sum.0 Request processed in 449us (2324us total) trans 111669149699 rc 0/0 00000100:00100000:2.0:1787397644.425437:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 226 00000020:00080000:2.0:1787397644.425443:0:66179:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397644.549670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397644.549795:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172224 00000100:00100000:2.0:1787397644.549806:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172224 00000100:00100000:2.0:1787397644.549869:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:2.0:1787397644.549879:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681172224:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397644.549961:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2404:x1874218681172224:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397644.549968:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00010000:00010000:0.0:1787397645.092737:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397646.116786:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397647.147171:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397648.166723:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397648.358276:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701013888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397648.358393:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701014016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359496:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359571:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701015040:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359616:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787397648.359622:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701014144:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359642:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359656:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701014656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.359727:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014528 00000100:00100000:2.0:1787397648.359736:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014528 00000100:00100000:2.0:1787397648.359816:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015040 00000100:00100000:2.0:1787397648.359820:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015040 00000100:00100000:2.0:1787397648.359843:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1787397648.359851:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701014528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359913:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701014528:12345-0@lo:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.359921:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1787397648.359936:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014144 00000100:00100000:2.0:1787397648.359939:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014144 00000100:00100000:2.0:1787397648.359956:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1787397648.359961:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701015040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.359986:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701015040:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.359991:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1787397648.360000:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1787397648.360005:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70457bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701014144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360024:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70457bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701014144:12345-0@lo:400:kworker.0 Request processed in 20us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.360029:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1787397648.360046:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701013888 00000100:00100000:2.0:1787397648.360061:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701013888 00000100:00100000:2.0:1787397648.360085:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014656 00000100:00100000:2.0:1787397648.360087:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014656 00000100:00100000:2.0:1787397648.360099:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1787397648.360105:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701013888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397648.360140:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397648.360177:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701013888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.360190:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1787397648.360201:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1787397648.360207:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701014656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360240:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701014656:12345-0@lo:400:kworker.0 Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.360245:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00080000:2.0:1787397648.360262:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397648.360267:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397648.360283:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701014272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.360346:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701014784:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.360392:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397648.360399:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701014400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.360439:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701014912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397648.360485:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014272 00000100:00100000:2.0:1787397648.360489:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014272 00000100:00100000:2.0:1787397648.360517:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014400 00000100:00100000:2.0:1787397648.360547:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014400 00000100:00100000:2.0:1787397648.360566:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1787397648.360572:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701014272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360609:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701014272:12345-0@lo:400:kworker.0 Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.360615:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1787397648.360635:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1787397648.360641:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701014400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360671:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701014400:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.360678:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:2.0:1787397648.360691:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397648.360693:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397648.360725:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701014400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360736:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701014272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360768:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701014144:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360779:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701014656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360789:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360801:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701015040:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.360875:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701013888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397648.362250:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701015168:0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.362339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397648.362415:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701015296:0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.362442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397648.364203:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701015424:0@lo:400:kworker.0 00000100:00100000:0.0:1787397648.364207:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014016 00000100:00100000:0.0:1787397648.364223:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014016 00000100:00100000:1.0:1787397648.364289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397648.364307:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787397648.364321:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701014016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.364354:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015424 00000100:00100000:1.0:1787397648.364360:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015424 00000100:00100000:0.0:1787397648.364404:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701014016:12345-0@lo:400:kworker.0 Request processed in 85us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397648.364414:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787397648.364418:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1787397648.364426:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701015424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.364478:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701015424:12345-0@lo:400:kworker.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397648.364486:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1787397648.364562:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701015424:0@lo:400:kworker.0 00000100:00100000:3.0:1787397648.364581:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014784 00000100:00100000:3.0:1787397648.364588:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014784 00000100:00100000:2.0:1787397648.364600:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701014912 00000100:00100000:2.0:1787397648.364607:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701014912 00000100:00100000:0.0:1787397648.371937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701014016:0@lo:400:kworker.0 00000100:00080000:1.0:1787397648.383274:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397648.383293:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397648.383630:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015168 00000100:00100000:2.0:1787397648.383650:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015168 00000100:00080000:1.0:1787397648.384501:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397648.385068:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015296 00000100:00100000:2.0:1787397648.385079:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1787397648.385080:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015296 00000100:00100000:2.0:1787397648.385099:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.385136:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1787397648.385145:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701014912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.386039:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701014784:12345-0@lo:400:kworker.0 Request processed in 942us (25660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.386065:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1787397648.386096:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1787397648.386128:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701015168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.386177:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701015168:12345-0@lo:400:kworker.0 Request processed in 53us (23839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.386184:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1787397648.386196:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1787397648.386202:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701015296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.386277:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701015296:12345-0@lo:400:kworker.0 Request processed in 75us (23834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397648.386281:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701014912:12345-0@lo:400:kworker.0 Request processed in 1134us (25815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397648.386288:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1787397648.386360:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701015296:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.386374:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701014912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397648.386385:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701014784:0@lo:400:kworker.0 00000100:00080000:2.0:1787397648.386464:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397648.386871:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1787397648.386923:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701015168:0@lo:400:kworker.0 00000100:00100000:1.0:1787397648.874721:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701015680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397648.874831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397648.874894:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397648.874901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701015552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397648.874931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397648.874959:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397648.874969:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397648.874995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397648.875052:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015680 00000100:00100000:1.0:1787397648.875080:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015680 00000100:00100000:1.0:1787397648.875147:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1787397648.875158:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701015680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397648.875207:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1787397648.875282:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701015680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397648.875291:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1787397648.875325:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015552 00000100:00100000:1.0:1787397648.875329:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015552 00000100:00100000:1.0:1787397648.875356:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015808 00000100:00100000:1.0:1787397648.875360:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015808 00000100:00100000:1.0:1787397648.875378:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1787397648.875385:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701015552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397648.875412:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397648.875445:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701015552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397648.875451:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1787397648.875463:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1787397648.875469:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701015808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397648.875485:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397648.875516:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701015808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397648.875563:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1787397648.875628:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397648.875668:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701015552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397648.875680:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701015680:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787397649.189825:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397649.383991:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701016064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397649.384269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397649.385331:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397649.385358:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701015936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397649.385436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397649.387294:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016064 00000100:00100000:0.0:1787397649.387316:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016064 00000100:00100000:0.0:1787397649.387408:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701015936 00000100:00100000:0.0:1787397649.387413:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701015936 00000100:00100000:0.0:1787397649.387437:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1787397649.387448:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701016064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397649.387485:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397649.387615:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701016064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397649.387623:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:0.0:1787397649.387642:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:0.0:1787397649.387649:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701015936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397649.387666:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397649.387703:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701015936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397649.387709:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:0.0:1787397649.387791:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701016064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397649.387843:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701015936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397649.672157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397649.672208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397649.672239:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397649.672260:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172608 00000100:00100000:3.0:1787397649.672267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397649.672275:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172608 00000100:00100000:3.0:1787397649.672296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397649.672340:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172864 00000100:00100000:3.0:1787397649.672345:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172864 00000100:00100000:0.0:1787397649.672357:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172480 00000100:00100000:0.0:1787397649.672362:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172480 00000100:00100000:3.0:1787397649.672384:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172736 00000100:00100000:3.0:1787397649.672389:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172736 00000100:00100000:0.0:1787397649.672404:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1265 00000100:00100000:0.0:1787397649.672418:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681172608:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397649.672426:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2533 00000100:00100000:3.0:1787397649.672439:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681172864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397649.672558:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681172864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397649.672567:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2533 00000100:00100000:3.0:1787397649.672589:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2534 00000100:00100000:3.0:1787397649.672596:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681172736:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397649.672732:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681172352 00000100:00100000:2.0:1787397649.672738:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681172352 00000100:00100000:2.0:1787397649.672772:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787397649.672781:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681172352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397649.673090:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2402:x1874218681172608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 674us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397649.673101:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1265 00000100:00100000:0.0:1787397649.673132:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1266 00000100:00100000:0.0:1787397649.673142:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2402:x1874218681172480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397649.673179:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:2402:x1874218681172480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397649.673187:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1266 00000100:00100000:3.0:1787397649.674539:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2402:x1874218681172736:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1916us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397649.674560:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2534 00000100:00080000:3.0:1787397649.674849:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397649.674857:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397649.674860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397649.674864:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397649.677722:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681172352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 4922us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397649.677743:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000001:00080000:2.0:1787397649.902268:0:90971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:0.0:1787397650.212868:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397651.237802:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397651.795861:0:91799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 07:20:49 (1787397649) 00000100:00100000:1.0:1787397651.901811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397651.901913:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173120 00000100:00100000:2.0:1787397651.901925:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173120 00000100:00100000:2.0:1787397651.902008:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1274 00000100:00100000:2.0:1787397651.902019:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:70848:x1874218681173120:12345-192.168.204.60@tcp:36:mkdir.0 00000100:00100000:2.0:1787397651.902142:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:66177:1874218701016192:0@lo:900:mdt00_001.0 00000100:00100000:2.0:1787397651.902205:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397651.902233:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0d80 going to sleep for 11 seconds 00000100:00080000:3.0:1787397651.902476:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397651.903003:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016192 00000100:00100000:1.0:1787397651.903009:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016192 00000100:00100000:1.0:1787397651.903042:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397651.903049:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66177:x1874218701016192:12345-0@lo:900:mdt00_001.0 00000100:00100000:1.0:1787397651.903118:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66177:x1874218701016192:12345-0@lo:900:mdt00_001.0 Request processed in 68us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397651.903126:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397651.903351:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:66177:1874218701016192:0@lo:900:mdt00_001.0 00000100:00100000:3.0:1787397651.903419:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016320:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.903459:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.903490:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820649cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397651.903589:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016320 00000100:00100000:1.0:1787397651.903603:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016320 00000100:00100000:1.0:1787397651.903631:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1787397651.903638:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397651.903704:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016320:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397651.903711:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1787397651.903947:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016320:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.904016:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.904042:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.904066:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8110146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397651.908204:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016448 00000100:00100000:1.0:1787397651.908222:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016448 00000100:00100000:1.0:1787397651.908289:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1787397651.908300:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397651.908451:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016448:12345-0@lo:1000:mdt00_001.0 Request processed in 152us (4407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397651.908460:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1787397651.908514:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803422300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016448:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397651.908628:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016576:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397651.908669:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397651.908701:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397651.909488:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016576 00000100:00100000:3.0:1787397651.909496:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016576 00000100:00100000:3.0:1787397651.909561:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1787397651.909580:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.909683:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016576:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (1013us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397651.909691:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:1.0:1787397651.909960:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016576:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787397651.910039:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.910050:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.910062:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397651.910078:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016704:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787397651.910112:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397651.910138:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787397651.910209:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016704 00000100:00100000:3.0:1787397651.910213:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016704 00000100:00100000:3.0:1787397651.910244:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1787397651.910251:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66177:x1874218701016704:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397651.910261:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397651.910280:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190963 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.910306:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.910325:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.910351:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.910364:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 8 pid: 66178 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397651.910377:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1874218701016832:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397651.910448:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820649cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397651.927079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397651.927152:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173248 00000100:00100000:1.0:1787397651.927162:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173248 00010000:00010000:1.0:1787397651.927216:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 9 pid: 66178 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397651.927254:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2592 00000100:00100000:1.0:1787397651.927264:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:2403:x1874218681173248:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397651.927280:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397651.927287:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 9 pid: 66178 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.927300:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 9 pid: 66178 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.927350:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:1.0:1787397651.927358:0:19654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.927369:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.927378:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.927413:0:19654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397651.927428:0:19654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701016960:0@lo:105: 00000100:00100000:1.0:1787397651.927479:0:19654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397651.927512:0:19654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0f00 going to sleep for 11 seconds 00000100:00080000:1.0:1787397651.927544:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397651.927560:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701016960 00000100:00100000:1.0:1787397651.927788:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701016960 00010000:00010000:0.0:1787397651.927852:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d1908e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fe3 expref: 9 pid: 66178 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397651.927868:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1874218701016832:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397651.927894:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00010000:00010000:0.0:1787397651.927894:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397651.927903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701016960:12345-0@lo:105: 00010000:00010000:0.0:1787397651.927903:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:0.0:1787397651.927912:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397651.927914:0:6506:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.927915:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a400, rc 0) 00010000:00010000:2.0:1787397651.927922:0:6506:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.927929:0:6506:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.927936:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.927942:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.927949:0:6506:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.927964:0:6506:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a82ee31e00) 00000100:00100000:0.0:1787397651.927969:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66177:x1874218701016704:12345-0@lo:101:mdt00_001.0 Request processed in 17719us (17856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.927976:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1787397651.928112:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701016704:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397651.928127:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397651.928147:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787397651.928184:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.928191:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.928199:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397651.928213:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017088:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787397651.928243:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.928311:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820649cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397651.928331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701016960:12345-0@lo:105: Request processed in 430us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397651.928335:0:19654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701016960:0@lo:105: 00000100:00100000:2.0:1787397651.928338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:3.0:1787397651.928344:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397651.928391:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2403:x1874218681173248:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 1129us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397651.928399:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2592 00000100:00100000:0.0:1787397651.928443:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017088 00000100:00100000:0.0:1787397651.928448:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017088 00000100:00100000:0.0:1787397651.928478:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1787397651.928485:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66177:x1874218701017088:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787397651.928501:0:23942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397651.928514:0:23942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190971 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.928559:0:23942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190971 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.928739:0:23942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190971 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.928746:0:23942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a8191cd600) 00010000:00010000:0.0:1787397651.928749:0:23942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397651.928751:0:23942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0a00, rc 0) 00000100:00100000:0.0:1787397651.928782:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017088:12345-0@lo:101:mdt00_001.0 Request processed in 297us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.928788:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1787397651.928867:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017088:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397651.928878:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397651.928888:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397651.928901:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787397651.928933:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017216:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.928963:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.928995:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820649240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.929037:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017216 00000100:00100000:0.0:1787397651.929041:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017216 00000100:00100000:0.0:1787397651.929074:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1787397651.929086:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397651.929143:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017216:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.929150:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1787397651.929208:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017216:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.929247:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017344:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.929270:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.929293:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.929333:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017344 00000100:00100000:0.0:1787397651.929338:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017344 00000100:00100000:0.0:1787397651.929368:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1787397651.929374:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397651.929442:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017344:12345-0@lo:1000:mdt00_001.0 Request processed in 67us (170us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397651.929448:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1787397651.929506:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017344:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.929609:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017472:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.929633:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.929650:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.929779:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017472 00000100:00100000:0.0:1787397651.929784:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017472 00000100:00100000:0.0:1787397651.929814:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1787397651.929820:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397651.929869:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017472:12345-0@lo:1000:mdt00_001.0 Request processed in 49us (235us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397651.929875:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1787397651.929930:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803423100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017472:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.929978:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017600:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.930013:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.930034:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.930074:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017600 00000100:00100000:0.0:1787397651.930078:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017600 00000100:00100000:0.0:1787397651.930107:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1787397651.930113:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397651.930158:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017600:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.930165:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1787397651.930220:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017600:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.930260:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017728:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.930281:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.930301:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.930339:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017728 00000100:00100000:0.0:1787397651.930348:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017728 00000100:00100000:0.0:1787397651.930377:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1787397651.930383:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397651.930439:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017728:12345-0@lo:1000:mdt00_001.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.930445:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:3.0:1787397651.930829:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017728:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.930869:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017856:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.930894:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397651.930908:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397651.930919:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701017856 00000100:00100000:3.0:1787397651.930922:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701017856 00000100:00100000:3.0:1787397651.930945:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:3.0:1787397651.930950:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397651.931005:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701017856:12345-0@lo:1000:mdt00_001.0 Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397651.931012:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:3.0:1787397651.931036:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701017856:0@lo:1000:mdt00_001.0 00000040:00080000:3.0:1787397651.931560:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].2, 1000 off35920 00000040:00080000:3.0:1787397651.931635:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].2, 1152 off36272 00000004:00080000:3.0:1787397651.931641:0:66177:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a82ee16780 with version 9 00000004:00080000:2.0:1787397651.932280:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 9 rpc_version 9 00000020:00100000:2.0:1787397651.932310:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787397651.932324:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83fa12d80 x1874218701018112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397651.932343:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701018112:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397651.932406:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397651.932431:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397651.932459:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018112 00000100:00100000:2.0:1787397651.932465:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018112 00000100:00100000:2.0:1787397651.932498:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:2.0:1787397651.932505:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701018112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397651.941388:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701018112:12345-0@lo:1000:osp_up0-1.0 Request processed in 8872us (8971us total) trans 111669149700 rc 0/0 00000100:00100000:2.0:1787397651.941405:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:3.0:1787397651.943083:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701018112:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787397651.943207:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943225:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943238:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397651.943258:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f5c471b reply state 00000000e9597823 transno 81604378734 ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943278:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943285:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:1.0:1787397651.943289:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397651.943294:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787397651.943300:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00080000:1.0:1787397651.943311:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787397651.943323:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943332:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943338:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943371:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787397651.943376:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787397651.943382:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397651.943401:0:66177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.943563:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397651.943570:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.943579:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:2.0:1787397651.943584:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397651.943593:0:6511:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.943628:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.943634:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397651.943678:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.943693:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82ee31e00/0x274786fe0d190963 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19096a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397651.943707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701018240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397651.943714:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397651.943716:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397651.943718:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397651.943781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397651.943951:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70848:x1874218681173120:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 41932us (42147us total) trans 81604378734 rc 0/0 00000100:00100000:1.0:1787397651.943962:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1274 00000100:00100000:2.0:1787397651.944091:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018240 00000100:00100000:2.0:1787397651.944099:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018240 00000100:00100000:2.0:1787397651.944150:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1787397651.944160:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701018240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397651.944173:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397651.944191:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19096a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190963 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397651.944206:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8132c5c00) 00010000:00010000:2.0:1787397651.944215:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397651.944256:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3649:x1874218701018240:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397651.944263:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1787397651.944616:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701018240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397651.984863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397651.985210:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173376 00000100:00100000:0.0:1787397651.985222:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173376 00000100:00100000:0.0:1787397651.985387:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1275 00000100:00100000:0.0:1787397651.985398:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70853:x1874218681173376:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397651.985419:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397651.985443:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d190986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d7fff expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.985928:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.985946:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.985958:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397651.986014:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397651.986019:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397651.986040:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.986067:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0000/0x274786fe0d190986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fff expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.986100:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fff expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.986108:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cd200) 00010000:00010000:0.0:1787397651.986111:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397651.986114:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1200, rc 0) 00000100:00100000:0.0:1787397651.986232:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173376:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 835us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.986240:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1275 00000100:00100000:3.0:1787397651.998727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397651.998822:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173504 00000100:00100000:0.0:1787397651.998834:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173504 00000100:00100000:0.0:1787397651.998904:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1276 00000100:00100000:0.0:1787397651.998915:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173504:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397651.998937:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397651.998959:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190994 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8006 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999036:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999051:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999063:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999073:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999094:0:66176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190971 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999103:0:66176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999138:0:66176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190971 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397651.999156:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218701018368:0@lo:104: 00000100:00100000:0.0:1787397651.999215:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397651.999254:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7049bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397651.999283:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787397651.999294:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018368 00000100:00100000:0.0:1787397651.999298:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018368 00000100:00100000:0.0:1787397651.999333:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787397651.999340:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66176:x1874218701018368:12345-0@lo:104: 00010000:00010000:0.0:1787397651.999353:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999402:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787397651.999408:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66176:x1874218701018368:12345-0@lo:104: Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397651.999415:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:0.0:1787397651.999472:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397651.999478:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999498:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787397651.999504:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397651.999513:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999871:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397651.999879:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397652.000788:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.000800:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720b800/0x274786fe0d190971 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190978 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.000822:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397652.000824:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397652.000827:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397652.000836:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397652.000854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701018496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397652.001051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397652.001151:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218701018368:0@lo:104: 00010000:00010000:0.0:1787397652.001172:0:66176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397652.012571:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018496 00000100:00100000:3.0:1787397652.012600:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018496 00010000:00010000:3.0:1787397652.012645:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x274786fe0d190971 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397652.012695:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1787397652.012704:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838247050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701018496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397652.012722:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787397652.014518:0:90971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00010000:00010000:1.0:1787397652.023829:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190978 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190971 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.023855:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a8191cd600) 00010000:00010000:1.0:1787397652.023860:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.023870:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.023876:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.023958:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397652.023995:0:66176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024003:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397652.024147:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66176:1874218701018624:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397652.024221:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397652.024258:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397652.024280:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018624 00000100:00100000:1.0:1787397652.024287:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018624 00000100:00100000:1.0:1787397652.024334:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1787397652.024344:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66176:x1874218701018624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397652.024422:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66176:x1874218701018624:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.024446:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1787397652.024495:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66176:1874218701018624:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787397652.024563:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024575:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024583:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397652.024620:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024636:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024643:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024651:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024657:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024663:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397652.024667:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024674:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024693:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cd200) 00010000:00010000:1.0:1787397652.024696:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397652.024700:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024707:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0400/0x274786fe0d19099b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024718:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024724:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024730:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024735:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397652.024738:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024745:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024752:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a8191cd600) 00010000:00010000:1.0:1787397652.024754:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397652.024757:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024762:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0800/0x274786fe0d1909a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024808:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d190994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8006 expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024821:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8006 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.024828:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066200) 00010000:00010000:1.0:1787397652.024830:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397652.024832:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31e00, rc 0) 00000100:00100000:1.0:1787397652.024878:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:70853:x1874218681173504:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 25965us (26163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.024885:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1276 00000100:00100000:1.0:1787397652.025042:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838247050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701018496:12345-0@lo:103:ldlm_bl.0 Request processed in 12339us (23990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.025051:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1787397652.025110:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701018496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397652.033315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.033694:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173632 00000100:00100000:1.0:1787397652.033706:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173632 00000100:00100000:1.0:1787397652.033758:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1277 00000100:00100000:1.0:1787397652.033767:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:70853:x1874218681173632:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397652.033790:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397652.033809:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d1909b0 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d800d expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.035439:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1909b7 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.035464:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1909b7 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.035476:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1909b7 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397652.035544:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1787397652.035548:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787397652.035589:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d1909b0 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d800d expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.035605:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1909b7 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d800d expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.035614:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:1.0:1787397652.035617:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787397652.035620:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00000100:00100000:1.0:1787397652.035690:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173632:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1923us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.035700:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1277 00000100:00100000:1.0:1787397652.049270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397652.049696:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173760 00000100:00100000:0.0:1787397652.049709:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173760 00000100:00100000:0.0:1787397652.049820:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1278 00000100:00100000:0.0:1787397652.049832:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173760:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397652.049855:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397652.049879:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909be lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8014 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.049970:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.049992:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050005:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050023:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050030:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050037:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050089:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050096:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050117:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050124:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050130:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397652.050135:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050142:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050154:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397652.050157:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397652.050162:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050168:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d1909c5 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050184:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050189:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050194:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050198:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397652.050208:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050214:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050222:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a8191cd700) 00010000:00010000:0.0:1787397652.050225:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397652.050227:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050233:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909cc lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050266:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909be lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8014 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050276:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397652.050278:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397652.050281:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909be lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8014 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.050290:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397652.050405:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173760:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 575us (1144us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397652.050413:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1278 00000100:00100000:3.0:1787397652.060261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397652.060346:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681173888 00000100:00100000:2.0:1787397652.060357:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681173888 00000100:00100000:2.0:1787397652.060426:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1279 00000100:00100000:2.0:1787397652.060436:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173888:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397652.060466:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397652.060488:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23a00/0x274786fe0d1909d3 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d801b expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060736:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060751:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060762:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060778:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060785:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060791:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060837:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060844:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060850:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060855:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397652.060860:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060877:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060890:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:2.0:1787397652.060893:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397652.060897:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060903:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d1909da lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060916:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060922:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060928:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060933:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397652.060936:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060942:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060950:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a817898700) 00010000:00010000:2.0:1787397652.060952:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397652.060955:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.060971:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d1909e1 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.061018:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23a00/0x274786fe0d1909d3 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d801b expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.061029:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:2.0:1787397652.061031:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397652.061035:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23a00/0x274786fe0d1909d3 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d801b expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.061045:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23a00, rc 0) 00000100:00100000:2.0:1787397652.061111:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681173888:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 676us (860us total) trans 0 rc 301/301 00000100:00100000:2.0:1787397652.061119:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1279 00000100:00100000:3.0:1787397652.068368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397652.071643:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681174016 00000100:00100000:0.0:1787397652.071661:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681174016 00000100:00100000:0.0:1787397652.071732:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1280 00000100:00100000:0.0:1787397652.071742:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+9:70853:x1874218681174016:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397652.071781:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397652.071807:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8022 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.071916:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.071933:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.071947:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397652.072020:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1787397652.072025:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397652.072055:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.072097:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8022 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.072129:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8022 expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.072140:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397652.072143:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787397652.072147:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1c00, rc 0) 00000100:00100000:0.0:1787397652.072294:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:70853:x1874218681174016:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 553us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397652.072304:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1280 00000100:00100000:1.0:1787397652.080516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397652.080688:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681174272 00000100:00100000:0.0:1787397652.080698:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681174272 00000100:00100000:0.0:1787397652.080758:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1281 00000100:00100000:0.0:1787397652.080768:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:70853:x1874218681174272:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397652.080791:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397652.080814:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8029 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397652.080944:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1787397652.081082:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8029 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.081098:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:0.0:1787397652.081101:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397652.081105:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0000/0x274786fe0d1909f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8029 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.081121:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397652.081230:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:70853:x1874218681174272:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 464us (724us total) trans 81604378735 rc 301/301 00000100:00100000:0.0:1787397652.081238:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1281 00000100:00100000:3.0:1787397652.092576:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.093113:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681174528 00000100:00100000:1.0:1787397652.093125:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681174528 00000100:00100000:1.0:1787397652.093188:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1282 00000100:00100000:1.0:1787397652.093197:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:70853:x1874218681174528:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:1.0:1787397652.093255:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397652.093296:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1c00/0x274786fe0d1909ef lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8022 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093315:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:1.0:1787397652.093320:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397652.093382:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093396:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093406:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093420:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093427:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.093434:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094009:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094020:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094027:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397652.094040:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000338f92c6 reply state 00000000e0c2d45a transno 81604378736 ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094056:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094062:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a806066c00) 00010000:00010000:1.0:1787397652.094065:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397652.094067:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787397652.094072:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1787397652.094081:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094088:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094094:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094100:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094105:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397652.094109:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094116:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094123:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:1.0:1787397652.094125:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397652.094128:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094142:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62800/0x274786fe0d190a04 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397652.094152:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000338f92c6 reply state 00000000e0c2d45a transno 81604378736 ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094159:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.094165:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a806066400) 00010000:00010000:1.0:1787397652.094167:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397652.094169:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787397652.094262:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:70853:x1874218681174528:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 1064us (1695us total) trans 81604378736 rc 0/0 00000100:00100000:1.0:1787397652.094271:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1282 00000100:00100000:2.0:1787397652.099970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397652.100125:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681174784 00000100:00100000:3.0:1787397652.100136:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681174784 00000100:00100000:3.0:1787397652.100192:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 227 00000100:00100000:3.0:1787397652.100203:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+12:70853:x1874218681174784:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397652.100549:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:70853:x1874218681174784:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 257us (498us total) trans 81604378737 rc 0/0 00000100:00100000:3.0:1787397652.100559:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 227 00000100:00100000:1.0:1787397652.145318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.145354:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.145393:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.145424:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681175168 00000100:00100000:1.0:1787397652.145434:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681175168 00000100:00100000:1.0:1787397652.145488:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681174912 00000100:00100000:1.0:1787397652.145492:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681174912 00000100:00100000:1.0:1787397652.145509:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681175040 00000100:00100000:1.0:1787397652.145511:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681175040 00000100:00100000:1.0:1787397652.145566:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 654 00000100:00100000:1.0:1787397652.145576:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+12:2404:x1874218681175168:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397652.145604:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397652.145627:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1904ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc7 expref: 12 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.145652:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397652.145707:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+11:2404:x1874218681175168:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.145714:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 654 00000100:00100000:1.0:1787397652.145734:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 655 00000100:00100000:1.0:1787397652.145740:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+10:2402:x1874218681174912:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397652.145747:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397652.145757:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74a00/0x274786fe0d1904e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fc0 expref: 10 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.145765:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397652.145783:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+9:2402:x1874218681174912:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.145789:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 655 00000100:00100000:1.0:1787397652.145801:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 656 00000100:00100000:1.0:1787397652.145807:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+8:2402:x1874218681175040:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397652.145814:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397652.145823:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050abc00/0x274786fe0d1906d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fdc expref: 8 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397652.145832:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397652.145849:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:2402:x1874218681175040:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 42us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.145855:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 656 00000100:00100000:1.0:1787397652.148091:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397652.148173:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681175424 00000100:00100000:0.0:1787397652.148184:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681175424 00000100:00100000:0.0:1787397652.148265:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4963 00000100:00100000:0.0:1787397652.148275:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+6:2401:x1874218681175424:12345-192.168.204.60@tcp:9:umount.0 00000020:00000080:0.0:1787397652.148305:0:26157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1902f6 00000020:00010000:0.0:1787397652.148312:0:26157:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a705064800: total 0 00000100:00080000:0.0:1787397652.148324:0:26157:0:(import.c:65:import_set_state_nolock()) ffff89a705067800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397652.148381:0:26157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968727 00000020:00010000:3.0:1787397652.148393:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a705064800: total 0 00010000:00010000:3.0:1787397652.148454:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a705064800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1787397652.148503:0:56853:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1787397652.148513:0:56853:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb atime from disk: 0 -> 1787397587 00002000:00010000:3.0:1787397652.148516:0:56853:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1787397652.148567:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19043f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f96 expref: 4 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397652.148585:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e90f04db-6a63-4f01-92c7-7bf813f9f081+3:2401:x1874218681175424:12345-192.168.204.60@tcp:9:umount.0 Request processed in 310us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397652.148593:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4963 00000100:00080000:1.0:1787397652.148688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787397652.148925:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a705064800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787397652.148943:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397652.148945:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397652.148946:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397652.158906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397652.159112:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681175808 00000100:00100000:0.0:1787397652.159130:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681175808 00000100:00100000:0.0:1787397652.159224:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4964 00000100:00100000:0.0:1787397652.159239:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+7:2401:x1874218681175808:12345-192.168.204.60@tcp:9:umount.0 00000020:00000080:0.0:1787397652.159274:0:26159:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1902ef 00000020:00010000:0.0:1787397652.159283:0:26159:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a828851000: total 0 00000100:00080000:0.0:1787397652.159288:0:26159:0:(import.c:65:import_set_state_nolock()) ffff89a7025d1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397652.159345:0:26159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968729 00000100:00100000:0.0:1787397652.159582:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e90f04db-6a63-4f01-92c7-7bf813f9f081+5:2401:x1874218681175808:12345-192.168.204.60@tcp:9:umount.0 Request processed in 346us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397652.159590:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4964 00000020:00010000:2.0:1787397652.159689:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a828851000: total 0 00010000:00010000:2.0:1787397652.159757:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a828851000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787397652.159830:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f8f expref: 4 pid: 26169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.159880:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f9d expref: 3 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.159897:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a828851000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787397652.159909:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397652.159929:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397652.159931:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397652.160015:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397652.169868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.173067:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681176320 00000100:00100000:1.0:1787397652.173082:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681176320 00000100:00100000:1.0:1787397652.173160:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1283 00000100:00100000:1.0:1787397652.173171:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+10:2401:x1874218681176320:12345-192.168.204.60@tcp:39:umount.0 00000020:00000080:1.0:1787397652.173221:0:74374:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190557 00000020:00010000:1.0:1787397652.173239:0:74374:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83670f000: total 0 00000100:00080000:1.0:1787397652.173244:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a817eff000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397652.173345:0:74374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149700 00000100:00100000:1.0:1787397652.173548:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e90f04db-6a63-4f01-92c7-7bf813f9f081+8:2401:x1874218681176320:12345-192.168.204.60@tcp:39:umount.0 Request processed in 379us (3690us total) trans 111669149701 rc 0/0 00000100:00100000:1.0:1787397652.173557:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1283 00000020:00010000:2.0:1787397652.178146:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83670f000: total 0 00010000:00010000:0.0:1787397652.178702:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83670f000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787397652.178745:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397652.178749:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397652.178761:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1800/0x274786fe0d190955 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7ff8 expref: 7 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.178792:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397652.178795:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787397652.178799:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d19072c lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7f88 expref: 6 pid: 91005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.179059:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066200) 00010000:00010000:0.0:1787397652.179063:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397652.179068:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d1909a9 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8006 expref: 5 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.179086:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cd200) 00010000:00010000:0.0:1787397652.179088:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397652.179092:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d19098d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fff expref: 4 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.179104:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83670f000, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1787397652.179119:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397652.179121:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397652.179123:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397652.187158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.187253:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681176576 00000100:00100000:1.0:1787397652.187271:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681176576 00000100:00100000:1.0:1787397652.187349:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1284 00000100:00100000:1.0:1787397652.187361:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+13:2401:x1874218681176576:12345-192.168.204.60@tcp:39:umount.0 00000020:00000080:1.0:1787397652.187411:0:66178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b299 00000020:00010000:1.0:1787397652.187430:0:66178:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83544d000: total 0 00000100:00080000:1.0:1787397652.187434:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a828a59800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397652.187492:0:66178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378737 00010000:00010000:3.0:1787397652.187570:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397652.187585:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397652.187701:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f04db-6a63-4f01-92c7-7bf813f9f081+11:2401:x1874218681176576:12345-192.168.204.60@tcp:39:umount.0 Request processed in 340us (559us total) trans 81604378738 rc 0/0 00000100:00100000:1.0:1787397652.187709:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1284 00010000:00010000:0.0:1787397652.187921:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.187948:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.187957:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.187964:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc1a774f0) 00000020:00010000:2.0:1787397652.187967:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83544d000: total 0 00010000:00010000:0.0:1787397652.187970:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.187983:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397652.187993:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188027:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a806066400) 00010000:00010000:0.0:1787397652.188031:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397652.188036:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188044:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d190a0b lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.188046:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83544d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787397652.188067:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188074:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188079:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188084:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397652.188087:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188092:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188099:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a806066c00) 00010000:00010000:0.0:1787397652.188101:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397652.188103:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.188108:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d190a12 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397652.190036:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.195131:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:2.0:1787397652.195142:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787397652.195155:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1909b7 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d800d expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397652.195238:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83544d000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787397652.195423:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397652.195427:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397652.195430:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397652.200053:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397652.200077:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397652.200099:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397652.200131:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066700) 00010000:00010000:3.0:1787397652.200134:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397652.200140:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397652.200177:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30e00/0x274786fe0d19097f lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397652.233358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397652.235404:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681176832 00000100:00100000:1.0:1787397652.235450:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681176832 00000100:00100000:1.0:1787397652.235595:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:1.0:1787397652.235610:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+7:2401:x1874218681176832:12345-192.168.204.60@tcp:251:umount.0 00000020:00000080:1.0:1787397652.235682:0:90984:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1904d9 00000020:00010000:1.0:1787397652.235691:0:90984:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a817ecd800: total 0 00000100:00080000:1.0:1787397652.235697:0:90984:0:(import.c:65:import_set_state_nolock()) ffff89a817ec8800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787397652.235786:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a817ecd800: total 0 00000100:00100000:1.0:1787397652.235812:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:367372d5-1a70-4e8f-8f10-c0f943f3662d+3:2401:x1874218681176832:12345-192.168.204.60@tcp:251:umount.0 Request processed in 204us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397652.235823:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00010000:00010000:2.0:1787397652.235878:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a817ecd800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787397652.235924:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa600/0x274786fe0d1904f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d7fce expref: 2 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397652.235945:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a817ecd800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787397652.235956:0:6510:0:(genops.c:906:class_export_put()) final put ffff89a817ecd800/367372d5-1a70-4e8f-8f10-c0f943f3662d 00010000:00010000:2.0:1787397652.235983:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397652.235985:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397652.235987:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397652.236149:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecd800/367372d5-1a70-4e8f-8f10-c0f943f3662d for MGS 00000020:00000080:3.0:1787397652.236210:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ec8800 for MGS 00010000:00010000:3.0:1787397652.260812:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397653.285743:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397653.339206:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.339409:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681176960 00000100:00100000:3.0:1787397653.339430:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681176960 00000100:00100000:3.0:1787397653.339485:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:3.0:1787397653.339494:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874218681176960:12345-192.168.204.60@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787397653.339556:0:90977:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp t0 exp 0000000000000000 cur 3532 last 0 00000020:00000080:3.0:1787397653.339589:0:90977:0:(genops.c:1406:class_connect()) connect: client e5696550-1ffc-466d-b13d-359d59b5fc5f, cookie 0x274786fe0d190a19 00000100:00080000:3.0:1787397653.339655:0:90977:0:(import.c:65:import_set_state_nolock()) ffff89a817ec8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397653.339737:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:2401:x1874218681176960:12345-192.168.204.60@tcp:250:mount.lustre.0 Request processed in 241us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.339746:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:1.0:1787397653.358770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397653.358814:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177088 00000100:00100000:1.0:1787397653.358824:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177088 00000100:00100000:1.0:1787397653.358878:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:1.0:1787397653.358887:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:70874:x1874218681177088:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787397653.358905:0:90975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397653.358926:0:90975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62200/0x274786fe0d190a20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d803e expref: -99 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397653.358968:0:90975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62200/0x274786fe0d190a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d803e expref: 6 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397653.358981:0:90975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62200/0x274786fe0d190a20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d803e expref: 6 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397653.358991:0:90975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:1.0:1787397653.359165:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70874:x1874218681177088:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 279us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.359173:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:2.0:1787397653.365903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.366038:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177216 00000100:00100000:0.0:1787397653.366048:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177216 00000100:00100000:0.0:1787397653.366116:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:0.0:1787397653.366126:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70874:x1874218681177216:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787397653.366275:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70874:x1874218681177216:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 150us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397653.366284:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:1.0:1787397653.372262:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.372448:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177344 00000100:00100000:3.0:1787397653.372459:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177344 00000100:00100000:3.0:1787397653.372515:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:3.0:1787397653.372572:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70874:x1874218681177344:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787397653.372590:0:90977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397653.372609:0:90977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b600/0x274786fe0d190a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8045 expref: -99 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.372640:0:90977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b600/0x274786fe0d190a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8045 expref: 7 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.372665:0:90977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b600/0x274786fe0d190a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8045 expref: 7 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.372675:0:90977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b600, rc 0) 00000100:00100000:3.0:1787397653.372739:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70874:x1874218681177344:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 216us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.372746:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:1.0:1787397653.375019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.375117:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177472 00000100:00100000:2.0:1787397653.375128:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177472 00000100:00100000:2.0:1787397653.375225:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:2.0:1787397653.375236:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70874:x1874218681177472:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787397653.375412:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70874:x1874218681177472:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 178us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397653.375445:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:2.0:1787397653.380939:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.381045:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177600 00000100:00100000:3.0:1787397653.381055:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177600 00000100:00100000:3.0:1787397653.381118:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:3.0:1787397653.381127:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70874:x1874218681177600:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787397653.381287:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70874:x1874218681177600:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.381294:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:2.0:1787397653.403536:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397653.404364:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177728 00000100:00100000:1.0:1787397653.404376:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177728 00000100:00100000:1.0:1787397653.404444:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:1.0:1787397653.404454:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177728:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397653.404738:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177728:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 284us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.404746:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:1.0:1787397653.438341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.438468:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177856 00000100:00100000:2.0:1787397653.438480:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177856 00000100:00100000:3.0:1787397653.438699:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:3.0:1787397653.438711:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177856:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787397653.439036:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177856:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 327us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.439046:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 94 00000100:00100000:2.0:1787397653.446362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.451398:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681177984 00000100:00100000:0.0:1787397653.451414:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681177984 00000100:00100000:1.0:1787397653.458245:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:1.0:1787397653.458262:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177984:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397653.458514:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70893:x1874218681177984:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 254us (12159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.458541:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:1.0:1787397653.463630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.463771:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178112 00000100:00100000:0.0:1787397653.463783:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178112 00000100:00100000:0.0:1787397653.463839:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:0.0:1787397653.463850:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70874:x1874218681178112:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787397653.463865:0:90976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397653.463884:0:90976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1200/0x274786fe0d190a2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8076 expref: -99 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397653.463927:0:90976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1200/0x274786fe0d190a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8076 expref: 9 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397653.463941:0:90976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1200/0x274786fe0d190a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8076 expref: 9 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397653.463958:0:90976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1200, rc 0) 00000100:00100000:0.0:1787397653.464019:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70874:x1874218681178112:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 170us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.464039:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 96 00000100:00100000:2.0:1787397653.469065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397653.469185:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178240 00000100:00100000:1.0:1787397653.469251:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178240 00000100:00100000:1.0:1787397653.469312:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:1.0:1787397653.469322:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70874:x1874218681178240:12345-192.168.204.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787397653.469349:0:90984:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787397653.469374:0:90984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787397653.469378:0:90984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787397653.469381:0:90984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787397653.469384:0:90984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787397653.469386:0:90984:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1787397653.474073:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70874:x1874218681178240:12345-192.168.204.60@tcp:256:mount.lustre.0 Request processed in 4738us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.474089:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:1.0:1787397653.476930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701018752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397653.477026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397653.477132:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018752 00000100:00100000:2.0:1787397653.477141:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018752 00000100:00100000:2.0:1787397653.477197:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1787397653.477206:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701018752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397653.477242:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397653.477309:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701018752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397653.477316:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1787397653.477470:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701018752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397653.477895:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701019136:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.477938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397653.478000:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701019264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.478026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397653.478080:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701019648:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478547:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701019008:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478616:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701019520:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478680:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787397653.478686:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701018880:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478739:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701019392:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478830:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701019776:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478870:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478909:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397653.478915:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701019904:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.478936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.478985:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701020032:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.479008:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.479046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397653.479052:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701020160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.479073:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397653.479097:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019776 00000100:00100000:0.0:1787397653.479236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397653.479269:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019136 00000100:00100000:0.0:1787397653.479274:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019136 00000100:00100000:0.0:1787397653.479320:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019264 00000100:00100000:0.0:1787397653.479323:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019264 00000100:00100000:0.0:1787397653.479338:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019008 00000100:00100000:0.0:1787397653.479341:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019008 00000100:00100000:0.0:1787397653.479355:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019392 00000100:00100000:0.0:1787397653.479357:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019392 00000100:00100000:0.0:1787397653.479370:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019904 00000100:00100000:0.0:1787397653.479372:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019904 00000100:00100000:0.0:1787397653.479388:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1787397653.479396:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479443:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701019136:12345-0@lo:400:kworker.0 Request processed in 47us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.479452:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1787397653.479467:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1787397653.479474:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701019264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479507:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701019264:12345-0@lo:400:kworker.0 Request processed in 34us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.479538:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1787397653.479552:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1787397653.479558:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701019008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479593:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701019008:12345-0@lo:400:kworker.0 Request processed in 35us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.479598:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1787397653.479609:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1787397653.479615:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479640:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701019392:12345-0@lo:400:kworker.0 Request processed in 25us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.479646:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1787397653.479658:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1787397653.479664:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701019904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479688:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701019904:12345-0@lo:400:kworker.0 Request processed in 25us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.479693:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1787397653.479769:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701019264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479799:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701019904:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479809:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701019392:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479817:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701019008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.479927:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701019136:0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480037:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019520 00000100:00100000:1.0:1787397653.480043:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019520 00000100:00100000:1.0:1787397653.480083:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1787397653.480090:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701019520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480148:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701019520:12345-0@lo:400:kworker.0 Request processed in 58us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.480154:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1787397653.480191:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020032 00000100:00100000:1.0:1787397653.480195:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020032 00000100:00100000:1.0:1787397653.480221:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020160 00000100:00100000:1.0:1787397653.480224:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020160 00000100:00100000:1.0:1787397653.480241:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701019648 00000100:00100000:1.0:1787397653.480244:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019648 00000100:00100000:1.0:1787397653.480266:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1787397653.480271:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480302:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701020032:12345-0@lo:400:kworker.0 Request processed in 31us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.480308:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1787397653.480319:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1787397653.480324:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480350:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701020160:12345-0@lo:400:kworker.0 Request processed in 26us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.480366:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1787397653.480378:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1787397653.480383:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480413:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701019648:12345-0@lo:400:kworker.0 Request processed in 30us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.480418:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00080000:1.0:1787397653.480435:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397653.480439:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397653.480442:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397653.480444:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397653.480483:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701020160:0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480510:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701020032:0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480546:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000004:00080000:1.0:1787397653.480551:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149700 committed transno 111669149700 00000100:00100000:1.0:1787397653.480568:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701019520:0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480590:0:90977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701018880 00000100:00100000:1.0:1787397653.480593:0:90977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701018880 00000100:00100000:1.0:1787397653.480619:0:90977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787397653.480625:0:90977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397653.480660:0:90977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701018880:12345-0@lo:400:kworker.0 Request processed in 35us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.480665:0:90977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787397653.480699:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701018880:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.481293:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701019776 00000100:00080000:1.0:1787397653.481393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397653.481493:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701019648:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.481601:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397653.481610:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701020288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.481651:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397653.481694:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020288 00000100:00100000:0.0:1787397653.481698:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020288 00000100:00100000:0.0:1787397653.481725:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1787397653.481732:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701020288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397653.481770:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701020288:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.481776:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1787397653.481805:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701020288:0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.481897:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1787397653.481906:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397653.481944:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701019776:12345-0@lo:400:kworker.0 Request processed in 40us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.481960:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1787397653.482022:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701019776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397653.483779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.483938:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178368 00000100:00100000:3.0:1787397653.483945:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178368 00000100:00100000:3.0:1787397653.484056:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:3.0:1787397653.484068:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70874:x1874218681178368:12345-192.168.204.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787397653.484098:0:90982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397653.484129:0:90982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a600/0x274786fe0d190a35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d807d expref: -99 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.484160:0:90982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a600/0x274786fe0d190a35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d807d expref: 10 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.484172:0:90982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a600/0x274786fe0d190a35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d807d expref: 10 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397653.484181:0:90982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:3.0:1787397653.484291:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70874:x1874218681178368:12345-192.168.204.60@tcp:101:mount.lustre.0 Request processed in 225us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.484298:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:2.0:1787397653.487922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397653.488053:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178496 00000100:00100000:1.0:1787397653.488064:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178496 00000100:00100000:1.0:1787397653.488221:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:1.0:1787397653.488232:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70874:x1874218681178496:12345-192.168.204.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787397653.488422:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70874:x1874218681178496:12345-192.168.204.60@tcp:501:mount.lustre.0 Request processed in 191us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.488430:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:2.0:1787397653.490471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.490573:0:90976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178624 00000100:00100000:0.0:1787397653.490582:0:90976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178624 00000100:00100000:0.0:1787397653.490641:0:90976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:0.0:1787397653.490650:0:90976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70874:x1874218681178624:12345-192.168.204.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787397653.490827:0:90976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70874:x1874218681178624:12345-192.168.204.60@tcp:503:mount.lustre.0 Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.490836:0:90976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:2.0:1787397653.501643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.501988:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178752 00000100:00100000:3.0:1787397653.501999:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178752 00000100:00100000:3.0:1787397653.502193:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:3.0:1787397653.502203:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70898:x1874218681178752:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787397653.502545:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70898:x1874218681178752:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 341us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.502555:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:2.0:1787397653.506859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397653.507104:0:90984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681178880 00000100:00100000:1.0:1787397653.507114:0:90984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681178880 00000100:00100000:1.0:1787397653.507233:0:90984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:1.0:1787397653.507244:0:90984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70898:x1874218681178880:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397653.507421:0:90984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70898:x1874218681178880:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 178us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.507430:0:90984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787397653.523843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.523892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.524007:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179008 00000100:00100000:0.0:1787397653.524018:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179008 00000100:00100000:0.0:1787397653.524070:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179264 00000100:00100000:0.0:1787397653.524073:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179264 00000100:00100000:0.0:1787397653.524100:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1285 00000100:00100000:0.0:1787397653.524124:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681179008:12345-192.168.204.60@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787397653.524161:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3532 last 0 00000020:00000080:0.0:1787397653.524214:0:74374:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d190a3c 00000004:00100000:0.0:1787397653.524241:0:74374:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787397653.524397:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1286 00000100:00100000:2.0:1787397653.524404:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681179264:12345-192.168.204.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787397653.524421:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3532 last 0 00000020:00000080:2.0:1787397653.524456:0:66178:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d190a43 00000004:00100000:2.0:1787397653.524470:0:66178:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787397653.525835:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397653.525933:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681179264:12345-192.168.204.60@tcp:38:mount.lustre.0 Request processed in 1525us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397653.525944:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1286 00000100:00080000:0.0:1787397653.526302:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a835591000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397653.526333:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681179008:12345-192.168.204.60@tcp:38:mount.lustre.0 Request processed in 2209us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.526340:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1285 00000100:00100000:2.0:1787397653.537919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.537976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.538770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397653.540840:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179392 00000100:00100000:0.0:1787397653.540855:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179392 00000100:00100000:3.0:1787397653.540883:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179136 00000100:00100000:3.0:1787397653.540887:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179136 00000100:00100000:0.0:1787397653.540935:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179520 00000100:00100000:0.0:1787397653.540939:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179520 00000100:00100000:0.0:1787397653.540990:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1287 00000100:00100000:1.0:1787397653.541111:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1288 00000100:00100000:1.0:1787397653.541124:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70874:x1874218681179520:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787397653.541164:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787397653.541499:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:0:x1874218681179392:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787397653.541515:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00080000:3.0:1787397653.543650:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397653.543663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397653.543756:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1289 00000100:00100000:3.0:1787397653.543768:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:0:x1874218681179136:12345-192.168.204.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787397653.543799:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:1.0:1787397653.545824:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70874:x1874218681179520:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 4686us (7039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.545842:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1288 00000100:00100000:0.0:1787397653.545980:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:0:x1874218681179392:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 4485us (8068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397653.545988:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1287 00000100:00100000:3.0:1787397653.547547:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:0:x1874218681179136:12345-192.168.204.60@tcp:41:mount.lustre.0 Request processed in 3774us (9563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.547560:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1289 00000100:00100000:2.0:1787397653.561140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.561320:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179648 00000100:00100000:3.0:1787397653.561331:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179648 00000100:00100000:3.0:1787397653.561397:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1290 00000100:00100000:3.0:1787397653.561407:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681179648:12345-192.168.204.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787397653.561511:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681179648:12345-192.168.204.60@tcp:40:mount.lustre.0 Request processed in 104us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.561518:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1290 00000100:00100000:2.0:1787397653.570775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.570816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397653.570839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.571004:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179776 00000100:00100000:3.0:1787397653.571015:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179776 00000100:00100000:3.0:1787397653.571053:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681179904 00000100:00100000:3.0:1787397653.571056:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681179904 00000100:00100000:3.0:1787397653.571072:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4965 00000100:00100000:3.0:1787397653.571080:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2401:x1874218681179776:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787397653.571116:0:26169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3532 last 0 00000020:00000080:3.0:1787397653.571153:0:26169:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d190a4a 00002000:00100000:3.0:1787397653.571165:0:26169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a803e9d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397653.571183:0:26169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397653.571266:0:26169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397653.571296:0:26169:0:(import.c:65:import_set_state_nolock()) ffff89a803e9b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397653.571364:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681179776:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 283us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.571371:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4965 00000100:00100000:3.0:1787397653.571389:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4966 00000100:00100000:3.0:1787397653.571410:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2401:x1874218681179904:12345-192.168.204.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787397653.571425:0:26169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3532 last 0 00000020:00000080:3.0:1787397653.571440:0:26169:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d190a51 00002000:00100000:3.0:1787397653.571445:0:26169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a803e9a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397653.571456:0:26169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397653.571496:0:26169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787397653.571512:0:26169:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397653.571585:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681179904:12345-192.168.204.60@tcp:8:mount.lustre.0 Request processed in 174us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397653.571593:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4966 00000100:00100000:1.0:1787397653.571775:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180032 00000100:00100000:1.0:1787397653.571780:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180032 00000100:00100000:1.0:1787397653.571820:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787397653.571827:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681180032:12345-192.168.204.60@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787397653.571878:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681180032:12345-192.168.204.60@tcp:900:mount.lustre.0 Request processed in 51us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.571885:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787397653.577603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397653.582079:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180160 00000100:00100000:3.0:1787397653.582096:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180160 00000100:00100000:2.0:1787397653.582367:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:2.0:1787397653.582381:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681180160:12345-192.168.204.60@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787397653.582476:0:66180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787397653.582707:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70874:x1874218681180160:12345-192.168.204.60@tcp:33:mount.lustre.0 Request processed in 328us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397653.582716:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:1.0:1787397653.988890:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397653.988951:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701020416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397653.989032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397653.989090:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020416 00000100:00100000:1.0:1787397653.989098:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020416 00000100:00100000:1.0:1787397653.989153:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1787397653.989163:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701020416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397653.989201:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:1.0:1787397653.989581:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701020416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 419us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.989589:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1787397653.989619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397653.989649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397653.989691:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701020416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397653.989769:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020544 00000100:00100000:2.0:1787397653.989775:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020544 00000100:00100000:2.0:1787397653.989819:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1787397653.989828:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701020544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397653.989845:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397653.989885:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701020544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397653.989892:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1787397653.990585:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701020672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397653.990627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397653.991068:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020672 00000100:00100000:1.0:1787397653.991075:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020672 00000100:00100000:1.0:1787397653.991163:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1787397653.991171:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701020672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397653.991188:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397653.991245:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701020672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397653.991262:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1787397653.991311:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701020544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397653.991597:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701020672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787397654.309188:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397654.501045:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397654.501071:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701020800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397654.501146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397654.501266:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020800 00000100:00100000:2.0:1787397654.501275:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020800 00000100:00100000:2.0:1787397654.501333:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1787397654.501344:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701020800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397654.501367:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397654.501417:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701020800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397654.501425:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1787397654.501471:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701020800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397654.502008:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701020928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397654.502051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397654.507078:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701020928 00000100:00100000:0.0:1787397654.507095:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701020928 00000100:00100000:0.0:1787397654.507234:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:0.0:1787397654.507245:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701020928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397654.507289:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397654.507391:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701020928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (5338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397654.507398:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1787397654.507516:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701020928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787397655.333020:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397655.579866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397655.588109:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180288 00000100:00100000:1.0:1787397655.588125:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180288 00000100:00100000:1.0:1787397655.588229:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1291 00000100:00100000:1.0:1787397655.588241:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180288:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397655.588261:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397655.588290:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d190a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80ae expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588364:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588378:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588390:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397655.588436:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397655.588439:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397655.588456:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588476:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d190a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588493:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397655.588514:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a806066d00) 00010000:00010000:1.0:1787397655.588517:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397655.588758:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63c00, rc 0) 00000100:00100000:1.0:1787397655.588831:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70942:x1874218681180288:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 593us (8976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397655.588839:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1291 00000100:00080000:3.0:1787397655.589917:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397655.593667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397655.595631:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180416 00000100:00100000:0.0:1787397655.595646:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180416 00000100:00100000:0.0:1787397655.595800:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1292 00000100:00100000:0.0:1787397655.595815:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70942:x1874218681180416:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397655.595858:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787397655.595962:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70942:x1874218681180416:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 151us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397655.595971:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1292 00000100:00100000:2.0:1787397655.603634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397655.603859:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180544 00000100:00100000:3.0:1787397655.603869:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180544 00000100:00100000:3.0:1787397655.603954:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1293 00000100:00100000:3.0:1787397655.603965:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180544:12345-192.168.204.60@tcp:41:lfs.0 00000100:00080000:1.0:1787397655.603971:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1787397655.604003:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397655.604073:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180544:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 110us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397655.604097:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1293 00000100:00100000:2.0:1787397655.615156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397655.615550:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180672 00000100:00100000:0.0:1787397655.615561:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180672 00000100:00100000:0.0:1787397655.615646:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2023 00000100:00100000:0.0:1787397655.615656:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180672:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397655.615694:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397655.615957:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180672:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 301us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397655.615965:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2023 00000100:00080000:1.0:1787397655.616184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397655.626704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397655.626785:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180800 00000100:00100000:0.0:1787397655.626796:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180800 00000100:00100000:0.0:1787397655.626871:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2024 00000100:00100000:0.0:1787397655.626882:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180800:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397655.626939:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397655.627024:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70942:x1874218681180800:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 143us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397655.627033:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2024 00000100:00080000:1.0:1787397655.627161:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397656.359368:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397656.438329:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397656.438430:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681180928 00000100:00100000:1.0:1787397656.438494:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681180928 00000100:00100000:1.0:1787397656.438832:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1294 00000100:00100000:1.0:1787397656.438843:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681180928:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:1.0:1787397656.438867:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397656.438888:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d190a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80b5 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.438965:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.438983:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.438996:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439011:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439025:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439032:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439116:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439124:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439132:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397656.439185:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439198:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439206:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439213:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439219:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397656.439224:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439231:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439251:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a806066d00) 00010000:00010000:1.0:1787397656.439254:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397656.439258:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439264:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d190a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439275:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439281:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439286:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439291:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397656.439294:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439299:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439307:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a806066a00) 00010000:00010000:1.0:1787397656.439309:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397656.439312:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439318:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d190a74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439363:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d190a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80b5 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439377:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80b5 expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397656.439384:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a806066900) 00010000:00010000:1.0:1787397656.439386:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397656.439388:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00000100:00100000:1.0:1787397656.439456:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681180928:12345-192.168.204.60@tcp:101:cp.0 Request processed in 614us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397656.439464:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1294 00000100:00100000:3.0:1787397656.445021:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397656.449793:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181056 00000100:00100000:1.0:1787397656.449816:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181056 00000100:00100000:1.0:1787397656.449883:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:1.0:1787397656.449903:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835613050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70976:x1874218681181056:12345-192.168.204.60@tcp:900:cp.0 00000100:00100000:1.0:1787397656.450013:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835613050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70976:x1874218681181056:12345-192.168.204.60@tcp:900:cp.0 Request processed in 121us (5001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397656.450021:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787397656.457358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397656.457458:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181184 00000100:00100000:0.0:1787397656.457471:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181184 00000100:00100000:0.0:1787397656.457655:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1295 00000100:00100000:0.0:1787397656.457680:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70976:x1874218681181184:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:0.0:1787397656.457702:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397656.457729:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1000/0x274786fe0d190a82 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80bc expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397656.457817:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0800/0x274786fe0d190a89 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397656.457831:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0800/0x274786fe0d190a89 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397656.457843:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0800/0x274786fe0d190a89 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397656.457905:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1787397656.457908:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787397656.457970:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1000/0x274786fe0d190a82 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80bc expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397656.457999:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0800/0x274786fe0d190a89 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80bc expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397656.458019:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:0.0:1787397656.458022:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787397656.458026:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0800, rc 0) 00000100:00100000:0.0:1787397656.458086:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7030c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681181184:12345-192.168.204.60@tcp:101:cp.0 Request processed in 409us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397656.458093:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1295 00000100:00100000:2.0:1787397656.463185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397656.463263:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181312 00000100:00100000:3.0:1787397656.463274:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181312 00000100:00100000:3.0:1787397656.463337:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1296 00000100:00100000:3.0:1787397656.463348:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681181312:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:3.0:1787397656.463370:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397656.463392:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a200/0x274786fe0d190a90 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80c3 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463460:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463475:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463487:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463501:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463519:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463549:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463632:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463788:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.463973:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397656.464016:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1787397656.464020:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397656.464045:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464058:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464065:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464071:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464077:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397656.464081:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464089:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464101:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:3.0:1787397656.464105:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397656.464110:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464127:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a000/0x274786fe0d190a97 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464299:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464306:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464312:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464318:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397656.464320:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464326:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464335:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a70229d800) 00010000:00010000:3.0:1787397656.464338:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397656.464341:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464347:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d190a9e lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464381:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a200/0x274786fe0d190a90 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80c3 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464406:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80c3 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.464413:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397656.464415:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787397656.464417:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720bc00, rc 0) 00000100:00100000:3.0:1787397656.464493:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181312:12345-192.168.204.60@tcp:101:cp.0 Request processed in 1146us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397656.464501:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1296 00000100:00100000:3.0:1787397656.469538:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397656.469629:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181440 00000100:00100000:2.0:1787397656.469641:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181440 00000100:00100000:2.0:1787397656.469728:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1297 00000100:00100000:2.0:1787397656.469739:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181440:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:2.0:1787397656.469761:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397656.469784:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22000/0x274786fe0d190aac lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80ca expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469867:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469882:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469911:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469926:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469933:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.469940:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470177:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470185:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470192:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470197:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397656.470201:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470208:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470220:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:2.0:1787397656.470223:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397656.470227:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470240:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d190ab3 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470254:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470260:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470266:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470271:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397656.470274:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470280:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470289:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a817898500) 00010000:00010000:2.0:1787397656.470291:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397656.470294:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470299:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d190aba lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470335:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22000/0x274786fe0d190aac lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ca expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470357:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:2.0:1787397656.470360:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397656.470365:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22000/0x274786fe0d190aac lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ca expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397656.470375:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22000, rc 0) 00000100:00100000:2.0:1787397656.470491:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181440:12345-192.168.204.60@tcp:101:cp.0 Request processed in 753us (991us total) trans 0 rc 301/301 00000100:00100000:2.0:1787397656.470499:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1297 00000100:00100000:2.0:1787397656.476903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397656.477033:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181568 00000100:00100000:3.0:1787397656.477044:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181568 00000100:00100000:3.0:1787397656.477111:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1298 00000100:00100000:3.0:1787397656.477122:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181568:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:3.0:1787397656.477143:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397656.477167:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b000/0x274786fe0d190ac1 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80d1 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477248:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477262:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477273:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477300:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477308:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477315:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477369:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477377:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477382:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477389:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477395:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397656.477399:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477407:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477418:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397656.477421:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397656.477425:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477438:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b400/0x274786fe0d190ac8 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477453:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477459:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477465:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477469:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397656.477472:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477478:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477485:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a70229d100) 00010000:00010000:3.0:1787397656.477487:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397656.477490:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477495:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d190acf lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477615:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b000/0x274786fe0d190ac1 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80d1 expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477636:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397656.477711:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397656.477717:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b000/0x274786fe0d190ac1 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80d1 expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397656.477728:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:3.0:1787397656.477796:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181568:12345-192.168.204.60@tcp:101:cp.0 Request processed in 675us (913us total) trans 0 rc 301/301 00000100:00100000:3.0:1787397656.478066:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1298 00000100:00100000:1.0:1787397656.481317:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397656.481437:0:66196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181696 00000100:00100000:3.0:1787397656.481446:0:66196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181696 00000100:00100000:3.0:1787397656.481494:0:66196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787397656.481502:0:66196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181696:12345-192.168.204.60@tcp:700:cp.0 00000020:02000000:3.0:1787397656.481514:0:66196:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:3.0:1787397656.492140:0:66196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681181696:12345-192.168.204.60@tcp:700:cp.0 Request processed in 10628us (10820us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397656.492155:0:66196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00010000:00010000:3.0:1787397657.381994:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787397657.577268:0:90971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:3.0:1787397657.577295:0:90971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:3.0:1787397657.577304:0:90971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149701 is committed 00000020:00000080:3.0:1787397657.577310:0:90971:0:(genops.c:906:class_export_put()) final put ffff89a83670f000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00100000:1.0:1787397657.578984:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:1.0:1787397657.578999:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:1.0:1787397657.579003:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a828851000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:0.0:1787397657.579008:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670f000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0000 00000020:00000080:0.0:1787397657.579069:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828851000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0000 00000020:00000080:0.0:1787397657.579095:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817eff000 for lustre-MDT0000 00000020:00000080:0.0:1787397657.579248:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7025d1800 for lustre-OST0000 00000001:00100000:3.0:1787397657.580090:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:3.0:1787397657.580109:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000001:00080000:3.0:1787397657.580119:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378738 is committed 00000020:00000080:3.0:1787397657.580221:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a83544d000/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00080000:3.0:1787397657.580244:0:75615:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a82ee16180 refcount 2 committed 0 result 0 batchid 77309411386 00000020:00080000:3.0:1787397657.580248:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a83b992d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a82ee16780 00000020:00080000:3.0:1787397657.580252:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].2 00000020:00080000:3.0:1787397657.580255:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a83b992f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a803ba0e00 00000020:00080000:3.0:1787397657.580258:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].2 00000020:00000080:0.0:1787397657.580448:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83544d000/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-MDT0001 00000020:00000080:0.0:1787397657.580515:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a59800 for lustre-MDT0001 00000020:00080000:1.0:1787397657.582745:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411386 committed batchid 77309411385 00000020:00080000:1.0:1787397657.582845:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000001:00100000:2.0:1787397657.584388:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:2.0:1787397657.584403:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:2.0:1787397657.584407:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a705064800/e90f04db-6a63-4f01-92c7-7bf813f9f081 00000020:00000080:0.0:1787397657.585728:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a705064800/e90f04db-6a63-4f01-92c7-7bf813f9f081 for lustre-OST0001 00000020:00000080:0.0:1787397657.585786:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a705067800 for lustre-OST0001 00010000:00010000:2.0:1787397658.411567:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397658.596770:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701021056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.596839:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701021440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.596865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397658.596938:0:90975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021056 00000100:00100000:1.0:1787397658.596946:0:90975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021056 00000100:00100000:1.0:1787397658.597016:0:90975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787397658.597025:0:90975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a837b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701021056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.599969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.599980:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701021568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600009:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701021952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600067:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701022080:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600095:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397658.600115:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701022464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600123:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701022592:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600203:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021440 00000100:00100000:0.0:1787397658.600205:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701021184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600210:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021440 00000100:00100000:0.0:1787397658.600235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397658.600276:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701021696:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600293:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021568 00000100:00100000:2.0:1787397658.600297:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021568 00000100:00100000:2.0:1787397658.600315:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022080 00000100:00100000:2.0:1787397658.600319:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022080 00000100:00100000:0.0:1787397658.600320:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600339:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022592 00000100:00100000:2.0:1787397658.600343:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022592 00000100:00100000:0.0:1787397658.600348:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022208:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600354:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021184 00000100:00100000:2.0:1787397658.600358:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021184 00000100:00100000:0.0:1787397658.600379:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600383:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1787397658.600394:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701021440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600402:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397658.600427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397658.600454:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397658.600463:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701021440:12345-0@lo:400:kworker.0 Request processed in 71us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397658.600472:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1787397658.600475:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701021312:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600492:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1787397658.600501:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701021568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397658.600551:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701021824:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600565:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701021568:12345-0@lo:400:kworker.0 Request processed in 65us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397658.600573:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1787397658.600580:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397658.600586:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021312 00000100:00100000:2.0:1787397658.600590:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021312 00000100:00100000:0.0:1787397658.600605:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.600611:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1787397658.600618:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701022080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600633:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397658.600674:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1787397658.600683:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701022592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600714:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701022592:12345-0@lo:400:kworker.0 Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.600720:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1787397658.600734:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1787397658.600740:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701021184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600770:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701021184:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.600776:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1787397658.600787:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1787397658.600792:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701021312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.600831:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701021312:12345-0@lo:400:kworker.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.600837:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1787397658.600869:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021952 00000100:00100000:0.0:1787397658.600873:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021952 00000100:00100000:0.0:1787397658.600902:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022464 00000100:00100000:0.0:1787397658.600905:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022464 00000100:00100000:0.0:1787397658.600923:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021824 00000100:00100000:0.0:1787397658.600926:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021824 00000100:00100000:0.0:1787397658.600944:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022336 00000100:00100000:0.0:1787397658.600946:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022336 00000100:00100000:0.0:1787397658.600966:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1787397658.600972:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701021952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601002:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701021952:12345-0@lo:400:kworker.0 Request processed in 30us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601008:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1787397658.601021:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1787397658.601027:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701022464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601053:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701022464:12345-0@lo:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601058:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1787397658.601068:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1787397658.601073:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701021824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601099:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701021824:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601104:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1787397658.601114:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1787397658.601126:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701022336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601155:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701022336:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601161:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1787397658.601187:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701021696 00000100:00100000:0.0:1787397658.601191:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701021696 00000100:00100000:0.0:1787397658.601207:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022208 00000100:00100000:0.0:1787397658.601210:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022208 00000100:00100000:0.0:1787397658.601220:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022720 00000100:00100000:0.0:1787397658.601222:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022720 00000100:00100000:0.0:1787397658.601233:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1787397658.601238:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701021696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601273:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701021696:12345-0@lo:400:kworker.0 Request processed in 34us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601279:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1787397658.601292:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1787397658.601296:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701022208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601322:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701022208:12345-0@lo:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601328:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:0.0:1787397658.601339:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1787397658.601344:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701022720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397658.601367:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397658.601395:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701022720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397658.601401:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1787397658.601482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701021312:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601493:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701021824:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601502:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022336:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601510:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701021184:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601542:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701021696:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601553:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022208:0@lo:400:kworker.0 00000100:00100000:0.0:1787397658.601566:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701022720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397658.602591:0:90975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a837b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701021056:12345-0@lo:400:kworker.0 Request processed in 5562us (5723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397658.602603:0:90975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787397658.603749:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8288c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701022080:12345-0@lo:400:kworker.0 Request processed in 40us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397658.603872:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00080000:2.0:1787397658.603925:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397658.603932:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397658.603934:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397658.603937:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397658.604004:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701021440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604019:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701021952:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604032:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701022464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604082:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701021568:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604097:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701022080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604111:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701022592:0@lo:400:kworker.0 00000100:00100000:2.0:1787397658.604122:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701021056:0@lo:400:kworker.0 00000100:00100000:3.0:1787397658.888794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397658.888867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397658.888903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397658.888927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397658.888953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397658.888995:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181952 00000100:00100000:3.0:1787397658.889006:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181952 00000100:00100000:3.0:1787397658.889085:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182080 00000100:00100000:3.0:1787397658.889089:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182080 00000100:00100000:3.0:1787397658.889117:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1279 00000100:00100000:3.0:1787397658.889128:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681181952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397658.889212:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681181952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397658.889220:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1279 00000100:00100000:3.0:1787397658.889238:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1280 00000100:00100000:3.0:1787397658.889245:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681182080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397658.889278:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681182080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397658.889285:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1280 00000100:00100000:3.0:1787397658.889307:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182208 00000100:00100000:3.0:1787397658.889317:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182208 00000100:00100000:3.0:1787397658.889363:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182336 00000100:00100000:3.0:1787397658.889366:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182336 00000100:00100000:3.0:1787397658.889391:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2543 00000100:00100000:3.0:1787397658.889397:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681182208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397658.889424:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681182208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397658.889431:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2543 00000100:00100000:3.0:1787397658.889442:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2544 00000100:00100000:3.0:1787397658.889448:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681182336:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397658.889471:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681182336:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397658.889477:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2544 00000100:00100000:3.0:1787397658.889495:0:90982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181824 00000100:00100000:3.0:1787397658.889498:0:90982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181824 00000100:00100000:3.0:1787397658.889546:0:90982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:3.0:1787397658.889566:0:90982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681181824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397658.889591:0:90982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80ff7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681181824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397658.889597:0:90982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00080000:3.0:1787397658.889635:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397658.889639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397658.889642:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397658.889644:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397659.108932:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701022848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397659.109075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397659.109218:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022848 00000100:00100000:0.0:1787397659.109228:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022848 00000100:00100000:0.0:1787397659.109293:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1787397659.109303:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701022848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397659.109334:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397659.109386:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701022848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397659.109394:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1787397659.109440:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701022848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397659.110921:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397659.110943:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701022976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397659.111006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397659.111091:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701022976 00000100:00100000:0.0:1787397659.111099:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701022976 00000100:00100000:0.0:1787397659.111152:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1787397659.111162:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701022976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397659.111196:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787397659.111380:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701022976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 219us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397659.111397:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1787397659.111439:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701022976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397659.112055:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701023104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397659.112182:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397659.112964:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023104 00000100:00100000:3.0:1787397659.112973:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023104 00000100:00100000:3.0:1787397659.113061:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1787397659.113073:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701023104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397659.113109:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397659.113175:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701023104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397659.113182:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:2.0:1787397659.113253:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701023104:0@lo:13:osp-pre-1-0.0 00000020:01000004:1.0:1787397659.119690:0:91993:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787397659.119757:0:91993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.119773:0:91993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.119782:0:91993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.119789:0:91993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.120051:0:91993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787397659.120058:0:91993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787397659.120090:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397659.120095:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397659.120102:0:91993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397659.120140:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787397659.120178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701023232:0@lo:39:umount.0 00000100:00100000:1.0:1787397659.120263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397659.122135:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397659.122148:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.122161:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397659.122167:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.122178:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397659.122186:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397659.122193:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397659.122196:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397659.122200:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397659.122241:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.122249:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397659.122348:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.122409:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55000/0x274786fe0d1905f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905f8 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.122435:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.122437:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.122439:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397659.122736:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701023360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397659.122940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397659.123005:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023360 00000100:00100000:0.0:1787397659.123013:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023360 00000100:00100000:0.0:1787397659.123064:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1787397659.123073:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701023360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397659.123087:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397659.123105:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31400/0x274786fe0d1905f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1905f1 expref: 24 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.123118:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397659.123154:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701023360:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397659.123161:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1787397659.123203:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701023360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397659.123290:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023232 00000100:00100000:2.0:1787397659.123296:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023232 00000100:00100000:2.0:1787397659.123401:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1787397659.123409:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701023232:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397659.123433:0:77740:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1906f4 00000100:00080000:2.0:1787397659.123442:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a83ae92800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787397659.123501:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218701023232:12345-0@lo:39:umount.0 Request processed in 93us (3237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397659.123508:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000020:00000080:2.0:1787397659.123516:0:77740:0:(genops.c:906:class_export_put()) final put ffff89a7090f8800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787397659.123581:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397659.123629:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787397659.123644:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701023232:0@lo:39:umount.0 00000100:00080000:1.0:1787397659.126137:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397659.126144:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787397659.126150:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397659.127516:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090f8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397659.127625:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae92800 for lustre-MDT0000 00010000:00010000:1.0:1787397659.129256:0:91993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129275:0:91993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129283:0:91993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129289:0:91993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129314:0:91993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397659.129322:0:91993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129328:0:91993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129335:0:91993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129341:0:91993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129447:0:91993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397659.129455:0:91993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129477:0:91993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129483:0:91993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129488:0:91993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129498:0:91993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787397659.129503:0:91993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129509:0:91993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129514:0:91993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129543:0:91993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397659.129560:0:91993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787397659.129563:0:91993:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787397659.129597:0:91993:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787397659.129601:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1787397659.129606:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787397659.129612:0:91993:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1787397659.130683:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787397659.130693:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130716:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397659.130720:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130729:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397659.130736:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397659.130742:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397659.130745:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787397659.130747:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787397659.130787:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130794:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397659.130829:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130836:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050ab600/0x274786fe0d190511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190518 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130860:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397659.130863:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130869:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397659.130872:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130885:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397659.130892:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397659.130896:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397659.130899:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787397659.130900:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787397659.130916:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130921:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397659.130938:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130943:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d190614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19061b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130952:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397659.130956:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130962:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397659.130964:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.130971:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397659.130988:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397659.130993:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787397659.130996:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787397659.130998:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787397659.131012:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131017:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397659.131023:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131029:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aba00/0x274786fe0d1905dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1905e3 expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131037:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397659.131040:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131044:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397659.131047:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131052:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397659.131057:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397659.131073:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397659.131075:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787397659.131077:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787397659.131091:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131097:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397659.131103:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131109:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d190503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19050a expref: -99 pid: 90970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131119:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.131121:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.131124:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.131132:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397659.131154:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701023744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397659.131235:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397659.131290:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397659.131296:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701023616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397659.131316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397659.131428:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023744 00000100:00100000:2.0:1787397659.131436:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023744 00000100:00100000:2.0:1787397659.131484:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023616 00000100:00100000:2.0:1787397659.131488:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023616 00000100:00100000:2.0:1787397659.131516:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1787397659.131553:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701023744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397659.131578:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397659.131595:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31800/0x274786fe0d1905e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1905dc expref: 24 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131608:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397659.131642:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701023744:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397659.131649:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1787397659.131665:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1787397659.131671:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701023616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397659.131681:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397659.131691:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19061b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190614 expref: 22 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.131699:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397659.131719:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701023616:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397659.131725:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1787397659.131756:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701023616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397659.131765:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701023744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397659.132593:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701023488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397659.132638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397659.132680:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397659.132686:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701023872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397659.132709:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397659.132740:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023488 00000100:00100000:0.0:1787397659.132745:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023488 00000100:00100000:0.0:1787397659.132791:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701023872 00000100:00100000:0.0:1787397659.132795:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701023872 00000100:00100000:0.0:1787397659.132817:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1787397659.132824:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701023488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397659.132834:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397659.132858:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d190518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190511 expref: 22 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.132869:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397659.132899:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701023488:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397659.132906:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1787397659.132944:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1787397659.132949:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218701023872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397659.132956:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397659.132965:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050abe00/0x274786fe0d19050a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190503 expref: 20 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.132973:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397659.132993:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701023872:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397659.132999:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:0.0:1787397659.133036:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397659.133056:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701023872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397659.133064:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701023488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397659.135263:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1787397659.136899:0:91993:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1787397659.137776:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1787397659.137792:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a835590800 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397659.137799:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7090fd000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397659.137803:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a828787000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397659.137808:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a704689800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397659.137812:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a83670e800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149700 stale:0 00000020:00080000:1.0:1787397659.137816:0:91993:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a703c8cd40) has exports, disconnecting them 00000020:00080000:1.0:1787397659.137821:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a835590800), last request at 1787397658 00000020:00000080:1.0:1787397659.137829:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190a3c 00000020:00010000:1.0:1787397659.137851:0:91993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a835590800: total 0 00000100:00080000:1.0:1787397659.137856:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a835591000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397659.137879:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a835590800): rc 0 00000020:00080000:1.0:1787397659.137882:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7090fd000), last request at 1787397627 00000020:00000080:1.0:1787397659.137885:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1906ed 00000100:00080000:1.0:1787397659.137889:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a7090fb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397659.137896:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7090fd000): rc 0 00000020:00000080:1.0:1787397659.137898:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a7090fd000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787397659.137911:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a828787000), last request at 1787397658 00000020:00000080:1.0:1787397659.137914:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1906e6 00000100:00080000:1.0:1787397659.137917:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a837bc0000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397659.137924:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a828787000): rc 0 00000020:00000080:1.0:1787397659.137926:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a828787000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787397659.137930:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a704689800), last request at 1787397658 00000020:00000080:1.0:1787397659.137932:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1906df 00000100:00080000:1.0:1787397659.137943:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a828785800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397659.137975:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a704689800): rc 0 00000020:00000080:1.0:1787397659.137986:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a704689800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787397659.137990:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a83670e800), last request at 1787397622 00000020:00000080:1.0:1787397659.137994:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19055e 00000100:00080000:1.0:1787397659.138007:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a836715000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787397659.138019:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83670e800): rc 0 00000020:00000080:1.0:1787397659.138021:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a83670e800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1787397659.138028:0:91993:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41d6bae0 00000100:00080000:1.0:1787397659.138068:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397659.138072:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397659.138992:0:91993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787397659.139023:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a7037c2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00010000:0.0:1787397659.139242:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a835590800: total 4 00010000:00010000:0.0:1787397659.139309:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a835590800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787397659.139377:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d190a7b lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80b5 expref: 3 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.139410:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d190a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 2 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.139424:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a835590800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787397659.139980:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.139989:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397659.140009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024000:0@lo:39:umount.0 00000100:00100000:2.0:1787397659.140105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397659.140162:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.140778:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787397659.140804:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397659.140881:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828787000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397659.140905:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a704689800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397659.140936:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397659.140963:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7090fb000 for lustre-MDT0000 00000020:00000080:2.0:1787397659.140968:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bc0000 for lustre-MDT0000 00000020:00000080:2.0:1787397659.140972:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828785800 for lustre-MDT0000 00000020:00000080:2.0:1787397659.140978:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836715000 for lustre-MDT0000 00000100:00100000:1.0:1787397659.142327:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024000 00000100:00100000:1.0:1787397659.142341:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024000 00000100:00100000:1.0:1787397659.142443:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1787397659.142462:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701024000:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787397659.142497:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19059d 00000100:00080000:1.0:1787397659.142506:0:8445:0:(import.c:65:import_set_state_nolock()) ffff89a8034da800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397659.142545:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00010000:00010000:2.0:1787397659.142604:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397659.142744:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218701024000:12345-0@lo:39:umount.0 Request processed in 291us (2638us total) trans 81604378739 rc 0/0 00000100:00100000:1.0:1787397659.142751:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00080000:2.0:1787397659.142805:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7037c2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787397659.142814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024000:0@lo:39:umount.0 00000100:00080000:2.0:1787397659.144994:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397659.144999:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968729 gen 3 00000004:00080000:2.0:1787397659.145022:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787397659.145106:0:91993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787397659.145131:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a705060800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787397659.145149:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397659.145151:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968727 gen 3 00000004:00080000:2.0:1787397659.145158:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397659.145234:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024128:0@lo:9:umount.0 00000100:00100000:2.0:1787397659.145310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397659.145366:0:91993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787397659.145376:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a837bc4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787397659.145391:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024256:0@lo:9:umount.0 00000100:00100000:2.0:1787397659.145414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397659.145448:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024128 00000100:00100000:2.0:1787397659.145467:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024128 00000100:00100000:2.0:1787397659.147242:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024256 00000100:00100000:2.0:1787397659.147256:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024256 00000100:00100000:1.0:1787397659.149254:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967 00000100:00100000:1.0:1787397659.149278:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701024128:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787397659.149314:0:25908:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1905b2 00000100:00080000:1.0:1787397659.149323:0:25908:0:(import.c:65:import_set_state_nolock()) ffff89a8037da800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397659.149400:0:25908:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968729 00000100:00100000:1.0:1787397659.151711:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701024128:12345-0@lo:9:umount.0 Request processed in 2436us (6391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397659.151742:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967 00000100:00100000:1.0:1787397659.151773:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968 00000100:00100000:1.0:1787397659.151783:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701024256:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787397659.151812:0:25908:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1905c7 00000100:00080000:1.0:1787397659.151822:0:25908:0:(import.c:65:import_set_state_nolock()) ffff89a7037c7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397659.151876:0:25908:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968727 00000100:00100000:1.0:1787397659.151966:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701024256:12345-0@lo:9:umount.0 Request processed in 184us (6549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397659.151972:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968 00010000:00010000:1.0:1787397659.152000:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397659.152007:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397659.152046:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787397659.152062:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787397659.152064:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397659.152068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024256:0@lo:9:umount.0 00000100:00080000:1.0:1787397659.152079:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a705060800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787397659.152083:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787397659.152084:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397659.152087:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701024128:0@lo:9:umount.0 00000020:00080000:2.0:1787397659.155236:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c8cd40) has no exports 00000020:00080000:2.0:1787397659.158592:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c8cd40) has no exports 00000020:00000080:0.0:1787397659.166343:0:56852:0:(genops.c:906:class_export_put()) final put ffff89a835590800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00010000:00010000:0.0:1787397659.166608:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.166612:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.166614:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397659.166665:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835590800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0000 00000020:00000080:1.0:1787397659.168833:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835591000 for lustre-MDT0000 00000020:00000080:2.0:1787397659.236428:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190573 00000020:00000080:2.0:1787397659.236444:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a836495000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787397659.236519:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787397659.236589:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397659.236606:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787397659.236612:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a829b90000) has no exports 00000020:00000080:0.0:1787397659.236776:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836495000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787397659.236950:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19056c 00000020:00000080:3.0:1787397659.236957:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a7090fa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397659.237013:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397659.237022:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397659.237025:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a83ae97000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787397659.237027:0:91993:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae97000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787397659.237036:0:91993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787397659.237341:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787397659.238817:0:91993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14a20 - data ffff89a83fef51b0/ffff89a703765800 00000020:01000000:3.0:1787397659.239112:0:91993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259cd80 - data ffff89a83ff6f870/ffff89a7026dec00 00000100:00080000:2.0:1787397659.297290:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397659.297299:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397659.297314:0:91993:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a828836680 x1874218701024000/t81604378739(81604378739) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397669 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397659.297342:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787397659.299946:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397659.299954:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968729 gen 4 00000004:00080000:2.0:1787397659.300019:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397659.300024:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787397659.300293:0:90990:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787397659.300298:0:90990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1787397659.300307:0:90990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:2.0:1787397659.301403:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397659.301408:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968727 gen 4 00000004:00080000:2.0:1787397659.301457:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397659.301460:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787397659.302019:0:90992:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787397659.302025:0:90992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:1.0:1787397659.302034:0:90992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:2.0:1787397659.303384:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19052d 00000020:00000080:2.0:1787397659.303398:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a7037c0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787397659.304433:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190542 00000020:00000080:2.0:1787397659.304444:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a8364e3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397659.304535:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787397659.305130:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787397659.305139:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.305153:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397659.305158:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a703c8b380) has no exports 00000004:01000000:2.0:1787397659.305349:0:91993:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787397659.305361:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1905c0 00000020:00000080:2.0:1787397659.305367:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a807dfe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397659.305397:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397659.305481:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787397659.305492:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.305500:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397659.305503:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a83b9d0000) has no exports 00000020:00000080:2.0:1787397659.305510:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1905b9 00000020:00000080:2.0:1787397659.305516:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a837bc3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397659.305618:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a807dfe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1787397659.306275:0:91993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787397659.306281:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397659.306285:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968727 gen 5 00000004:00080000:2.0:1787397659.306291:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397659.306293:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397659.306324:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397659.306390:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.306400:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397659.306408:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1905a4 00000020:00000080:2.0:1787397659.306413:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a8364e0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397659.306416:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787397659.306421:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.306425:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397659.306428:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a7033a3380) has no exports 00000020:00000080:2.0:1787397659.306433:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190596 00000020:00000080:2.0:1787397659.306436:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a817ec8000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787397659.307052:0:91993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787397659.307057:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397659.307060:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968729 gen 5 00000004:00080000:2.0:1787397659.307063:0:91993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397659.307065:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397659.307093:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.307102:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787397659.307115:0:91993:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787397659.307121:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190588 00000020:00000080:2.0:1787397659.307127:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a8364e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397659.307132:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787397659.307136:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.307151:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397659.307153:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a703c88000) has no exports 00000020:00000080:2.0:1787397659.307158:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190581 00000020:00000080:2.0:1787397659.307162:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a7037c7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397659.308429:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bc4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787397659.308444:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a8364e7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397659.308448:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787397659.308456:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397659.308582:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397659.308590:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ec8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397659.308596:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a705060800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397659.308600:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a8364e1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397659.308603:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787397659.308606:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397659.308648:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397659.308653:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787397659.316001:0:91993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787397659.316013:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397659.316018:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397659.316027:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397659.316151:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.316168:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397659.316202:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.316206:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397659.316213:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a803902000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397659.316218:0:91993:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803902000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397659.316225:0:91993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397659.316337:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190549 00000020:00000080:2.0:1787397659.316343:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a8364e1800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787397659.316445:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7037c2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787397659.316453:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a8364e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397659.316456:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787397659.316462:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787397659.316677:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787397659.316699:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.316706:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397659.316710:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a703c899c0) has no exports 00000020:00000080:2.0:1787397659.316751:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.316757:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787397659.316763:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190550 00000020:00000080:2.0:1787397659.316772:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a8364e3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397659.316926:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787397659.316932:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a7037c2800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787397659.316934:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787397659.316939:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787397659.317036:0:91993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad2e800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787397659.317040:0:91993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad2e800 3 00000020:01000004:2.0:1787397659.317044:0:91993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70ad2e800 from lustre-MDT0000 00000020:00000080:2.0:1787397659.317073:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.317079:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787397659.317082:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a7037c4800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787397659.317084:0:91993:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787397659.317107:0:91993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787397659.317147:0:91993:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787397659.317151:0:91993:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787397659.317154:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787397659.317157:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.317161:0:91993:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787397659.317169:0:91993:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a817ecd800 e5696550-1ffc-466d-b13d-359d59b5fc5f 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397659.317176:0:91993:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a8034db000 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397659.317181:0:91993:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a829b94d40) has exports, disconnecting them 00000020:00080000:2.0:1787397659.317186:0:91993:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a817ecd800), last request at 1787397653 00000020:00000080:2.0:1787397659.317204:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190a19 00000020:00010000:2.0:1787397659.317209:0:91993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a817ecd800: total 1 00000100:00080000:2.0:1787397659.317213:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a817ec8800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397659.317240:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a817ecd800): rc 0 00000020:00080000:2.0:1787397659.317244:0:91993:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a8034db000), last request at 1787397622 00000020:00000080:2.0:1787397659.317258:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1904fc 00000020:00010000:2.0:1787397659.317261:0:91993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a8034db000: total 1 00000100:00080000:2.0:1787397659.317263:0:91993:0:(import.c:65:import_set_state_nolock()) ffff89a8034da000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397659.317273:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8034db000): rc 0 00000020:00080000:2.0:1787397659.317277:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a829b94d40) has no exports 00000020:00010000:2.0:1787397659.317288:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a817ecd800: total 1 00010000:00010000:2.0:1787397659.317314:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a817ecd800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1787397659.317345:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1200/0x274786fe0d190a2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8076 expref: 5 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.317362:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b600/0x274786fe0d190a27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8045 expref: 4 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.317373:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62200/0x274786fe0d190a20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d803e expref: 3 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.317400:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a600/0x274786fe0d190a35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d807d expref: 2 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397659.317409:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a817ecd800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1787397659.317430:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a817ecd800/e5696550-1ffc-466d-b13d-359d59b5fc5f 00000020:00010000:0.0:1787397659.317469:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a8034db000: total 2 00010000:00010000:0.0:1787397659.317507:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a8034db000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787397659.317547:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55a00/0x274786fe0d19066f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190668 expref: 14 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317559:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75e00/0x274786fe0d19067d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190676 expref: 13 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317570:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75800/0x274786fe0d190699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190692 expref: 12 pid: 90975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317579:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75600/0x274786fe0d190629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190622 expref: 11 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317588:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31200/0x274786fe0d19068b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190684 expref: 10 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317609:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee30200/0x274786fe0d190645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19063e expref: 9 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317620:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74000/0x274786fe0d1906a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1906a0 expref: 8 pid: 90976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317629:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74400/0x274786fe0d190637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190630 expref: 7 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317641:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75000/0x274786fe0d1906b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1906ae expref: 6 pid: 90977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317651:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee30800/0x274786fe0d1906c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1906bc expref: 5 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317663:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31600/0x274786fe0d190653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19064c expref: 4 pid: 90984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317688:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aae00/0x274786fe0d1906d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1906ca expref: 3 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317699:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee30600/0x274786fe0d190661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19065a expref: 2 pid: 90982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397659.317708:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a8034db000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787397659.317722:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a8034db000/99b57a74-e5dc-42df-b087-b10fad741506 00000020:00000080:1.0:1787397659.317887:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787397659.317951:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.317954:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397659.317955:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.318019:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.318022:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397659.318024:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397659.318065:0:90977:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a8360de800:90977] 2 exiting: rc = 0 00000100:00100000:1.0:1787397659.318166:0:90984:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff89a836509c00:90984] 4 exiting: rc = 0 00000100:00100000:3.0:1787397659.318188:0:90982:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a81a804000:90982] 3 exiting: rc = 0 00000100:00100000:3.0:1787397659.318287:0:90976:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a8178be000:90976] 1 exiting: rc = 0 00000100:00100000:1.0:1787397659.318320:0:90975:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a704b69c00:90975] 0 exiting: rc = 1 00000020:00000080:1.0:1787397659.318449:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecd800/e5696550-1ffc-466d-b13d-359d59b5fc5f for MGS 00000020:00000080:1.0:1787397659.318489:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8034db000/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:1.0:1787397659.318506:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ec8800 for MGS 00000020:00000080:1.0:1787397659.318512:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8034da000 for MGS 00000100:00100000:2.0:1787397659.318612:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318627:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318635:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318642:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318660:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318682:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318689:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318695:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318701:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318706:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318712:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318717:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318722:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318732:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318739:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318744:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318749:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318904:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318916:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318922:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318927:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318932:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318936:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318970:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318984:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318989:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.318996:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319003:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319009:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319015:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319022:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319028:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319033:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319040:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319046:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319051:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319056:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319062:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319069:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319075:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319080:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319085:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319092:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319097:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319102:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319108:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319115:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319121:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319127:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319135:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319139:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319144:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319149:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319154:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319159:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319165:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319171:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319176:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319181:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319195:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319200:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319205:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319210:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397659.319216:0:91993:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787397659.320317:0:91993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a705d4b7e0 - data ffff89a701ed2ca8/ffff89a808339000 00000020:01000000:2.0:1787397659.320467:0:91993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70441c3c0 - data ffff89a83fd7a510/ffff89a8366c6400 00000020:00000080:2.0:1787397659.321098:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1904d2 00000020:00000080:2.0:1787397659.321108:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a83670d800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787397659.321123:0:91993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad2e800 from MGS, refs=2 00000020:01000004:2.0:1787397659.321127:0:91993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad2e800 2 00000020:01000004:2.0:1787397659.321130:0:91993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70ad2e800 from MGS 00000020:00000080:2.0:1787397659.321150:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.321159:0:91993:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787397659.321161:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a70ad2b800/MGS 00000020:00000080:2.0:1787397659.321164:0:91993:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2b800/MGS for MGS 00000020:01000000:2.0:1787397659.321172:0:91993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787397659.321489:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787397659.321494:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.321505:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787397659.321513:0:91993:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a835449000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397659.321519:0:91993:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a83b9d4d40) has exports, disconnecting them 00000020:00080000:2.0:1787397659.321858:0:91993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a835449000), last request at 1787397622 00000020:00000080:2.0:1787397659.321862:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190606 00000020:00080000:2.0:1787397659.321886:0:91993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a835449000): rc 0 00000020:00000080:2.0:1787397659.321896:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a835449000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397659.322275:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397659.322284:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835449000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787397659.329207:0:91993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787397659.329218:0:91993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397659.329222:0:91993:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397659.329230:0:91993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397659.329393:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397659.329419:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787397659.329426:0:91993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad2e800 1 00000020:00000080:2.0:1787397659.329433:0:91993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1904c4 00000020:00000080:1.0:1787397659.329465:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a703748000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397659.329476:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a837bb5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787397659.329479:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787397659.329491:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787397659.329515:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a70ad2d000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787397659.329551:0:91993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787397659.329556:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397659.329561:0:91993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397659.329565:0:91993:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a829b919c0) has no exports 00000020:00000080:1.0:1787397659.329608:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787397659.386453:0:91993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397659.386469:0:91993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787397659.386475:0:91993:0:(genops.c:906:class_export_put()) final put ffff89a70ad2c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787397659.386480:0:91993:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787397659.386493:0:91993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787397659.386862:0:91993:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a70ad29800 00000020:02000400:0.0:1787397659.386972:0:91993:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787397659.431002:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397659.622396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701024512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397659.622487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397659.622678:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024512 00000100:00100000:1.0:1787397659.622687:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024512 00000100:00100000:1.0:1787397659.622752:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1787397659.622762:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701024512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397659.622786:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397659.622858:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701024512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397659.622866:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:3.0:1787397659.622956:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701024512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397659.625234:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701024384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397659.625311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397659.625872:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024384 00000100:00100000:3.0:1787397659.625881:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024384 00000100:00100000:3.0:1787397659.625938:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1787397659.625947:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701024384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397659.625972:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397659.626028:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701024384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397659.626036:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1787397659.626145:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701024384:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787397660.453352:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397661.476823:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397662.501496:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397663.524836:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397663.716771:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701024640:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.716919:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701025024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397663.716985:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701024896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397663.717059:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025024 00000100:00100000:0.0:1787397663.717069:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025024 00000100:00100000:2.0:1787397663.717070:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701025536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397663.717128:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1787397663.717138:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397663.717139:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874218701025024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701025152:0@lo:400:kworker.0 00000020:00080000:0.0:1787397663.717154:0:66178:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397663.717177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397663.717201:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701025664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397663.717210:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874218701025024:12345-0@lo:400:kworker.0 Request processed in 70us (194us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397663.717228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397663.717265:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397663.717271:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397663.717275:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397663.717280:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397663.717284:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3507 00000100:00080000:2.0:1787397663.717291:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397663.717297:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1787397663.717318:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025152 00000100:00100000:0.0:1787397663.717323:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025152 00000100:00100000:2.0:1787397663.717339:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705a24700 x1874218701025792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397663.717365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701025024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397663.717368:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025664 00000100:00100000:0.0:1787397663.717373:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025664 00000100:00100000:2.0:1787397663.717408:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025536 00000100:00100000:2.0:1787397663.717412:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025536 00000100:00100000:2.0:1787397663.717449:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:2.0:1787397663.717457:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717510:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701025536:12345-0@lo:400:kworker.0 Request processed in 54us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397663.717518:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:2.0:1787397663.717565:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1787397663.717574:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701025152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397663.717578:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701024768:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717617:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701025152:12345-0@lo:400:kworker.0 Request processed in 44us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397663.717625:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397663.717629:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1787397663.717648:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024768 00000100:00100000:1.0:1787397663.717649:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701025280:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.717652:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024768 00000100:00100000:2.0:1787397663.717667:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1787397663.717673:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1874218701025664:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397663.717678:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397663.717704:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3648:x1874218701025664:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397663.717710:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1787397663.717721:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1787397663.717724:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701024768:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787397663.717728:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397663.717765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397663.717777:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701024768:12345-0@lo:400:kworker.0 Request processed in 50us (152us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397663.717784:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:1.0:1787397663.717809:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397663.717813:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397663.717816:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397663.717828:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397663.717831:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3507 00000100:00080000:1.0:1787397663.717836:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397663.717854:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa13b80 x1874218701025920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397663.717866:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701024768:0@lo:400:kworker.0 00000100:00100000:1.0:1787397663.717889:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701025792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397663.717916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397663.717927:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701025920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397663.717959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1787397663.718935:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701024640 offset 0 length 224: 4 00000100:00100000:2.0:1787397663.719023:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025792 00000100:00100000:2.0:1787397663.719030:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025792 00000100:00100000:2.0:1787397663.719054:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025920 00000100:00100000:2.0:1787397663.719057:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025920 00000100:00100000:0.0:1787397663.719064:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1787397663.719073:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701025792:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397663.719079:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1787397663.719086:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701025920:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397663.719120:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397663.719166:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701025920:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 80us (1220us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397663.719173:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00080000:2.0:1787397663.719222:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397663.719227:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397663.719230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701025920:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397663.719264:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701025152:0@lo:400:kworker.0 00000100:00080000:2.0:1787397663.719276:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397663.719278:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397663.719282:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787397663.719286:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397663.719289:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3507 00000100:00080000:2.0:1787397663.719295:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397663.719315:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705a27b80 x1874218701026048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397663.719345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701025664:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.719359:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701025536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.719388:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701026048:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397663.719419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397663.719488:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025280 00000100:00100000:1.0:1787397663.719495:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025280 00000100:00100000:1.0:1787397663.719541:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1787397663.719546:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218701025280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397663.719552:0:8446:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397663.719587:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3650:x1874218701025280:12345-0@lo:400:kworker.0 Request processed in 40us (1823us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397663.719593:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00080000:1.0:1787397663.719621:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397663.719624:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397663.719627:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397663.719631:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397663.719635:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3507 00000100:00080000:1.0:1787397663.719639:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397663.719662:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83af27480 x1874218701026176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397663.719675:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701025280:0@lo:400:kworker.0 00000100:00100000:1.0:1787397663.719716:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026048 00000100:00100000:1.0:1787397663.719720:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026048 00000100:00100000:1.0:1787397663.719739:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1787397663.719744:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701026048:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1787397663.720562:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397663.720617:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701025792:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1543us (2698us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397663.720626:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1787397663.720688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1787397663.722240:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397663.722320:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701026048:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2572us (2899us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397663.722332:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1787397663.722366:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701024896 00000100:00100000:1.0:1787397663.722373:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701024896 00000100:00100000:1.0:1787397663.725039:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1787397663.725057:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701024896:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397663.725202:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397663.725210:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397663.725292:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701024896:12345-0@lo:400:kworker.0 Request processed in 239us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397663.725300:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000001:00100000:3.0:1787397663.726902:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787397663.726920:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:3.0:1787397663.726926:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a8034d8800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1787397663.727002:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411386 batchid updated 00000020:00080000:3.0:1787397663.727034:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:3.0:1787397663.727108:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a704edff00 with version 10 00000020:00080000:3.0:1787397663.727120:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411386 cancel update log [0x2000088d1:0x2:0x0].2: rc = 0 00000020:00080000:3.0:1787397663.727203:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411386 cancel update log [0x2400090a0:0x2:0x0].2: rc = 0 00000020:00080000:3.0:1787397663.727211:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:3.0:1787397663.727221:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 10 rpc_version 10 00000020:00100000:3.0:1787397663.727259:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397663.727269:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70adc6300 x1874218701026432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397663.727293:0:75622:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff89a70adc6300 x1874218701026432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397663.727313:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00080000:2.0:1787397663.729400:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397663.729416:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397663.729422:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701026048:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787397663.729441:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397663.729444:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397663.729447:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701025792:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787397663.729485:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701026176:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397663.729568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397663.729802:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701024896:0@lo:400:kworker.0 00000100:00100000:0.0:1787397663.729814:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701025408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397663.729895:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397663.730082:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701025408 00000100:00100000:2.0:1787397663.730090:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701025408 00000100:00100000:2.0:1787397663.730156:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1787397663.730167:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397663.730219:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701025408:12345-0@lo:400:kworker.0 Request processed in 55us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397663.730226:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00080000:0.0:1787397663.732167:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397663.732238:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701025408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397663.732616:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026176 00000100:00100000:3.0:1787397663.732627:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026176 00000100:00100000:3.0:1787397663.732672:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:3.0:1787397663.732680:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701026176:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1787397663.732713:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397663.732928:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701026176:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 245us (3358us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397663.732937:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000020:00000080:1.0:1787397663.735169:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8034d8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787397663.735347:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8034da800 for lustre-MDT0001 00000100:00080000:2.0:1787397663.737657:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397663.737671:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397663.737676:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701026176:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397664.013808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397664.013854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:1.0:1787397664.013885:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681182464 offset 0 length 224: 4 00000100:00100000:1.0:1787397664.013907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397664.013953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397664.014075:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182592 00000100:00100000:3.0:1787397664.014086:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182592 00000100:00100000:3.0:1787397664.014133:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182720 00000100:00100000:3.0:1787397664.014136:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182720 00000100:00100000:3.0:1787397664.014177:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1283 00000100:00100000:3.0:1787397664.014187:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681182720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397664.014268:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681182720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397664.014276:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1283 00000100:00100000:3.0:1787397664.014297:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1306 00000100:00100000:3.0:1787397664.014302:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1874218681182592:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:3.0:1787397664.014309:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:3.0:1787397664.014332:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1874218681182592:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (538us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397664.014339:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1306 00000100:00100000:0.0:1787397664.014680:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182848 00000100:00100000:0.0:1787397664.014685:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182848 00000100:00100000:0.0:1787397664.014721:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2547 00000100:00100000:0.0:1787397664.014730:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681182848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397664.014777:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681182848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 49us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397664.014784:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2547 00000100:00100000:0.0:1787397664.014796:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681182976 00000100:00100000:0.0:1787397664.014799:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681182976 00000100:00100000:0.0:1787397664.014822:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2548 00000100:00100000:0.0:1787397664.014828:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681182976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397664.014855:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681182976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397664.014862:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2548 00000100:00080000:0.0:1787397664.014897:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397664.014901:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397664.014903:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397664.037696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397664.037834:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681183104 00000100:00100000:2.0:1787397664.037844:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681183104 00000100:00100000:2.0:1787397664.037896:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1307 00000100:00100000:2.0:1787397664.037905:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681183104:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787397664.037932:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397664.038015:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681183104:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 Request processed in 109us (329us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397664.038024:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1307 00010000:00010000:2.0:1787397664.548785:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397664.742518:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:3.0:1787397664.742764:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701026560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397664.742852:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397664.743328:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8040cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701026688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397664.743432:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397664.743469:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026560 00000100:00100000:3.0:1787397664.743477:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026560 00000100:00100000:3.0:1787397664.743519:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026688 00000100:00100000:3.0:1787397664.743543:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026688 00000100:00100000:3.0:1787397664.743561:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1787397664.743569:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701026560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397664.743598:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397664.743639:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701026560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397664.743646:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1787397664.743664:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1787397664.743670:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701026688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397664.743686:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397664.743719:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701026688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397664.743726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1787397664.743775:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8040cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701026688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397664.743817:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701026560:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787397664.747050:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397664.747059:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a8037d8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397664.748603:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037d8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397664.748681:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8037da800 for lustre-OST0000 00000001:00100000:2.0:1787397664.751745:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397664.751755:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a807dfc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397664.751918:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a807dfc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787397664.751981:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7037c7000 for lustre-OST0001 00010000:00010000:1.0:1787397665.583555:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397665.764666:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:0.0:1787397666.596818:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397666.788633:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:2.0:1787397667.623549:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397667.812666:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:0.0:1787397668.645914:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397668.837062:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00080000:3.0:1787397668.837288:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397668.837294:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397668.837313:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397668.837321:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3543 00000100:00080000:3.0:1787397668.837326:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397668.837333:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397668.837384:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b520380 x1874218701026944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397668.837407:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397668.837410:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397668.837412:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397668.837415:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3543 00000100:00080000:3.0:1787397668.837418:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397668.837421:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397668.837431:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b522a00 x1874218701027200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397668.837452:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397668.837455:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397668.837457:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397668.837460:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:3.0:1787397668.837462:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397668.837466:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397668.837477:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521c00 x1874218701027456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397668.837498:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397668.837501:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397668.837511:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397668.837551:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:3.0:1787397668.837554:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397668.837571:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397668.837587:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b520700 x1874218701027840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397668.837603:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701026816:0@lo:400:kworker.0 00000100:00100000:3.0:1787397668.837641:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701027072:0@lo:400:kworker.0 00000400:00000100:1.0:1787397668.837671:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701026816 offset 0 length 224: 4 00000100:00100000:2.0:1787397668.837772:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701026944:0@lo:38:kworker.0 00000100:00100000:0.0:1787397668.837780:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701027584:0@lo:400:kworker.0 00000100:00100000:3.0:1787397668.845434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397668.846718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701027712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397668.846917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397668.847004:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027712 00000100:00100000:1.0:1787397668.847013:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027712 00000100:00100000:1.0:1787397668.847073:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:1.0:1787397668.847083:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701027712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397668.847139:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701027712:12345-0@lo:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397668.847146:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:1.0:1787397668.847170:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397668.847200:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701027712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397668.847241:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701027328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397668.847272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397668.847554:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027072 00000100:00100000:3.0:1787397668.847561:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027072 00000100:00100000:3.0:1787397668.847618:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027328 00000100:00100000:3.0:1787397668.847622:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027328 00000100:00100000:3.0:1787397668.847656:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1787397668.847665:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701027072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397668.847725:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701027072:12345-0@lo:400:kworker.0 Request processed in 60us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397668.847732:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1787397668.847748:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1787397668.847754:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397668.847792:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701027328:12345-0@lo:400:kworker.0 Request processed in 38us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397668.847889:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701027328:0@lo:400:kworker.0 00000100:00080000:1.0:1787397668.847923:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397668.849116:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1787397668.849187:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701027072:0@lo:400:kworker.0 00000100:00100000:2.0:1787397668.850083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397668.850128:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701027200:0@lo:38:kworker.0 00000100:00100000:0.0:1787397668.850136:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397668.850166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397668.851156:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701027456:0@lo:38:kworker.0 00000100:00100000:2.0:1787397668.851210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397668.851385:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027456 00000100:00100000:2.0:1787397668.851393:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027456 00000100:00100000:2.0:1787397668.851431:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1787397668.851438:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701027456:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397668.851461:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397668.851504:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701027456:12345-0@lo:38:kworker.0 Request processed in 64us (292us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397668.851549:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00080000:2.0:1787397668.851588:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397668.851593:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397668.851597:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701027456:0@lo:38:kworker.0 00000100:00100000:2.0:1787397668.851604:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701027840:0@lo:38:kworker.0 00000100:00100000:2.0:1787397668.851634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397668.851668:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026944 00000100:00100000:2.0:1787397668.851672:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026944 00000100:00100000:2.0:1787397668.851695:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027200 00000100:00100000:2.0:1787397668.851697:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027200 00000100:00100000:2.0:1787397668.851711:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027840 00000100:00100000:2.0:1787397668.851713:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027840 00000100:00100000:2.0:1787397668.851728:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1787397668.851732:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701026944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397668.851743:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397668.851770:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701026944:12345-0@lo:38:kworker.0 Request processed in 36us (1689us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397668.851776:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1787397668.851788:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1787397668.851791:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701027200:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397668.851800:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397668.851823:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701027200:12345-0@lo:38:kworker.0 Request processed in 30us (1657us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397668.851829:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1787397668.851840:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1787397668.851843:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701027840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397668.851859:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397668.851904:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701027840:12345-0@lo:38:kworker.0 Request processed in 58us (269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397668.851910:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00080000:2.0:1787397668.851939:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397668.851943:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397668.851945:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701027840:0@lo:38:kworker.0 00000100:00080000:2.0:1787397668.851971:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397668.851974:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397668.851977:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701026944:0@lo:38:kworker.0 00000100:00080000:2.0:1787397668.851985:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397668.851988:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397668.851991:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701027200:0@lo:38:kworker.0 00000100:00100000:3.0:1787397668.852386:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027584 00000100:00100000:3.0:1787397668.852393:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027584 00000100:00100000:3.0:1787397668.852454:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1787397668.852470:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701027584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397668.852541:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701027584:12345-0@lo:400:kworker.0 Request processed in 53us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397668.852550:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00080000:1.0:1787397668.852623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397668.852723:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701027584:0@lo:400:kworker.0 00000100:00100000:3.0:1787397669.126461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397669.126512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397669.126598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397669.126962:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681183488 00000100:00100000:1.0:1787397669.126974:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681183488 00000100:00100000:0.0:1787397669.127128:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681183744 00000100:00100000:0.0:1787397669.127133:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681183744 00000100:00100000:0.0:1787397669.127174:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2551 00000100:00100000:0.0:1787397669.127184:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681183744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397669.127266:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681183744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397669.127274:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2551 00000100:00100000:1.0:1787397669.127342:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681183360 00000100:00100000:1.0:1787397669.127347:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681183360 00000100:00100000:1.0:1787397669.127372:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1286 00000100:00100000:1.0:1787397669.127381:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681183488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397669.127426:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681183488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397669.127431:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1311 00000100:00100000:0.0:1787397669.127437:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681183360:12345-192.168.204.60@tcp:38:kworker.0 00000100:00100000:1.0:1787397669.127451:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1286 00010000:00020000:0.0:1787397669.127465:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397669.127504:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681183360:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 64us (991us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397669.127516:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1311 00000100:00080000:2.0:1787397669.127586:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397669.127592:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1787397669.127853:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681183232 offset 0 length 224: 4 00000100:00100000:3.0:1787397669.127896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397669.128268:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681183616 00000100:00100000:1.0:1787397669.128274:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681183616 00000100:00100000:1.0:1787397669.128369:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2552 00000100:00100000:1.0:1787397669.128378:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681183616:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397669.128431:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681183616:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397669.128440:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2552 00000100:00080000:2.0:1787397669.133325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787397669.668969:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397669.861931:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:1.0:1787397669.863724:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397669.863745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701027968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397669.863816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397669.863859:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701027968 00000100:00100000:1.0:1787397669.863866:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701027968 00000100:00100000:1.0:1787397669.863912:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1787397669.863919:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701027968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397669.863949:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397669.863989:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701027968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397669.863995:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1787397669.864047:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701027968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397669.864262:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397669.864274:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701028096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397669.864308:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397669.864785:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028096 00000100:00100000:2.0:1787397669.864792:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028096 00000100:00100000:2.0:1787397669.864833:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1787397669.864840:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701028096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397669.864859:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397669.864901:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701028096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397669.864907:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1787397669.865445:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701028096:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787397670.693252:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397670.884859:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:0.0:1787397671.716706:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397671.908718:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:3.0:1787397672.718102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397672.718136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397672.718160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:3.0:1787397672.718182:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681183872 offset 0 length 224: 4 00000100:00100000:3.0:1787397672.718371:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184256 00000100:00100000:3.0:1787397672.718381:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184256 00000100:00100000:3.0:1787397672.718443:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2553 00000100:00100000:3.0:1787397672.718452:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681184256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397672.718556:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681184256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 71us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397672.718563:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2553 00000100:00100000:3.0:1787397672.718604:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184000 00000100:00100000:3.0:1787397672.718608:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184000 00000100:00100000:3.0:1787397672.718630:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184128 00000100:00100000:3.0:1787397672.718633:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184128 00000100:00100000:3.0:1787397672.718674:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1287 00000100:00100000:3.0:1787397672.718682:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703645c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681184128:12345-192.168.204.60@tcp:38:kworker.0 00010000:02000400:3.0:1787397672.718715:0:67264:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client 784819ec-79bc-4534-8fa6-902d7a92d2f8 (at 192.168.204.60@tcp) reconnecting 00010000:00080000:3.0:1787397672.736895:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp ffff89a829b1c800 cur 3552 last 1787397672 00000100:00100000:3.0:1787397672.736931:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1312 00000100:00100000:3.0:1787397672.736940:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681184000:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397672.736964:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397672.737724:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681184000:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 779us (19582us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397672.737736:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1312 00000100:00080000:3.0:1787397672.737773:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397672.737780:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397672.737841:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397672.737879:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184384 00000100:00100000:1.0:1787397672.737889:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184384 00000100:00100000:1.0:1787397672.737955:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2554 00000100:00100000:1.0:1787397672.737966:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681184384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397672.738105:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681184384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397672.738115:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2554 00000100:00080000:1.0:1787397672.738137:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00100000:3.0:1787397672.742569:0:67264:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.60@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1787397672.742611:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1787397672.742635:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397672.742787:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703645c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681184128:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 24104us (24624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397672.742800:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1287 00010000:00010000:2.0:1787397672.743038:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397672.753386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397672.753426:0:66196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681181696 00000100:00100000:3.0:1787397672.753436:0:66196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681181696 00000100:00100000:0.0:1787397672.754119:0:66195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787397672.754136:0:66195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681181696:12345-192.168.204.60@tcp:700:cp.0 00000100:00080000:0.0:1787397672.754288:0:66195:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff89a70698f100 x1874218701028224/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397672.754299:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:0.0:1787397672.932613:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:0.0:1787397673.765079:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397673.765582:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00080000:2.0:1787397673.961262:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397673.961269:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397673.961273:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397673.961282:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3548 00000100:00080000:2.0:1787397673.961288:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397673.961295:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397673.961305:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:2.0:1787397673.961317:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa10380 x1874218701028480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397673.961321:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397673.961348:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701028352:0@lo:400:kworker.0 00000100:00080000:2.0:1787397673.961360:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397673.961363:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397673.961365:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397673.961368:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3548 00000100:00080000:2.0:1787397673.961370:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397673.961373:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397673.961382:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12300 x1874218701028736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397673.961394:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397673.961397:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:0.0:1787397673.961397:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701028352 offset 0 length 224: 4 00000100:00080000:2.0:1787397673.961399:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397673.961402:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:2.0:1787397673.961404:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397673.961408:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397673.961416:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12680 x1874218701028992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397673.961465:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397673.961468:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397673.961470:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397673.961473:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:2.0:1787397673.961476:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397673.961479:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397673.961490:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12a00 x1874218701029376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397673.961509:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701029120:0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.961511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701028480:0@lo:38:kworker.0 00000100:00100000:2.0:1787397673.961570:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397673.961570:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397673.961590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701028736:0@lo:38:kworker.0 00000100:00100000:2.0:1787397673.961609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397673.961624:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701028992:0@lo:38:kworker.0 00000100:00100000:2.0:1787397673.961657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397673.961675:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701029376:0@lo:38:kworker.0 00000100:00100000:2.0:1787397673.961695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397673.961720:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397673.961724:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701028608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397673.961725:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701029248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.961749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397673.961750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397673.961769:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397673.961773:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701028864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397673.961779:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029120 00000100:00100000:0.0:1787397673.961786:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029120 00000100:00100000:2.0:1787397673.961794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397673.961824:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028480 00000100:00100000:2.0:1787397673.961827:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028480 00000100:00100000:0.0:1787397673.961833:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029248 00000100:00100000:0.0:1787397673.961836:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029248 00000100:00100000:2.0:1787397673.961847:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028736 00000100:00100000:2.0:1787397673.961855:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028736 00000100:00100000:0.0:1787397673.961857:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1787397673.961864:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701029120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.961865:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029376 00000100:00100000:2.0:1787397673.961867:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029376 00000100:00100000:2.0:1787397673.961874:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028608 00000100:00100000:2.0:1787397673.961875:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028608 00000100:00100000:2.0:1787397673.961889:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028864 00000100:00100000:2.0:1787397673.961891:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028864 00000100:00100000:2.0:1787397673.961908:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1787397673.961913:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701029120:12345-0@lo:400:kworker.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397673.961914:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701028608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397673.961920:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1787397673.961936:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1787397673.961942:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701029248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.961945:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701028608:12345-0@lo:400:kworker.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397673.961951:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1787397673.961963:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:0.0:1787397673.961966:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701029248:12345-0@lo:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397673.961968:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397673.961972:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:2.0:1787397673.961991:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701028864:12345-0@lo:400:kworker.0 Request processed in 23us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397673.961997:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1787397673.962007:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1787397673.962007:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701029248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.962011:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701028480:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397673.962017:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701029120:0@lo:400:kworker.0 00010000:00020000:2.0:1787397673.962028:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397673.962066:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701028480:12345-0@lo:38:kworker.0 Request processed in 54us (497us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397673.962072:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1787397673.962097:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1787397673.962101:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701028736:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1787397673.962101:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397673.962106:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397673.962108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00020000:2.0:1787397673.962110:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397673.962133:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701028736:12345-0@lo:38:kworker.0 Request processed in 30us (523us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397673.962147:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1787397673.962160:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1787397673.962164:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701029376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397673.962174:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397673.962199:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701029376:12345-0@lo:38:kworker.0 Request processed in 34us (504us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397673.962205:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1787397673.962225:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028992 00000100:00100000:2.0:1787397673.962229:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028992 00000100:00100000:2.0:1787397673.962257:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1787397673.962262:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701028992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397673.962272:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397673.962296:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701028992:12345-0@lo:38:kworker.0 Request processed in 33us (639us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397673.962302:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1787397673.962343:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701028864:0@lo:400:kworker.0 00000100:00100000:2.0:1787397673.962353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701028608:0@lo:400:kworker.0 00000100:00080000:0.0:1787397673.963311:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397673.963321:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397673.963325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701028480:0@lo:38:kworker.0 00000100:00080000:0.0:1787397673.963402:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397673.963405:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397673.963408:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701028736:0@lo:38:kworker.0 00000100:00080000:0.0:1787397673.963418:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397673.963421:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397673.963434:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701028992:0@lo:38:kworker.0 00000100:00080000:0.0:1787397673.963445:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397673.963448:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397673.963451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701029376:0@lo:38:kworker.0 00000100:00100000:1.0:1787397674.797283:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00010000:00010000:2.0:1787397674.805369:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397674.980947:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:0.0:1787397674.982214:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701029504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397674.982286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397674.982409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397674.982416:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701029632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397674.982441:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397674.987771:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029504 00000100:00100000:1.0:1787397674.987788:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029504 00000100:00100000:0.0:1787397674.987967:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029632 00000100:00100000:0.0:1787397674.987972:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029632 00000100:00100000:0.0:1787397674.987991:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1787397674.988001:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701029504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397674.988035:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397674.988117:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701029504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397674.988124:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1787397674.988155:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1787397674.988164:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701029632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397674.988185:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397674.988214:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701029632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (5773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397674.988220:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1787397674.988269:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701029632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397674.988295:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701029504:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787397675.812945:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397675.818265:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:3.0:1787397676.009219:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:3.0:1787397676.839085:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00010000:00010000:0.0:1787397676.844457:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397677.029435:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000400:00000100:1.0:1787397677.832866:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681184640 offset 0 length 224: 4 00000100:00100000:1.0:1787397677.832914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397677.832961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397677.832992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397677.833022:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185024 00000100:00100000:1.0:1787397677.833031:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185024 00000100:00100000:1.0:1787397677.833082:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185152 00000100:00100000:1.0:1787397677.833085:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185152 00000100:00100000:1.0:1787397677.833108:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4969 00000100:00100000:1.0:1787397677.833120:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681185024:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:1.0:1787397677.833152:0:26166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190a4a 00000100:00080000:1.0:1787397677.833160:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a803e9b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397677.833206:0:26166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968729 00000100:00100000:1.0:1787397677.833358:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681185024:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 240us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397677.833366:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4969 00000100:00100000:1.0:1787397677.833383:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4970 00000100:00100000:1.0:1787397677.833401:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681185152:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:1.0:1787397677.833413:0:26166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190a51 00000100:00080000:1.0:1787397677.833418:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397677.833442:0:26166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968727 00000100:00100000:0.0:1787397677.833678:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184768 00000100:00100000:0.0:1787397677.833683:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184768 00000100:00100000:0.0:1787397677.833709:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1316 00000100:00100000:0.0:1787397677.833714:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681184768:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397677.833734:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397677.833761:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681184768:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 46us (848us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397677.833767:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1316 00000100:00100000:1.0:1787397677.833927:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681185152:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 526us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397677.833933:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4970 00000100:00080000:1.0:1787397677.833950:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397677.833954:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787397677.833966:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397677.834080:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397677.836681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397677.836725:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681184896 00000100:00100000:1.0:1787397677.836735:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681184896 00000100:00100000:1.0:1787397677.836790:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1290 00000100:00100000:1.0:1787397677.836800:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681184896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397677.836867:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681184896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397677.836875:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1290 00000100:00080000:1.0:1787397677.836896:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787397677.868844:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397677.869216:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:0.0:1787397678.052619:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000020:01000004:2.0:1787397678.622880:0:92414:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787397678.622886:0:92414:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787397678.622887:0:92414:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787397678.623062:0:92414:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a70ad28000 00000020:01000004:2.0:1787397678.623134:0:92414:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787397678.623148:0:92414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787397678.623165:0:92414:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a83b9d3380) 00000020:00000080:2.0:1787397678.623182:0:92414:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787397678.721056:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397678.721339:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.728135:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.728318:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.728869:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.729118:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.729538:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.729756:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.729932:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.730208:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.730546:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.730723:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.730929:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.731274:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787397678.732497:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787397678.734736:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.735181:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.735580:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.735783:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.736034:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.736264:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.736773:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.737223:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.737639:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.737874:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.738160:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.738556:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.738796:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.739086:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.739321:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.739751:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.740034:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.740265:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.740590:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.741050:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.741716:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.741911:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.742161:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.742347:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.742702:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.742883:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787397678.743127:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787397678.743305:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787397678.746205:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787397678.747669:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787397678.747954:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787397678.749377:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787397678.750573:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787397678.751151:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787397678.751558:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787397678.752118:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787397678.752498:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787397678.752720:0:92414:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1787397678.754448:0:92414:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787397678.754708:0:92414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787397678.754717:0:92414:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787397678.754728:0:92414:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190add 00000020:01000004:2.0:1787397678.754734:0:92414:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787397678.754746:0:92414:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787397678.754751:0:92414:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70ad28000 from MGS 00000020:01000004:2.0:1787397678.754755:0:92414:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787397678.754764:0:92414:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a83b9d4d40) 00000020:00000080:2.0:1787397678.754775:0:92414:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1787397678.754833:0:92414:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad28000 from MGS, refs=2 00080000:01000000:2.0:1787397678.754839:0:92414:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787397678.754843:0:92414:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190aeb 00010000:00010000:2.0:1787397678.754972:0:92414:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1787397678.763331:0:92414:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787397678.764350:0:92418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787397678.764477:0:92414:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787397678.764516:0:92414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397678.765879:0:92414:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787397678.766211:0:92414:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397678.766502:0:92414:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787397678.766509:0:92414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787397678.772617:0:92414:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787397678.772633:0:92414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787397678.774971:0:92414:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787397678.774983:0:92414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787397678.775728:0:92414:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787397678.775758:0:92414:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1787397678.775760:0:92414:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1787397678.775763:0:92414:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1787397678.775770:0:92414:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787397678.775776:0:92414:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787397678.775780:0:92414:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787397678.775782:0:92414:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787397678.775791:0:92414:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a836693b80 x1874218701024640/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397678.775811:0:92414:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83b523480 x1874218701026816/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397684 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397678.775828:0:92414:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83fa10000 x1874218701028352/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787397678.775839:0:92414:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787397678.775842:0:92414:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787397678.775843:0:92414:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787397678.775847:0:92414:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1787397678.775922:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701024640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.775982:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701028352:0@lo:400:kworker.0 00000100:00100000:1.0:1787397678.776105:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701026816:0@lo:400:kworker.0 10000000:01000000:2.0:1787397678.776256:0:92414:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1787397678.776271:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776282:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776290:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1787397678.776308:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776319:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aac00/0x274786fe0d1906bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1906c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776336:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776366:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776371:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776375:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776379:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d190622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190629 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776388:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776394:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776400:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776404:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776407:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54e00/0x274786fe0d19063e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190645 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776415:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776421:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776426:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776430:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776433:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d190668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19066f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776462:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776469:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776475:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776479:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776483:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55600/0x274786fe0d190676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19067d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776492:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776500:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776506:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776509:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776513:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54200/0x274786fe0d190692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190699 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776550:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776558:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776563:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776573:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776578:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee31000/0x274786fe0d1906a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1906a7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776586:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776593:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776598:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776601:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776604:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa200/0x274786fe0d1906ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1906d1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776615:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776621:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776626:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776629:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776632:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d190630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190637 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776644:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776650:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776664:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397678.776667:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776671:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d19064c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190653 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776681:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776688:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776693:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397678.776696:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776699:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54600/0x274786fe0d19065a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190661 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776707:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776712:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776717:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397678.776719:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776722:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee30c00/0x274786fe0d190684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19068b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.776730:0:92414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397678.776746:0:92414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397678.776751:0:92414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787397678.776754:0:92414:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787397678.776759:0:92414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050ab000/0x274786fe0d1906ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1906b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397678.776773:0:92414:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 67, was 0): DISCONN 00000100:00080000:2.0:1787397678.776779:0:92414:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397678.776784:0:92414:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3501 00000100:00080000:2.0:1787397678.776792:0:92414:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397678.776819:0:92414:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705388000 x1874218701029760/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397678.776841:0:92414:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1787397678.777060:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701029760:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787397678.777133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397678.777267:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029760 00000100:00100000:2.0:1787397678.777275:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029760 00000100:00100000:2.0:1787397678.777313:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397678.777321:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1874218701029760:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787397678.777347:0:92419:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3558 last 0 00000020:00000080:2.0:1787397678.777705:0:92419:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d190af2 00000100:00080000:2.0:1787397678.777857:0:92419:0:(import.c:65:import_set_state_nolock()) ffff89a70ad2a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397678.777926:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218701029760:12345-0@lo:250:mount.lustre.0 Request processed in 603us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.777934:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787397678.779248:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 27 00000100:00080000:0.0:1787397678.779262:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:0.0:1787397678.779271:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787397678.779275:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787397678.779279:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787397678.779282:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787397678.779312:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787397678.779323:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701029760:0@lo:250:mount.lustre.0 00000020:01000000:0.0:1787397678.779383:0:65702:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:0.0:1787397678.779406:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1787397678.779409:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397678.779411:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397678.779413:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.779414:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.779415:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.779417:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.779418:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397678.779420:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.779421:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397678.779469:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397678.779477:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1787397678.779479:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397678.779480:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397678.779481:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.779483:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.779484:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.779485:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.779486:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397678.779487:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.779488:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397678.779501:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397678.779505:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1787397678.779507:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397678.779508:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397678.779509:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.779510:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.779511:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.779512:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.779514:0:65702:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397678.779515:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.779516:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397678.779553:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1787397678.779586:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701030016:0@lo:253:kworker.0 00000100:00100000:0.0:1787397678.779638:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.779675:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397678.779680:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701029888:0@lo:253:kworker.0 00000100:00100000:0.0:1787397678.779718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.779753:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030016 00000100:00100000:0.0:1787397678.779760:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030016 00000100:00100000:0.0:1787397678.779796:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701029888 00000100:00100000:0.0:1787397678.779799:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701029888 00000100:00100000:0.0:1787397678.779813:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787397678.779821:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:3651:x1874218701030016:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397678.779844:0:92421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1787397678.779876:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701030144:0@lo:253:kworker.0 00000100:00100000:0.0:1787397678.779905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.780690:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030144 00000100:00100000:0.0:1787397678.780698:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030144 00000100:00100000:0.0:1787397678.780724:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397678.780730:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3651:x1874218701029888:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397678.780752:0:92419:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:2.0:1787397678.780853:0:92414:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1787397678.780872:0:92414:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787397678.780908:0:92414:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787397678.780914:0:92414:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397678.781030:0:92414:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397678.781060:0:92414:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787397678.781179:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397678.781182:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397678.781183:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397678.781184:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397678.781185:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397678.781187:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397678.781188:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397678.781189:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397678.781191:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397678.781192:0:92414:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397678.781194:0:92414:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787397678.781196:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397678.781198:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397678.781199:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397678.781200:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397678.781201:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397678.781203:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397678.781204:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397678.781205:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397678.781206:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397678.781207:0:92414:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397678.781225:0:92414:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787397678.781239:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397678.781329:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397678.781350:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d73c0 going to sleep for 11 seconds 10000000:01000000:3.0:1787397678.784343:0:92423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1787397678.784585:0:92422:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787397678.784594:0:92422:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787397678.785023:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030272 00000100:00100000:1.0:1787397678.785034:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030272 20000000:01000000:0.0:1787397678.785672:0:92421:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:0.0:1787397678.789892:0:92425:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787397678.789900:0:92425:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787397678.789904:0:92425:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787397678.789907:0:92425:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787397678.790266:0:92425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787397678.790500:0:92421:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787397678.790551:0:92421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787397678.792688:0:92421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397678.792710:0:92421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787397678.792819:0:92419:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787397678.793177:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:3651:x1874218701030016:12345-0@lo:253:kworker.0 Request processed in 13352us (13534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.793190:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787397678.793237:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397678.793247:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:3648:x1874218701030144:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397678.793275:0:92421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1787397678.793327:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397678.793329:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397678.793331:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.793332:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.793333:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.793335:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.793336:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397678.793338:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.793339:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397678.793343:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701030016:0@lo:253:kworker.0 20000000:01000000:1.0:1787397678.793607:0:92423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397678.793611:0:92423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397678.793641:0:92423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793658:0:92423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397678.793668:0:92423:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056967s 00010000:00010000:1.0:1787397678.793673:0:92423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793694:0:92423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793700:0:92423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793708:0:92423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793714:0:92423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397678.793719:0:92423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793727:0:92423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793739:0:92423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793747:0:92423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.793753:0:92423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62a00/0x274786fe0d190af9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397678.797747:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787397678.797766:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+7:92414:x1874218701030272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787397678.797817:0:92424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397678.797820:0:92424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787397678.797823:0:92424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1787397678.797830:0:92424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787397678.799219:0:92419:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397678.799236:0:92419:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787397678.799329:0:92423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397678.799334:0:92423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397678.799373:0:92423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799390:0:92423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397678.799399:0:92423:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066120s 00010000:00010000:3.0:1787397678.799404:0:92423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799411:0:92423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799418:0:92423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799426:0:92423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799447:0:92423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397678.799461:0:92423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799469:0:92423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799485:0:92423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799492:0:92423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.799498:0:92423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b000/0x274786fe0d190b00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397678.799732:0:92421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787397678.800237:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3651:x1874218701029888:12345-0@lo:253:kworker.0 Request processed in 19502us (20513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.800248:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1787397678.800374:0:3651:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397678.800377:0:3651:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397678.800379:0:3651:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397678.800380:0:3651:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397678.800381:0:3651:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397678.800390:0:3651:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397678.800392:0:3651:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397678.800394:0:3651:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397678.800395:0:3651:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397678.800399:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701029888:0@lo:253:kworker.0 00000100:00100000:3.0:1787397678.800976:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+6:92414:x1874218701030272:12345-0@lo:253:mount.lustre.0 Request processed in 3214us (19643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.800985:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787397678.801159:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397678.801174:0:92414:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787397678.801176:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397678.801178:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397678.801179:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.801180:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.801181:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.801182:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.801183:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397678.801185:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397678.801186:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.801187:0:92414:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787397678.801207:0:92414:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70ad28000 from lustre-MDT0000 10000000:01000000:0.0:1787397678.801234:0:92414:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787397678.801237:0:92414:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787397678.801247:0:92414:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a70ad28000 10000000:01000000:0.0:1787397678.801251:0:92414:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787397678.801257:0:92414:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a70ad28000 10000000:01000000:0.0:1787397678.801259:0:92414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787397678.801263:0:92414:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a70ad28000 from 1 10000000:01000000:0.0:1787397678.801274:0:92414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787397678.801315:0:92414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.801326:0:92414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.801337:0:92414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397678.801375:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397678.801412:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.801449:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397678.801594:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030400 00000100:00100000:1.0:1787397678.801600:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030400 00000100:00100000:1.0:1787397678.801635:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787397678.801643:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+6:92414:x1874218701030400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397678.801656:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397678.801669:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63e00/0x274786fe0d190b0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190b07 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.801689:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63e00/0x274786fe0d190b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190b07 expref: 7 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.801698:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63e00/0x274786fe0d190b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190b07 expref: 7 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.801706:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63e00, rc 0) 00000100:00100000:1.0:1787397678.801744:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:92414:x1874218701030400:12345-0@lo:101:mount.lustre.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397678.801751:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787397678.801944:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397678.801968:0:92414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.801978:0:92414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397678.801991:0:92414:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787397678.802007:0:92414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.802020:0:92414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397678.802033:0:92414:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787397678.802037:0:92414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397678.802042:0:92414:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a70ad28000 10000000:01000000:3.0:1787397678.802045:0:92414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787397678.802048:0:92414:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787397678.802050:0:92414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397678.802194:0:92414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.802203:0:92414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.802211:0:92414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397678.802225:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397678.802256:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.802282:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.803329:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030528 00000100:00100000:0.0:1787397678.803339:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030528 00000100:00100000:0.0:1787397678.803397:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787397678.803406:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+7:92414:x1874218701030528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397678.803420:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397678.803439:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190b15 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.803471:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190b15 expref: 8 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.803482:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190b15 expref: 8 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.803490:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397678.803572:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:92414:x1874218701030528:12345-0@lo:101:mount.lustre.0 Request processed in 166us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.803587:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787397678.803814:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397678.803831:0:92414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.803841:0:92414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397678.803920:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397678.803952:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.803987:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.804093:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030656 00000100:00100000:0.0:1787397678.804097:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030656 00000100:00100000:0.0:1787397678.804128:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787397678.804135:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:92414:x1874218701030656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397678.804258:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701030656:12345-0@lo:501:mount.lustre.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.804265:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397678.804681:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397678.804713:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397678.804761:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.804779:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.805221:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030784 00000100:00100000:0.0:1787397678.805226:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030784 00000100:00100000:0.0:1787397678.805294:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787397678.805304:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701030784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397678.806203:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701030784:12345-0@lo:503:mount.lustre.0 Request processed in 897us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.806213:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787397678.806351:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701030784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397678.806946:0:92426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92426:1874218701030912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397678.807011:0:92426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.811534:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701030912 00000100:00100000:1.0:1787397678.811560:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701030912 20000000:01000000:1.0:1787397678.811593:0:92421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:3.0:1787397678.811603:0:92426:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b0c0 going to sleep for 11 seconds 20000000:01000000:3.0:1787397678.811615:0:92423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397678.811619:0:92423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397678.811643:0:92423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811659:0:92423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397678.811668:0:92423:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066120s 00010000:00010000:3.0:1787397678.811673:0:92423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811680:0:92423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811706:0:92423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811713:0:92423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811720:0:92423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397678.811725:0:92423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811734:0:92423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811748:0:92423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397678.811751:0:92421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:3.0:1787397678.811757:0:92423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.811766:0:92423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720aa00/0x274786fe0d190b23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397678.811932:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397678.811944:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:92426:x1874218701030912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397678.812625:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:3648:x1874218701030144:12345-0@lo:253:kworker.0 Request processed in 19377us (32715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.812635:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1787397678.812716:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397678.812719:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397678.812720:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397678.812722:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397678.812723:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397678.812724:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397678.812726:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397678.812728:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397678.812729:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397678.812733:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701030144:0@lo:253:kworker.0 00000100:00100000:2.0:1787397678.813876:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:92426:x1874218701030912:12345-0@lo:502:llog_process_th.0 Request processed in 1929us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.813896:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397678.815134:0:92426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92426:1874218701030912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397678.815177:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397678.815190:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.815193:0:92426:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787397678.815198:0:92426:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787397678.815201:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397678.815215:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a829b90000) 00000020:00000080:3.0:1787397678.815251:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1787397678.815257:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787397678.815345:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787397678.817572:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190b31 00000020:00000080:3.0:1787397678.817859:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787397678.817870:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.817875:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.817877:0:92426:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787397678.817880:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397678.817886:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.817888:0:92426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787397678.817892:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397678.817904:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a829b93380) 00000020:00000080:3.0:1787397678.817925:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1787397678.817931:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787397678.817933:0:92426:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787397678.817936:0:92426:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787397678.817942:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787397678.818006:0:92426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad28000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787397678.818019:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a829b919c0) 00000020:00000080:3.0:1787397678.818030:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1787397678.818084:0:92426:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787397678.818089:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190b46 00000020:00000080:3.0:1787397678.818174:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787397678.818180:0:92426:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787397678.818184:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d190b4d 00080000:01000000:3.0:1787397678.818189:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787397678.818192:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190b54 00000100:00100000:1.0:1787397678.884613:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00010000:00010000:1.0:1787397678.884783:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397678.904935:0:92426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1787397678.905639:0:92426:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149700 lx: 0 gen 21 00000001:00080000:3.0:1787397678.905690:0:92426:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 0 srv lr: 111669149700 lx: 0 gen 23 00000001:00000004:3.0:1787397678.905711:0:92426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149700 00000001:00080000:3.0:1787397678.906051:0:92426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787397678.906163:0:92426:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a801377f00: xid 1874218701018112, transno 111669149700, client gen 21, slot idx 0 00000020:00000080:3.0:1787397678.906893:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a829b94d40) 00000020:00000080:3.0:1787397678.906916:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1787397678.909089:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787397678.909105:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190b70 00000020:00000080:3.0:1787397678.915113:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397678.924219:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d190b77 00000020:00000080:2.0:1787397678.924777:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787397678.924790:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397678.924797:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397678.924799:0:92426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787397678.924802:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787397678.924805:0:92426:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787397678.924806:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397678.924808:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787397678.924809:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787397678.924812:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397678.924813:0:92426:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787397678.924816:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397678.924821:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397678.924822:0:92426:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787397678.924826:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787397678.924877:0:92426:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787397678.924901:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397678.924904:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397678.924905:0:92426:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787397678.924908:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397678.924911:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397678.924913:0:92426:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787397678.924916:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787397678.924921:0:92426:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:2.0:1787397678.924951:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397678.924965:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a83b9d0000) 00000020:00000080:2.0:1787397678.924983:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787397678.924990:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787397678.925052:0:92426:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787397678.925058:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787397678.925065:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190b85 00010000:00080000:2.0:1787397678.925107:0:92426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a8364e1000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397678.929179:0:92426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1787397678.932154:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397678.932170:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787397678.932212:0:92426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787397678.932236:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190b8c 00000100:00080000:3.0:1787397678.932247:0:92426:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397678.932253:0:92426:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a8364e1000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397678.932295:0:92426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523100 x1874218701031040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397678.932323:0:92426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787397678.932398:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.932401:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.932403:0:92426:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787397678.932406:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397678.932409:0:92426:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1787397678.932411:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397678.932412:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397678.932414:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397678.932417:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.932418:0:92426:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397678.932420:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397678.932425:0:92426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397678.932429:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.932438:0:92426:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787397678.932443:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397678.932447:0:92426:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:3.0:1787397678.932480:0:92426:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397678.932483:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397678.932495:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a703f58000) 00000020:00000080:3.0:1787397678.932510:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1787397678.932516:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787397678.932597:0:92426:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787397678.932604:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787397678.932610:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190b9a 00010000:00080000:3.0:1787397678.932641:0:92426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a703c37800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397678.932818:0:92426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:2.0:1787397678.933394:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397678.933401:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397678.933404:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397678.933410:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3553 00000100:00080000:2.0:1787397678.933414:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787397678.933419:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397678.933447:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705388e00 x1874218701031168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397678.933499:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397678.933503:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397678.933505:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397678.933509:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3553 00000100:00080000:2.0:1787397678.933511:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787397678.933514:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397678.933562:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705389f80 x1874218701031424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397678.933592:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397678.933596:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397678.933597:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397678.933601:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3553 00000100:00080000:2.0:1787397678.933604:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787397678.933607:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397678.933619:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705389880 x1874218701031680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397678.933649:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397678.933652:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397678.933653:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397678.933657:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3553 00000100:00080000:2.0:1787397678.933659:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787397678.933663:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397678.933672:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705389500 x1874218701032064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397678.934125:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701031296:0@lo:400:kworker.0 00000100:00100000:3.0:1787397678.934198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.934233:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397678.934239:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701031936:0@lo:400:kworker.0 00000100:00100000:3.0:1787397678.934264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.934296:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031296 00000100:00100000:3.0:1787397678.934303:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031296 00000100:00100000:3.0:1787397678.934465:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1787397678.934477:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701031296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397678.934547:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701031296:12345-0@lo:400:kworker.0 Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.934555:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1787397678.934821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701031040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397678.934858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.934883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701031168:0@lo:38:kworker.0 00000100:00100000:0.0:1787397678.934915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.934932:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701031424:0@lo:38:kworker.0 00000100:00100000:0.0:1787397678.934953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.934969:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701031680:0@lo:38:kworker.0 00000100:00100000:0.0:1787397678.934989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.935005:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701032064:0@lo:38:kworker.0 00000100:00100000:0.0:1787397678.935025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.935066:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701031552:0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.935090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.935108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397678.935114:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701031808:0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.935142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.935171:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031040 00000100:00100000:0.0:1787397678.935176:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031040 00000100:00100000:0.0:1787397678.935197:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031680 00000100:00100000:0.0:1787397678.935200:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031680 00000100:00100000:0.0:1787397678.935211:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:0.0:1787397678.935217:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701031040:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787397678.935242:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3558 last 0 00000020:00000080:0.0:1787397678.935274:0:8445:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190ba1 00000004:00100000:0.0:1787397678.935287:0:8445:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787397678.935497:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031168 00000100:00100000:3.0:1787397678.935501:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031168 00000100:00100000:3.0:1787397678.935514:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031424 00000100:00100000:3.0:1787397678.935517:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031424 00000100:00100000:3.0:1787397678.935562:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032064 00000100:00100000:3.0:1787397678.935565:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032064 00000100:00100000:3.0:1787397678.935572:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031552 00000100:00100000:3.0:1787397678.935575:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031552 00000100:00100000:3.0:1787397678.935596:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1787397678.935603:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701031552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397678.935648:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701031552:12345-0@lo:400:kworker.0 Request processed in 45us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.935655:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1787397678.935668:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1787397678.935673:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701031168:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397678.935710:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701031168:12345-0@lo:38:kworker.0 Request processed in 36us (794us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397678.935716:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1787397678.935726:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1787397678.935730:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701031424:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397678.935755:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701031424:12345-0@lo:38:kworker.0 Request processed in 24us (801us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397678.935760:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1787397678.935770:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1787397678.935774:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701032064:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397678.935799:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701032064:12345-0@lo:38:kworker.0 Request processed in 23us (773us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397678.935805:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1787397678.935847:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701031296:0@lo:400:kworker.0 00000100:00080000:0.0:1787397678.936033:0:8445:0:(import.c:65:import_set_state_nolock()) ffff89a83879f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397678.936070:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701031040:12345-0@lo:38:llog_process_th.0 Request processed in 851us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.936077:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:0.0:1787397678.936098:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1787397678.936109:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701031680:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397678.936140:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701031680:12345-0@lo:38:kworker.0 Request processed in 30us (1150us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787397678.936146:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1787397678.936186:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031936 00000100:00100000:0.0:1787397678.936191:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031936 00000100:00100000:0.0:1787397678.936229:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701031808 00000100:00100000:0.0:1787397678.936232:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701031808 00000100:00100000:0.0:1787397678.936256:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1787397678.936263:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701031936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.936300:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701031936:12345-0@lo:400:kworker.0 Request processed in 38us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.936307:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1787397678.936319:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1787397678.936324:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701031808:12345-0@lo:400:kworker.0 00000040:01000000:2.0:1787397678.936637:0:92426:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397678.937161:0:92426:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1787397678.937306:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397678.937312:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397678.937314:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397678.937618:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701031808:0@lo:400:kworker.0 00000100:00100000:1.0:1787397678.937632:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701031552:0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.937869:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701031808:12345-0@lo:400:kworker.0 Request processed in 27us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.937879:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1787397678.938132:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701031936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397678.938160:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397678.938169:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:0.0:1787397678.938178:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787397678.938184:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787397678.938187:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364e1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397678.938197:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701031040:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787397678.938209:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397678.938219:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787397678.938222:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701031168:0@lo:38:kworker.0 00000100:00080000:0.0:1787397678.938235:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397678.938238:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787397678.938241:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701031424:0@lo:38:kworker.0 00000100:00080000:0.0:1787397678.938251:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397678.938254:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787397678.938257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701031680:0@lo:38:kworker.0 00000100:00080000:0.0:1787397678.938266:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397678.938269:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787397678.938272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701032064:0@lo:38:kworker.0 00000100:00100000:1.0:1787397678.939771:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397678.939792:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701032192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397678.939861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.940085:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032192 00000100:00100000:3.0:1787397678.940094:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032192 00000100:00100000:3.0:1787397678.940159:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:3.0:1787397678.940168:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701032192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397678.940203:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397678.940258:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701032192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.940264:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1787397678.940840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701032192:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787397678.941977:0:92426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397678.942251:0:92426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:3.0:1787397678.946786:0:92426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:1.0:1787397678.947366:0:92432:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1787397678.947372:0:92432:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787397678.949153:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397678.949167:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397678.949213:0:92426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787397678.949237:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190ba8 00000100:00080000:3.0:1787397678.949247:0:92426:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397678.949253:0:92426:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a703c37800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397678.949287:0:92426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b523800 x1874218701032320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397678.949366:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701032320:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397678.949436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397678.949549:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032320 00000100:00100000:2.0:1787397678.949557:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032320 00000100:00100000:2.0:1787397678.949598:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971 00000100:00100000:2.0:1787397678.949605:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701032320:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787397678.949631:0:26164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3558 last 0 00000020:00000080:2.0:1787397678.949656:0:26164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190baf 00002000:00100000:2.0:1787397678.949669:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a7037c6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787397678.949674:0:26164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787397678.949677:0:26164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397678.949748:0:26164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787397678.949770:0:26164:0:(import.c:65:import_set_state_nolock()) ffff89a7037c1800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787397678.950082:0:92426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787397678.950191:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.950195:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.950197:0:92426:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787397678.950200:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397678.950203:0:92426:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787397678.950204:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397678.950206:0:92426:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397678.950207:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397678.950210:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.950211:0:92426:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397678.950214:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397678.950218:0:92426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397678.950235:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.950236:0:92426:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787397678.950239:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397678.950243:0:92426:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:3.0:1787397678.950262:0:92426:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397678.950264:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397678.950277:0:92426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a703f5b380) 00000020:00000080:3.0:1787397678.950293:0:92426:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787397678.950299:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787397678.950476:0:92426:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787397678.950483:0:92426:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787397678.950489:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d190bbd 00010000:00080000:3.0:1787397678.950517:0:92426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a828782800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397678.950770:0:92426:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1787397678.950840:0:92426:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787397678.950856:0:92426:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787397678.951753:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701032320:12345-0@lo:8:llog_process_th.0 Request processed in 2141us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.951767:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971 00000040:00080000:3.0:1787397678.952990:0:92426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397678.953197:0:92426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:3.0:1787397678.953307:0:92426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:3.0:1787397678.953912:0:92434:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1787397678.953918:0:92434:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787397678.954828:0:92426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397678.954842:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397678.954884:0:92426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787397678.954910:0:92426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190bc4 00000100:00080000:3.0:1787397678.954923:0:92426:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397678.954930:0:92426:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a828782800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397678.954974:0:92426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b521880 x1874218701032448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397678.954995:0:92426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787397678.955220:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.955225:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.955227:0:92426:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787397678.955230:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397678.955234:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.955235:0:92426:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787397678.955239:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787397678.955241:0:92426:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787397678.955243:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.955246:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.955247:0:92426:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787397678.955249:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397678.955251:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.955252:0:92426:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787397678.955255:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787397678.955286:0:92426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92426:1874218701032576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397678.955385:0:92426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.955419:0:92426:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d10840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.955592:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397678.955601:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397678.955609:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787397678.955614:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787397678.955617:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a703c37800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787397678.955632:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397678.955639:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701032320:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397678.955661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701032448:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397678.955699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.955741:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032448 00000100:00100000:0.0:1787397678.955747:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032448 00000100:00100000:0.0:1787397678.955791:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:0.0:1787397678.955798:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701032448:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787397678.955826:0:8501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3558 last 0 00000020:00000080:0.0:1787397678.955855:0:8501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d190bcb 00002000:00100000:0.0:1787397678.955868:0:8501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a83879e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787397678.955872:0:8501:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787397678.955875:0:8501:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397678.955935:0:8501:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787397678.955958:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a8037d8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397678.956003:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701032448:12345-0@lo:8:llog_process_th.0 Request processed in 203us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.956011:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000100:00100000:0.0:1787397678.956050:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397678.956055:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397678.956060:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787397678.956134:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787397678.956137:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828782800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787397678.956144:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397678.956148:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701032448:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397678.956201:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701032704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397678.956228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.956262:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032704 00000100:00100000:0.0:1787397678.956266:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032704 00000100:00100000:0.0:1787397678.956303:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1787397678.956309:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701032704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397678.956329:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397678.956460:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701032704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.956467:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00080000:0.0:1787397678.956486:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397678.956514:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701032704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397678.956717:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032576 00000100:00100000:2.0:1787397678.956728:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032576 00000100:00100000:2.0:1787397678.956767:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787397678.956774:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:92426:x1874218701032576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397678.956885:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:92426:x1874218701032576:12345-0@lo:502:llog_process_th.0 Request processed in 111us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.956892:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:3.0:1787397678.957003:0:92432:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787397678.957142:0:92432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3558247618736ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787397678.957150:0:92432:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787397678.957197:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701032832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397678.957232:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397678.957323:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032832 00000100:00100000:2.0:1787397678.957327:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032832 00000100:00080000:0.0:1787397678.957464:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397678.957600:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:2.0:1787397678.957607:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701032832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397678.957628:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397678.957667:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701032832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.957673:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1787397678.957749:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701032832:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787397678.957955:0:92434:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787397678.961002:0:92434:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3558251476976ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787397678.961016:0:92434:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787397678.961224:0:92426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92426:1874218701032576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397678.961269:0:92426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397678.961277:0:92426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397678.961279:0:92426:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787397678.961284:0:92426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:2.0:1787397678.963163:0:92415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787397678.964474:0:92415:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:0.0:1787397678.964786:0:92414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787397678.964818:0:92414:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787397678.964884:0:92414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.964898:0:92414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397678.964978:0:92414:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70ad28000 from 1 10000000:01000000:1.0:1787397678.964982:0:92414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397678.965020:0:92414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.965029:0:92414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.965040:0:92414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397678.965131:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701032960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397678.965205:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.965286:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397678.965334:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701032960 00000100:00100000:2.0:1787397678.965341:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701032960 00000100:00100000:2.0:1787397678.965624:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397678.965636:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:92414:x1874218701032960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397678.965650:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397678.965669:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190bd2 expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.965693:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 9 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.965705:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 9 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397678.965724:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:2.0:1787397678.965819:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701032960:12345-0@lo:101:mount.lustre.0 Request processed in 185us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397678.965826:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787397678.965920:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701032960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397678.965936:0:92414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.965953:0:92414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397678.967924:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033088:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787397678.968002:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.968045:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d10840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.968126:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033088 00000100:00100000:0.0:1787397678.968134:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033088 00000100:00100000:0.0:1787397678.968190:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397678.968200:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701033088:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787397678.968219:0:92424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787397678.968236:0:92424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787397678.968239:0:92424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787397678.968242:0:92424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787397678.968245:0:92424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:0.0:1787397678.968335:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701033088:12345-0@lo:256:mount.lustre.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.968348:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397678.968742:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033088:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787397678.969317:0:92414:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397678.969488:0:92414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.969501:0:92414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397678.969509:0:92414:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a70ad28000 from 1 10000000:01000000:3.0:1787397678.969512:0:92414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397678.969565:0:92414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.969573:0:92414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397678.969582:0:92414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397678.969601:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397678.969643:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397678.969682:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d10840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.969881:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033216 00000100:00100000:0.0:1787397678.969889:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033216 00000100:00100000:0.0:1787397678.969931:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397678.969939:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:92414:x1874218701033216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397678.969951:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397678.969965:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1c00/0x274786fe0d190be7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190be0 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.969986:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1c00/0x274786fe0d190be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190be0 expref: 10 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.969997:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1c00/0x274786fe0d190be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190be0 expref: 10 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.970006:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1c00, rc 0) 00000100:00100000:0.0:1787397678.970045:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033216:12345-0@lo:101:mount.lustre.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.970052:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397678.970113:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397678.970127:0:92414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.970136:0:92414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397678.970193:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397678.970228:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.970248:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033344 00000100:00100000:0.0:1787397678.970251:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033344 00000100:00100000:0.0:1787397678.970271:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397678.970277:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397678.970589:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033344:12345-0@lo:501:mount.lustre.0 Request processed in 311us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.970596:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397678.970620:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.970633:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397678.970659:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397678.970697:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.970717:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033472 00000100:00100000:0.0:1787397678.970721:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033472 00000100:00100000:0.0:1787397678.970742:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787397678.970748:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397678.970817:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033472:12345-0@lo:503:mount.lustre.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.970823:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787397678.970857:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.970869:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397678.971148:0:92436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92436:1874218701033600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397678.971180:0:92436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.971199:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033600 00000100:00100000:0.0:1787397678.971203:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033600 00000100:00100000:0.0:1787397678.971230:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397678.971235:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92436:x1874218701033600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397678.972006:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:92436:x1874218701033600:12345-0@lo:502:llog_process_th.0 Request processed in 766us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.972014:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397678.972054:0:92436:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.972132:0:92436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92436:1874218701033600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397678.972157:0:92436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397678.972166:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397678.972168:0:92436:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787397678.972174:0:92436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70ad28000 00000020:00000080:0.0:1787397678.972177:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397678.972185:0:92436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397678.972188:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397678.972190:0:92436:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787397678.972192:0:92436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397678.972194:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397678.972196:0:92436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787397678.972199:0:92436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70ad28000 00000020:00000080:0.0:1787397678.972201:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787397678.972332:0:92436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92436:1874218701033728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397678.972458:0:92436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397678.972484:0:92436:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397678.972637:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033728 00000100:00100000:3.0:1787397678.972643:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033728 00000100:00100000:3.0:1787397678.972673:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397678.972681:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:92436:x1874218701033728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397678.972781:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:92436:x1874218701033728:12345-0@lo:502:llog_process_th.0 Request processed in 100us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.972788:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397678.974595:0:92436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92436:1874218701033728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397678.974644:0:92436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397678.974657:0:92436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397678.974659:0:92436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787397678.974664:0:92436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787397678.974888:0:92414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787397678.974911:0:92414:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787397678.974944:0:92414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.974955:0:92414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397678.975020:0:92414:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787397678.975024:0:92414:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a70ad28000 10000000:01000000:1.0:1787397678.975027:0:92414:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a70ad28000 10000000:01000000:1.0:1787397678.975031:0:92414:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787397678.975037:0:92414:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70ad28000 from 1 10000000:01000000:1.0:1787397678.975040:0:92414:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397678.975082:0:92414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.975091:0:92414:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.975100:0:92414:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397678.975121:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397678.975181:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.975221:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.975491:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033856 00000100:00100000:0.0:1787397678.975505:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033856 00000100:00100000:0.0:1787397678.975582:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787397678.975591:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701033856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397678.975606:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397678.975621:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190bee expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.975643:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190bee expref: 11 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.975655:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190bee expref: 11 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397678.975665:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1000, rc 0) 00000100:00100000:0.0:1787397678.975701:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701033856:12345-0@lo:101:mount.lustre.0 Request processed in 111us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.975708:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787397678.976167:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397678.976182:0:92414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397678.976192:0:92414:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397678.976261:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397678.976293:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.976326:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397678.976495:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701033984 00000100:00100000:3.0:1787397678.976500:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701033984 00000100:00100000:3.0:1787397678.976565:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787397678.976574:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701033984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397678.976692:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701033984:12345-0@lo:501:mount.lustre.0 Request processed in 118us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397678.976700:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397678.977074:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701033984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397678.977104:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701034112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397678.977146:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.977175:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397678.977274:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034112 00000100:00100000:0.0:1787397678.977279:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034112 00000100:00100000:0.0:1787397678.977312:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787397678.977319:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701034112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397678.977607:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701034112:12345-0@lo:503:mount.lustre.0 Request processed in 287us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397678.977615:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787397678.977735:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701034112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397678.978713:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397678.978774:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.978808:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034240 00000100:00100000:1.0:1787397678.978813:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034240 00000100:00100000:1.0:1787397678.978853:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787397678.978860:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397678.978962:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034240:12345-0@lo:502:llog_process_th.0 Request processed in 101us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397678.978970:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787397678.979019:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397678.979039:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034240:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787397678.979108:0:92437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787397678.979123:0:92437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a7033a3380) 00000020:00000080:1.0:1787397678.979156:0:92437:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787397678.987656:0:92437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad28000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787397678.987673:0:92437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad28000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787397678.987677:0:92437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad28000 4 00010000:00080000:1.0:1787397678.987719:0:92437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a828a5b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397678.992630:0:92437:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1787397678.992737:0:92437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787397678.992786:0:92437:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787397678.992799:0:92437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d190c03 00000100:00080000:1.0:1787397678.992810:0:92437:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397678.992816:0:92437:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a828a5b800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397678.992854:0:92437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a8a80 x1874218701034368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397678.992886:0:92437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787397678.993106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701034368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397678.993179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.997192:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034368 00000100:00100000:1.0:1787397678.997214:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034368 00000100:00100000:1.0:1787397678.997280:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1787397678.997290:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701034368:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397678.997580:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701034368:12345-0@lo:38:llog_process_th.0 Request processed in 289us (4399us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397678.997588:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1787397678.997663:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397678.997673:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397678.997677:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787397678.997681:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701034368:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397678.999592:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397678.999683:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397678.999728:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.000564:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034496 00000100:00100000:3.0:1787397679.000575:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034496 00000100:00100000:3.0:1787397679.000633:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787397679.000643:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397679.000808:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034496:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.000816:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787397679.000935:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397679.000995:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397679.001031:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397679.001162:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034624 00000100:00100000:0.0:1787397679.001167:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034624 00000100:00100000:0.0:1787397679.001201:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787397679.001207:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397679.001270:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:92437:x1874218701034624:12345-0@lo:502:llog_process_th.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.001277:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397679.002168:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.002195:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:92437:1874218701034624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787397679.002224:0:92437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787397679.002657:0:92414:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787397679.002683:0:92414:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397679.002705:0:92414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.002718:0:92414:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397679.002770:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787397679.002772:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397679.002773:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397679.002775:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397679.002776:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397679.002778:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397679.002779:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397679.002781:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397679.002783:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397679.002785:0:92414:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397679.002788:0:92414:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787397679.002791:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397679.002792:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397679.002793:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397679.002794:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397679.002795:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397679.002796:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397679.002797:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397679.002798:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397679.002799:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397679.002800:0:92414:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397679.002827:0:92414:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787397679.002842:0:92414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701034752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397679.002895:0:92414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397679.002934:0:92414:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.003012:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034752 00000100:00100000:1.0:1787397679.003018:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034752 00000100:00100000:1.0:1787397679.003138:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787397679.003149:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:92414:x1874218701034752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397679.003175:0:92419:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397679.003193:0:92419:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787397679.008578:0:92419:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397679.008602:0:92419:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787397679.008719:0:92423:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397679.008726:0:92423:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397679.008753:0:92423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.008774:0:92423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 11 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.008784:0:92423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.008828:0:92423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 11 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.008842:0:92423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 11 pid: 92421 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397679.008859:0:92423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92423:1874218701034880:0@lo:104: 00000100:00100000:0.0:1787397679.008930:0:92423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397679.008982:0:92423:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803b2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.009040:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701034880 00000100:00100000:1.0:1787397679.009049:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701034880 00000100:00100000:1.0:1787397679.009107:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787397679.009116:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:92423:x1874218701034880:12345-0@lo:104: 00010000:00010000:1.0:1787397679.009130:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009182:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397679.009188:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:92423:x1874218701034880:12345-0@lo:104: Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.009195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:1.0:1787397679.009217:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397679.009222:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009243:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397679.009247:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009256:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397679.009263:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397679.009268:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397679.009301:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009308:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397679.009328:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009334:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d190bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bd9 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009350:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397679.009352:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397679.009353:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397679.009458:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701035008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397679.009488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.009556:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035008 00000100:00100000:1.0:1787397679.009561:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035008 00010000:00010000:1.0:1787397679.009577:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 12 pid: 92421 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.009607:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1787397679.009614:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+12:3648:x1874218701035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397679.009624:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397679.009630:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 12 pid: 92421 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009640:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 12 pid: 92421 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009659:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009667:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397679.009679:0:19657:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000955731s 00010000:00010000:1.0:1787397679.009683:0:19657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009690:0:19657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009696:0:19657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009702:0:19657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009709:0:19657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397679.009720:0:19657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009727:0:19657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009736:0:19657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009745:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397679.009775:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+12:3648:x1874218701035008:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.009781:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1787397679.009821:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701035008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397679.009848:0:92423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23c00/0x274786fe0d190bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190bd2 expref: 11 pid: 92421 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.009857:0:92423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92423:1874218701034880:0@lo:104: 00010000:00010000:1.0:1787397679.009870:0:92423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009878:0:92423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009884:0:92423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.009891:0:92423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0400/0x274786fe0d190c0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.010558:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:92414:x1874218701034752:12345-0@lo:253:mount.lustre.0 Request processed in 7408us (7659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.010570:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787397679.010620:0:92414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:92414:1874218701034752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787397679.010632:0:92414:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787397679.010635:0:92414:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787397679.010638:0:92414:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787397679.010639:0:92414:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397679.010640:0:92414:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397679.010641:0:92414:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397679.010643:0:92414:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397679.010644:0:92414:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787397679.010645:0:92414:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787397679.010647:0:92414:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397679.010648:0:92414:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787397679.010660:0:92414:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1787397679.031800:0:92414:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:1.0:1787397679.032462:0:92414:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787397679.033152:0:92444:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:0.0:1787397679.033157:0:92444:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:01000000:0.0:1787397679.035749:0:92445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787397679.036012:0:92414:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787397679.036460:0:92445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787397679.038723:0:92446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.038807:0:92446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.038868:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035136 00000100:00100000:1.0:1787397679.038876:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035136 00000100:00100000:1.0:1787397679.038937:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:1.0:1787397679.038947:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.039026:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.039033:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:1.0:1787397679.039067:0:92446:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.039090:0:92446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787397679.039116:0:92446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787397679.039139:0:92446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.039167:0:92446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.039180:0:92446:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.041229:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035264 00000100:00100000:2.0:1787397679.041249:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035264 00000100:00100000:2.0:1787397679.041318:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1787397679.041328:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787397679.041516:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 189us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.041541:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1787397679.041850:0:92446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.041942:0:92446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.041978:0:92446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.042004:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035392 00000100:00100000:1.0:1787397679.042009:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035392 00000100:00100000:1.0:1787397679.042044:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1787397679.042051:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397679.042110:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92446:x1874218701035392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.042116:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1787397679.042138:0:92446:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.042152:0:92446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92446:1874218701035392:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787397679.042201:0:92446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787397679.042277:0:92414:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787397679.042308:0:92414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787397679.043234:0:92414:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787397679.043245:0:92414:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787397679.043291:0:92414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397679.045676:0:92445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787397679.045754:0:92445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787397679.046980:0:92414:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787397679.047331:0:92446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787397679.047466:0:92446:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787397679.047471:0:92446:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1787397679.048284:0:92414:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787397679.048347:0:92414:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787397679.048887:0:92414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787397679.051132:0:92414:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:0.0:1787397679.054411:0:92414:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149700 00010000:00080000:3.0:1787397679.055273:0:92447:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92447 00010000:02000000:3.0:1787397679.055320:0:92447:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1787397679.055325:0:92447:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1787397679.055328:0:92447:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1787397679.055401:0:92414:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787397679.055418:0:92414:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787397679.055436:0:92414:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787397679.055462:0:92414:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787397679.060046:0:92414:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787397679.060397:0:92414:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787397679.077127:0:66196:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1787397679.077146:0:66196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:0.0:1787397679.080642:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 10000000:01000000:3.0:1787397679.844873:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787397679.844883:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70ad28000 from 120 10000000:01000000:3.0:1787397679.844889:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397679.844969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.844982:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.844993:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.845367:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.846621:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.846670:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.846772:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035520 00000100:00100000:0.0:1787397679.846781:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035520 00000100:00100000:0.0:1787397679.846842:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787397679.846852:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218701035520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397679.846867:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397679.846886:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1400/0x274786fe0d190c18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c11 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.846913:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1400/0x274786fe0d190c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c11 expref: 11 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.846925:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1400/0x274786fe0d190c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c11 expref: 11 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.846934:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1400, rc 0) 00000100:00100000:0.0:1787397679.846999:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701035520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.847005:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787397679.847909:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.847934:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.847966:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.848037:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.848082:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.848121:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.848769:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035648 00000100:00100000:0.0:1787397679.848789:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035648 00000100:00100000:0.0:1787397679.848842:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397679.848851:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701035648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397679.848871:0:92422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787397679.848889:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397679.848892:0:92422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:0.0:1787397679.848993:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701035648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.849000:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787397679.851095:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787397679.851174:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397679.851185:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.851197:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.851208:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397679.851211:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:3.0:1787397679.851214:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397679.851246:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.851254:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.851271:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.851301:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.851362:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.851576:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.851719:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035776 00000100:00100000:0.0:1787397679.851727:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035776 00000100:00100000:0.0:1787397679.851781:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787397679.851792:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701035776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397679.851808:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397679.851824:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c1f expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.851848:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c1f expref: 12 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.851890:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c1f expref: 12 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.851899:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0c00, rc 0) 00000100:00100000:0.0:1787397679.851939:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701035776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.851946:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397679.852083:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.852098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.852108:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.852174:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.852202:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.852227:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.852284:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701035904 00000100:00100000:3.0:1787397679.852355:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701035904 00000100:00100000:3.0:1787397679.852468:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787397679.852480:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701035904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.852800:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701035904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.852807:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397679.860387:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701035904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.860630:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.860733:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.860773:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036032 00000100:00100000:0.0:1787397679.860775:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.860781:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036032 00000100:00100000:1.0:1787397679.860833:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787397679.860842:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701036032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.860971:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701036032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.860979:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787397679.861894:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397679.862909:0:92479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787397679.871468:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787397679.871519:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397679.871544:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.871557:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397679.871971:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397679.871975:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 117 10000000:01000000:2.0:1787397679.871979:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397679.872016:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.872025:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.872035:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.872073:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.872139:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.872184:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.872263:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036160 00000100:00100000:1.0:1787397679.872278:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036160 00000100:00100000:1.0:1787397679.872331:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397679.872351:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701036160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.872364:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397679.872385:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63000/0x274786fe0d190c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c2d expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.872418:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63000/0x274786fe0d190c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c2d expref: 13 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.872428:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63000/0x274786fe0d190c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c2d expref: 13 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.872448:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00000100:00100000:1.0:1787397679.872497:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701036160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.872504:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787397679.872720:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.872734:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.872742:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.872789:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.872821:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.872851:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.873544:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036288 00000100:00100000:1.0:1787397679.873552:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036288 00000100:00100000:1.0:1787397679.873635:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787397679.873644:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701036288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397679.873662:0:92422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397679.873679:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397679.873683:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787397679.873686:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787397679.873688:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787397679.873690:0:92422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:1.0:1787397679.873795:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701036288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.873811:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397679.873818:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787397679.873895:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397679.873903:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.873922:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.873932:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787397679.873934:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1787397679.873937:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397679.873961:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.873969:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.873978:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.873995:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.874024:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.879632:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.880046:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036416 00000100:00100000:2.0:1787397679.880056:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036416 00000100:00100000:2.0:1787397679.880153:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787397679.880165:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701036416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.880183:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397679.880202:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c3b expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.880230:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c3b expref: 14 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.880240:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c3b expref: 14 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.880265:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22800, rc 0) 00000100:00100000:2.0:1787397679.880336:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (6310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.880344:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787397679.880414:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.880444:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.880454:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.880680:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.880716:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.880749:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.881180:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036544 00000100:00100000:1.0:1787397679.881186:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036544 00000100:00100000:1.0:1787397679.881214:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787397679.881220:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.881644:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.881653:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787397679.881696:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.881727:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.881773:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.882603:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036672 00000100:00100000:1.0:1787397679.882611:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036672 00000100:00100000:1.0:1787397679.882641:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787397679.882649:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.885731:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3074us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.885747:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787397679.886686:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.886716:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397679.892077:0:92482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1787397679.892492:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1787397679.892519:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787397679.892556:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.892570:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397679.892580:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1787397679.892583:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:2.0:1787397679.892586:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397679.892629:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.892637:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.892648:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.892675:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.892747:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.892791:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.894038:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036800 00000100:00100000:1.0:1787397679.894050:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036800 00000100:00100000:1.0:1787397679.894109:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787397679.894119:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701036800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.894134:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397679.894150:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63a00/0x274786fe0d190c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c49 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.894176:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63a00/0x274786fe0d190c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c49 expref: 15 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.894187:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63a00/0x274786fe0d190c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c49 expref: 15 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.894196:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63a00, rc 0) 00000100:00100000:1.0:1787397679.894262:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701036800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.894270:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397679.894461:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.894479:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.894489:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.894508:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787397679.894513:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.894561:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.894570:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397679.894572:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:3.0:1787397679.894575:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397679.894599:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.894606:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.894614:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.894637:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.894672:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.894701:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.895052:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701036928 00000100:00100000:2.0:1787397679.895064:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701036928 00000100:00100000:2.0:1787397679.895099:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787397679.895107:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701036928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.895115:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397679.895125:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22400/0x274786fe0d190c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c57 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.895143:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22400/0x274786fe0d190c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c57 expref: 16 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.895151:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22400/0x274786fe0d190c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c57 expref: 16 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.895158:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22400, rc 0) 00000100:00100000:2.0:1787397679.895204:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701036928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.895210:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787397679.896274:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701036928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.896292:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.896323:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.896408:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.896762:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.896796:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.896860:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037056 00000100:00100000:2.0:1787397679.896866:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037056 00000100:00100000:2.0:1787397679.896912:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787397679.896922:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701037056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.897058:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701037056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.897065:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787397679.897145:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.897175:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.897214:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.897237:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.897283:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037184 00000100:00100000:2.0:1787397679.897287:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037184 00000100:00100000:2.0:1787397679.897321:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787397679.897328:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701037184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.900320:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701037184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2981us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.900335:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397679.904877:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397679.907821:0:92483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397679.907965:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397679.907993:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397679.908005:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.908027:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.908038:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397679.908041:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:3.0:1787397679.908044:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397679.908084:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.908093:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.908104:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.908129:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.908198:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.908249:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037312 00000100:00100000:3.0:1787397679.908250:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.908258:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037312 00000100:00100000:2.0:1787397679.908310:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787397679.908320:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701037312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.908335:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397679.908348:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c65 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.908453:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c65 expref: 17 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.908465:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c65 expref: 17 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.908474:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23a00, rc 0) 00000100:00100000:2.0:1787397679.908538:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.908547:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397679.908594:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.908610:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.908620:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.908687:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.908731:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.908776:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.908809:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037440 00000100:00100000:0.0:1787397679.908814:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037440 00000100:00100000:0.0:1787397679.908846:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787397679.908853:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.908993:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.909001:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397679.909482:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.909552:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.909604:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00010000:00010000:0.0:1787397679.909646:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397679.909660:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.909697:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.909877:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037568 00000100:00100000:2.0:1787397679.909883:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037568 00000100:00100000:2.0:1787397679.909928:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397679.909947:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.910060:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.910075:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787397679.910091:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397679.928476:0:92485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1787397679.928570:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1787397679.928606:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397679.928619:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.928633:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.928643:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787397679.928646:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787397679.928649:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397679.928688:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.928696:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.928708:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.928734:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.928800:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.928849:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.929155:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037696 00000100:00100000:1.0:1787397679.929175:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037696 00000100:00100000:1.0:1787397679.929329:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787397679.929340:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701037696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.929355:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397679.929368:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c73 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.929390:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c73 expref: 18 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.929401:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c73 expref: 18 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.929410:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00000100:00100000:1.0:1787397679.929465:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701037696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.929473:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397679.929500:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.929542:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.929553:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.929611:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.929639:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.929667:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.930499:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037824 00000100:00100000:2.0:1787397679.930507:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037824 00000100:00100000:2.0:1787397679.931540:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787397679.931554:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701037824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.931744:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701037824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.931752:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397679.933552:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.933618:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.933691:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.933734:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.934305:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701037952 00000100:00100000:2.0:1787397679.934313:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701037952 00000100:00100000:2.0:1787397679.934446:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787397679.934458:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701037952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.938673:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701037952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4208us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.938688:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787397679.938720:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701037952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397679.940252:0:92488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1787397679.940673:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1787397679.940700:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787397679.940714:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.940726:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397679.940736:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787397679.940739:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:0.0:1787397679.940742:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397679.940892:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.940903:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.940915:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.940938:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.940998:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.941038:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.941502:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038080 00000100:00100000:3.0:1787397679.941511:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038080 00000100:00100000:3.0:1787397679.941596:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397679.941606:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701038080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.941621:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397679.941635:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a800/0x274786fe0d190c88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c81 expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.941662:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a800/0x274786fe0d190c88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c81 expref: 19 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.941673:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a800/0x274786fe0d190c88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c81 expref: 19 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.941689:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a800, rc 0) 00000100:00100000:3.0:1787397679.941745:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.941752:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787397679.942031:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.942109:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.942119:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.942182:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.942209:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.943303:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.943717:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038208 00000100:00100000:0.0:1787397679.943726:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038208 00000100:00100000:0.0:1787397679.943885:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787397679.943897:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.944068:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.944076:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787397679.944168:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.944217:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.944266:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.951593:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.953884:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038336 00000100:00100000:2.0:1787397679.953899:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038336 00000100:00100000:2.0:1787397679.953968:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787397679.953978:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.954572:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 594us (10304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.954582:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787397679.955206:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397679.957415:0:92490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397679.957588:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397679.957613:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397679.957626:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.957639:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.957649:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397679.957651:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:3.0:1787397679.957654:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397679.957697:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.957704:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.957714:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.957755:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.957820:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.957870:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038464 00000100:00100000:3.0:1787397679.957871:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.957879:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038464 00000100:00100000:2.0:1787397679.957927:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787397679.957936:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701038464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397679.957950:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397679.957964:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c8f expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.958000:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c8f expref: 20 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.958011:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c8f expref: 20 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397679.958020:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:2.0:1787397679.958131:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.958138:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397679.958667:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.958685:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.958693:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397679.959020:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.959061:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.959098:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.959130:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038592 00000100:00100000:0.0:1787397679.959136:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038592 00000100:00100000:0.0:1787397679.959173:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397679.959181:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.959291:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.959298:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787397679.959303:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.959338:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.959379:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397679.959442:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.959481:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038720 00000100:00100000:3.0:1787397679.959486:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038720 00000100:00100000:3.0:1787397679.959584:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787397679.959594:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.959674:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.959681:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787397679.959751:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397679.963467:0:92491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1787397679.963571:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1787397679.963602:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397679.963615:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.963627:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397679.963637:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787397679.963640:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1787397679.963642:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787397679.963679:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.963687:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.963698:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397679.963730:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.963807:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397679.963848:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.964116:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038848 00000100:00100000:3.0:1787397679.964124:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038848 00000100:00100000:3.0:1787397679.964173:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787397679.964182:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701038848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.964194:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397679.964209:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190c9d expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.964231:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190c9d expref: 21 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.964250:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c9d expref: 21 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.964258:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:3.0:1787397679.964308:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701038848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.964315:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787397679.965242:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.965270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.965282:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.965349:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.965390:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.965427:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.965556:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701038976 00000100:00100000:2.0:1787397679.965561:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701038976 00000100:00100000:2.0:1787397679.965608:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787397679.965618:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701038976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.965763:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701038976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.965780:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397679.965824:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.965857:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.965897:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.965927:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397679.966029:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039104 00000100:00100000:2.0:1787397679.966034:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039104 00000100:00100000:2.0:1787397679.966055:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397679.966060:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701039104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397679.971616:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701039104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5544us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397679.971631:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397679.971664:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397679.980005:0:92494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1787397679.980101:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1787397679.980131:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787397679.980143:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.980156:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397679.980166:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787397679.980169:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:0.0:1787397679.980172:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787397679.980212:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.980220:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397679.980230:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397679.980274:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.980339:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397679.980395:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397679.980814:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039232 00000100:00100000:3.0:1787397679.980823:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039232 00000100:00100000:3.0:1787397679.980881:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787397679.980891:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701039232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.980905:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397679.980922:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b600/0x274786fe0d190cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190cab expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.980966:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b600/0x274786fe0d190cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190cab expref: 22 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.980978:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b600/0x274786fe0d190cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190cab expref: 22 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.980988:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b600, rc 0) 00000100:00100000:3.0:1787397679.981048:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397679.981055:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397679.981218:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.981232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.981242:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397679.981318:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.981361:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397679.981407:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.981801:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039360 00000100:00100000:0.0:1787397679.981807:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039360 00000100:00100000:0.0:1787397679.981903:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787397679.981911:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.982034:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.982053:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397679.982061:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.982102:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.982140:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.982171:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397679.982842:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039488 00000100:00100000:0.0:1787397679.982853:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039488 00000100:00100000:0.0:1787397679.982896:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787397679.982905:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397679.983099:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397679.983106:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787397679.983213:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397679.985245:0:92496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397679.985543:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397679.985568:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397679.985591:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.985603:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.985614:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1787397679.985618:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:3.0:1787397679.985621:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787397679.985665:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.985674:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.985685:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.985710:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.985773:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.985818:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.985952:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039616 00000100:00100000:1.0:1787397679.985973:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039616 00000100:00100000:1.0:1787397679.986025:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397679.986034:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701039616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.986047:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397679.986061:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63c00/0x274786fe0d190cc0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190cb9 expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986084:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63c00/0x274786fe0d190cc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190cb9 expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986095:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63c00/0x274786fe0d190cc0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190cb9 expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986161:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63c00, rc 0) 00000100:00100000:1.0:1787397679.986301:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701039616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 267us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.986310:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787397679.986677:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.986700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.986710:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.986729:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787397679.986733:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.986740:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397679.986747:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787397679.986749:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:3.0:1787397679.986751:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787397679.986768:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.986775:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.986782:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.986796:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.986828:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.986865:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.986878:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039744 00000100:00100000:1.0:1787397679.986884:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039744 00000100:00100000:1.0:1787397679.986921:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787397679.986930:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701039744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397679.986938:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397679.986949:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d190cc7 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986964:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 24 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986973:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 24 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397679.986987:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:1.0:1787397679.987022:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701039744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397679.987030:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397679.987034:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397679.987058:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.987067:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397679.987120:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397679.987146:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397679.987169:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397679.987250:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701039872 00000100:00100000:1.0:1787397679.987255:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701039872 00000100:00100000:1.0:1787397679.987286:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397679.987293:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701039872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397679.987764:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701039872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 469us (615us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397679.987772:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787397679.987783:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701039872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787397679.987818:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787397679.987825:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397679.987833:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397680.101626:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:1.0:1787397680.101815:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397680.101834:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701040000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397680.101908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397680.102449:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040000 00000100:00100000:1.0:1787397680.102458:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040000 00000100:00100000:1.0:1787397680.102517:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1787397680.102551:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701040000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397680.102756:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701040128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397680.102796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397680.102834:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040128 00000100:00100000:2.0:1787397680.102838:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040128 00000100:00100000:2.0:1787397680.102860:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1787397680.102866:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701040128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397680.102878:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397680.102920:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701040128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397680.102927:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00002000:00000024:1.0:1787397680.103099:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397680.103140:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701040000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 591us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397680.103146:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00080000:1.0:1787397680.103164:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397680.103167:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397680.103206:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701040000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397680.103690:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701040128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397680.903144:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397680.903486:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185536 00000100:00100000:0.0:1787397680.903500:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185536 00000100:00100000:0.0:1787397680.903661:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1293 00000100:00100000:0.0:1787397680.903674:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681185536:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397680.903791:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681185536:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 120us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397680.903801:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1293 00000100:00080000:1.0:1787397680.904584:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397680.907168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397680.907245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397680.907476:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185408 00000100:00100000:0.0:1787397680.907491:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185408 00000100:00100000:0.0:1787397680.907588:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1321 00000100:00100000:0.0:1787397680.907600:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681185408:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:0.0:1787397680.907648:0:66177:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a7090fb000, cookie 0x274786fe0d190b62 00010000:00080000:0.0:1787397680.907673:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t0 exp ffff89a7090fb000 cur 3560 last 1787397678 00010000:02000400:0.0:1787397680.907683:0:66177:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:1.0:1787397680.908056:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185280 00000100:00100000:1.0:1787397680.908061:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185280 00000100:00100000:1.0:1787397680.908097:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 60 00000100:00100000:1.0:1787397680.908104:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874218681185280:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:1.0:1787397680.908122:0:92422:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp t0 exp 0000000000000000 cur 3560 last 0 00000020:00000080:1.0:1787397680.908163:0:92422:0:(genops.c:1406:class_connect()) connect: client e5696550-1ffc-466d-b13d-359d59b5fc5f, cookie 0x274786fe0d190cd5 00000100:00080000:1.0:1787397680.908350:0:92422:0:(import.c:65:import_set_state_nolock()) ffff89a703749000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397680.908458:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:2401:x1874218681185280:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 352us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397680.908467:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 60 00010000:00080000:0.0:1787397680.923443:0:66177:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1787397680.923808:0:66177:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00010000:00010000:1.0:1787397680.935192:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397680.936690:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a829b1e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397680.936809:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681185408:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 29210us (29562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397680.936823:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1321 00000100:00100000:2.0:1787397680.936982:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:0.0:1787397680.953751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397680.953852:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185664 00000100:00100000:1.0:1787397680.953878:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185664 00000100:00100000:1.0:1787397680.953954:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1322 00000100:00100000:1.0:1787397680.953966:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681185664:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397680.953996:0:77740:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a83fa11c00 x1874218681185664/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:121/0 lens 328/0 e 0 to 0 dl 1787397691 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397680.954024:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681185664:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 62us (289us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397680.954031:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1322 00010000:00080000:2.0:1787397680.954336:0:92447:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1787397681.125606:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00010000:00010000:3.0:1787397681.956791:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397681.958673:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:0.0:1787397682.152633:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:1.0:1787397682.762553:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397682.762642:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185792 00000100:00100000:2.0:1787397682.762652:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185792 00000100:00100000:2.0:1787397682.762710:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787397682.762721:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:70888:x1874218681185792:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397682.762749:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397682.762770:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23000/0x274786fe0d190cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80d8 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397682.762799:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23000/0x274786fe0d190cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80d8 expref: 6 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397682.762810:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23000/0x274786fe0d190cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80d8 expref: 6 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397682.762818:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23000, rc 0) 00000100:00100000:2.0:1787397682.762891:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681185792:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 171us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397682.762899:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:1.0:1787397682.765516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397682.765657:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681185920 00000100:00100000:3.0:1787397682.765668:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681185920 00000100:00100000:3.0:1787397682.765798:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:3.0:1787397682.765808:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681185920:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397682.765834:0:92422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1787397682.765858:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397682.765863:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1787397682.765872:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1787397682.765875:0:92422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1787397682.765940:0:92422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1787397682.771201:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681185920:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 5383us (5682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397682.771216:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:2.0:1787397682.780322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397682.782624:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186048 00000100:00100000:3.0:1787397682.782640:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186048 00000100:00100000:3.0:1787397682.782721:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:3.0:1787397682.782733:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681186048:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397682.782750:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397682.782772:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80df expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397682.782803:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 7 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397682.782815:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 7 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397682.782824:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75200, rc 0) 00000100:00100000:3.0:1787397682.782895:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681186048:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 165us (8402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397682.782903:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787397682.787480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397682.787635:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186176 00000100:00100000:3.0:1787397682.787646:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186176 00000100:00100000:3.0:1787397682.787741:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787397682.787751:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681186176:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397682.787926:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681186176:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 176us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397682.787934:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:2.0:1787397682.791308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397682.791387:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186304 00000100:00100000:3.0:1787397682.791397:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186304 00000100:00100000:3.0:1787397682.791455:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:3.0:1787397682.791465:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681186304:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397682.791622:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681186304:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397682.791630:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:2.0:1787397682.799925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397682.800740:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186432 00000100:00100000:0.0:1787397682.800754:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186432 00000100:00100000:0.0:1787397682.800849:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:0.0:1787397682.800859:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681186432:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397682.800887:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397682.800909:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1e00/0x274786fe0d190cea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80e6 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397682.800937:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1e00/0x274786fe0d190cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80e6 expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397682.800949:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1e00/0x274786fe0d190cea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80e6 expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397682.800958:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1e00, rc 0) 00000100:00100000:0.0:1787397682.801151:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186432:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 293us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397682.801158:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:2.0:1787397682.804200:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397682.804307:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186560 00000100:00100000:1.0:1787397682.804326:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186560 00000100:00100000:1.0:1787397682.804389:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:1.0:1787397682.804399:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186560:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397682.804556:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186560:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397682.804564:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787397682.814179:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397682.814277:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186688 00000100:00100000:1.0:1787397682.814288:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186688 00000100:00100000:1.0:1787397682.814347:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:1.0:1787397682.814357:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186688:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397682.814514:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186688:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 157us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397682.814541:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:0.0:1787397682.828475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397682.828636:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186816 00000100:00100000:1.0:1787397682.828647:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186816 00000100:00100000:1.0:1787397682.828701:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:1.0:1787397682.828712:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681186816:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397682.828729:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397682.828750:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80ed expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397682.828778:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 10 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397682.828790:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 10 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397682.828816:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63800, rc 0) 00000100:00100000:1.0:1787397682.828888:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681186816:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397682.828896:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787397682.831568:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397682.831780:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681186944 00000100:00100000:0.0:1787397682.831791:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681186944 00000100:00100000:0.0:1787397682.831891:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:0.0:1787397682.831902:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681186944:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397682.832038:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681186944:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 138us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397682.832047:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:1.0:1787397682.955416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397682.958834:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187072 00000100:00100000:0.0:1787397682.958852:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187072 00000100:00100000:0.0:1787397682.959301:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1294 00000100:00100000:0.0:1787397682.959313:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681187072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397682.959408:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681187072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397682.959415:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1294 00000100:00080000:1.0:1787397682.963500:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397682.980745:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00010000:00010000:2.0:1787397682.981199:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397683.172587:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000001:00100000:0.0:1787397683.691878:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787397683.691892:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397683.691896:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a803e9d800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397683.691920:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9d800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:0.0:1787397683.691961:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a803e9b000 for lustre-OST0000 00000001:00100000:0.0:1787397683.696005:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787397683.696018:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397683.696029:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a803e9a800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787397683.696351:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e9a800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:3.0:1787397683.696417:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5c000 for lustre-OST0001 00000001:02000400:3.0:1787397683.968153:0:92699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787397684.004686:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397684.004754:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 0 seconds 00000100:00100000:0.0:1787397684.196953:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 0 seconds 00000100:00100000:2.0:1787397684.198001:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701040256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397684.198080:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397684.198208:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040256 00000100:00100000:1.0:1787397684.198216:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040256 00000100:00100000:1.0:1787397684.198277:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1787397684.198287:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701040256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397684.198322:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397684.198380:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701040256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397684.198387:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:2.0:1787397684.198475:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701040256:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787397684.199381:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397684.199385:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397684.199389:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397684.199398:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397684.199418:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa13800 x1874218701040512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397684.199443:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397684.199446:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397684.199448:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397684.199453:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397684.199463:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa10380 x1874218701040768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397684.199485:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397684.199488:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397684.199490:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397684.199494:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397684.199507:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698ce00 x1874218701041024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397684.199543:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397684.199547:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397684.199548:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397684.199553:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397684.199577:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698c700 x1874218701041408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397684.199597:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787397684.199600:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397684.199601:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397684.199606:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a828a5b800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397684.199615:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8179a2300 x1874218701041792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397684.199641:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701040384:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.199692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.199723:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701041280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.199748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.199770:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397684.199775:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701040640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.200983:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041280 00000100:00100000:3.0:1787397684.200994:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041280 00000100:00100000:3.0:1787397684.201197:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1787397684.201208:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701041280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.201739:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701041280:12345-0@lo:400:kworker.0 Request processed in 532us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.201748:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:0.0:1787397684.202101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202139:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701041536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.202176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202231:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701041280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.202260:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701040512:0@lo:38:kworker.0 00000100:00100000:0.0:1787397684.202286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701040768:0@lo:38:kworker.0 00000100:00100000:0.0:1787397684.202324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202339:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701041024:0@lo:38:kworker.0 00000100:00100000:0.0:1787397684.202384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202402:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701041408:0@lo:38:kworker.0 00000100:00100000:0.0:1787397684.202423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202439:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701041792:0@lo:38:kworker.0 00000100:00100000:0.0:1787397684.202459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397684.202485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397684.202490:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701040896:0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.202505:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041536 00000100:00100000:3.0:1787397684.202512:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041536 00000100:00100000:0.0:1787397684.202517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202566:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701041664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.202574:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1787397684.202585:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.202597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202621:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397684.202629:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701041152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.202646:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701041536:12345-0@lo:400:kworker.0 Request processed in 63us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.202653:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1787397684.202663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.202935:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040384 00000100:00100000:0.0:1787397684.202941:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040384 00000100:00100000:0.0:1787397684.202983:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787397684.202991:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.203023:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701040384:12345-0@lo:400:kworker.0 Request processed in 33us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.203030:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787397684.203071:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040640 00000100:00100000:0.0:1787397684.203074:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040640 00000100:00100000:0.0:1787397684.203091:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040512 00000100:00100000:0.0:1787397684.203093:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040512 00000100:00100000:0.0:1787397684.203103:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040768 00000100:00100000:0.0:1787397684.203105:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040768 00000100:00100000:0.0:1787397684.203113:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041408 00000100:00100000:0.0:1787397684.203115:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041408 00000100:00100000:0.0:1787397684.203132:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041792 00000100:00100000:0.0:1787397684.203134:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041792 00000100:00100000:0.0:1787397684.203142:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701040896 00000100:00100000:0.0:1787397684.203144:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701040896 00000100:00100000:0.0:1787397684.203160:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1787397684.203166:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701040640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.203286:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701040640:12345-0@lo:400:kworker.0 Request processed in 120us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.203294:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1787397684.203309:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1787397684.203314:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701040896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.203342:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701040896:12345-0@lo:400:kworker.0 Request processed in 28us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.203494:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1787397684.203510:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1787397684.203513:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701040512:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.203559:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3563 last 0 00000020:00000080:0.0:1787397684.203594:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d190cf8 00000004:00100000:0.0:1787397684.203609:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397684.203729:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a7050a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397684.203769:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701040512:12345-0@lo:38:kworker.0 Request processed in 253us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.203776:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1787397684.203791:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1787397684.204197:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701040768:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.204217:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3563 last 0 00000020:00000080:0.0:1787397684.204245:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d190cff 00000004:00100000:0.0:1787397684.204253:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397684.204270:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a829b18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397684.204300:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701040768:12345-0@lo:38:kworker.0 Request processed in 503us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.204307:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1787397684.204322:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1787397684.204326:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701041408:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.204340:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3563 last 0 00000020:00000080:0.0:1787397684.204372:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d190d06 00000004:00100000:0.0:1787397684.204378:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397684.204392:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a706d32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397684.204419:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701041408:12345-0@lo:38:kworker.0 Request processed in 91us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.204425:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1787397684.204440:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1787397684.204445:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701041792:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.204459:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3563 last 0 00000020:00000080:0.0:1787397684.204482:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d190d0d 00000004:00100000:0.0:1787397684.204487:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397684.204500:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a8037dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397684.204560:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701041792:12345-0@lo:38:kworker.0 Request processed in 113us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.204566:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1787397684.206231:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041664 00000100:00100000:3.0:1787397684.206244:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041664 00000100:00100000:3.0:1787397684.206320:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041152 00000100:00100000:3.0:1787397684.206323:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041152 00000100:00100000:3.0:1787397684.206363:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1787397684.206374:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701041664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.206445:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701041664:12345-0@lo:400:kworker.0 Request processed in 74us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.206451:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1787397684.206467:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1787397684.206472:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701041152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397684.206494:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701041152:12345-0@lo:400:kworker.0 Request processed in 23us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.206500:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00080000:3.0:1787397684.206541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397684.206545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397684.206547:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397684.208101:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041024 00000100:00100000:0.0:1787397684.208119:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041024 00000100:00100000:0.0:1787397684.208156:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:0.0:1787397684.208165:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701041024:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.208289:0:23942:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a837bc0000, cookie 0x274786fe0d190b5b 00010000:00080000:0.0:1787397684.208296:0:23942:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff89a837bc0000 cur 3563 last 1787397678 00000004:00100000:0.0:1787397684.208316:0:23942:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397684.208357:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a8037dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397684.208435:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701041024:12345-0@lo:38:kworker.0 Request processed in 269us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.208443:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:0.0:1787397684.208537:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701040640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.208556:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701041536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.208570:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701040384:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.208625:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701041152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.208639:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701040896:0@lo:400:kworker.0 00000100:00100000:0.0:1787397684.208654:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701041664:0@lo:400:kworker.0 00010000:00080000:0.0:1787397684.208698:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83fa13800 x1874218701040512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.208710:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:0.0:1787397684.210086:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a83fa13800 x1874218701040512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.210099:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397684.210104:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397684.210116:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397684.210122:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701040512:0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.210147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83fa10380 x1874218701040768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.210160:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:0.0:1787397684.211036:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a83fa10380 x1874218701040768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.211046:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397684.211049:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397684.211055:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397684.211060:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701040768:0@lo:38:kworker.0 00000100:00080000:0.0:1787397684.211089:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1787397684.211099:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787397684.211105:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1787397684.211108:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000100:00080000:0.0:1787397684.211111:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 111669149700 last 0 00000100:00080000:0.0:1787397684.211115:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:0.0:1787397684.211142:0:92447:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787397684.211148:0:92447:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 111669149701 00000020:00080000:0.0:1787397684.211153:0:92447:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397684.211157:0:92447:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000020:00080000:0.0:1787397684.211161:0:92447:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397684.211164:0:92447:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000100:00100000:0.0:1787397684.211262:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701041024:0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.211290:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70698c700 x1874218701041408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.211300:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1787397684.212615:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a70698c700 x1874218701041408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397709 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.212627:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787397684.212631:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397684.212635:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1787397684.212640:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cd9a0db3): req@ffff89a70698f100 x1874218701028224/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397684.212658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701041408:0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.212686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a8179a2300 x1874218701041792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.212699:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:0.0:1787397684.212705:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787397684.212710:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397684.212712:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397684.212716:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701041792:0@lo:38:kworker.0 00010000:00080000:0.0:1787397684.212764:0:92716:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1787397684.212768:0:92716:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1787397684.212773:0:92716:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1787397684.213340:0:92716:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787397684.213401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701041920:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397684.213482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397684.215603:0:66195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397684.215647:0:66195:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464180 going to sleep for 11 seconds 00000100:00100000:2.0:1787397684.215671:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701041920 00000100:00100000:2.0:1787397684.215679:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701041920 00000100:00100000:2.0:1787397684.215731:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:2.0:1787397684.215741:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701041920:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787397684.215765:0:8446:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a8179a3480 x1874218701041920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:125/0 lens 224/0 e 0 to 0 dl 1787397695 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397684.215782:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701041920:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (2300us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397684.215788:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000020:00080000:0.0:1787397684.217491:0:92447:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397684.217499:0:92447:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149701 00010000:00080000:0.0:1787397684.217502:0:92447:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1787397684.217505:0:92447:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397684.217513:0:92447:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397684.217516:0:92447:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397684.217543:0:92447:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a83fa11c00 x1874218681185664/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:121/0 lens 328/0 e 0 to 0 dl 1787397691 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397684.217569:0:92447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397684.219958:0:92447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80ae expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.220006:0:92447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.220028:0:92447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.220037:0:92447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0a00, rc 0) 00010000:00080000:0.0:1787397684.220120:0:92447:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1787397684.220139:0:92447:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1787397684.222790:0:66192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701028224 00000100:00100000:1.0:1787397684.222884:0:66192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701028224 00000100:00100000:1.0:1787397684.222955:0:66192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787397684.222964:0:66192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66195:x1874218701028224:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1787397684.222985:0:66192:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff89a70538a680 x1874218701028224/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:125/0 lens 264/0 e 0 to 0 dl 1787397695 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397684.228189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397684.228234:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187200 00000100:00100000:3.0:1787397684.228243:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187200 00000100:00100000:3.0:1787397684.228310:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1297 00000100:00100000:3.0:1787397684.228329:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681187200:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787397684.228363:0:74374:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a83b521c00 x1874218681187200/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:125/0 lens 224/0 e 0 to 0 dl 1787397695 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397684.228397:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681187200:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 Request processed in 76us (213us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397684.228405:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1297 00010000:00080000:3.0:1787397684.228426:0:92447:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787397684.228794:0:92447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 40000000:02000000:0.0:1787397684.232468:0:66192:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:1.0:1787397684.247854:0:66192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66195:x1874218701028224:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 24884us (32249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397684.247868:0:66192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397684.248103:0:66195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:66195:1874218701028224:0@lo:700:mdt_seqm_0000.0 40000000:02000000:2.0:1787397684.248119:0:66195:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:0.0:1787397684.248312:0:92415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:0.0:1787397684.248321:0:92415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787397684.248407:0:92447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1787397684.248453:0:92447:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1787397684.248465:0:92447:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a8179a3480 x1874218701041920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:125/0 lens 224/0 e 0 to 0 dl 1787397695 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397684.248673:0:92447:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a83b521c00 x1874218681187200/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:125/0 lens 224/0 e 0 to 0 dl 1787397695 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.248736:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787397684.248745:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a8179a2300 x1874218701041920/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397700 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.248762:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a8179a2300 x1874218701041920/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397700 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397684.248770:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787397684.248887:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1787397684.248894:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004675d3d6): req@ffff89a70adc6300 x1874218701026432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397684.248910:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701041920:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397684.249056:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.249080:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf480 going to sleep for 11 seconds 00000100:00100000:0.0:1787397684.249098:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701026432 00000100:00100000:0.0:1787397684.249104:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701026432 00000100:00100000:0.0:1787397684.249143:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:0.0:1787397684.249151:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75622:x1874218701026432:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397684.249734:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701026432:12345-0@lo:1000:osp_up0-1.0 Request processed in 582us (677us total) trans 115964116993 rc 0/0 00000100:00100000:0.0:1787397684.249742:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:0.0:1787397684.249780:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701042048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397684.249818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.249851:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042048 00000100:00100000:0.0:1787397684.249855:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042048 00000100:00100000:0.0:1787397684.249877:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1787397684.249883:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701042048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397684.249904:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787397684.249940:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701042048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.249956:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1787397684.250002:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701042048:0@lo:41:osp-pre-0-1.0 00010000:02000000:0.0:1787397684.250069:0:92447:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:1.0:1787397684.250990:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701026432:0@lo:1000:osp_up0-1.0 00000004:00000080:0.0:1787397684.263950:0:92447:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe4809fe10 00100000:10000000:0.0:1787397684.263964:0:92447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1787397684.265306:0:92433:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000100:00100000:0.0:1787397684.265367:0:92433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92433:1874218701042176:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787397684.265444:0:92433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.265473:0:92433:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787397684.265488:0:92435:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:0.0:1787397684.265504:0:92435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92435:1874218701042304:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787397684.265541:0:92435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397684.265555:0:92435:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397684.265576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042176 00000100:00100000:0.0:1787397684.265583:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042176 00000100:00100000:0.0:1787397684.265621:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042304 00000100:00100000:0.0:1787397684.265624:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042304 00000100:00100000:0.0:1787397684.265649:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973 00000100:00100000:0.0:1787397684.265657:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:92433:x1874218701042176:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787397684.265685:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -62 00002000:02000040:0.0:1787397684.265689:0:8435:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1857) 00000100:00100000:3.0:1787397684.265761:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:3.0:1787397684.265773:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92435:x1874218701042304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787397684.265791:0:26162:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -63 00002000:02000040:3.0:1787397684.265795:0:26162:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1857) 00002000:00010000:3.0:1787397684.265840:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.266208:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266226:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.266231:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.266239:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266257:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266268:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266276:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266312:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397684.266352:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397684.266360:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.266370:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.266375:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.266386:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.266403:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.266411:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d190d1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.266429:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.266430:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.266432:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397684.266436:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.266444:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266453:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.266456:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.266460:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266473:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266480:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.266487:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.267220:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397684.267287:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.267294:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.267310:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.267321:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.267325:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.267335:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.267343:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.267362:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.269071:0:66195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681181696:12345-192.168.204.60@tcp:700:cp.0 Request processed in 11514935us (11515689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397684.269085:0:66195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00010000:00010000:1.0:1787397684.270394:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397684.270406:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270420:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.270425:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270436:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270457:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270463:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d190d22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270489:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397684.270493:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270499:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.270503:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270510:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270553:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.270561:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.270563:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.270565:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.275115:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397684.275129:0:26162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d190d29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397684.275383:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.275392:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275406:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.275410:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.275417:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275430:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275447:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275454:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275472:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397684.275513:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.275518:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275544:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.275547:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.275552:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275561:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275569:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275577:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275605:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397684.275647:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.275653:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275662:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.275664:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.275668:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275677:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275684:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275692:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275707:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397684.275747:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.275752:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275760:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.275768:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.275773:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275782:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275791:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275798:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275814:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787397684.275865:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.275870:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275878:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.275880:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.275884:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275893:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275901:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275923:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.275933:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787397684.276202:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276208:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276215:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276218:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276222:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276230:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276237:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276245:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276252:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787397684.276289:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276295:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276308:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276311:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276321:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276330:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276338:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276354:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276364:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787397684.276405:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276410:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276418:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276421:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276425:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276433:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276451:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276459:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276467:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1787397684.276506:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276511:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276518:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276543:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276547:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276557:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276565:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276572:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276591:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000001:00100000:2.0:1787397684.276610:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787397684.276628:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276633:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276640:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276643:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276647:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276655:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276662:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276669:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276677:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1787397684.276708:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276713:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276720:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276727:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276730:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276739:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276747:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276754:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276762:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1787397684.276795:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.276801:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276808:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.276811:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.276814:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276824:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276831:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276912:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.276923:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1787397684.277035:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.277040:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277048:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.277051:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.277054:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277062:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277069:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277075:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277083:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1787397684.277122:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.277126:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277139:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.277142:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.277146:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277155:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277163:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277169:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.277177:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1787397684.278781:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.278791:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278807:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.278811:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.278817:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278832:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278855:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278863:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278873:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1787397684.278931:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.278936:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.278945:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.278948:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.278953:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279156:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279165:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279174:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279195:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1787397684.279320:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279326:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279335:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279338:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279342:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279363:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279371:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279378:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279386:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1787397684.279427:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279432:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279440:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279449:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279453:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279463:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279470:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279478:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279486:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1787397684.279552:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279558:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279566:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279569:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279572:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279580:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279586:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279598:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279606:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1787397684.279646:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279651:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279658:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279661:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279664:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279672:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279679:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279685:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279694:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1787397684.279729:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279734:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279746:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279748:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279752:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279760:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279767:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279773:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279781:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1787397684.279820:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279825:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279833:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279835:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279839:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279847:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279866:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279873:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279881:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:3.0:1787397684.279920:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.279926:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279934:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.279936:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.279940:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.279949:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281313:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281326:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281360:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:3.0:1787397684.281432:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.281438:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281447:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.281450:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.281454:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281464:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281472:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281477:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281485:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00010000:00010000:3.0:1787397684.281650:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1787397684.281656:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281665:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.281675:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281683:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281700:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281706:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d190d30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281724:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:3.0:1787397684.281727:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281733:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.281735:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281741:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281749:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281755:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d190d37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281780:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1787397684.281784:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281790:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.281793:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281801:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281811:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281817:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d190d3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281829:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1787397684.281832:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281838:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.281841:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281870:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281881:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281888:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d190d45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.281903:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1787397684.282029:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282038:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.282041:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282050:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282062:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282068:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d190d4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282094:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1787397684.282098:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282105:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.282108:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282115:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282126:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d190d53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282146:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1787397684.282150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282156:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.282160:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282180:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282190:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282196:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d190d5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282209:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1787397684.282213:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.282223:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282230:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282240:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d190d61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282271:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1787397684.282275:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282281:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.282284:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282291:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282301:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282309:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d190d68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.282321:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1787397684.282324:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283601:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.283609:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283636:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283653:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283660:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d190d6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283680:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1787397684.283684:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283691:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.283694:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283702:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283712:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283720:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d190d76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283744:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1787397684.283748:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283754:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.283758:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283766:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283777:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283784:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d190d7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283797:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1787397684.283801:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283807:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.283810:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283828:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283839:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283862:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d190d84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283876:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1787397684.283880:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283887:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.283890:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283899:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283909:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283917:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d190d8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.283939:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1787397684.283942:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285134:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285141:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285153:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285168:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285175:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d190d92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285192:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1787397684.285196:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285203:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285207:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285228:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285239:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285246:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d190d99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285258:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787397684.285262:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285272:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285279:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285288:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285295:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d190da0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285322:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787397684.285325:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285331:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285334:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285341:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285363:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285370:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d190da7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285381:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787397684.285385:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285391:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285394:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285411:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285421:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285433:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d190dae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285446:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787397684.285450:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285456:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285460:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285467:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285476:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285483:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d190db5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285819:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787397684.285823:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285830:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285833:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285840:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285850:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285856:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d190dbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285867:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397684.285870:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285876:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285879:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285897:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285906:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285914:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d190dc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285926:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397684.285930:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285936:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.285939:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285946:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.285955:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286144:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d190dca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286167:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397684.286171:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286177:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.286180:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286188:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286198:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d190dd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.286216:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.286218:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.286265:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397684.286385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:3.0:1787397684.286430:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.286436:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.286442:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.286447:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397684.286663:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187456 00000100:00100000:2.0:1787397684.286674:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187456 00000100:00100000:2.0:1787397684.286745:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1327 00000100:00100000:2.0:1787397684.286756:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681187456:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:2.0:1787397684.286778:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397684.286798:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d190dd8 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80f4 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397684.286837:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397684.286894:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.286913:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.286923:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.286944:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701042432:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787397684.287037:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287050:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.287055:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.287061:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287071:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287080:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287088:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287106:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397684.287167:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.287173:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287180:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.287183:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.287187:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287196:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287210:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287218:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287231:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397684.287278:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.287283:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287291:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.287294:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.287297:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287306:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287313:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287318:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287357:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397684.287400:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.287404:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287412:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.287415:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.287418:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287426:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287433:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287439:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287452:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787397684.287492:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.287498:0:26162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287505:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.287517:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.287544:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287555:0:26162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287563:0:26162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287570:0:26162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.287585:0:26162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1787397684.287879:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397684.287911:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae1240 going to sleep for 11 seconds 00000100:00080000:2.0:1787397684.287932:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397684.287953:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042432 00002000:00080000:3.0:1787397684.288094:0:26162:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00000100:00100000:3.0:1787397684.288151:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92435:x1874218701042304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22379us (22607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.288159:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00010000:00010000:3.0:1787397684.288193:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787397684.288198:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288207:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.288211:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288219:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288243:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288251:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d190ddf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288271:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787397684.288275:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288281:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.288283:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288290:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288301:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288308:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d190ded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288322:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397684.288325:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288339:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.288342:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288364:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288375:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288382:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d190df4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288394:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397684.288397:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288403:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.288406:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288412:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288420:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288434:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d190dfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288446:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397684.288450:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288456:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.288460:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288467:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288476:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288482:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677d3e91/0x274786fe0d190e02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.288495:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288496:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288498:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288505:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288512:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288554:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.288560:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397684.289125:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042432 00000100:00100000:2.0:1787397684.289197:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1787397684.289207:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701042432:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397684.289243:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397684.289269:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d190e09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190de6 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.289296:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d190e09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397684.292708:0:92435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92435:1874218701042304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787397684.292730:0:92435:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:1.0:1787397684.292809:0:92435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92435:1874218701042688:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397684.293090:0:92435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397684.293122:0:92435:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81936f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397684.293142:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701042560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397684.293173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397684.293290:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d190e09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.293306:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:2.0:1787397684.293309:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397684.293313:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22c00, rc 0) 00000100:00100000:1.0:1787397684.293365:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042688 00000100:00100000:1.0:1787397684.293373:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042688 00000100:00100000:1.0:1787397684.293428:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975 00000100:00100000:1.0:1787397684.293437:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:92435:x1874218701042688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787397684.293480:0:26167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00000100:00100000:3.0:1787397684.293829:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701042432:12345-0@lo:101:mdt00_005.0 Request processed in 4620us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397684.293840:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1787397684.293846:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701042432:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397684.293883:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190e09 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.293897:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190e09 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397684.293920:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397684.293928:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190e09 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.293936:0:77740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190e09 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294003:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294016:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294025:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294041:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294048:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.294054:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.294513:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701042816:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397684.294569:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397684.294591:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397684.294619:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042816 00000100:00100000:0.0:1787397684.294625:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042816 00000100:00100000:0.0:1787397684.294668:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:0.0:1787397684.294678:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701042816:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397684.294779:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701042816:12345-0@lo:1000:mdt00_005.0 Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.294787:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:0.0:1787397684.294828:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701042816:0@lo:1000:mdt00_005.0 00000004:00080000:0.0:1787397684.296401:0:77740:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xd1:0x0], count =369 00000004:00080000:0.0:1787397684.296412:0:77740:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xd1:0x0]+369 in llog 00000004:00080000:0.0:1787397684.296426:0:77740:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x242:0x0], index 0: 0 00010000:00010000:0.0:1787397684.296631:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1600/0x274786fe0d190e1e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296646:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1600/0x274786fe0d190e1e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296657:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1600/0x274786fe0d190e1e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296700:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296708:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 2/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296715:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296721:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397684.296725:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296734:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296755:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:0.0:1787397684.296758:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397684.296762:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296768:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22a00/0x274786fe0d190e10 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397684.296782:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097f12807 reply state 00000000d2328977 transno 81604378740 ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296792:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296799:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a817ea6500) 00010000:00010000:0.0:1787397684.296802:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397684.296805:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787397684.296842:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d190dd8 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80f4 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296860:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1600/0x274786fe0d190e1e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80f4 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397684.296868:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff89a82250cf00) 00010000:00010000:0.0:1787397684.296871:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397684.296873:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1600, rc 0) 00000100:00100000:0.0:1787397684.296938:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:70976:x1874218681187456:12345-192.168.204.60@tcp:101:cp.0 Request processed in 10182us (10555us total) trans 81604378740 rc 0/0 00000100:00100000:0.0:1787397684.296948:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1327 00000100:00100000:0.0:1787397684.297898:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701042560 00000100:00100000:0.0:1787397684.297908:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701042560 00000100:00100000:0.0:1787397684.297978:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1787397684.297989:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701042560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397684.298015:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397684.298086:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701042560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (4911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.298093:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1787397684.298158:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701042560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397684.300516:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:92435:x1874218701042688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7073us (7421us total) trans 4294968728 rc 0/0 00000100:00100000:1.0:1787397684.300560:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975 00002000:00010000:1.0:1787397684.300710:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.300719:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.300747:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.300751:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.300758:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.300774:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.300785:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.301037:0:92435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92435:1874218701042688:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397684.301052:0:92435:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00010000:00010000:1.0:1787397684.301096:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397684.301178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397684.301211:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187584 00010000:00010000:1.0:1787397684.301220:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.301306:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.301312:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301321:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.301325:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.301329:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301340:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397684.301356:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187584 00010000:00010000:1.0:1787397684.301374:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301389:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397684.301397:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4976 00000100:00100000:0.0:1787397684.301407:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2401:x1874218681187584:12345-192.168.204.60@tcp:8:cp.0 00010000:00080000:0.0:1787397684.301439:0:26161:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3563 last 0 00010000:00010000:2.0:1787397684.301465:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:0.0:1787397684.301467:0:26161:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d190e3a 00010000:00010000:2.0:1787397684.301473:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787397684.301480:0:26161:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a8310ad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00010000:00010000:2.0:1787397684.301483:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.301491:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787397684.301498:0:26161:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:2.0:1787397684.301501:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301543:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301552:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d190e2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787397684.301565:0:26161:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:2.0:1787397684.301574:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.301579:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787397684.301595:0:26161:0:(import.c:65:import_set_state_nolock()) ffff89a8310ab000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1787397684.301597:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.301603:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301612:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301627:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301636:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.301638:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.301641:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397684.301648:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681187584:12345-192.168.204.60@tcp:8:cp.0 Request processed in 241us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397684.301656:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4976 00010000:00010000:1.0:1787397684.301749:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.301754:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d190e33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.301881:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.301938:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.301944:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301951:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.301954:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.301958:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301967:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301974:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.301992:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302041:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.302085:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.302090:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302098:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.302101:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.302105:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302124:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302132:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302140:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302224:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397684.302230:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302237:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.302241:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302249:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302260:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302273:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d190e41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302285:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.302289:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302295:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.302298:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302306:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302314:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302320:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302322:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302324:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.302385:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.302390:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d190e48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.302452:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.302458:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302466:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.302469:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.302474:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302483:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302490:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302499:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302539:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.302544:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302552:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.302561:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302570:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302581:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302590:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.302651:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.302656:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d190e4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.302698:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.302703:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302720:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.302723:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.302728:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302737:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302745:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302752:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302775:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.302779:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302786:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.302790:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302805:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302816:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.302823:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302829:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.302831:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.302934:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.302939:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d190e56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.302982:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.302987:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.302995:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.302998:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.303002:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303018:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303027:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303034:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303066:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.303071:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303078:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.303082:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303089:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303101:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303108:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303180:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303182:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.303233:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.303239:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d190e5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.303293:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.303299:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303306:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.303309:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.303313:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303322:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303353:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303361:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303389:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.303394:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303401:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.303404:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303412:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303429:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303437:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303439:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303440:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.303498:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.303503:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d190e64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.303571:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.303577:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303584:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.303587:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.303591:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303599:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303607:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303625:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303671:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.303677:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303684:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.303688:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303696:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303708:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303715:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303717:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.303719:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.303774:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.303778:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d190e6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.303839:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.303844:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303853:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.303856:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.303860:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303869:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303877:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.303885:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.303979:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.303984:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304002:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.304005:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304014:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304024:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304032:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304035:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.304082:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.304087:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d190e72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.304202:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.304207:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304214:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.304217:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.304220:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304228:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304234:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304240:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304271:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.304276:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304283:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.304286:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304295:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304305:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304318:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304320:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304322:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.304377:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.304382:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d190e79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.304450:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.304455:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304463:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.304466:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.304471:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304480:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304487:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.304494:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304550:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.304556:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304563:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.304567:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304575:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304586:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.304594:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304596:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.304598:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.305265:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.305275:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d190e80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.305367:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.306032:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.306040:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.306057:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:1.0:1787397684.306062:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.306066:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.306071:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306083:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306091:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306099:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.306212:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187712 00000100:00100000:2.0:1787397684.306223:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187712 00000100:00100000:2.0:1787397684.306292:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4977 00000100:00100000:2.0:1787397684.306303:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:0:x1874218681187712:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:2.0:1787397684.306321:0:26164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787397684.306322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787397684.306340:0:26164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d80fb expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397684.306447:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397684.306464:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:2.0:1787397684.306467:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397684.306474:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 7 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.306488:0:26164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 7 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.306501:0:26164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23400, rc 0) 00000100:00100000:2.0:1787397684.306580:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:0:x1874218681187712:12345-192.168.204.60@tcp:101:cp.0 Request processed in 279us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397684.306588:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4977 00010000:00010000:1.0:1787397684.306727:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.306782:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.306789:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306873:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.306876:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.306881:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306890:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306899:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397684.306905:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306908:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306914:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.306916:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306919:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306928:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306942:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306950:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d190e87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.306965:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397684.306974:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397684.306977:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.306994:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.306997:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.307003:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397684.307005:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.307007:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.307015:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:3.0:1787397684.307016:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.307018:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.307022:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.307024:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d190e95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.307031:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.307036:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.307037:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.307039:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.307046:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.307674:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.307682:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.307691:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.307695:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.307704:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.307729:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.307739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.307740:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.307742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.308326:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.308365:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.308373:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d190e9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.308477:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.308483:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308492:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.308495:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.308500:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308510:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308517:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308539:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308587:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.308593:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308601:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.308605:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308613:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308625:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308633:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.308634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.308638:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.308701:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.308706:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d190ea3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.308774:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.308780:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308788:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.308791:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.308868:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308877:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308885:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.308891:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308925:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.308930:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308948:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.308951:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308960:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308971:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.308980:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.308983:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.308984:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.309045:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.309050:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d190eaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.309426:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.309433:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.309452:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.309455:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.309459:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.309468:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.309476:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.309482:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397684.309638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397684.309945:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187840 00000100:00100000:3.0:1787397684.309954:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187840 00010000:00010000:2.0:1787397684.310006:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.310013:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.310021:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.310024:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.310032:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.310043:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.310057:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.310058:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.310060:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397684.310061:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4978 00000100:00100000:3.0:1787397684.310071:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70976:x1874218681187840:12345-192.168.204.60@tcp:101:cp.0 00010000:00010000:3.0:1787397684.310087:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397684.310101:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8102 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.310125:0:26168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 8 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.310140:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.310143:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.310148:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 8 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.310181:0:26168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 8 pid: 26164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.310196:0:26168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 8 pid: 26164 timeout: 3663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.310222:0:26168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:26168:1874218701042944:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397684.310374:0:26168:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723000 going to sleep for 11 seconds 00010000:00010000:2.0:1787397684.310485:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.310513:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.310671:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d190eb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.310902:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.310908:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.310916:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.310919:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.310923:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.310939:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.310947:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.310953:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.310972:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397684.311029:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397684.311034:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311043:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397684.311047:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311055:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.311057:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.311062:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311070:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.311073:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.311076:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311078:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311085:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311086:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d190ebf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311094:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311100:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.311102:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.311104:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.311176:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311225:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.311270:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.311276:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311284:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.311287:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.311291:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311300:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311309:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311316:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311353:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397684.311359:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311366:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.311369:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311377:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311388:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311394:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d190ec6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311407:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.311411:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311416:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.311425:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311432:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311442:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311450:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.311451:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.311454:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.311511:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.311516:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d190ecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.311611:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.311616:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311624:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.311626:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.311630:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311639:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311647:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311654:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311703:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.311708:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311715:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.311718:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311727:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.311739:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311890:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.311896:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d190ed4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.311903:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.311905:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.311946:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.311952:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311970:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.311973:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.311977:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311986:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.311994:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.312000:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.312022:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.312033:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.312040:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.312043:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.312051:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.312062:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.312071:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.312072:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.312074:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.312908:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.312916:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d190edb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.312996:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.313002:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313011:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.313014:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.313019:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313036:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313045:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313052:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.313125:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.313131:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.313139:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.313143:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.313152:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.313163:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.313177:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.313178:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.313180:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.313220:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397684.313314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397684.313363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681187968 00000100:00100000:3.0:1787397684.313373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681187968 00010000:00010000:3.0:1787397684.313406:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 9 pid: 26164 timeout: 3663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.313436:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2595 00000100:00100000:3.0:1787397684.313446:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681187968:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397684.313465:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397684.313474:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397684.313480:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 9 pid: 26164 timeout: 3663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313480:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d190ee2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.313493:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 9 pid: 26164 timeout: 3663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.313516:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.313519:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397684.313543:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 9 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.313552:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 9 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.313554:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.313559:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313566:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.313568:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.313572:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313579:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397684.313586:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 9 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313596:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.313599:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1874218701043072:192.168.204.60@tcp:105: 00010000:00010000:1.0:1787397684.313603:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313617:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397684.313625:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397684.313629:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313635:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.313638:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313645:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313655:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313662:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058812326/0x274786fe0d190ee9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.313667:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723840 going to sleep for 11 seconds 00010000:00010000:1.0:1787397684.313674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.313682:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.313683:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.313725:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.313730:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313737:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.313740:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.313745:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313754:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313762:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313769:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313783:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397684.313790:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397684.313794:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313802:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.313805:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313824:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313836:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313844:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917b51a8/0x274786fe0d190ef0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313858:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.313859:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.313861:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.313903:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.313908:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313916:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.313919:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.313923:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313932:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313939:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313952:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.313972:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.314014:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.314020:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314027:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.314030:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.314033:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314040:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314048:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314054:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314064:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397684.314101:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.314105:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314119:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.314122:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.314125:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314134:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314140:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314147:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314159:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787397684.314165:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397684.314168:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314174:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397684.314177:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.314184:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315051:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397684.315063:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315073:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.315077:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315086:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315102:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315111:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d190efe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315135:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.315139:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315146:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.315155:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315164:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315181:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315200:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9702f2a/0x274786fe0d190f05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315215:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.315217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.315219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.315226:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.315336:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315352:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d190ef7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315366:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.315369:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.315370:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397684.315454:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.315460:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315469:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.315473:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.315478:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315489:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315497:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315505:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.315688:0:26168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d190e8e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80fb expref: 9 pid: 26164 timeout: 3663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397684.315701:0:26168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:26168:1874218701042944:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397684.315726:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 8 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397684.315739:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1874218701043072:192.168.204.60@tcp:105: 00010000:00010000:2.0:1787397684.315739:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030e00, rc 0) 00010000:00010000:3.0:1787397684.315750:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397684.315791:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681187968:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 2345us (2478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397684.315791:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70976:x1874218681187840:12345-192.168.204.60@tcp:101:cp.0 Request processed in 5720us (6159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397684.315810:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4978 00000100:00100000:3.0:1787397684.315881:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2595 00010000:00010000:1.0:1787397684.315934:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397684.315979:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.315984:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.315992:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.315995:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.316000:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316009:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316017:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316024:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316055:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397684.316062:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316069:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.316073:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316081:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316093:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316100:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030105228/0x274786fe0d190f0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316114:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.316117:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316123:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.316127:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316147:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316157:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316165:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.316167:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.316169:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.316276:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397684.316281:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6681fd9/0x274786fe0d190f13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397684.316336:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397684.316341:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316368:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:1.0:1787397684.316371:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397684.316375:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316385:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316393:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397684.316401:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316569:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397684.316575:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316582:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397684.316586:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316593:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316604:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397684.316611:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.316613:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.316615:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397684.317728:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397684.318007:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397684.318060:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:2.0:1787397684.318067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:1.0:1787397684.318068:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008624731e/0x274786fe0d190f1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787397684.318486:0:8435:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00000100:00100000:3.0:1787397684.318594:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188224 00000100:00100000:3.0:1787397684.318603:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188224 00000100:00100000:1.0:1787397684.318624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:92433:x1874218701042176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 52965us (53177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397684.318635:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973 00000100:00100000:3.0:1787397684.318649:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 229 00000100:00100000:3.0:1787397684.318658:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:70976:x1874218681188224:12345-192.168.204.60@tcp:35:cp.0 00000100:00100000:2.0:1787397684.318729:0:92433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92433:1874218701042176:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787397684.318746:0:92433:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x703:0x0] 00000100:00100000:1.0:1787397684.318891:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701043200:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787397684.318900:0:66180:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 81604378741 00000100:00100000:1.0:1787397684.318933:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397684.318996:0:92433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92433:1874218701043328:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397684.319023:0:92433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397684.319054:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:70976:x1874218681188224:12345-192.168.204.60@tcp:35:cp.0 Request processed in 396us (990us total) trans 81604378742 rc 0/0 00000100:00100000:3.0:1787397684.319061:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 229 00000100:00100000:1.0:1787397684.319063:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043200 00000020:00080000:3.0:1787397684.319065:0:66180:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397684.319073:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043200 00000100:00100000:3.0:1787397684.319088:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043328 00000100:00100000:3.0:1787397684.319092:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043328 00000100:00100000:1.0:1787397684.319101:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1787397684.319113:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979 00000100:00100000:3.0:1787397684.319119:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:92433:x1874218701043328:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787397684.319120:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701043200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397684.319135:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00080000:3.0:1787397684.319145:0:26169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000100:00100000:2.0:1787397684.319242:0:92433:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397684.319305:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701043200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397684.319311:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:0.0:1787397684.319501:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701043200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397684.321298:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:92433:x1874218701043328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2174us (2269us total) trans 4294968730 rc 0/0 00000100:00100000:3.0:1787397684.321309:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979 00000100:00100000:0.0:1787397684.321403:0:92433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92433:1874218701043328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397684.321418:0:92433:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00000020:00000004:1.0:1787397684.842272:0:92753:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397684.842867:0:92753:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397685.032736:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397685.221540:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397685.221575:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701043456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397685.221682:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397685.221730:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043456 00000100:00100000:0.0:1787397685.221742:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043456 00000100:00100000:0.0:1787397685.221814:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1787397685.221827:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701043456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397685.221860:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397685.221936:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701043456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397685.221945:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1787397685.222358:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701043456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397685.222697:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397685.222711:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701043584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397685.222763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397685.222841:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043584 00000100:00100000:1.0:1787397685.222847:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043584 00000100:00100000:1.0:1787397685.222904:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1787397685.222913:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701043584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397685.222931:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397685.222983:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701043584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397685.223126:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701043584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397685.223213:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000020:00000004:0.0:1787397685.845309:0:92803:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787397685.845869:0:92803:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787397685.976460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397685.976547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397685.976686:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188352 00000100:00100000:2.0:1787397685.976698:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188352 00000100:00100000:2.0:1787397685.976750:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:2.0:1787397685.976761:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681188352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397685.976835:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681188352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 75us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397685.976843:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:2.0:1787397685.977662:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397685.977702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397685.977728:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188736 00000100:00100000:2.0:1787397685.977733:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188736 00000100:00100000:2.0:1787397685.977768:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2563 00000100:00100000:2.0:1787397685.977776:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681188736:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397685.977820:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681188736:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397685.977833:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2563 00000100:00100000:3.0:1787397685.977955:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188480 00000100:00100000:3.0:1787397685.977961:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188480 00000100:00100000:3.0:1787397685.977994:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188608 00000100:00100000:3.0:1787397685.977997:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188608 00000100:00100000:3.0:1787397685.978019:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1298 00000100:00100000:3.0:1787397685.978026:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681188480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397685.978061:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681188480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397685.978067:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1298 00000100:00100000:3.0:1787397685.978102:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1299 00000100:00100000:3.0:1787397685.978109:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2402:x1874218681188608:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397685.978138:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2402:x1874218681188608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397685.978144:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1299 00000100:00100000:0.0:1787397685.996726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397685.996816:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188864 00000100:00100000:1.0:1787397685.996826:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188864 00000100:00100000:1.0:1787397685.996885:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1328 00000100:00100000:1.0:1787397685.996894:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71251:x1874218681188864:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787397685.996914:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397685.996936:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d190f21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8109 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397686.000324:0:67264:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3334us 00010000:00010000:1.0:1787397686.013217:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013241:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013257:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013273:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013280:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013286:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397686.013456:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701043712:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787397686.013564:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397686.013601:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397686.013640:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043712 00000100:00100000:1.0:1787397686.013647:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043712 00000100:00100000:1.0:1787397686.013697:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1787397686.013706:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67264:x1874218701043712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787397686.013786:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67264:x1874218701043712:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.013794:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1787397686.013840:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701043712:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787397686.013885:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013903:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013911:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397686.013948:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013963:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013970:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013977:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013983:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.013989:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397686.013993:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014001:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014012:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397686.014015:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397686.014019:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014032:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d190f28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014045:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014050:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014055:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014059:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397686.014062:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014067:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014074:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a81301cf00) 00010000:00010000:1.0:1787397686.014076:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397686.014079:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014085:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d190f2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014123:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d190f21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8109 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014148:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8109 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.014156:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a81301c900) 00010000:00010000:1.0:1787397686.014158:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397686.014160:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75600, rc 0) 00000100:00100000:1.0:1787397686.014212:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71251:x1874218681188864:12345-192.168.204.60@tcp:101:rm.0 Request processed in 17319us (17496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.014220:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1328 00000100:00100000:0.0:1787397686.018645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397686.018716:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681188992 00000100:00100000:1.0:1787397686.018727:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681188992 00000100:00100000:1.0:1787397686.018798:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1329 00000100:00100000:1.0:1787397686.018810:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71251:x1874218681188992:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787397686.018831:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397686.018852:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74e00/0x274786fe0d190f3d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8110 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.018909:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d190f44 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.018923:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d190f44 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.018935:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d190f44 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397686.018984:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1787397686.019003:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787397686.019045:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74e00/0x274786fe0d190f3d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8110 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.019063:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d190f44 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8110 expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.019071:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:1.0:1787397686.019075:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787397686.019078:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74600, rc 0) 00000100:00100000:1.0:1787397686.019131:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71251:x1874218681188992:12345-192.168.204.60@tcp:101:rm.0 Request processed in 323us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.019139:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1329 00000100:00080000:0.0:1787397686.019196:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397686.031749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.031825:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681189248 00000100:00100000:3.0:1787397686.031836:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681189248 00000100:00100000:3.0:1787397686.031902:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1330 00000100:00100000:3.0:1787397686.031912:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71251:x1874218681189248:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397686.031935:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397686.031959:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190f4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8117 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397686.032077:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1787397686.032182:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190f4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8117 expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.032197:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809953c00) 00010000:00010000:3.0:1787397686.032199:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397686.032204:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190f4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8117 expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.032223:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00000100:00100000:3.0:1787397686.032294:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71251:x1874218681189248:12345-192.168.204.60@tcp:101:rm.0 Request processed in 383us (554us total) trans 81604378743 rc 301/301 00000100:00100000:3.0:1787397686.032302:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1330 00010000:00010000:3.0:1787397686.057168:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397686.057740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.062000:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681189376 00000100:00100000:3.0:1787397686.062016:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681189376 00000100:00100000:3.0:1787397686.062075:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 230 00000100:00100000:3.0:1787397686.062085:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71251:x1874218681189376:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787397686.074111:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71251:x1874218681189376:12345-192.168.204.60@tcp:37:rm.0 Request processed in 12016us (16367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.074126:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 230 00000100:00100000:3.0:1787397686.084909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397686.085079:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681189632 00000100:00100000:0.0:1787397686.085091:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681189632 00000100:00100000:0.0:1787397686.085137:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 231 00000100:00100000:0.0:1787397686.085147:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71251:x1874218681189632:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787397686.085390:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:71251:x1874218681189632:12345-192.168.204.60@tcp:35:rm.0 Request processed in 243us (489us total) trans 81604378744 rc 0/0 00000100:00100000:0.0:1787397686.085398:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 231 00000100:00100000:2.0:1787397686.095974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397686.098271:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681189888 00000100:00100000:0.0:1787397686.098286:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681189888 00000100:00100000:0.0:1787397686.098371:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1331 00000100:00100000:0.0:1787397686.098383:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:71251:x1874218681189888:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397686.098425:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397686.098451:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d811e expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.098581:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d190f60 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.098595:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d190f60 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.098607:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d190f60 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397686.098618:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1787397686.098728:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d811e expref: 18 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.098752:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d190f60 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d811e expref: 17 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.098760:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:0.0:1787397686.098763:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787397686.098767:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0200, rc 0) 00000100:00100000:0.0:1787397686.098831:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:71251:x1874218681189888:12345-192.168.204.60@tcp:101:rm.0 Request processed in 451us (2872us total) trans 81604378745 rc 0/0 00000100:00100000:0.0:1787397686.098839:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1331 00000100:00100000:3.0:1787397686.105994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.106035:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681190016 00000100:00100000:3.0:1787397686.106045:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681190016 00000100:00100000:3.0:1787397686.106117:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1332 00000100:00100000:3.0:1787397686.106128:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:71251:x1874218681190016:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397686.106153:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397686.106175:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190f6e lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8125 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106246:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106261:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106273:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397686.106331:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:3.0:1787397686.106335:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397686.106368:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106394:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190f6e lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8125 expref: 19 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106414:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8125 expref: 18 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.106423:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397686.106426:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397686.106429:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031600, rc 0) 00000100:00100000:3.0:1787397686.106486:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:71251:x1874218681190016:12345-192.168.204.60@tcp:101:rm.0 Request processed in 359us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.106494:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1332 00000100:00100000:1.0:1787397686.116342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.116411:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681190272 00000100:00100000:3.0:1787397686.116422:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681190272 00000100:00100000:3.0:1787397686.116484:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1333 00000100:00100000:3.0:1787397686.116495:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:71251:x1874218681190272:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397686.116516:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397686.116560:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f7c lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d812c expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397686.116666:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1787397686.116769:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f7c lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d812c expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.116784:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:3.0:1787397686.116801:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397686.116806:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f7c lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d812c expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.116822:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397686.116879:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:71251:x1874218681190272:12345-192.168.204.60@tcp:101:rm.0 Request processed in 386us (547us total) trans 81604378746 rc 301/301 00000100:00100000:3.0:1787397686.116887:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1333 00000100:00100000:2.0:1787397686.121673:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.121761:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681190400 00000100:00100000:3.0:1787397686.121772:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681190400 00000100:00100000:3.0:1787397686.121837:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 232 00000100:00100000:3.0:1787397686.121848:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:71251:x1874218681190400:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:0.0:1787397686.128844:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:71251:x1874218681190400:12345-192.168.204.60@tcp:37:rm.0 Request processed in 6984us (7169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397686.128858:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 232 00000100:00100000:2.0:1787397686.132671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.132762:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681190656 00000100:00100000:3.0:1787397686.132782:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681190656 00000100:00100000:3.0:1787397686.132869:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 233 00000100:00100000:3.0:1787397686.132883:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:71251:x1874218681190656:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787397686.134101:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:71251:x1874218681190656:12345-192.168.204.60@tcp:35:rm.0 Request processed in 1212us (1429us total) trans 81604378747 rc 0/0 00000100:00100000:3.0:1787397686.134117:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 233 00000100:00100000:2.0:1787397686.139511:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397686.143248:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681190912 00000100:00100000:0.0:1787397686.143262:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681190912 00000100:00100000:0.0:1787397686.143417:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1334 00000100:00100000:0.0:1787397686.143430:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:71251:x1874218681190912:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397686.143457:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397686.143481:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1200/0x274786fe0d190f8a lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8133 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.143630:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f91 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.143645:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f91 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.143656:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f91 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397686.143667:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1787397686.143773:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1200/0x274786fe0d190f8a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8133 expref: 23 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.143791:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f91 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8133 expref: 22 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.143798:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:0.0:1787397686.143801:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787397686.143804:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0400, rc 0) 00000100:00100000:0.0:1787397686.143866:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681190912:12345-192.168.204.60@tcp:101:rm.0 Request processed in 439us (4364us total) trans 81604378748 rc 0/0 00000100:00100000:0.0:1787397686.143890:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1334 00000100:00100000:0.0:1787397686.148283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.148452:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681191040 00000100:00100000:3.0:1787397686.148467:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681191040 00000100:00100000:3.0:1787397686.148611:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1335 00000100:00100000:3.0:1787397686.148626:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71251:x1874218681191040:12345-192.168.204.60@tcp:41:rm.0 00000004:00000024:3.0:1787397686.148709:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:3.0:1787397686.148819:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71251:x1874218681191040:12345-192.168.204.60@tcp:41:rm.0 Request processed in 197us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.148854:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1335 00000100:00080000:0.0:1787397686.151378:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397686.152136:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.152244:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681191296 00000100:00100000:3.0:1787397686.152255:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681191296 00000100:00100000:3.0:1787397686.152427:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1336 00000100:00100000:3.0:1787397686.152440:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681191296:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397686.152506:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787397686.152581:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1600/0x274786fe0d190e1e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80f4 expref: 22 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152605:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff89a82250cf00) 00010000:00010000:3.0:1787397686.152632:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031600/0x274786fe0d190f75 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8125 expref: 21 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152643:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397686.152646:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397686.152666:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152678:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152687:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152697:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152704:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152725:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152816:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152824:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.152831:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397686.153047:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].2, 64 off8320 00000004:00080000:3.0:1787397686.153058:0:74374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3565443534793ns, next at 3566443532476ns, rc = 0 00010000:00010000:3.0:1787397686.153110:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153119:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153126:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153133:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153138:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153144:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153179:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397686.153198:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153205:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153211:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153217:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397686.153221:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153227:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153236:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff89a809953c00) 00010000:00010000:3.0:1787397686.153238:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397686.153241:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153246:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030000/0x274786fe0d190fad lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153261:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153266:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 2/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153282:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153286:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397686.153288:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153294:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153300:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:3.0:1787397686.153303:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397686.153305:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153323:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030200/0x274786fe0d190f9f lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397686.153344:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec83ba61 reply state 000000003532def4 transno 81604378749 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153354:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.153360:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a817ea6500) 00010000:00010000:3.0:1787397686.153362:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397686.153364:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397686.153438:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681191296:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1000us (1312us total) trans 81604378749 rc 0/0 00010000:00010000:0.0:1787397686.153583:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397686.153597:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.153608:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397686.153612:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.153623:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.153640:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff89a809953c00) 00010000:00010000:0.0:1787397686.153644:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397686.153649:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.153655:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d190fb4 lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.153682:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397686.153684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397686.153686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397686.157150:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1336 00000100:00100000:2.0:1787397686.165219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397686.165419:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681191552 00000100:00100000:0.0:1787397686.165433:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681191552 00000100:00100000:0.0:1787397686.165507:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 234 00000100:00100000:0.0:1787397686.165517:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681191552:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787397686.165892:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:71251:x1874218681191552:12345-192.168.204.60@tcp:35:rm.0 Request processed in 374us (687us total) trans 81604378750 rc 0/0 00000100:00100000:0.0:1787397686.166141:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 234 00000100:00100000:2.0:1787397686.172592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397686.174024:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681191808 00000100:00100000:1.0:1787397686.174041:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681191808 00000100:00100000:1.0:1787397686.174124:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1337 00000100:00100000:1.0:1787397686.174136:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:71251:x1874218681191808:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787397686.174214:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787397686.174243:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0400/0x274786fe0d190f91 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8133 expref: 23 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174267:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d190aa5 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80c3 expref: 22 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174280:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a70229d600) 00010000:00010000:1.0:1787397686.174325:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d190f44 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8110 expref: 21 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174336:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:1.0:1787397686.174340:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397686.174362:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174375:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174385:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174398:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174405:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174411:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174495:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174503:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174510:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397686.174803:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1787397686.174825:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174833:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174839:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174846:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397686.174851:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174860:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174871:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff89a81301cb00) 00010000:00010000:1.0:1787397686.174887:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787397686.174893:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174900:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d190fc9 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174923:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174930:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174936:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174941:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174951:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397686.174954:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174960:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174969:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:1.0:1787397686.174971:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397686.174974:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.174980:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d190fbb lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397686.174990:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f040240 reply state 00000000863c5e13 transno 81604378751 ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.175002:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.175008:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a81301cf00) 00010000:00010000:1.0:1787397686.175010:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397686.175012:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397686.175099:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681191808:12345-192.168.204.60@tcp:36:rm.0 Request processed in 964us (2578us total) trans 81604378751 rc 0/0 00000100:00100000:1.0:1787397686.175108:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1337 00000100:00100000:2.0:1787397686.180048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397686.180107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.180290:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192192 00000100:00100000:3.0:1787397686.180316:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192192 00000100:00100000:3.0:1787397686.180401:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 235 00000100:00100000:3.0:1787397686.180415:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681192192:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787397686.180814:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:71251:x1874218681192192:12345-192.168.204.60@tcp:35:rm.0 Request processed in 399us (778us total) trans 81604378752 rc 0/0 00000100:00100000:3.0:1787397686.180824:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 235 00000100:00100000:2.0:1787397686.181429:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681191936 00000100:00100000:2.0:1787397686.181440:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681191936 00000100:00100000:2.0:1787397686.181546:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 662 00000100:00100000:2.0:1787397686.181556:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681191936:12345-192.168.204.60@tcp:103:rm.0 00010000:00010000:2.0:1787397686.181572:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397686.181602:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d190f36 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8109 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.181627:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a81301c900) 00010000:00010000:2.0:1787397686.181640:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397686.181686:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681191936:12345-192.168.204.60@tcp:103:rm.0 Request processed in 131us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397686.181693:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 662 00000100:00100000:2.0:1787397686.198922:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397686.201345:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192448 00000100:00100000:1.0:1787397686.201368:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192448 00000100:00100000:1.0:1787397686.201452:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1338 00000100:00100000:1.0:1787397686.201482:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:71251:x1874218681192448:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787397686.203220:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787397686.203277:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0200/0x274786fe0d190f60 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d811e expref: 23 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.203321:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0800/0x274786fe0d190a89 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80bc expref: 22 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.203335:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a8191cd700) 00010000:00010000:1.0:1787397686.203361:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397686.203429:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.203438:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.203449:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397686.203477:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701043840:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787397686.204176:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397686.204273:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397686.205826:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701043840 00000100:00100000:2.0:1787397686.205848:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701043840 00000100:00100000:2.0:1787397686.206008:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1787397686.206021:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701043840:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787397686.206053:0:23942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397686.206082:0:23942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190fd0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.206124:0:23942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 6 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.206137:0:23942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 9 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.206185:0:23942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 6 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.206202:0:23942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 6 pid: 92447 timeout: 3665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397686.206218:0:23942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23942:1874218701043968:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397686.206378:0:23942:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397686.212328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397686.212742:0:23942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23942:1874218701043968:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397686.212791:0:23942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 9 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.212807:0:23942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:3.0:1787397686.212811:0:23942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397686.212816:0:23942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 9 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.212829:0:23942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23400, rc 0) 00000100:00100000:3.0:1787397686.212914:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701043840:12345-0@lo:101:mdt00_001.0 Request processed in 6895us (8740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.212925:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1787397686.213790:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701043840:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787397686.213821:0:66177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.213835:0:66177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397686.214123:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192576 00000100:00100000:0.0:1787397686.214135:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192576 00010000:00010000:0.0:1787397686.214191:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 3665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397686.214284:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2596 00000100:00100000:0.0:1787397686.214295:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681192576:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397686.214330:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397686.214338:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 3665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214353:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 3665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214381:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d190d14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ae expref: 7 pid: 92447 timeout: 3665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214401:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397686.214407:0:19654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214420:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214430:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397686.214485:0:19654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397686.214501:0:19654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701044096:0@lo:105: 00000100:00100000:0.0:1787397686.214620:0:19654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397686.214659:0:19654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397686.214794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044096 00000100:00100000:1.0:1787397686.214800:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044096 00000100:00100000:1.0:1787397686.214842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787397686.214850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701044096:12345-0@lo:105: 00010000:00010000:1.0:1787397686.214863:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214875:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214885:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214892:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214900:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214908:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.214938:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a828a75e00) 00010000:00010000:2.0:1787397686.215230:0:66177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.215243:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397686.215274:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397686.215349:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.215358:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.215369:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397686.215758:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044224:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787397686.215812:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397686.215848:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397686.215911:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044224 00000100:00100000:3.0:1787397686.215918:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044224 00000100:00100000:3.0:1787397686.215967:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1787397686.215977:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701044224:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397686.216013:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397686.216039:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d190fe5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190fde expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216082:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d190fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190fde expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216098:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d190fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fde expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216107:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a809953900) 00010000:00010000:3.0:1787397686.216110:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397686.216114:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397686.216168:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044224:12345-0@lo:101:mdt00_001.0 Request processed in 191us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.216176:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1787397686.216242:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044224:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397686.216260:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216270:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397686.216289:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787397686.216351:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044352:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397686.216382:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397686.216399:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397686.216416:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044352 00000100:00100000:3.0:1787397686.216420:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044352 00000100:00100000:3.0:1787397686.216445:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1787397686.216461:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397686.216564:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044352:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.216572:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1787397686.216604:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044352:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397686.216648:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397686.216671:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397686.216685:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397686.216697:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044480 00000100:00100000:3.0:1787397686.216700:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044480 00000100:00100000:3.0:1787397686.216720:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1787397686.216726:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397686.216816:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044480:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (143us total) trans 0 rc 1/1 00000100:00100000:3.0:1787397686.216822:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1787397686.216848:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044480:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787397686.216899:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216908:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.216918:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397686.216929:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044608:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787397686.216952:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397686.216974:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397686.216985:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044608 00000100:00100000:3.0:1787397686.216989:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044608 00000100:00100000:3.0:1787397686.217013:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1787397686.217018:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701044608:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397686.217028:0:23942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397686.217042:0:23942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d190ff3 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190fec expref: -99 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217062:0:23942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d190ff3 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190fec expref: 11 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217074:0:23942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d190ff3 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190fec expref: 11 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217081:0:23942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a809953300) 00010000:00010000:3.0:1787397686.217084:0:23942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397686.217087:0:23942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031600, rc 0) 00000100:00100000:3.0:1787397686.217114:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66177:x1874218701044608:12345-0@lo:101:mdt00_001.0 Request processed in 95us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397686.217120:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1787397686.217145:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701044608:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397686.217156:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217166:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217201:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217209:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.217217:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397686.217683:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].3, 432 off36352 00000040:00080000:3.0:1787397686.217747:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].3, 512 off36784 00000004:00080000:3.0:1787397686.217755:0:66177:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a808723540 with version 11 00000100:00100000:1.0:1787397686.218469:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701044096:12345-0@lo:105: Request processed in 135us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.218485:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000004:00080000:1.0:1787397686.218560:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 11 rpc_version 11 00000020:00100000:1.0:1787397686.218601:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397686.218613:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a806916680 x1874218701044864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397686.218638:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701044864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397686.218709:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397686.218752:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397686.219671:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044864 00000100:00100000:3.0:1787397686.219684:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044864 00000100:00100000:3.0:1787397686.219851:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:3.0:1787397686.219863:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75622:x1874218701044864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397686.220391:0:19654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701044096:0@lo:105: 00010000:00010000:0.0:1787397686.220427:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397686.220509:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681192576:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 6213us (8203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397686.220548:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2596 00000100:00100000:3.0:1787397686.225629:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75622:x1874218701044864:12345-0@lo:1000:osp_up0-1.0 Request processed in 5751us (6902us total) trans 115964116994 rc 0/0 00000100:00100000:3.0:1787397686.225649:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:1.0:1787397686.229904:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701044864:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1787397686.232739:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1787397686.235811:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.235835:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.235845:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.235852:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397686.235859:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.235867:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.235889:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a809953100) 00010000:00010000:2.0:1787397686.235893:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397686.235897:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236206:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031200/0x274786fe0d190ffa lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236248:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236259:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236266:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236359:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787397686.236382:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397686.236390:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236398:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.236405:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236434:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397686.236443:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236452:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:3.0:1787397686.236457:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397686.236562:0:15258:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236619:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236626:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397686.236668:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 1/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236676:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030000/0x274786fe0d190fec lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190ff3 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236692:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397686.236696:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236702:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:3.0:1787397686.236705:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397686.236713:0:15258:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236729:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236735:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397686.236746:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397686.236754:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397686.236756:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397686.236758:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397686.236824:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701044992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397686.236914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397686.237091:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397686.237098:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701045120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397686.237122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397686.237291:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701044992 00000100:00100000:1.0:1787397686.237301:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701044992 00000100:00100000:1.0:1787397686.237370:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045120 00000100:00100000:1.0:1787397686.237373:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045120 00000100:00100000:1.0:1787397686.237399:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1787397686.237408:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3648:x1874218701044992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397686.237424:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397686.237446:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031600/0x274786fe0d190ff3 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190fec expref: 13 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.237464:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff89a809953300) 00010000:00010000:1.0:1787397686.237596:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397686.237643:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3648:x1874218701044992:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.237651:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1787397686.237674:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1787397686.237681:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3648:x1874218701045120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397686.237689:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397686.237701:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d190fd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190fd0 expref: 11 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397686.237723:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397686.237727:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397686.237752:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838245050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701045120:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397686.237758:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1787397686.237841:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701045120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397686.237851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701044992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397686.238691:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787397686.238706:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75e00/0x274786fe0d190fd0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190fd7 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397686.238732:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397686.238757:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397686.238767:0:66177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397686.238866:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:71251:x1874218681192448:12345-192.168.204.60@tcp:36:rm.0 Request processed in 37383us (39954us total) trans 81604378753 rc 0/0 00000100:00100000:2.0:1787397686.238876:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1338 00010000:00010000:3.0:1787397686.243281:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397687.079683:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397688.115056:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397689.152092:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397689.317008:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701045248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.317110:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701045504:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.317141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397689.317237:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045248 00000100:00100000:0.0:1787397689.317254:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045248 00000100:00100000:0.0:1787397689.317314:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787397689.317336:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701045248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.320698:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701045376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397689.324072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.324109:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701045760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.324155:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045504 00000100:00100000:2.0:1787397689.324166:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045504 00000100:00100000:3.0:1787397689.324201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.324239:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701046272:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.324285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.324325:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701046784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.324358:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.324424:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701045632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.324452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397689.327467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397689.327500:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046272 00000100:00100000:0.0:1787397689.327510:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046272 00000100:00100000:0.0:1787397689.327585:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046784 00000100:00100000:0.0:1787397689.327588:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046784 00000100:00100000:0.0:1787397689.327640:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1787397689.327650:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701046272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.327740:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701046272:12345-0@lo:400:kworker.0 Request processed in 91us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397689.327746:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1787397689.327762:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1787397689.327768:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701046784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.327797:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701046784:12345-0@lo:400:kworker.0 Request processed in 28us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397689.327802:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00080000:0.0:1787397689.327820:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397689.327992:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701046272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.328011:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701046784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.328103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397689.328139:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701045888:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.328194:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701045248:12345-0@lo:400:kworker.0 Request processed in 10860us (11057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397689.328203:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787397689.328792:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701045248:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.329025:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045376 00000100:00100000:1.0:1787397689.329031:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045376 00000100:00100000:1.0:1787397689.329072:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:1.0:1787397689.329079:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701045376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397689.329123:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1787397689.329174:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701045376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397689.329181:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:1.0:1787397689.330493:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1787397689.330510:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.330594:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701045504:12345-0@lo:400:kworker.0 Request processed in 90us (6530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397689.330603:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1787397689.331078:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045760 00000100:00100000:2.0:1787397689.331085:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045760 00000100:00100000:2.0:1787397689.331189:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1787397689.331196:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701045760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331241:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701045760:12345-0@lo:400:kworker.0 Request processed in 46us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397689.331259:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1787397689.331299:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701045760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331452:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701045504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331463:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701046016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397689.331538:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701046528:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397689.331592:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046016 00000100:00100000:2.0:1787397689.331596:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046016 00000100:00100000:2.0:1787397689.331621:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046528 00000100:00100000:2.0:1787397689.331624:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046528 00000100:00100000:2.0:1787397689.331638:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1787397689.331643:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701046016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331674:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701046016:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397689.331680:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1787397689.331689:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1787397689.331694:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331716:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701046528:12345-0@lo:400:kworker.0 Request processed in 22us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397689.331722:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1787397689.331745:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701046528:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.331752:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701047040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397689.331776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397689.331798:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047040 00000100:00100000:2.0:1787397689.331801:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047040 00000100:00100000:2.0:1787397689.331826:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1787397689.331832:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701047040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397689.331853:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397689.331969:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701047040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397689.331976:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1787397689.332005:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701047040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397689.332038:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701046016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.332468:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045632 00000100:00100000:0.0:1787397689.332474:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045632 00000100:00080000:1.0:1787397689.334472:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397689.334480:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397689.337456:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1787397689.337472:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701045632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.337587:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701045632:12345-0@lo:400:kworker.0 Request processed in 121us (13132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397689.337595:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1787397689.338342:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701045632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.338363:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701046144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.338445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.338479:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701046656:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.338569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.338592:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701047168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397689.339104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397689.339148:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701045888 00000100:00100000:0.0:1787397689.339156:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701045888 00000100:00100000:3.0:1787397689.342373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397689.342585:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047168 00000100:00100000:3.0:1787397689.342597:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047168 00000100:00100000:3.0:1787397689.342663:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1787397689.342675:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701047168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397689.342733:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:3.0:1787397689.342830:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701047168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (2835us total) trans 0 rc 0/0 00000100:00080000:1.0:1787397689.342835:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397689.342844:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1787397689.342882:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046144 00000100:00100000:3.0:1787397689.342888:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046144 00000100:00100000:3.0:1787397689.342940:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046656 00000100:00100000:3.0:1787397689.342944:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046656 00000100:00080000:1.0:1787397689.342981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397689.343044:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1787397689.343053:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701046144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.343094:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701046144:12345-0@lo:400:kworker.0 Request processed in 42us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397689.343101:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1787397689.343546:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1787397689.343574:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701046656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.343628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701046144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.343654:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701047168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397689.343683:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701046656:12345-0@lo:400:kworker.0 Request processed in 121us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397689.343695:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1787397689.343701:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701046656:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.345006:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701046400:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.345077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397689.345123:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701046912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.345145:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397689.345198:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701045376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397689.345358:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046400 00000100:00100000:3.0:1787397689.345366:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046400 00000100:00100000:3.0:1787397689.345412:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701046912 00000100:00100000:3.0:1787397689.345416:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701046912 00000100:00100000:3.0:1787397689.345438:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1787397689.345444:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.345496:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701046400:12345-0@lo:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397689.345517:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1787397689.345557:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1787397689.345563:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397689.345595:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701046912:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397689.345601:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1787397689.345760:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701046400:0@lo:400:kworker.0 00000100:00100000:1.0:1787397689.345772:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701046912:0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.350010:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1787397689.350025:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701045888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397689.350123:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701045888:12345-0@lo:400:kworker.0 Request processed in 102us (11025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397689.350140:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1787397689.350214:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701045888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397689.829419:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397689.829450:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397689.829557:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397689.830517:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047296 00000100:00100000:1.0:1787397689.830561:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047296 00000100:00100000:1.0:1787397689.830616:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1787397689.830626:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701047296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397689.830662:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397689.830740:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701047296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397689.830748:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:2.0:1787397689.832016:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701047296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787397689.839269:0:92415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000001:00080000:2.0:1787397689.839767:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968730 is committed 00000001:00100000:2.0:1787397689.839893:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00010000:00010000:3.0:1787397689.841201:0:75615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397689.841226:0:75615:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.841287:0:75615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.841294:0:75615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397689.841325:0:75615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23e00/0x274786fe0d190fde lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d190fe5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397689.841343:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378753 is committed 00000004:00080000:3.0:1787397689.841361:0:75615:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:0.0:1787397689.841387:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701047424:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1787397689.841455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397689.841569:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397689.841577:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047424 00010000:00010000:2.0:1787397689.841578:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397689.841584:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047424 00010000:00010000:2.0:1787397689.841585:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841590:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397689.841594:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841601:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841631:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a817ea6500) 00010000:00010000:2.0:1787397689.841635:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397689.841639:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841645:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22600/0x274786fe0d190e17 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841659:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841664:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841670:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841675:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397689.841678:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841683:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841690:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff89a817ea6500) 00010000:00010000:2.0:1787397689.841692:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397689.841695:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841700:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030a00/0x274786fe0d190fa6 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841726:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841733:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841738:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841743:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc1a774f0) 00000100:00100000:3.0:1787397689.841747:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00010000:00010000:2.0:1787397689.841747:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397689.841752:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397689.841756:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701047424:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787397689.841761:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff89a81301cf00) 00010000:00010000:2.0:1787397689.841764:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397689.841766:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.841770:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397689.841789:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d190fe5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190fde expref: 8 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.841806:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff89a809953900) 00010000:00010000:3.0:1787397689.841815:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397689.841867:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701047424:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 111us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397689.841874:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1787397689.842308:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397689.842326:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701047552:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1787397689.842482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397689.842569:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701047424:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787397689.843108:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75200/0x274786fe0d190fc2 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397689.843649:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047552 00000100:00100000:0.0:1787397689.843658:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047552 00000100:00100000:0.0:1787397689.843709:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980 00000100:00100000:0.0:1787397689.843718:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701047552:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:0.0:1787397689.843747:0:25908:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:578 count 1 00010000:00010000:0.0:1787397689.843787:0:25908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.843811:0:25908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 5 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.843820:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x242:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1787397689.843825:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787397689.843829:0:25908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.843881:0:25908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 5 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.843894:0:25908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 5 pid: 26168 timeout: 3669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397689.843907:0:25908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25908:1874218701047680:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397689.845737:0:25908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264e40 going to sleep for 11 seconds 00000001:00080000:1.0:1787397689.849037:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968728 is committed 00000100:00100000:2.0:1787397689.857618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397689.857785:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192704 00000100:00100000:3.0:1787397689.857795:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192704 00010000:00010000:3.0:1787397689.857842:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 6 pid: 26168 timeout: 3669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397689.857896:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2597 00000100:00100000:3.0:1787397689.857906:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681192704:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397689.857921:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397689.857927:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 6 pid: 26168 timeout: 3669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.857940:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 6 pid: 26168 timeout: 3669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.857967:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787397689.857972:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787397689.857978:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.857989:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397689.858028:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397689.858081:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681192704:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 176us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397689.858089:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2597 00000100:00080000:1.0:1787397689.861953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787397689.862359:0:25908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051f5932c/0x274786fe0d190eb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8102 expref: 5 pid: 26168 timeout: 3669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397689.862384:0:25908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25908:1874218701047680:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397689.862408:0:25908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.862420:0:25908:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.862427:0:25908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.862439:0:25908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.862471:0:25908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397689.862491:0:25908:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397689.862715:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397689.862722:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397689.862730:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397689.862735:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397689.862744:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397689.862765:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397689.862773:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397689.862793:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397689.862795:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397689.862797:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397689.863121:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701047552:12345-0@lo:6:osp-syn-0-1.0 Request processed in 19402us (20636us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1787397689.863131:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980 00000004:00080000:3.0:1787397689.863210:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70698ca80/2, rc 0, transno 4294968731 00000100:00100000:3.0:1787397689.863217:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701047552:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1787397690.213515:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397690.341087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701047808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397690.341157:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397690.345219:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397690.345259:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701047936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397690.345334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397690.348263:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047808 00000100:00100000:0.0:1787397690.348278:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047808 00000100:00100000:0.0:1787397690.348426:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701047936 00000100:00100000:0.0:1787397690.348430:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701047936 00000100:00100000:0.0:1787397690.348450:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:0.0:1787397690.348459:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701047808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397690.348487:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397690.348581:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1787397690.348585:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701047808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (7428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397690.348591:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701047936:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397690.348593:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00002000:00000024:2.0:1787397690.348603:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397690.348642:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701047936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397690.348662:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1787397690.348682:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701047936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397690.348761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701047808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397691.142346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397691.142398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397691.142438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397691.142477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397691.142518:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193088 00000100:00100000:2.0:1787397691.142565:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193088 00000100:00100000:2.0:1787397691.142647:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192960 00000100:00100000:2.0:1787397691.142650:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192960 00000100:00100000:2.0:1787397691.142681:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1306 00000100:00100000:2.0:1787397691.142694:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681193088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397691.142801:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681193088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397691.142811:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1306 00000100:00100000:2.0:1787397691.142833:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1307 00000100:00100000:2.0:1787397691.142840:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681192960:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397691.142869:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681192960:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397691.142876:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1307 00000100:00100000:2.0:1787397691.142899:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193216 00000100:00100000:2.0:1787397691.142904:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193216 00000100:00100000:2.0:1787397691.142938:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2568 00000100:00100000:2.0:1787397691.142945:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681193216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397691.142977:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681193216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397691.143005:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2568 00000100:00080000:2.0:1787397691.143025:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397691.143031:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397691.143033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397691.143454:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681192832 00000100:00100000:3.0:1787397691.143462:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681192832 00000100:00100000:3.0:1787397691.143512:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:3.0:1787397691.143553:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681192832:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397691.143603:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681192832:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397691.143611:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00010000:00010000:1.0:1787397691.239419:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397692.261073:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397693.286598:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397693.624453:0:93000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 07:21:30 (1787397690) 00010000:00010000:2.0:1787397694.308761:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397694.436628:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397694.436651:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701048192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397694.436722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.436764:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397694.436787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.436816:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048192 00000100:00100000:2.0:1787397694.436824:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048192 00000100:00100000:2.0:1787397694.436866:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1787397694.436873:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701048192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397694.436903:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397694.436952:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701048192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.436959:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1787397694.436989:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048064 00000100:00100000:2.0:1787397694.436992:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048064 00000100:00100000:2.0:1787397694.437020:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1787397694.437025:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701048064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397694.437043:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397694.437078:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701048064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.437095:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00080000:2.0:1787397694.437113:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397694.437155:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701048192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397694.437166:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968728 gen 2 00000100:00100000:2.0:1787397694.437182:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397694.437732:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701048704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437771:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437791:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701049216:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787397694.437837:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701048576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437884:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701049088:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437919:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701049600:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437961:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701048448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.437982:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.437996:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701048960:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438015:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.438030:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701049472:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.438071:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787397694.438077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701048320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438078:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049216 00000100:00100000:1.0:1787397694.438083:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049216 00000100:00100000:0.0:1787397694.438105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397694.438119:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049088 00000100:00100000:1.0:1787397694.438122:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049088 00000100:00100000:0.0:1787397694.438126:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701048832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438139:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049472 00000100:00100000:1.0:1787397694.438142:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049472 00000100:00100000:0.0:1787397694.438157:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.438174:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701049344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438177:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1787397694.438190:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701049216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.438220:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048704 00000100:00100000:0.0:1787397694.438224:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048704 00000100:00100000:1.0:1787397694.438230:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701049216:12345-0@lo:400:kworker.0 Request processed in 40us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.438237:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1787397694.438245:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048576 00000100:00100000:0.0:1787397694.438248:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048576 00000100:00100000:1.0:1787397694.438251:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1787397694.438256:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438259:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049600 00000100:00100000:0.0:1787397694.438261:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049600 00000100:00100000:0.0:1787397694.438271:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048448 00000100:00100000:0.0:1787397694.438273:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048448 00000100:00100000:0.0:1787397694.438295:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048832 00000100:00100000:1.0:1787397694.438297:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701049088:12345-0@lo:400:kworker.0 Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438298:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048832 00000100:00100000:1.0:1787397694.438303:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1787397694.438308:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049344 00000100:00100000:0.0:1787397694.438310:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049344 00000100:00100000:1.0:1787397694.438313:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1787397694.438318:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438321:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1787397694.438326:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701048704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438346:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701049472:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438351:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701048704:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.438352:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1787397694.438357:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1787397694.438367:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1787397694.438370:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048320 00000100:00100000:1.0:1787397694.438373:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048320 00000100:00100000:0.0:1787397694.438373:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701048576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438396:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787397694.438398:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701048576:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.438401:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701048320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438404:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1787397694.438414:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1787397694.438419:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397694.438425:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701048320:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.438431:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787397694.438440:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701049600:12345-0@lo:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438445:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1787397694.438454:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1787397694.438459:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438486:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701048448:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438491:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1787397694.438502:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1787397694.438507:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438564:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701048832:12345-0@lo:400:kworker.0 Request processed in 56us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438571:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:0.0:1787397694.438582:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1787397694.438587:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438611:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701049344:12345-0@lo:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.438617:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1787397694.438686:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701048576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438697:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701049088:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438705:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701049600:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438713:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701048704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438722:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701049216:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438753:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701048320:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438762:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701048832:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438770:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701049344:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438778:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701048448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397694.438786:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968730 gen 2 00000100:00100000:0.0:1787397694.438794:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701049472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397694.439593:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701048960 00000100:00100000:3.0:1787397694.439602:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701048960 00000100:00100000:3.0:1787397694.439661:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:3.0:1787397694.439667:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397694.439720:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701048960:12345-0@lo:400:kworker.0 Request processed in 53us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397694.439725:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1787397694.439826:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:0.0:1787397694.439832:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000004:00080000:0.0:1787397694.439856:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000020:00080000:0.0:1787397694.439861:0:3649:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a808723240 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:0.0:1787397694.439865:0:3649:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a804fc2d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a808723540 00000020:00080000:0.0:1787397694.439868:0:3649:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].3 00000020:00080000:0.0:1787397694.439871:0:3649:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a804fc2700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a82f212000 00000020:00080000:0.0:1787397694.439874:0:3649:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].3 00000020:00080000:3.0:1787397694.439909:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411387 committed batchid 77309411386 00000020:00080000:3.0:1787397694.439979:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000100:00100000:0.0:1787397694.440877:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701048960:0@lo:400:kworker.0 00000100:00080000:2.0:1787397694.441170:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397694.441175:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397694.441179:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397694.441181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397694.441201:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397694.441219:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701049728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397694.441455:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397694.441703:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701049728 00000100:00100000:1.0:1787397694.441711:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701049728 00000100:00100000:3.0:1787397694.441811:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1787397694.441822:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701049728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397694.441858:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787397694.441909:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701049728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397694.441917:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:2.0:1787397694.442168:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701049728:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1787397694.650473:0:93048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe36f0fc80 00000020:00000080:3.0:1787397694.650493:0:93048:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787397694.650499:0:93048:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 4 00000020:00000080:3.0:1787397694.650507:0:93048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe36f0fce0 20000000:00000080:3.0:1787397694.650514:0:93048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff89a836731400 uarg=0000000000000000 00000040:00100000:3.0:1787397694.651092:0:93048:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:3.0:1787397694.651881:0:93048:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:3.0:1787397694.652020:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:3.0:1787397694.652047:0:93048:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397694.652066:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:3.0:1787397694.652085:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:3.0:1787397694.652171:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:3.0:1787397694.652182:0:93048:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397694.652197:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:3.0:1787397694.652366:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:3.0:1787397694.654844:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:3.0:1787397694.654891:0:93048:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397694.654936:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:2.0:1787397694.655998:0:93048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:2.0:1787397694.656049:0:93048:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787397694.656076:0:93048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656096:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190b15 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656104:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190bee expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656111:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656119:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c3b expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656136:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c65 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656155:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c73 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656162:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c8f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656171:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190c9d expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656179:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656190:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 9 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656198:0:93048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 9 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656206:0:93048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656254:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 9 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656272:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 9 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656301:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701049856:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397694.656419:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 9 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656428:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 9 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656437:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701049984:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397694.656468:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656477:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 23 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656486:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050112:0@lo:104: 00000100:00100000:2.0:1787397694.656553:0:93048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397694.656587:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656595:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 23 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656610:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050240:0@lo:104: 00000100:00100000:2.0:1787397694.656635:0:93048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397694.656664:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656672:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 23 pid: 92421 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656690:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050368:0@lo:104: 00000100:00100000:0.0:1787397694.656708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050112 00000100:00100000:0.0:1787397694.656717:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050112 00000100:00100000:2.0:1787397694.656729:0:93048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397694.656769:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656778:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 23 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656786:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050496:0@lo:104: 00000100:00100000:2.0:1787397694.656806:0:93048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.656819:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050240 00000100:00100000:0.0:1787397694.656825:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050240 00010000:00010000:2.0:1787397694.656826:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656836:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 23 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397694.656844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050368 00000100:00100000:2.0:1787397694.656845:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050624:0@lo:104: 00000100:00100000:0.0:1787397694.656849:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050368 00000100:00100000:0.0:1787397694.656866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050496 00000100:00100000:0.0:1787397694.656869:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050496 00000100:00100000:2.0:1787397694.656879:0:93048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397694.656886:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787397694.656895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93048:x1874218701050112:12345-0@lo:104: 00010000:00010000:2.0:1787397694.656904:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.656908:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656917:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656928:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050752:0@lo:104: 00010000:00010000:2.0:1787397694.656963:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.656984:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.656993:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050880:0@lo:104: 00010000:00010000:2.0:1787397694.657025:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.657034:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 23 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.657041:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701051008:0@lo:104: 00010000:00010000:2.0:1787397694.657066:0:93048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.657075:0:93048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.657083:0:93048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701051136:0@lo:104: 00000100:00100000:2.0:1787397694.657102:0:93048:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397694.657124:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050112:0@lo:104: 00000100:00100000:3.0:1787397694.657207:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787397694.657231:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397694.657244:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397694.657253:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397694.657263:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397694.657269:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787397694.657275:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787397694.657317:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787397694.657324:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93048:x1874218701050112:12345-0@lo:104: Request processed in 431us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.657332:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787397694.657350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050624 00000100:00100000:0.0:1787397694.657354:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050624 00000100:00100000:0.0:1787397694.657370:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050752 00000100:00100000:0.0:1787397694.657372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050752 00000100:00100000:0.0:1787397694.657381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701050880 00000100:00100000:0.0:1787397694.657390:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701050880 00000100:00100000:0.0:1787397694.657404:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051008 00000100:00100000:0.0:1787397694.657406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051008 00000100:00100000:0.0:1787397694.657414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051136 00000100:00100000:0.0:1787397694.657416:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051136 00000100:00100000:0.0:1787397694.657427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787397694.657433:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+10:93048:x1874218701050240:12345-0@lo:104: 00010000:00010000:0.0:1787397694.657442:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.657919:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787397694.657927:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+10:93048:x1874218701050240:12345-0@lo:104: Request processed in 494us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.657934:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00010000:1.0:1787397694.657951:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787397694.657954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00010000:00010000:1.0:1787397694.657961:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397694.657963:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+9:93048:x1874218701050368:12345-0@lo:104: 00010000:00010000:1.0:1787397694.657990:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397694.657995:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658004:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397694.658026:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397694.658032:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397694.658067:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658074:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397694.658094:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658101:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a400/0x274786fe0d190cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190cce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658114:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397694.658117:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658123:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397694.658126:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658156:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397694.658162:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397694.658168:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397694.658183:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658188:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397694.658194:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658201:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f0e00/0x274786fe0d190c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190ca4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658211:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397694.658213:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397694.658215:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397694.658237:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397694.658273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397694.658302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397694.658308:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397694.658325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397694.658348:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051264 00000100:00100000:1.0:1787397694.658353:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051264 00010000:00010000:1.0:1787397694.658376:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 24 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.658408:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051392 00000100:00100000:1.0:1787397694.658412:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051392 00010000:00010000:1.0:1787397694.658423:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 25 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.658443:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1787397694.658450:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+25:3648:x1874218701051264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.658461:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397694.658466:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 25 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658475:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 25 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658489:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62200/0x274786fe0d190cce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190cc7 expref: 25 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658500:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397694.658549:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701051264:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.658556:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1787397694.658574:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1787397694.658580:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701051392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.658587:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397694.658590:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 23 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658599:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 23 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.658617:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397694.658641:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701051392:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.658647:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1787397694.658685:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397694.658693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397694.659380:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787397694.659391:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+9:93048:x1874218701050496:12345-0@lo:104: 00010000:00010000:1.0:1787397694.659403:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659457:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397694.659463:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+9:93048:x1874218701050496:12345-0@lo:104: Request processed in 75us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.659469:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787397694.659486:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787397694.659492:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:93048:x1874218701050624:12345-0@lo:104: 00010000:00010000:1.0:1787397694.659499:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659561:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787397694.659565:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a0f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:93048:x1874218701050624:12345-0@lo:104: Request processed in 75us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.659571:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:1.0:1787397694.659586:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397694.659598:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659605:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397694.659609:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659618:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397694.659625:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397694.659631:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397694.659659:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659666:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397694.659685:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.659688:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.659692:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ae00/0x274786fe0d190c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.659750:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787397694.659755:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+7:93048:x1874218701050368:12345-0@lo:104: Request processed in 1794us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.659773:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787397694.659809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787397694.659816:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93048:x1874218701050752:12345-0@lo:104: 00010000:00010000:0.0:1787397694.659824:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.659856:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787397694.659868:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93048:x1874218701050752:12345-0@lo:104: Request processed in 53us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.659874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787397694.659888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787397694.659895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:93048:x1874218701050880:12345-0@lo:104: 00010000:00010000:0.0:1787397694.659903:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.659931:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787397694.659936:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:93048:x1874218701050880:12345-0@lo:104: Request processed in 43us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.659942:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787397694.659953:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787397694.659959:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:93048:x1874218701051008:12345-0@lo:104: 00010000:00010000:0.0:1787397694.659967:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.660006:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787397694.660011:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:93048:x1874218701051008:12345-0@lo:104: Request processed in 52us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397694.660017:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787397694.660032:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787397694.660039:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:93048:x1874218701051136:12345-0@lo:104: 00010000:00010000:0.0:1787397694.660046:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660048:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787397694.660057:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660066:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660069:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397694.660079:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:2.0:1787397694.660087:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397694.660094:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:93048:x1874218701051136:12345-0@lo:104: Request processed in 54us (2829us total) trans 0 rc 0/0 10000000:00010000:2.0:1787397694.660098:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660104:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660121:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660128:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660134:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660152:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d190c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660165:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787397694.660169:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660176:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660179:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660185:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397694.660192:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660204:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660218:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660225:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660238:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660245:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d190c8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660254:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787397694.660257:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660262:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660265:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660271:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397694.660277:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660282:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660294:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660299:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660311:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660318:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d190c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660327:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397694.660330:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660336:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660339:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660346:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397694.660351:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660356:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660372:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660378:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660383:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660389:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b200/0x274786fe0d190c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190c26 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660398:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397694.660407:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660412:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660415:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660422:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397694.660428:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660433:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660447:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660453:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660459:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660466:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62000/0x274786fe0d190bee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190bf5 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660475:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397694.660478:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660483:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397694.660486:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660504:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397694.660510:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397694.660515:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397694.660547:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660553:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397694.660559:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660564:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b400/0x274786fe0d190b15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d190b1c expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.660573:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397694.660575:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397694.660577:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397694.660592:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701051520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.660630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.660662:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701052032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.660682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.660702:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397694.660725:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701051648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397694.662235:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:0.0:1787397694.662275:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397694.662290:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701051904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397694.662347:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a600/0x274786fe0d190ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c9d expref: 22 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.662363:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050240:0@lo:104: 00010000:00010000:1.0:1787397694.662710:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397694.662713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397694.662715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397694.663643:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051520 00000100:00100000:3.0:1787397694.663655:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051520 00010000:00010000:3.0:1787397694.663691:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 22 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.663724:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052032 00000100:00100000:3.0:1787397694.663728:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052032 00010000:00010000:3.0:1787397694.663740:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.663770:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:3.0:1787397694.663778:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701051520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397694.663794:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397694.663809:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 23 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.664059:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1787397694.664071:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701052032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.664081:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397694.664097:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.664126:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 23 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.665631:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 23 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.665660:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397694.667490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.667629:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701052160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.667697:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.667879:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051648 00000100:00100000:2.0:1787397694.667886:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051648 00010000:00010000:2.0:1787397694.667914:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 24 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668089:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052160 00000100:00100000:2.0:1787397694.668093:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052160 00010000:00010000:3.0:1787397694.668097:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397694.668110:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 25 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668134:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1787397694.668155:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+25:3650:x1874218701051648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397694.668164:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+25:3650:x1874218701051520:12345-0@lo:103:ldlm_bl.0 Request processed in 4385us (7531us total) trans 0 rc 0/0 00010000:00010000:2.0:1787397694.668169:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787397694.668175:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00010000:00010000:2.0:1787397694.668177:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 25 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.668190:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 25 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.668203:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00010000:00010000:2.0:1787397694.668204:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397694.668213:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701052160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397694.668223:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397694.668229:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 24 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668239:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701051648:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (753us total) trans 0 rc 0/0 00010000:00010000:3.0:1787397694.668243:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 24 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668250:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00010000:00010000:3.0:1787397694.668262:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397694.668292:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701052160:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.668299:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050368:0@lo:104: 00000100:00100000:3.0:1787397694.668301:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00010000:00010000:2.0:1787397694.668318:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62c00/0x274786fe0d190c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c73 expref: 22 pid: 92419 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.668330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.668335:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050496:0@lo:104: 00010000:00010000:2.0:1787397694.668363:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23a00/0x274786fe0d190c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c65 expref: 21 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.668365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.668378:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050624:0@lo:104: 00000100:00100000:2.0:1787397694.668391:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050752:0@lo:104: 00000100:00100000:3.0:1787397694.668393:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701052288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397694.668406:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0c00/0x274786fe0d190c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c1f expref: 20 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668416:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701050880:0@lo:104: 00000100:00100000:3.0:1787397694.668422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397694.668433:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1000/0x274786fe0d190bf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190bee expref: 19 pid: 92422 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668442:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701051008:0@lo:104: 00000100:00100000:2.0:1787397694.668456:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701051136:0@lo:104: 00000100:00100000:3.0:1787397694.668460:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051776 00000100:00100000:3.0:1787397694.668466:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051776 00010000:00010000:3.0:1787397694.668480:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 19 pid: 92421 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668615:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052288 00000100:00100000:2.0:1787397694.668625:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052288 00010000:00010000:2.0:1787397694.668640:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 20 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397694.668656:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1787397694.668661:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701051776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397694.668669:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397694.668673:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 20 pid: 92421 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.668681:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 20 pid: 92421 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.668703:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23c00/0x274786fe0d190c96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c8f expref: 20 pid: 92421 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.668721:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397694.668900:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701051776:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.668907:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1787397694.668999:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1787397694.669008:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701052288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397694.669088:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397694.669093:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 18 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.669102:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 18 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.669112:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0000/0x274786fe0d190b1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190b15 expref: 18 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397694.669121:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397694.669155:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+17:3648:x1874218701052288:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.669161:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1787397694.669192:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701051648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.669202:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701052160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.669209:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701051520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397694.669359:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701052032:12345-0@lo:103:ldlm_bl.0 Request processed in 5290us (8673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.669367:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1787397694.669465:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701052032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.669635:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397694.669642:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397694.670641:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701051776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397694.670672:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701052288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397694.671847:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397694.671883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397694.671952:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701049856:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397694.671963:0:93048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93048:1874218701049984:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397694.672007:0:93048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.672135:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193344 00000100:00100000:1.0:1787397694.672157:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193344 00010000:00010000:1.0:1787397694.672194:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 10 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.672227:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193472 00000100:00100000:1.0:1787397694.672231:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193472 00010000:00010000:1.0:1787397694.672244:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 11 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397694.672274:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2606 00000100:00100000:1.0:1787397694.672283:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2405:x1874218681193344:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.672300:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397694.672307:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 11 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.672316:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2607 00010000:00010000:1.0:1787397694.672323:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 11 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.672330:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2405:x1874218681193472:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397694.672340:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397694.672347:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 11 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397694.672412:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63800/0x274786fe0d190cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80ed expref: 11 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.672588:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 10 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.672601:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75200/0x274786fe0d190ce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80df expref: 10 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.672615:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397694.672703:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2405:x1874218681193472:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 377us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397694.672711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2607 00000100:00100000:0.0:1787397694.673999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397694.674073:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701051904 00000100:00100000:3.0:1787397694.674081:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701051904 00010000:00010000:3.0:1787397694.674106:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 16 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397694.674231:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:3.0:1787397694.674241:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+16:3649:x1874218701051904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397694.674253:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397694.674259:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 16 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674270:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 16 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674287:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22800/0x274786fe0d190c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d190c3b expref: 16 pid: 92424 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674302:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674316:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674334:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674341:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674349:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674355:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674372:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397694.674378:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674389:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674407:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674421:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397694.674470:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+15:3649:x1874218701051904:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397694.674478:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00010000:00010000:3.0:1787397694.674605:0:93048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674614:0:93048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397694.674622:0:93048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62a00/0x274786fe0d191008 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397694.674862:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701051904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397694.675995:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397694.676071:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:2405:x1874218681193344:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 3783us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397694.676083:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2606 00000100:00100000:3.0:1787397694.948760:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397694.948787:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701052416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397694.949169:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397694.950028:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052416 00000100:00100000:2.0:1787397694.950040:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052416 00000100:00100000:2.0:1787397694.950110:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1787397694.950120:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701052416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397694.950160:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397694.950228:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701052416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397694.950235:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1787397694.950665:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701052416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787397695.335989:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397695.461113:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701052672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397695.461191:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397695.461238:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397695.461245:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701052544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397695.461266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397695.461564:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052672 00000100:00100000:2.0:1787397695.461572:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052672 00000100:00100000:2.0:1787397695.461610:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052544 00000100:00100000:2.0:1787397695.461612:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052544 00000100:00100000:2.0:1787397695.461627:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1787397695.461635:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701052672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397695.461658:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397695.461704:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701052672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397695.461711:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1787397695.461727:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1787397695.461733:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701052544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397695.461743:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397695.461819:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701052544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397695.461832:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1787397695.462108:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701052544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397695.462133:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701052672:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1787397695.468157:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968731 is committed 00000100:00100000:0.0:1787397695.692477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397695.692627:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193600 00000100:00100000:3.0:1787397695.692650:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193600 00000100:00100000:3.0:1787397695.692709:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:3.0:1787397695.692720:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681193600:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397695.692736:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397695.692756:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d813a expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397695.692786:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397695.692798:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397695.692944:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00000100:00100000:3.0:1787397695.693006:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681193600:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 287us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397695.693014:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 76 00000100:00100000:0.0:1787397695.700339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397695.700448:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193728 00000100:00100000:1.0:1787397695.700459:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193728 00000100:00100000:1.0:1787397695.700610:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:1.0:1787397695.700624:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681193728:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397695.700813:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681193728:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 193us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397695.700820:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:3.0:1787397695.709040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397695.712244:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193856 00000100:00100000:2.0:1787397695.712259:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193856 00000100:00100000:2.0:1787397695.712326:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:2.0:1787397695.712337:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681193856:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397695.712491:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681193856:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 155us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397695.712500:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 78 00000100:00100000:0.0:1787397695.718008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397695.724264:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681193984 00000100:00100000:2.0:1787397695.724279:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681193984 00000100:00100000:3.0:1787397695.727712:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397695.727727:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71843:x1874218681193984:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787397695.727901:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71843:x1874218681193984:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 176us (9902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397695.727910:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:2.0:1787397695.735697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397695.735875:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194112 00000100:00100000:1.0:1787397695.735886:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194112 00000100:00100000:1.0:1787397695.735947:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:1.0:1787397695.735957:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71843:x1874218681194112:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397695.736174:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71843:x1874218681194112:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 218us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397695.736183:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:3.0:1787397695.739604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397695.739761:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194240 00000100:00100000:0.0:1787397695.739772:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194240 00000100:00100000:0.0:1787397695.739835:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:0.0:1787397695.739846:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681194240:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397695.739863:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397695.739888:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8141 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397695.739921:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 10 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397695.739932:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 10 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397695.739942:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0200, rc 0) 00000100:00100000:0.0:1787397695.740010:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681194240:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 166us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397695.740042:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:3.0:1787397695.742041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397695.742462:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194368 00000100:00100000:1.0:1787397695.742473:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194368 00000100:00100000:1.0:1787397695.742567:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 82 00000100:00100000:1.0:1787397695.742577:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681194368:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397695.742767:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681194368:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 191us (734us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397695.742775:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 82 10000000:01000000:2.0:1787397696.038594:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397696.038602:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70ad28000 from 52 10000000:01000000:2.0:1787397696.038608:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397696.038657:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.038668:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.038679:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.038706:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701052800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.038791:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.038839:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.039177:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052800 00000100:00100000:3.0:1787397696.039187:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052800 00000100:00100000:3.0:1787397696.039285:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787397696.039295:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701052800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397696.039312:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397696.039328:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19101d expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.039357:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19101d expref: 16 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.039371:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19101d expref: 16 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.039381:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397696.039447:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701052800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.039455:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787397696.039688:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701052800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397696.039712:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.039722:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.039794:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701052928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.039834:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.039868:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.040382:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701052928 00000100:00100000:3.0:1787397696.040389:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701052928 00000100:00100000:3.0:1787397696.040444:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787397696.040453:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701052928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.040639:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701052928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.040647:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787397696.040947:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701052928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.041003:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.041061:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.041089:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.044253:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053056 00000100:00100000:3.0:1787397696.044271:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053056 00000100:00100000:3.0:1787397696.044361:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787397696.044371:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701053056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.044583:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701053056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.044599:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787397696.046591:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.049072:0:93050:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93050:1874218701053184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.049188:0:93050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.049237:0:93050:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.050273:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053184 00000100:00100000:0.0:1787397696.050283:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053184 00000100:00100000:0.0:1787397696.050338:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787397696.050348:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:93050:x1874218701053184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.050503:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:93050:x1874218701053184:12345-0@lo:502:llog_process_th.0 Request processed in 156us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.050510:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787397696.051439:0:93050:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93050:1874218701053184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.051513:0:93050:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93050:1874218701053312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.051589:0:93050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.051634:0:93050:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.051704:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053312 00000100:00100000:3.0:1787397696.051710:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053312 00000100:00100000:3.0:1787397696.051759:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787397696.051769:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:93050:x1874218701053312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.051885:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:93050:x1874218701053312:12345-0@lo:502:llog_process_th.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.051893:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787397696.052223:0:93050:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93050:1874218701053312:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397696.052244:0:93050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1787397696.052412:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1787397696.052432:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397696.052443:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.052454:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397696.052464:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787397696.052466:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:1.0:1787397696.052469:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397696.052497:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.052506:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.052515:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397696.052572:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.052610:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.052641:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.053953:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053440 00000100:00100000:0.0:1787397696.053964:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053440 00000100:00100000:0.0:1787397696.054030:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787397696.054041:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701053440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.054054:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397696.054071:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19102b expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.054098:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19102b expref: 17 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.054108:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19102b expref: 17 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.054129:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0400, rc 0) 00000100:00100000:0.0:1787397696.054199:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701053440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.054206:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787397696.054375:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397696.054404:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.054413:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.054482:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.054515:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.054580:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.056867:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053568 00000100:00100000:1.0:1787397696.056882:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053568 00000100:00100000:1.0:1787397696.056959:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787397696.056969:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701053568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.057171:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701053568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.057178:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787397696.057375:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.057445:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.057494:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397696.057557:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.057643:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053696 00000100:00100000:2.0:1787397696.057648:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053696 00000100:00100000:2.0:1787397696.057680:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787397696.057688:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701053696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.057782:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701053696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.057789:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787397696.057876:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701053696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.059282:0:93051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701053824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.059349:0:93051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.059393:0:93051:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.059514:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053824 00000100:00100000:2.0:1787397696.059549:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053824 00000100:00100000:2.0:1787397696.059596:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787397696.059606:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701053824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.059851:0:93051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701053824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397696.059879:0:93051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397696.059890:0:93051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397696.059892:0:93051:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1787397696.059897:0:93051:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1787397696.059955:0:93051:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:3.0:1787397696.060665:0:93051:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00000100:00100000:2.0:1787397696.061249:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701053824:12345-0@lo:502:llog_process_th.0 Request processed in 1639us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.061260:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00080000:10000000:3.0:1787397696.065556:0:93051:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:3.0:1787397696.068206:0:93051:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:3.0:1787397696.070009:0:93051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701053952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.070181:0:93051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.070278:0:93051:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.070328:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701053952 00000100:00100000:1.0:1787397696.070336:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701053952 00000100:00100000:1.0:1787397696.070423:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787397696.070433:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701053952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.070686:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701053952:12345-0@lo:502:llog_process_th.0 Request processed in 253us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.070694:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787397696.070929:0:93051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701053952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.070978:0:93051:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701054080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.071015:0:93051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397696.071054:0:93051:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.071131:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054080 00000100:00100000:2.0:1787397696.071136:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054080 00000100:00100000:2.0:1787397696.071174:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787397696.071182:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701054080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.071317:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:93051:x1874218701054080:12345-0@lo:502:llog_process_th.0 Request processed in 135us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.071324:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787397696.072172:0:93051:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93051:1874218701054080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397696.072212:0:93051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397696.072222:0:93051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397696.072224:0:93051:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:3.0:1787397696.072229:0:93051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1787397696.073248:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1787397696.073281:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787397696.073294:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.073306:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397696.073316:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397696.073319:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 52 10000000:01000000:0.0:1787397696.073322:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397696.073358:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.073367:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.073378:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397696.073414:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.073473:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397696.073573:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.073676:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054208 00000100:00100000:3.0:1787397696.073689:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054208 00000100:00100000:3.0:1787397696.073744:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787397696.073752:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701054208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397696.073764:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397696.073777:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191039 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.073802:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191039 expref: 18 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.073813:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191039 expref: 18 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.073822:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030600, rc 0) 00000100:00100000:3.0:1787397696.073869:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.073877:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787397696.073921:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.073936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.073945:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397696.073997:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.074032:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397696.074186:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.078960:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054336 00000100:00100000:1.0:1787397696.078976:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054336 00000100:00100000:0.0:1787397696.080416:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787397696.080430:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.080639:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (6613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.080646:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787397696.080750:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.080804:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.080875:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.082856:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.084495:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054464 00000100:00100000:1.0:1787397696.084509:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054464 00000100:00100000:1.0:1787397696.084684:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787397696.084696:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.085102:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 408us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.085129:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787397696.085164:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.086340:0:93052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93052:1874218701054592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.086410:0:93052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.086455:0:93052:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.086907:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054592 00000100:00100000:1.0:1787397696.086914:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054592 00000100:00100000:1.0:1787397696.086992:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787397696.087002:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:93052:x1874218701054592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.087147:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:93052:x1874218701054592:12345-0@lo:502:llog_process_th.0 Request processed in 146us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.087156:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787397696.091319:0:93052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93052:1874218701054592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.091421:0:93052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93052:1874218701054720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.091503:0:93052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.091561:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054720 00000100:00100000:2.0:1787397696.091567:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054720 00000100:00100000:2.0:1787397696.091610:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787397696.091619:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:93052:x1874218701054720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.093446:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:93052:x1874218701054720:12345-0@lo:502:llog_process_th.0 Request processed in 1820us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.093457:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787397696.093539:0:93052:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803df2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.093563:0:93052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93052:1874218701054720:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397696.093604:0:93052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1787397696.099071:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1787397696.099310:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397696.099323:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.099337:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397696.099349:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787397696.099353:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1787397696.099356:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787397696.099403:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.099411:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.099421:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397696.099466:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.099763:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.099814:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.099881:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054848 00000100:00100000:2.0:1787397696.099888:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054848 00000100:00100000:2.0:1787397696.099955:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787397696.099965:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701054848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397696.099978:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397696.099991:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191047 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.100014:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191047 expref: 19 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.100024:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191047 expref: 19 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.100033:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63600, rc 0) 00000100:00100000:2.0:1787397696.100082:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701054848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.100088:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787397696.100431:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397696.100446:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.100456:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397696.100547:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.100580:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.100606:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.101706:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701054976 00000100:00100000:2.0:1787397696.101717:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701054976 00000100:00100000:2.0:1787397696.101770:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787397696.101778:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701054976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.101930:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701054976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.102065:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701054976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.102097:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787397696.102128:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.102181:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.102212:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.102763:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055104 00000100:00100000:2.0:1787397696.102768:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055104 00000100:00100000:2.0:1787397696.102808:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787397696.102814:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701055104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.102919:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701055104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.102925:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787397696.103055:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.105281:0:93053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.105366:0:93053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.105410:0:93053:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.105468:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055232 00000100:00100000:0.0:1787397696.105475:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055232 00000100:00100000:0.0:1787397696.105540:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787397696.105549:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.108208:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055232:12345-0@lo:502:llog_process_th.0 Request processed in 2653us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.108237:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787397696.108365:0:93053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397696.108406:0:93053:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397696.108423:0:93053:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397696.108425:0:93053:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:1.0:1787397696.108431:0:93053:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1787397696.108490:0:93053:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1787397696.108557:0:93053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.108612:0:93053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.108647:0:93053:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80ab0c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.108921:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055360 00000100:00100000:2.0:1787397696.108928:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055360 00000100:00100000:2.0:1787397696.108982:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787397696.108993:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.109098:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055360:12345-0@lo:502:llog_process_th.0 Request processed in 105us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.109104:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787397696.109239:0:93053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.109276:0:93053:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.109310:0:93053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.109339:0:93053:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.109384:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055488 00000100:00100000:2.0:1787397696.109389:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055488 00000100:00100000:2.0:1787397696.109460:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787397696.109468:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.109564:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:93053:x1874218701055488:12345-0@lo:502:llog_process_th.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.109570:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787397696.109812:0:93053:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93053:1874218701055488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397696.109835:0:93053:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397696.109842:0:93053:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397696.109844:0:93053:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1787397696.109848:0:93053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:3.0:1787397696.110034:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:3.0:1787397696.110055:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787397696.110065:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.110076:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397696.110086:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397696.110088:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 52 10000000:01000000:3.0:1787397696.110091:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397696.110127:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.110146:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.110156:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.110171:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.110204:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.110947:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.111036:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055616 00000100:00100000:0.0:1787397696.111042:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055616 00000100:00100000:0.0:1787397696.111093:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787397696.111102:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701055616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.111125:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397696.111146:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191055 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.111174:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191055 expref: 20 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.111186:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191055 expref: 20 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.111195:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0800, rc 0) 00000100:00100000:0.0:1787397696.111237:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701055616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.111245:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787397696.111387:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397696.111402:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.111412:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.111471:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.111501:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.111544:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.111557:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055744 00000100:00100000:3.0:1787397696.111561:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055744 00000100:00100000:3.0:1787397696.111581:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787397696.111587:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701055744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.111713:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701055744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.111720:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787397696.111754:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.111778:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.111814:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.111823:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397696.111839:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701055872 00000100:00100000:3.0:1787397696.111842:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701055872 00000100:00100000:3.0:1787397696.111858:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787397696.111865:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701055872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.111934:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701055872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.111940:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787397696.111972:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701055872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.112938:0:93054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93054:1874218701056000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.112984:0:93054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.113059:0:93054:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.113168:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056000 00000100:00100000:0.0:1787397696.113173:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056000 00000100:00100000:0.0:1787397696.113212:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787397696.113219:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93054:x1874218701056000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.113325:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93054:x1874218701056000:12345-0@lo:502:llog_process_th.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.113332:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787397696.113440:0:93054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93054:1874218701056000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.113479:0:93054:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93054:1874218701056128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397696.113512:0:93054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.114006:0:93054:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.116257:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056128 00000100:00100000:0.0:1787397696.116290:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056128 00000100:00100000:1.0:1787397696.119332:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787397696.119361:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:93054:x1874218701056128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.121766:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:93054:x1874218701056128:12345-0@lo:502:llog_process_th.0 Request processed in 2411us (8244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.121781:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787397696.121953:0:93054:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93054:1874218701056128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397696.121996:0:93054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1787397696.122409:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1787397696.122435:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397696.122448:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.122458:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397696.122483:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787397696.122485:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787397696.122487:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397696.122517:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.122546:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.122556:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.122579:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.122640:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.122679:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.122733:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056256 00000100:00100000:0.0:1787397696.122740:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056256 00000100:00100000:0.0:1787397696.122787:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787397696.122796:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701056256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.122810:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397696.122825:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191063 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.122848:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191063 expref: 21 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.122859:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191063 expref: 21 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.122868:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1200, rc 0) 00000100:00100000:0.0:1787397696.122912:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.122919:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787397696.123208:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397696.123222:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.123230:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.123283:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.123310:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.123333:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.123380:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056384 00000100:00100000:0.0:1787397696.123385:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056384 00000100:00100000:0.0:1787397696.123418:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787397696.123425:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.123591:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.123599:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787397696.123945:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.123975:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.124026:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.124058:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.124137:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056512 00000100:00100000:0.0:1787397696.124141:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056512 00000100:00100000:0.0:1787397696.124171:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787397696.124184:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.124277:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.124284:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787397696.124452:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397696.125342:0:93055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1787397696.130667:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787397696.130703:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787397696.130716:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.130728:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397696.130793:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397696.130797:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 52 10000000:01000000:2.0:1787397696.130800:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397696.130845:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.130869:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.130880:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.130906:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.130982:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.131030:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.131055:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056640 00000100:00100000:0.0:1787397696.131063:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056640 00000100:00100000:0.0:1787397696.131133:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787397696.131143:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.131156:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397696.131170:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191071 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.131194:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191071 expref: 22 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.131206:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191071 expref: 22 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.131215:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397696.131263:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.131270:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787397696.131656:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397696.131672:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.131681:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.131741:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.131769:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.131797:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.132184:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056768 00000100:00100000:0.0:1787397696.132189:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056768 00000100:00100000:0.0:1787397696.132229:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787397696.132237:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.132369:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.132387:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787397696.132607:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.132645:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.132685:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.132713:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.132755:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701056896 00000100:00100000:1.0:1787397696.132759:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701056896 00000100:00100000:1.0:1787397696.132785:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787397696.132792:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.132883:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.132895:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787397696.136922:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.138372:0:93056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93056:1874218701057024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.138464:0:93056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.138503:0:93056:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.138666:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057024 00000100:00100000:0.0:1787397696.138674:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057024 00000100:00100000:0.0:1787397696.138725:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787397696.138735:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:93056:x1874218701057024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397696.138872:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:93056:x1874218701057024:12345-0@lo:502:llog_process_th.0 Request processed in 138us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.138879:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787397696.138935:0:93056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93056:1874218701057024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.138979:0:93056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93056:1874218701057152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397696.139015:0:93056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397696.139055:0:93056:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397696.139080:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057152 00000100:00100000:2.0:1787397696.139084:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057152 00000100:00100000:2.0:1787397696.139211:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787397696.139219:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:93056:x1874218701057152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397696.139301:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:93056:x1874218701057152:12345-0@lo:502:llog_process_th.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.139308:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787397696.139399:0:93056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93056:1874218701057152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787397696.139421:0:93056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1787397696.139884:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1787397696.139910:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397696.139921:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.139933:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397696.139942:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787397696.139945:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787397696.139947:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397696.139976:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.139984:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.140003:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.140018:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.140052:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.140078:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.140263:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057280 00000100:00100000:0.0:1787397696.140268:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057280 00000100:00100000:0.0:1787397696.140296:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787397696.140304:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701057280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397696.140312:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397696.140325:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19107f expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.140354:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19107f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.140365:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19107f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397696.140374:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1000, rc 0) 00000100:00100000:0.0:1787397696.140416:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397696.140423:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787397696.140485:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397696.140499:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.140508:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.140585:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.140614:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.140645:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.140685:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057408 00000100:00100000:1.0:1787397696.140690:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057408 00000100:00100000:1.0:1787397696.140717:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787397696.140723:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.140841:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.140848:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787397696.140909:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.140934:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.140972:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.140997:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.141034:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057536 00000100:00100000:1.0:1787397696.141038:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057536 00000100:00100000:1.0:1787397696.141067:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787397696.141073:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397696.141168:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.141174:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787397696.141291:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397696.142169:0:93057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1787397696.142363:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787397696.142387:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787397696.142398:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.142409:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397696.142431:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787397696.142433:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397696.142436:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787397696.142468:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.142476:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397696.142485:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397696.142504:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397696.142642:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397696.142675:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397696.142807:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057664 00000100:00100000:1.0:1787397696.142813:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057664 00000100:00100000:1.0:1787397696.142858:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787397696.142866:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8302fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701057664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397696.142877:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397696.142891:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19108d expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.142913:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19108d expref: 24 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.142923:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19108d expref: 24 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397696.142931:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75e00, rc 0) 00000100:00100000:1.0:1787397696.142978:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8302fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701057664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.142984:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787397696.143081:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397696.143095:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.143125:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.143174:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397696.143202:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397696.143230:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397696.143310:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057792 00000100:00100000:0.0:1787397696.143325:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057792 00000100:00100000:0.0:1787397696.143359:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787397696.143366:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701057792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397696.143440:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701057792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (235us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397696.143447:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787397696.143561:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701057792:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787397696.143583:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787397696.143589:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397696.143596:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397696.260328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397696.260438:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194496 00000100:00100000:1.0:1787397696.260449:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194496 00000100:00100000:1.0:1787397696.260508:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:1.0:1787397696.260549:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681194496:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397696.260624:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681194496:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.260632:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:3.0:1787397696.273882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397696.273932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397696.274269:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194624 00000100:00100000:0.0:1787397696.274282:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194624 00000100:00100000:2.0:1787397696.274288:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194880 00000100:00100000:2.0:1787397696.274295:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194880 00000100:00100000:1.0:1787397696.274415:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1314 00000100:00100000:1.0:1787397696.274431:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681194624:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397696.274571:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681194624:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 145us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397696.274581:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1314 00000100:00100000:2.0:1787397696.277201:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2572 00000100:00100000:2.0:1787397696.277219:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681194880:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397696.277438:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681194880:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 222us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397696.277447:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2572 00000100:00080000:3.0:1787397696.278379:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397696.278387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397696.278492:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397696.279243:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681194752 00000100:00100000:3.0:1787397696.279255:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681194752 00000100:00100000:3.0:1787397696.279316:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1315 00000100:00100000:3.0:1787397696.279327:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681194752:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397696.279391:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681194752:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 66us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397696.279399:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1315 00000100:00080000:3.0:1787397696.279423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397696.358290:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397697.383803:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397698.408100:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787397698.545007:0:93154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcb669fd10 00000020:00000080:2.0:1787397698.545021:0:93154:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787397698.545027:0:93154:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 4 00000020:00000080:2.0:1787397698.545090:0:93154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcb669fd70 20000000:00000080:2.0:1787397698.545104:0:93154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff89a8048f1c00 uarg=0000000000000000 00000040:00100000:2.0:1787397698.545705:0:93154:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:2.0:1787397698.545712:0:93154:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:2.0:1787397698.545799:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:2.0:1787397698.545820:0:93154:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1787397698.545838:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:2.0:1787397698.545856:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:2.0:1787397698.545921:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:2.0:1787397698.545933:0:93154:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1787397698.545947:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:2.0:1787397698.545961:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:2.0:1787397698.546019:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:2.0:1787397698.546027:0:93154:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1787397698.546040:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:2.0:1787397698.546975:0:93154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:2.0:1787397698.547004:0:93154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787397698.547027:0:93154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.547048:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.547056:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 9 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548803:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19101d expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548820:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19102b expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548827:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548853:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191047 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548860:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191055 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548867:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191063 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548874:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191071 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548880:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19107f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548886:0:93154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19108d expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.548895:0:93154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.549133:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.549149:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 23 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.549163:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701057920:0@lo:104: 00000100:00100000:2.0:1787397698.549331:0:93154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397698.549451:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 23 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.549460:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 23 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.549469:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058048:0@lo:104: 00000100:00100000:2.0:1787397698.549491:0:93154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397698.549607:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.549619:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 23 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.549627:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058176:0@lo:104: 00000100:00100000:2.0:1787397698.549652:0:93154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397698.549728:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701057920 00000100:00100000:3.0:1787397698.549738:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701057920 00000100:00100000:3.0:1787397698.549794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058048 00000100:00100000:3.0:1787397698.549797:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058048 00000100:00100000:3.0:1787397698.549812:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787397698.549821:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701057920:12345-0@lo:104: 00010000:00010000:3.0:1787397698.549834:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.549885:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787397698.549891:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701057920:12345-0@lo:104: Request processed in 72us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397698.549898:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787397698.549916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787397698.549921:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701058048:12345-0@lo:104: 00010000:00010000:3.0:1787397698.549928:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.549971:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787397698.549987:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701058048:12345-0@lo:104: Request processed in 66us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397698.549994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00010000:3.0:1787397698.550012:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397698.550018:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550025:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397698.550029:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550038:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397698.550045:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397698.550051:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397698.550054:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397698.550059:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.550077:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397698.550080:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.550087:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550090:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397698.550094:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550096:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1787397698.550099:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397698.550113:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550114:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.550119:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397698.550121:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d19108d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191094 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.550124:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.550130:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800030e00/0x274786fe0d19107f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191086 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.550145:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397698.550147:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397698.550148:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397698.550149:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397698.550150:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397698.550152:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397698.550162:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701058432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397698.550166:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701058304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397698.550191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397698.550192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397698.550284:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550293:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 23 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550302:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058560:0@lo:104: 00010000:00010000:2.0:1787397698.550328:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 23 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550336:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 23 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550344:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058688:0@lo:104: 00010000:00010000:2.0:1787397698.550378:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550385:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550392:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058816:0@lo:104: 00010000:00010000:2.0:1787397698.550414:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550421:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550427:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058944:0@lo:104: 00010000:00010000:2.0:1787397698.550447:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 23 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550454:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 23 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550462:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059072:0@lo:104: 00010000:00010000:2.0:1787397698.550486:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550494:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550502:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059200:0@lo:104: 00010000:00010000:2.0:1787397698.550553:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 9 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.550568:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 9 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.550579:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059328:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397698.550862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058176 00000100:00100000:0.0:1787397698.550868:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058176 00000100:00100000:1.0:1787397698.552259:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058432 00000100:00100000:1.0:1787397698.552272:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058432 00010000:00010000:1.0:1787397698.552315:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 24 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397698.552351:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058304 00000100:00100000:1.0:1787397698.552355:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058304 00010000:00010000:1.0:1787397698.552367:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 25 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397698.552388:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00010000:00010000:2.0:1787397698.552450:0:93154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.552462:0:93154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 9 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.552475:0:93154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059456:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397698.552560:0:93154:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a801377f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397698.552591:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701057920:0@lo:104: 00000100:00100000:2.0:1787397698.552601:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058048:0@lo:104: 00000100:00100000:1.0:1787397698.552629:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1787397698.552638:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+25:3648:x1874218701058304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397698.552651:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397698.552656:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 25 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.552667:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 25 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.552695:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75e00/0x274786fe0d191094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19108d expref: 25 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397698.552696:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+25:3649:x1874218701058432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397698.552705:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397698.552709:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 24 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.552710:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397698.552717:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 24 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.552726:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1000/0x274786fe0d191086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19107f expref: 24 pid: 92421 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.552734:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397698.552771:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701058304:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397698.552775:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701058432:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397698.552779:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1787397698.552781:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1787397698.552847:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701058432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397698.552876:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701058304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.553057:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787397698.553628:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.553728:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397698.553774:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058560 00000100:00100000:2.0:1787397698.553780:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058560 00000100:00100000:2.0:1787397698.553829:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787397698.553836:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836731c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701058176:12345-0@lo:104: 00010000:00010000:2.0:1787397698.553849:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.553901:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787397698.553907:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836731c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701058176:12345-0@lo:104: Request processed in 72us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397698.553923:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787397698.553955:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787397698.553962:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701058560:12345-0@lo:104: 00010000:00010000:2.0:1787397698.553970:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397698.554086:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787397698.554092:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701058560:12345-0@lo:104: Request processed in 131us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397698.554099:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787397698.554135:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058176:0@lo:104: 00000100:00100000:2.0:1787397698.554144:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058560:0@lo:104: 00000100:00100000:0.0:1787397698.554216:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.554485:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.554494:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.554504:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.554512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058688 00000100:00100000:0.0:1787397698.554516:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058688 00000100:00100000:0.0:1787397698.554561:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058816 00000100:00100000:0.0:1787397698.554564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058816 00000100:00100000:0.0:1787397698.554574:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701058944 00000100:00100000:0.0:1787397698.554576:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701058944 00000100:00100000:0.0:1787397698.554584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059072 00000100:00100000:0.0:1787397698.554586:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059072 00000100:00100000:0.0:1787397698.554594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059200 00000100:00100000:0.0:1787397698.554596:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059200 00000100:00100000:0.0:1787397698.554607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787397698.554614:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+7:93154:x1874218701058688:12345-0@lo:104: 00010000:00010000:0.0:1787397698.554622:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.554670:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787397698.554676:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+7:93154:x1874218701058688:12345-0@lo:104: Request processed in 63us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.554682:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787397698.554694:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787397698.554700:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93154:x1874218701058816:12345-0@lo:104: 00010000:00010000:0.0:1787397698.554707:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.554741:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787397698.554746:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+6:93154:x1874218701058816:12345-0@lo:104: Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.554752:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787397698.554766:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787397698.554771:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:93154:x1874218701058944:12345-0@lo:104: 00010000:00010000:0.0:1787397698.554778:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.554807:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787397698.554812:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:93154:x1874218701058944:12345-0@lo:104: Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.554817:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1787397698.554829:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787397698.554835:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701059072:12345-0@lo:104: 00010000:00010000:0.0:1787397698.554842:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.554875:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787397698.554880:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:93154:x1874218701059072:12345-0@lo:104: Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.554886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787397698.554899:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1787397698.554905:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701059200:12345-0@lo:104: 00010000:00010000:0.0:1787397698.554912:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.554937:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787397698.554942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:93154:x1874218701059200:12345-0@lo:104: Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.554947:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:0.0:1787397698.554963:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787397698.554968:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555046:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555051:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555060:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555079:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555085:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555127:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555135:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555154:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555160:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191078 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555174:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787397698.555177:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555182:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555185:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555192:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555198:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555203:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555214:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555431:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555440:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555456:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d191063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19106a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555466:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787397698.555469:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555475:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555478:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555485:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555491:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555496:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555510:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555515:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555551:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555559:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800031c00/0x274786fe0d191055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19105c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555568:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787397698.555577:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555582:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555585:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555592:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555597:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555602:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555616:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555624:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555630:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555635:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19104e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555644:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397698.555646:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555652:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555654:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555670:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555677:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555682:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555695:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555701:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555706:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555711:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f1600/0x274786fe0d191039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191040 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555719:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397698.555722:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555728:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555731:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555738:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555743:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555755:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555769:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555774:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555778:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555784:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d19102b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191032 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555792:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397698.555794:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555799:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397698.555802:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555809:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397698.555815:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397698.555820:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397698.555830:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555835:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397698.555846:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.555852:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d19101d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191024 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.555865:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397698.555865:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397698.555867:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397698.555868:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397698.555872:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397698.555883:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701059712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.555883:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701059584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397698.555923:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397698.555924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397698.555946:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.555958:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701060096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397698.555960:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701060224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.555983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.556013:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059584 00000100:00100000:0.0:1787397698.556019:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059584 00010000:00010000:0.0:1787397698.556040:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 22 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.556073:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059712 00000100:00100000:0.0:1787397698.556076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059712 00010000:00010000:0.0:1787397698.556088:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 23 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397698.556099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.556106:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060096 00000100:00100000:0.0:1787397698.556109:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060096 00010000:00010000:0.0:1787397698.556118:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 24 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397698.556127:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060224 00000100:00100000:1.0:1787397698.556131:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060224 00000100:00100000:0.0:1787397698.556136:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1787397698.556142:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+25:3650:x1874218701059584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397698.556144:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 25 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397698.556160:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00010000:00010000:0.0:1787397698.556161:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787397698.556165:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+25:3651:x1874218701059712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.556167:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 25 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.556171:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397698.556174:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 25 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.556177:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 25 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.556264:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 25 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.556492:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058688:0@lo:104: 00000100:00100000:2.0:1787397698.556502:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058816:0@lo:104: 00000100:00100000:2.0:1787397698.556509:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701058944:0@lo:104: 00000100:00100000:2.0:1787397698.556517:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059072:0@lo:104: 00000100:00100000:2.0:1787397698.556541:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059200:0@lo:104: 00000100:00100000:2.0:1787397698.557331:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397698.557368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:0.0:1787397698.557438:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0000/0x274786fe0d191078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191071 expref: 25 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557456:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.557503:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701059584:12345-0@lo:103:ldlm_bl.0 Request processed in 1359us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.557511:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1787397698.557548:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195008 00000100:00100000:0.0:1787397698.557553:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195008 00010000:00010000:0.0:1787397698.557573:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 10 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.557586:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195136 00000100:00100000:0.0:1787397698.557588:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195136 00010000:00010000:0.0:1787397698.557597:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 11 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.557609:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1787397698.557616:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701060096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.557628:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.557632:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557661:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557672:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030600/0x274786fe0d191040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191039 expref: 23 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397698.557779:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701059584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.557825:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.557857:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701060096:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.557864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1787397698.557877:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1787397698.557884:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701060224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.557891:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.557895:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 21 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557904:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 21 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557913:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0400/0x274786fe0d191032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19102b expref: 21 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.557920:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.557948:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218701060224:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.557954:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1787397698.557969:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2615 00000100:00100000:0.0:1787397698.557975:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2405:x1874218681195008:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.557989:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.557994:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 11 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558002:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 11 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558012:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.558044:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2405:x1874218681195008:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 68us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.558050:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2615 00000100:00100000:0.0:1787397698.558072:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2616 00000100:00100000:0.0:1787397698.558080:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a838247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681195136:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.558087:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.558091:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 10 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558100:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 10 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558109:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.558126:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a838247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681195136:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 48us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.558133:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2616 00000100:00100000:0.0:1787397698.558173:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701059840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.558204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.558455:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701060352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.558486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.558504:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397698.558511:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701059968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.558552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397698.558574:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059840 00000100:00100000:0.0:1787397698.558578:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059840 00010000:00010000:0.0:1787397698.558594:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 20 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.558608:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060352 00000100:00100000:0.0:1787397698.558610:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060352 00010000:00010000:0.0:1787397698.558620:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 21 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.558630:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701059968 00000100:00100000:0.0:1787397698.558632:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701059968 00010000:00010000:0.0:1787397698.558640:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 22 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397698.558650:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1787397698.558657:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701059840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.558666:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.558669:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 22 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558690:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 22 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558701:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0800/0x274786fe0d19105c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191055 expref: 22 pid: 92424 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558722:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.558750:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701059840:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.558757:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1787397698.558770:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1787397698.558776:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701060352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.558782:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.558786:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 20 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558793:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 20 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558801:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030200/0x274786fe0d191024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19101d expref: 20 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558809:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.558828:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701060352:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.558834:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1787397698.558844:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1787397698.558849:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701059968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397698.558855:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397698.558858:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 18 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558865:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 18 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558882:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63600/0x274786fe0d19104e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191047 expref: 18 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397698.558891:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.558911:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+17:3648:x1874218701059968:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.558916:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00010000:00010000:0.0:1787397698.558941:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397698.558958:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701059968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.558967:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701059840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.558974:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701060352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397698.559051:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701060224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397698.559377:0:93154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0200/0x274786fe0d191016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8141 expref: 9 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397698.559388:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059328:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397698.559399:0:93154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030000/0x274786fe0d19100f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d813a expref: 8 pid: 92422 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397698.559421:0:93154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93154:1874218701059456:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397698.559460:0:93154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397698.559497:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701060096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397698.567134:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1200/0x274786fe0d19106a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191063 expref: 16 pid: 92419 timeout: 3677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567163:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567196:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567218:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567227:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567233:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567239:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567245:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397698.567250:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567257:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.567441:0:93154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397698.567450:0:93154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567828:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567838:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62200/0x274786fe0d19109b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397698.567855:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397698.568118:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+15:3651:x1874218701059712:12345-0@lo:103:ldlm_bl.0 Request processed in 11948us (12167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397698.568128:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1787397698.569307:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701059712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397699.429457:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397699.556858:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701060864:0@lo:400:kworker.0 00000100:00100000:1.0:1787397699.556929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.556963:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060864 00000100:00100000:1.0:1787397699.556969:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397699.556973:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060864 00000100:00100000:1.0:1787397699.556977:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701060480:0@lo:400:kworker.0 00000100:00100000:1.0:1787397699.557003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397699.557029:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701060992:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.557041:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1787397699.557060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.557067:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701060864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397699.557087:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060992 00000100:00100000:1.0:1787397699.557091:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060992 00000100:00100000:1.0:1787397699.557121:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1787397699.557128:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.557150:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701060864:12345-0@lo:400:kworker.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.557160:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1787397699.557165:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701060992:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397699.557173:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:3.0:1787397699.557188:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397699.557193:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397699.557199:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701060736:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.557209:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701060608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397699.557295:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060480 00000100:00100000:0.0:1787397699.557299:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060480 00000100:00100000:2.0:1787397699.557387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701061504:0@lo:400:kworker.0 00000100:00100000:0.0:1787397699.557434:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787397699.557440:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:3648:x1874218701060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560322:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.560378:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701061120:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.560449:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701061632:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560493:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.560560:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397699.560569:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701061248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.560619:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701061760:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.560753:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060608 00000100:00100000:3.0:1787397699.560760:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060608 00000100:00100000:3.0:1787397699.560819:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1787397699.560827:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.560966:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701060608:12345-0@lo:400:kworker.0 Request processed in 138us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.560974:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1787397699.561001:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061248 00000100:00100000:3.0:1787397699.561005:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061248 00000100:00100000:3.0:1787397699.561030:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061760 00000100:00100000:3.0:1787397699.561032:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061760 00000100:00100000:3.0:1787397699.561065:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1787397699.561072:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701061248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561104:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701061248:12345-0@lo:400:kworker.0 Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.561109:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1787397699.561259:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1787397699.561268:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701061760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561300:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701061760:12345-0@lo:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.561306:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00080000:3.0:1787397699.561344:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397699.561348:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397699.561363:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701061376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.561411:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701061888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.561465:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701060992:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561479:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701060864:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561510:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061376 00000100:00100000:3.0:1787397699.561514:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061376 00000100:00100000:3.0:1787397699.561574:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061888 00000100:00100000:3.0:1787397699.561578:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061888 00000100:00100000:3.0:1787397699.561603:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1787397699.561610:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.561648:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701061376:12345-0@lo:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.561654:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1787397699.562006:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1787397699.562014:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701061888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562060:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701061888:12345-0@lo:400:kworker.0 Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.562067:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00080000:3.0:1787397699.562093:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397699.562113:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701061376:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562196:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701061888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562237:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 2 00000004:00080000:3.0:1787397699.562243:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70698ca80, transno 4294968731 00000100:00100000:3.0:1787397699.562257:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701061248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562268:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701061760:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562280:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701060608:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562370:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701062144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397699.562398:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.562420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397699.562426:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701062272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397699.562447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.562471:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061120 00000100:00100000:3.0:1787397699.562476:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061120 00000100:00100000:3.0:1787397699.562498:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061632 00000100:00100000:3.0:1787397699.562502:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061632 00000100:00100000:1.0:1787397699.562740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.562757:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062272 00000100:00100000:3.0:1787397699.562763:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062272 00000100:00100000:3.0:1787397699.562781:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1787397699.562789:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701061120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.562801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397699.562830:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701062016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562847:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701061120:12345-0@lo:400:kworker.0 Request processed in 57us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.562877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397699.562929:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1787397699.562944:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1787397699.562951:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701061632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.562988:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701061632:12345-0@lo:400:kworker.0 Request processed in 37us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.563006:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1787397699.563023:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1787397699.563031:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701062272:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397699.563065:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062144 00000004:00000024:3.0:1787397699.563069:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1787397699.563070:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062144 00000100:00100000:3.0:1787397699.563107:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701062272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.563119:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1787397699.563128:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701062144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397699.563149:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397699.563181:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701062144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.563187:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1787397699.563217:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701060736 00000100:00100000:2.0:1787397699.563221:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701060736 00000100:00100000:2.0:1787397699.563253:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701061504 00000100:00100000:2.0:1787397699.563257:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701061504 00000100:00100000:2.0:1787397699.563274:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062016 00000100:00100000:2.0:1787397699.563276:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062016 00000100:00100000:2.0:1787397699.563289:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:2.0:1787397699.563294:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701060736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.563309:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:2.0:1787397699.563333:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701060736:12345-0@lo:400:kworker.0 Request processed in 37us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397699.563340:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1787397699.563349:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701061504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397699.563387:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701061504:12345-0@lo:400:kworker.0 Request processed in 40us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.563426:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:2.0:1787397699.563444:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1787397699.563452:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701062016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397699.563474:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:3648:x1874218701060480:12345-0@lo:400:kworker.0 Request processed in 6030us (6465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397699.563485:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787397699.563491:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701062016:12345-0@lo:400:kworker.0 Request processed in 40us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.563498:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00080000:2.0:1787397699.563538:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397699.563562:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701062400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397699.563607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397699.563641:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701060480:0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.563679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701061504:0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.563688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701062016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.563732:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701062272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397699.563748:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701062144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397699.563758:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701061632:0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.563767:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701061120:0@lo:400:kworker.0 00000100:00100000:2.0:1787397699.563797:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062400 00000100:00100000:2.0:1787397699.563800:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062400 00000100:00100000:2.0:1787397699.563825:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:2.0:1787397699.563831:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701062400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397699.563846:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445527552 avail 1299288064 00000100:00100000:2.0:1787397699.563879:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701062400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397699.563885:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:2.0:1787397699.563923:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701062400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397699.564617:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1787397699.565949:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701060736:0@lo:400:kworker.0 00000020:00080000:0.0:1787397699.570555:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411387 batchid updated 00000020:00080000:3.0:1787397699.570653:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:3.0:1787397699.570718:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a703fcdd80 with version 12 00000020:00080000:3.0:1787397699.570738:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x2000088d1:0x2:0x0].3: rc = 0 00000004:00080000:2.0:1787397699.570851:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 12 rpc_version 12 00000020:00100000:2.0:1787397699.570887:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787397699.570898:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af24380 x1874218701062656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397699.570920:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701062656:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397699.570988:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397699.571022:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f16c0 going to sleep for 11 seconds 00000020:00080000:3.0:1787397699.571124:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a0:0x2:0x0].3: rc = 0 00000020:00080000:3.0:1787397699.571132:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:0.0:1787397699.571178:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062656 00000100:00100000:0.0:1787397699.571186:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062656 00000100:00100000:0.0:1787397699.571400:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:0.0:1787397699.571409:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701062656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397699.571574:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701062656:12345-0@lo:1000:osp_up0-1.0 Request processed in 165us (584us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1787397699.571583:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1787397699.571795:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701062656:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397700.069311:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397700.069386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.069552:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062784 00000100:00100000:3.0:1787397700.069561:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062784 00000100:00100000:3.0:1787397700.069663:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1787397700.069673:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701062784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397700.069702:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397700.069757:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701062784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.069779:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1787397700.069854:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701062784:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1787397700.388655:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397700.388662:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70ad28000 from 55 10000000:01000000:0.0:1787397700.388668:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397700.388716:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.388728:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.388739:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397700.388763:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701062912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.388824:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397700.388870:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.388944:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701062912 00000100:00100000:1.0:1787397700.388952:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701062912 00000100:00100000:1.0:1787397700.389002:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787397700.389010:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701062912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397700.389023:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397700.389044:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75e00/0x274786fe0d1910a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910a2 expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.389066:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75e00/0x274786fe0d1910a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910a2 expref: 16 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.389090:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75e00/0x274786fe0d1910a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910a2 expref: 16 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.389099:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75e00, rc 0) 00000100:00100000:1.0:1787397700.389141:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701062912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.389149:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787397700.389323:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701062912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397700.389337:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.389346:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397700.389404:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.389427:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397700.389446:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.389495:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063040 00000100:00100000:2.0:1787397700.389499:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063040 00000100:00100000:2.0:1787397700.389549:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787397700.389556:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701063040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.389685:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701063040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.389692:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787397700.389799:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.389826:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.389861:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.389888:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.389932:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063168 00000100:00100000:1.0:1787397700.389936:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063168 00000100:00100000:1.0:1787397700.389962:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787397700.389969:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701063168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.390052:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701063168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.390059:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787397700.390128:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.390443:0:93155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93155:1874218701063296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397700.390474:0:93155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.390492:0:93155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.393744:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063296 00000100:00100000:2.0:1787397700.393758:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063296 00000100:00100000:2.0:1787397700.393826:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787397700.393837:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:93155:x1874218701063296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.394038:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:93155:x1874218701063296:12345-0@lo:502:llog_process_th.0 Request processed in 190us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.394048:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787397700.395292:0:93155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93155:1874218701063296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397700.395367:0:93155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93155:1874218701063424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397700.395421:0:93155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.395464:0:93155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.395563:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063424 00000100:00100000:1.0:1787397700.395569:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063424 00000100:00100000:1.0:1787397700.395620:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787397700.395629:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:93155:x1874218701063424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397700.395749:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:93155:x1874218701063424:12345-0@lo:502:llog_process_th.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.395758:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787397700.395907:0:93155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93155:1874218701063424:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787397700.395926:0:93155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1787397700.396189:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1787397700.396211:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397700.396222:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.396246:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397700.396257:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787397700.396260:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:1.0:1787397700.396263:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397700.396295:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.396303:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.396313:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397700.396329:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.396361:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.396390:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.396437:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063552 00000100:00100000:0.0:1787397700.396441:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063552 00000100:00100000:0.0:1787397700.396475:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787397700.396483:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701063552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397700.396493:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397700.396507:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0400/0x274786fe0d1910b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910b0 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.396570:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0400/0x274786fe0d1910b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910b0 expref: 17 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.396582:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0400/0x274786fe0d1910b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910b0 expref: 17 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.396592:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0400, rc 0) 00000100:00100000:0.0:1787397700.396633:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701063552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.396650:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787397700.396773:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.396786:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.396795:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397700.396847:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.396873:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.396905:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.397001:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063680 00000100:00100000:0.0:1787397700.397005:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063680 00000100:00100000:0.0:1787397700.397044:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787397700.397057:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701063680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.397199:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701063680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.397206:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787397700.397309:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.397336:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.397373:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.397394:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.397446:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063808 00000100:00100000:1.0:1787397700.397450:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063808 00000100:00100000:1.0:1787397700.397480:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787397700.397486:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701063808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.397589:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701063808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.397595:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787397700.397684:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701063808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.398258:0:93156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93156:1874218701063936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397700.398298:0:93156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.398331:0:93156:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.398380:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701063936 00000100:00100000:2.0:1787397700.398385:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701063936 00000100:00100000:2.0:1787397700.398417:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787397700.398424:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:93156:x1874218701063936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.398550:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:93156:x1874218701063936:12345-0@lo:502:llog_process_th.0 Request processed in 124us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.398566:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787397700.398747:0:93156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93156:1874218701063936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397700.398769:0:93156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397700.398781:0:93156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397700.398783:0:93156:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1787397700.398788:0:93156:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1787397700.398805:0:93156:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1787397700.399410:0:93156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93156:1874218701064064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397700.399457:0:93156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787397700.399579:0:93157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70ad28000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787397700.399584:0:93157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad28000 4 00000100:00100000:1.0:1787397700.399811:0:93156:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.409233:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064064 00000100:00100000:0.0:1787397700.409248:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064064 00000100:00100000:0.0:1787397700.409309:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787397700.409319:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:93156:x1874218701064064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397700.409504:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:93156:x1874218701064064:12345-0@lo:502:llog_process_th.0 Request processed in 185us (10045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.409511:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787397700.409937:0:93156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93156:1874218701064064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397700.409973:0:93156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397700.409980:0:93156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397700.409983:0:93156:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397700.409987:0:93156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1787397700.410163:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:2.0:1787397700.410183:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787397700.410194:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.410204:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397700.410213:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397700.410216:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 55 10000000:01000000:2.0:1787397700.410218:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397700.410249:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.410257:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.410266:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.410286:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.410328:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.410364:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.410416:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064192 00000100:00100000:1.0:1787397700.410420:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064192 00000100:00100000:1.0:1787397700.410459:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787397700.410467:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701064192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397700.410476:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397700.410487:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75c00/0x274786fe0d1910c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910be expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.410508:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75c00/0x274786fe0d1910c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910be expref: 18 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.410559:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75c00/0x274786fe0d1910c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910be expref: 18 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.410569:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:1.0:1787397700.410606:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.410612:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787397700.410743:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.410756:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.410764:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397700.410819:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.410845:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.410869:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.410960:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064320 00000100:00100000:1.0:1787397700.410964:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064320 00000100:00100000:1.0:1787397700.410994:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787397700.411001:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.411265:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.411284:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787397700.420241:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.420333:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.420405:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.420461:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.420549:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064448 00000100:00100000:2.0:1787397700.420557:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064448 00000100:00100000:2.0:1787397700.420610:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787397700.420619:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.420736:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.420752:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787397700.422819:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.423454:0:93158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93158:1874218701064576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397700.423545:0:93158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.423572:0:93158:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.423624:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064576 00000100:00100000:2.0:1787397700.423631:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064576 00000100:00100000:2.0:1787397700.423691:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787397700.423701:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:93158:x1874218701064576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.423834:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:93158:x1874218701064576:12345-0@lo:502:llog_process_th.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.423843:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787397700.423894:0:93158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93158:1874218701064576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.423934:0:93158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93158:1874218701064704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.423967:0:93158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.423986:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064704 00000100:00100000:2.0:1787397700.423990:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064704 00000100:00100000:2.0:1787397700.424012:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787397700.424018:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:93158:x1874218701064704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.424082:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:93158:x1874218701064704:12345-0@lo:502:llog_process_th.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.424090:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787397700.424118:0:93158:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a828d83cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.424129:0:93158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93158:1874218701064704:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397700.424147:0:93158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1787397700.424205:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1787397700.424224:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397700.424234:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424250:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397700.424260:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397700.424263:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:2.0:1787397700.424266:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397700.424288:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424296:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424304:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.424316:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.424340:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.424352:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.424366:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064832 00000100:00100000:2.0:1787397700.424369:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064832 00000100:00100000:2.0:1787397700.424389:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787397700.424394:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701064832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397700.424403:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397700.424414:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62000/0x274786fe0d1910d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910cc expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424434:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62000/0x274786fe0d1910d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910cc expref: 19 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424456:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62000/0x274786fe0d1910d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910cc expref: 19 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424465:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:2.0:1787397700.424499:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701064832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.424505:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787397700.424559:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397700.424571:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.424581:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.424625:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.424648:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.424669:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.424680:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701064960 00000100:00100000:2.0:1787397700.424683:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701064960 00000100:00100000:2.0:1787397700.424705:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787397700.424710:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701064960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.424802:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701064960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.424809:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787397700.424838:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701064960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.424873:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.424904:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.424922:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.424937:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065088 00000100:00100000:2.0:1787397700.424941:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065088 00000100:00100000:2.0:1787397700.424968:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787397700.424974:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701065088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.425058:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701065088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.425065:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787397700.425357:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.433054:0:93159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93159:1874218701065216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397700.433160:0:93159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.433206:0:93159:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.433255:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065216 00000100:00100000:2.0:1787397700.433263:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065216 00000100:00100000:2.0:1787397700.433316:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787397700.433326:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:93159:x1874218701065216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.433456:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:93159:x1874218701065216:12345-0@lo:502:llog_process_th.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.433464:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787397700.433789:0:93159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93159:1874218701065216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397700.433817:0:93159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397700.433829:0:93159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397700.433832:0:93159:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1787397700.433838:0:93159:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1787397700.433854:0:93159:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1787397700.433875:0:93159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93159:1874218701065344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397700.433911:0:93159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.433941:0:93159:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.433982:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065344 00000100:00100000:2.0:1787397700.433986:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065344 00000100:00100000:2.0:1787397700.434019:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787397700.434035:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:93159:x1874218701065344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.434109:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:93159:x1874218701065344:12345-0@lo:502:llog_process_th.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.434117:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787397700.434231:0:93159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93159:1874218701065344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397700.434248:0:93159:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397700.434253:0:93159:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397700.434254:0:93159:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397700.434258:0:93159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:2.0:1787397700.434424:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:2.0:1787397700.434447:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787397700.434463:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.434474:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397700.434484:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397700.434487:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 55 10000000:01000000:2.0:1787397700.434490:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397700.434515:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.434555:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.434565:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.434580:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.434611:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.434752:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.441316:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065472 00000100:00100000:0.0:1787397700.441329:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065472 00000100:00100000:1.0:1787397700.446900:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787397700.446916:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701065472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397700.446933:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397700.446952:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75800/0x274786fe0d1910e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910da expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.446980:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75800/0x274786fe0d1910e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910da expref: 20 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.447010:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75800/0x274786fe0d1910e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910da expref: 20 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.447019:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00000100:00100000:1.0:1787397700.447110:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701065472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (12497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.447117:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787397700.447210:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397700.447229:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.447238:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.447314:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.447358:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397700.452652:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397700.457584:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.460434:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065600 00000100:00100000:0.0:1787397700.460449:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065600 00000100:00100000:0.0:1787397700.461304:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787397700.461320:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701065600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.461500:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701065600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (14141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.461508:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787397700.462368:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.462425:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.462489:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.462534:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.462552:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065728 00000100:00100000:2.0:1787397700.462558:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065728 00000100:00100000:2.0:1787397700.463913:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787397700.463924:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701065728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.464080:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701065728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.464089:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787397700.464139:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701065728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.464377:0:93160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93160:1874218701065856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.464420:0:93160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.464441:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065856 00000100:00100000:2.0:1787397700.464446:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065856 00000100:00100000:2.0:1787397700.464465:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787397700.464471:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93160:x1874218701065856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.464558:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93160:x1874218701065856:12345-0@lo:502:llog_process_th.0 Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.465258:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787397700.465311:0:93160:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.465330:0:93160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93160:1874218701065856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.465384:0:93160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93160:1874218701065984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.465422:0:93160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.465447:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701065984 00000100:00100000:2.0:1787397700.465451:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701065984 00000100:00100000:2.0:1787397700.465473:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787397700.465479:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93160:x1874218701065984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.466264:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:93160:x1874218701065984:12345-0@lo:502:llog_process_th.0 Request processed in 781us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.466273:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787397700.466317:0:93160:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.466333:0:93160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93160:1874218701065984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397700.466355:0:93160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1787397700.467297:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1787397700.467327:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397700.467338:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.467350:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397700.467360:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787397700.467362:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1787397700.467365:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787397700.467398:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.467405:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.467413:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397700.467431:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.467490:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.467896:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.467982:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066112 00000100:00100000:2.0:1787397700.467988:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066112 00000100:00100000:2.0:1787397700.468082:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787397700.468093:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701066112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397700.468105:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397700.468119:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63400/0x274786fe0d1910ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910e8 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.468143:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63400/0x274786fe0d1910ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910e8 expref: 21 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.468153:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63400/0x274786fe0d1910ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910e8 expref: 21 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.468162:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63400, rc 0) 00000100:00100000:2.0:1787397700.468229:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70511e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.468235:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787397700.468336:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397700.468350:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.468360:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397700.468415:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.468440:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.471362:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.471432:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066240 00000100:00100000:0.0:1787397700.471441:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066240 00000100:00100000:0.0:1787397700.471488:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787397700.471497:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.471682:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.471702:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787397700.472150:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.472213:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.472261:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397700.472290:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397700.474042:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066368 00000100:00100000:2.0:1787397700.474054:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066368 00000100:00100000:2.0:1787397700.474122:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787397700.474131:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.474282:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397700.474290:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787397700.474569:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397700.475483:0:93161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1787397700.475916:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1787397700.475939:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787397700.475952:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.475963:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397700.475972:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397700.475975:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 55 10000000:01000000:2.0:1787397700.475977:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397700.476011:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.476019:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.476039:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.476076:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.476131:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.476169:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810ca1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397700.476278:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066496 00000100:00100000:3.0:1787397700.476284:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066496 00000100:00100000:3.0:1787397700.476328:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787397700.476338:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701066496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.476350:0:92419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397700.476363:0:92419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030000/0x274786fe0d1910fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1910f6 expref: -99 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.476384:0:92419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030000/0x274786fe0d1910fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1910f6 expref: 22 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.476394:0:92419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030000/0x274786fe0d1910fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1910f6 expref: 22 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.476403:0:92419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00000100:00100000:3.0:1787397700.476440:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701066496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.476447:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787397700.477567:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397700.477592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397700.477605:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.477784:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.477827:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.478002:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810ca1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.479767:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066624 00000100:00100000:1.0:1787397700.479782:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066624 00000100:00100000:3.0:1787397700.482912:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787397700.482925:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701066624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.483169:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701066624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (5339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.483178:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787397700.486985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397700.487061:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195264 00000100:00100000:3.0:1787397700.487071:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195264 00000100:00100000:3.0:1787397700.487131:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00100000:3.0:1787397700.487142:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681195264:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.487157:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397700.487176:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031200/0x274786fe0d191104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8148 expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.487204:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031200/0x274786fe0d191104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8148 expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.487215:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031200/0x274786fe0d191104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8148 expref: 9 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.487224:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031200, rc 0) 00000100:00100000:3.0:1787397700.487286:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195264:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 146us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.487293:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00100000:1.0:1787397700.491401:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.491472:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.491583:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.491620:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397700.497100:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066752 00000100:00100000:3.0:1787397700.497115:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066752 00000100:00100000:3.0:1787397700.497165:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787397700.497174:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701066752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.497348:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701066752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (5764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.497355:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787397700.497465:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397700.497566:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701066752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.497624:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195392 00000100:00100000:1.0:1787397700.497628:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195392 00000100:00100000:1.0:1787397700.497905:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 157 00000100:00100000:1.0:1787397700.497912:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195392:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.498021:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195392:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 109us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.498049:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 157 00000100:00100000:2.0:1787397700.498477:0:93162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93162:1874218701066880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.498541:0:93162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.498576:0:93162:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.498882:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701066880 00000100:00100000:1.0:1787397700.498888:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701066880 00000100:00100000:1.0:1787397700.498925:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787397700.498932:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:93162:x1874218701066880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397700.499038:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:93162:x1874218701066880:12345-0@lo:502:llog_process_th.0 Request processed in 106us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.499044:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787397700.501111:0:93162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93162:1874218701066880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.501188:0:93162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93162:1874218701067008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397700.501253:0:93162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397700.501283:0:93162:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.501769:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067008 00000100:00100000:0.0:1787397700.501776:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067008 00000100:00100000:0.0:1787397700.501830:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787397700.501839:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:93162:x1874218701067008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397700.501979:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:93162:x1874218701067008:12345-0@lo:502:llog_process_th.0 Request processed in 140us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.501987:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787397700.502150:0:93162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:93162:1874218701067008:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397700.502174:0:93162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1787397700.502356:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1787397700.502379:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397700.502391:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.502402:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397700.502411:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787397700.502414:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787397700.502416:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397700.502444:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.502452:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.502460:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397700.502475:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.502506:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.502594:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397700.503203:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067136 00000100:00100000:0.0:1787397700.503212:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067136 00000100:00100000:0.0:1787397700.503257:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787397700.503266:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701067136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397700.503278:0:92422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397700.503293:0:92422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f0000/0x274786fe0d191112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19110b expref: -99 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.503316:0:92422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f0000/0x274786fe0d191112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19110b expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.503327:0:92422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f0000/0x274786fe0d191112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19110b expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.503347:0:92422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0000, rc 0) 00000100:00100000:0.0:1787397700.503385:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.503392:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787397700.503516:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.503555:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.503571:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397700.503634:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.503725:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.503752:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397700.503767:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067264 00000100:00100000:3.0:1787397700.503770:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067264 00000100:00100000:3.0:1787397700.503804:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787397700.503811:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.503925:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.503932:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787397700.504084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397700.504219:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195520 00000100:00100000:0.0:1787397700.504224:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195520 00000100:00100000:3.0:1787397700.504289:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.504318:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.504358:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397700.504381:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397700.504430:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067392 00000100:00100000:1.0:1787397700.504434:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067392 00000100:00100000:0.0:1787397700.505973:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:0.0:1787397700.505989:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195520:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397700.506121:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195520:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 136us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.506129:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:1.0:1787397700.509117:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787397700.509138:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.509304:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b96e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.509312:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787397700.509424:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397700.510290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397700.510476:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195648 00000100:00100000:3.0:1787397700.510483:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195648 00000100:00100000:3.0:1787397700.510549:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 164 00000100:00100000:3.0:1787397700.510559:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71887:x1874218681195648:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787397700.510692:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71887:x1874218681195648:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 133us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.510706:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 164 00000040:00080000:3.0:1787397700.513333:0:93163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1787397700.513671:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787397700.513695:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787397700.513706:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.513718:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397700.513728:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787397700.513731:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787397700.513734:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787397700.513770:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.513786:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.513797:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397700.513820:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.513880:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.513926:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397700.514056:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067520 00000100:00100000:3.0:1787397700.514063:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067520 00000100:00100000:3.0:1787397700.514113:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787397700.514121:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701067520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397700.514134:0:92424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397700.514147:0:92424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031600/0x274786fe0d191120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191119 expref: -99 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.514171:0:92424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031600/0x274786fe0d191120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191119 expref: 24 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.514182:0:92424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031600/0x274786fe0d191120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191119 expref: 24 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397700.514191:0:92424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031600, rc 0) 00000100:00100000:3.0:1787397700.514229:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701067520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.514236:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787397700.514316:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397700.514329:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.514338:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397700.514391:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.514416:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.514438:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397700.514490:0:92419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067648 00000100:00100000:3.0:1787397700.514494:0:92419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067648 00000100:00100000:3.0:1787397700.514548:0:92419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787397700.514555:0:92419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701067648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397700.514625:0:92419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701067648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397700.514632:0:92419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787397700.515069:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701067648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787397700.515096:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787397700.515102:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397700.515109:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397700.515232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397700.515287:0:92424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195776 00000100:00100000:3.0:1787397700.515292:0:92424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195776 00000100:00100000:3.0:1787397700.515325:0:92424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00100000:3.0:1787397700.515333:0:92424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71887:x1874218681195776:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787397700.515434:0:92424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:71887:x1874218681195776:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 101us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397700.515442:0:92424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00100000:2.0:1787397700.517933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397700.518422:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681195904 00000100:00100000:0.0:1787397700.518432:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681195904 00000100:00100000:0.0:1787397700.518554:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 168 00000100:00100000:0.0:1787397700.518564:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681195904:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397700.518582:0:92421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397700.518603:0:92421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1600/0x274786fe0d191127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d814f expref: -99 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.518632:0:92421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1600/0x274786fe0d191127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d814f expref: 10 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.518653:0:92421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1600/0x274786fe0d191127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d814f expref: 10 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397700.518662:0:92421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1600, rc 0) 00000100:00100000:0.0:1787397700.518731:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681195904:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 166us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397700.518738:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 168 00000100:00100000:2.0:1787397700.522764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397700.528155:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196032 00000100:00100000:1.0:1787397700.528172:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196032 00000100:00100000:1.0:1787397700.528267:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 169 00000100:00100000:1.0:1787397700.528277:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681196032:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397700.528396:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681196032:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 120us (5641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397700.528404:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 169 00000100:00100000:1.0:1787397700.582877:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701067776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397700.582948:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.582996:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397700.583003:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701067904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397700.583036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397700.583071:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067776 00000100:00100000:1.0:1787397700.583079:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067776 00000100:00100000:1.0:1787397700.583118:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701067904 00000100:00100000:1.0:1787397700.583121:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701067904 00000100:00100000:1.0:1787397700.583136:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1787397700.583143:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701067776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397700.583167:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397700.583209:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701067776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.583218:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1787397700.583236:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1787397700.583242:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701067904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397700.583271:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397700.583298:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701067904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397700.583303:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:1.0:1787397700.583343:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701067904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397700.583355:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701067776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397701.381016:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.381065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.381094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.381120:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397701.381138:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196288 00000100:00100000:3.0:1787397701.381140:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196544 00000100:00100000:3.0:1787397701.381148:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196544 00000100:00100000:1.0:1787397701.381148:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196288 00000100:00100000:3.0:1787397701.381744:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2577 00000100:00100000:3.0:1787397701.381755:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681196544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397701.381828:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681196544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 75us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.381835:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2577 00000100:00100000:3.0:1787397701.381859:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196160 00000100:00100000:3.0:1787397701.381862:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196160 00000100:00100000:3.0:1787397701.381886:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:3.0:1787397701.381892:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681196160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397701.381992:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681196160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.382001:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:3.0:1787397701.382040:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196416 00000100:00100000:3.0:1787397701.382050:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196416 00000100:00100000:1.0:1787397701.382388:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1322 00000100:00100000:1.0:1787397701.382397:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681196288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397701.382431:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681196288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.382438:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1322 00000100:00100000:1.0:1787397701.382504:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1323 00000100:00100000:1.0:1787397701.382512:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681196416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397701.382553:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681196416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.382559:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1323 00000100:00080000:3.0:1787397701.382610:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397701.382614:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397701.382617:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787397701.478783:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397701.681670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.691665:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196672 00000100:00100000:3.0:1787397701.691679:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196672 00000100:00100000:3.0:1787397701.691756:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1339 00000100:00100000:3.0:1787397701.691767:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71907:x1874218681196672:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787397701.691787:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397701.691809:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19112e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8156 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.691879:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.691893:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.691906:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397701.691959:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397701.691963:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397701.691998:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.692036:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19112e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8156 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.692054:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8156 expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.692075:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:3.0:1787397701.692078:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397701.692082:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:3.0:1787397701.692144:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681196672:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 380us (10484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.692153:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1339 00000100:00100000:0.0:1787397701.699534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397701.699572:0:66196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681196800 00000100:00100000:0.0:1787397701.699581:0:66196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681196800 00000100:00100000:0.0:1787397701.699634:0:66196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:0.0:1787397701.699644:0:66196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681196800:12345-192.168.204.60@tcp:700:mkdir.0 00000100:00100000:0.0:1787397701.699727:0:66196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681196800:12345-192.168.204.60@tcp:700:mkdir.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.699736:0:66196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787397701.702194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397701.702271:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681197056 00000100:00100000:0.0:1787397701.702280:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681197056 00000100:00100000:0.0:1787397701.702336:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1340 00000100:00100000:0.0:1787397701.702346:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681197056:12345-192.168.204.60@tcp:36:mkdir.0 00010000:00010000:0.0:1787397701.702399:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397701.702426:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191135 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8156 expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702447:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397701.702453:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397701.702824:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702838:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702863:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702878:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702885:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.702892:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704126:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704144:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704154:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397701.704172:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007982ce4e reply state 00000000ce0468a4 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704183:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704190:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:0.0:1787397701.704193:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397701.704197:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787397701.704203:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787397701.704218:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704225:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704232:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704238:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704243:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.704248:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704254:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704264:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397701.704266:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.704269:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704274:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19113c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397701.704286:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007982ce4e reply state 00000000ce0468a4 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704294:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.704310:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397701.704312:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397701.704315:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787397701.704453:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71907:x1874218681197056:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 2104us (2263us total) trans 115964116996 rc 0/0 00000100:00100000:0.0:1787397701.704462:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1340 00000100:00100000:0.0:1787397701.707160:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.707210:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681197184 00000100:00100000:3.0:1787397701.707221:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681197184 00000100:00100000:1.0:1787397701.707630:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1341 00000100:00100000:1.0:1787397701.707644:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71907:x1874218681197184:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397701.707666:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397701.707686:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d191151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d815d expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707767:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707781:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707794:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397701.707842:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397701.707846:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397701.707867:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707891:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d191151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d815d expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707908:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d815d expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.707916:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397701.707919:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397701.707922:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75200, rc 0) 00000100:00100000:1.0:1787397701.708029:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71907:x1874218681197184:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 388us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.708037:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1341 00000100:00100000:3.0:1787397701.713102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397701.713510:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681197440 00000100:00100000:0.0:1787397701.713641:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681197440 00000100:00100000:1.0:1787397701.713766:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1342 00000100:00100000:1.0:1787397701.713777:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71907:x1874218681197440:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397701.713818:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397701.713840:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d19115f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8164 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713915:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713943:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713956:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713967:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713974:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.713980:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397701.714099:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787397701.714168:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714176:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714182:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714198:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397701.714202:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714208:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714220:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397701.714223:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397701.714227:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714234:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75400/0x274786fe0d191166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714248:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714254:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714260:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714265:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397701.714267:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714272:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714290:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a82ebb1200) 00010000:00010000:1.0:1787397701.714292:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397701.714295:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714301:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19116d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714334:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d19115f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8164 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714343:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397701.714345:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397701.714349:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d19115f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8164 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.714357:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:1.0:1787397701.714428:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71907:x1874218681197440:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 653us (1336us total) trans 115964116997 rc 301/301 00000100:00100000:1.0:1787397701.714435:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1342 00000100:00100000:2.0:1787397701.726073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.726166:0:66197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681197568 00000100:00100000:3.0:1787397701.726176:0:66197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681197568 00000100:00100000:3.0:1787397701.726227:0:66197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:3.0:1787397701.726236:0:66197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71907:x1874218681197568:12345-192.168.204.60@tcp:900:mkdir.0 00000100:00100000:3.0:1787397701.726325:0:66197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71907:x1874218681197568:12345-192.168.204.60@tcp:900:mkdir.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.726343:0:66197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787397701.729637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.729744:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681197824 00000100:00100000:3.0:1787397701.729754:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681197824 00000100:00100000:3.0:1787397701.729817:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 236 00000100:00100000:3.0:1787397701.729835:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71907:x1874218681197824:12345-192.168.204.60@tcp:35:mkdir.0 00000100:00100000:3.0:1787397701.730088:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71907:x1874218681197824:12345-192.168.204.60@tcp:35:mkdir.0 Request processed in 254us (459us total) trans 115964116998 rc 0/0 00000100:00100000:3.0:1787397701.730097:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 236 00000100:00100000:0.0:1787397701.733985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.735123:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198080 00000100:00100000:3.0:1787397701.735276:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198080 00000100:00100000:3.0:1787397701.735342:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1343 00000100:00100000:3.0:1787397701.735353:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71907:x1874218681198080:12345-192.168.204.60@tcp:36:mkdir.0 00000100:00100000:3.0:1787397701.735498:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068032:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.735593:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.735685:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.735845:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068032 00000100:00100000:0.0:1787397701.735851:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068032 00000100:00100000:0.0:1787397701.735895:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:0.0:1787397701.735904:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397701.736478:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068032:12345-0@lo:1000:mdt00_001.0 Request processed in 573us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.736487:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1787397701.736502:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068032:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.736604:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068160:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.736899:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.736994:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.737457:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068160 00000100:00100000:0.0:1787397701.737463:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068160 00000100:00100000:0.0:1787397701.737579:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:0.0:1787397701.737589:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397701.737663:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068160:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.737669:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1787397701.737889:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068160:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.738601:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068288:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.739870:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.745205:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.750233:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068288 00000100:00100000:2.0:1787397701.750251:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068288 00000100:00100000:2.0:1787397701.750315:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1787397701.750325:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787397701.750517:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068288:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (10650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397701.750540:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1787397701.752216:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068288:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787397701.752304:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.752314:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.752325:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.752344:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068416:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787397701.752395:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.752598:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.754071:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068416 00000100:00100000:0.0:1787397701.754097:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068416 00000100:00100000:2.0:1787397701.756083:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1787397701.756107:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068416:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787397701.756130:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.756154:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d19117b expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.756184:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.756194:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.756214:0:8446:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1787397701.756246:0:8446:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1787397701.756317:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.756326:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:2.0:1787397701.756329:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.756333:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.756341:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:2.0:1787397701.756420:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068416:12345-0@lo:101:mdt00_001.0 Request processed in 324us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.756427:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1787397701.758592:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068416:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397701.758616:0:66177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.758629:0:66177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397701.763947:0:92415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000001:00080000:1.0:1787397701.763971:0:92415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:0.0:1787397701.765928:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.765946:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.765954:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.765960:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.765966:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.765974:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.765994:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397701.765997:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.766011:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766018:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d191143 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766045:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766052:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766058:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766080:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.766084:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766089:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766109:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:0.0:1787397701.766111:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.766118:0:3634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766129:0:3634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766137:0:3634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.766180:0:3634:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.766195:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3634:1874218701068544:0@lo:105: 00000100:00100000:0.0:1787397701.766264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.766316:0:3634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.767017:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787397701.767034:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068544 00000100:00100000:1.0:1787397701.767042:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068544 00000100:00100000:1.0:1787397701.767110:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787397701.767121:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3634:x1874218701068544:12345-0@lo:105: 00010000:00010000:1.0:1787397701.767143:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767153:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767161:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767168:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767175:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767184:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.767213:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a800031000) 00000100:00100000:1.0:1787397701.767269:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3634:x1874218701068544:12345-0@lo:105: Request processed in 150us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.767294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787397701.767556:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3634:1874218701068544:0@lo:105: 00010000:00010000:0.0:1787397701.767577:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.767596:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d19114a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.767651:0:66177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.767663:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397701.767686:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1787397701.767725:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.767733:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.767743:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.767761:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068672:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787397701.767805:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.767840:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.767841:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068672 00000100:00100000:2.0:1787397701.767848:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068672 00000100:00100000:2.0:1787397701.767887:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1787397701.767893:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701068672:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787397701.767907:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.767921:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d191189 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.767940:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191189 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.767952:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191189 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.767961:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff89a817ea6200) 00010000:00010000:2.0:1787397701.767963:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.767972:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63600, rc 0) 00000100:00100000:2.0:1787397701.768022:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068672:12345-0@lo:101:mdt00_001.0 Request processed in 128us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.768029:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1787397701.768061:0:66177:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:3.0:1787397701.768067:0:66177:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:3.0:1787397701.768084:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068672:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787397701.768101:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.768111:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397701.768123:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1787397701.768152:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068800:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.768181:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.768208:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.768264:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068800 00000100:00100000:0.0:1787397701.768268:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068800 00000100:00100000:0.0:1787397701.768299:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1787397701.768309:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397701.768377:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068800:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.768384:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1787397701.768568:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068800:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.768608:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068928:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.768632:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.768649:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.768713:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701068928 00000100:00100000:0.0:1787397701.768718:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701068928 00000100:00100000:0.0:1787397701.768740:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1787397701.768746:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397701.768906:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701068928:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (272us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397701.768913:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1787397701.771794:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701068928:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.772279:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069056:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.772354:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.772396:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.772619:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069056 00000100:00100000:2.0:1787397701.772628:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069056 00000100:00100000:2.0:1787397701.772689:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:2.0:1787397701.772699:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787397701.772804:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069056:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (449us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397701.772813:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1787397701.772964:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069056:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.773030:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069184:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.773056:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.773081:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.773125:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069184 00000100:00100000:0.0:1787397701.773130:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069184 00000100:00100000:0.0:1787397701.773161:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1787397701.773168:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787397701.773232:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069184:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.773239:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:3.0:1787397701.773355:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069184:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.773394:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069312:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.773646:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.773660:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.774165:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069312 00000100:00100000:1.0:1787397701.774172:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069312 00000100:00100000:1.0:1787397701.774217:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1787397701.774226:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397701.774314:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069312:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.774334:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1787397701.774640:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069312:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.774695:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069440:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787397701.774724:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.774745:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.776074:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069440 00000100:00100000:2.0:1787397701.776085:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069440 00000100:00100000:2.0:1787397701.776138:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1787397701.776146:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787397701.776269:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701069440:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.776276:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1787397701.776640:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701069440:0@lo:1000:mdt00_001.0 00000040:00080000:3.0:1787397701.777131:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].4, 968 off37320 00000040:00080000:3.0:1787397701.777190:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].4, 1120 off37904 00000004:00080000:3.0:1787397701.777197:0:66177:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a835b9ed80 with version 13 00000004:00080000:2.0:1787397701.777295:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 13 rpc_version 13 00000020:00100000:2.0:1787397701.777322:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787397701.777438:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af24700 x1874218701069696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397701.777461:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701069696:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397701.777507:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.777706:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.778057:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069696 00000100:00100000:0.0:1787397701.778065:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069696 00000100:00100000:0.0:1787397701.778128:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1787397701.778137:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701069696:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397701.778589:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75622:x1874218701069696:12345-0@lo:1000:osp_up0-1.0 Request processed in 452us (1079us total) trans 115964116999 rc 0/0 00000100:00100000:0.0:1787397701.778597:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1787397701.778737:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701069696:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787397701.781951:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.781974:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.781990:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397701.782020:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e885e2a3 reply state 0000000070089f00 transno 81604378754 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782032:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782039:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:3.0:1787397701.782042:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397701.782046:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787397701.782052:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:3.0:1787397701.782063:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1787397701.782087:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782096:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782103:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782133:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787397701.782140:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1787397701.782145:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.782152:0:66177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.782302:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681198080:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 46947us (48323us total) trans 81604378754 rc 0/0 00000100:00100000:3.0:1787397701.782311:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1343 00010000:00010000:1.0:1787397701.782830:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397701.782837:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.782847:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397701.782852:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397701.782860:0:15258:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.782895:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.782902:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397701.782930:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.782938:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031000/0x274786fe0d19117b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d191182 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.782956:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397701.782958:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397701.782960:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397701.783037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701069824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397701.783088:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.783207:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069824 00000100:00100000:2.0:1787397701.783224:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069824 00000100:00100000:2.0:1787397701.783276:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1787397701.783285:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701069824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397701.783297:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397701.783314:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191182 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19117b expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.783339:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:2.0:1787397701.783349:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397701.783401:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3648:x1874218701069824:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.783409:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1787397701.783604:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701069824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397701.787574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397701.787741:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198336 00000100:00100000:1.0:1787397701.787752:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198336 00000100:00100000:1.0:1787397701.787825:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1344 00000100:00100000:1.0:1787397701.787837:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681198336:12345-192.168.204.60@tcp:36:mkdir.0 00010000:00010000:1.0:1787397701.787915:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397701.787943:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d191158 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d815d expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.787963:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397701.787968:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397701.788109:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71907:x1874218681198336:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 274us (544us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787397701.788116:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1344 00000100:00100000:0.0:1787397701.792221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397701.793092:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198464 00000100:00100000:1.0:1787397701.793104:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198464 00000100:00100000:1.0:1787397701.793230:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1345 00000100:00100000:1.0:1787397701.793241:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71907:x1874218681198464:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397701.793264:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397701.793284:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d19119e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d816b expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793349:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793362:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793374:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397701.793429:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397701.793432:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397701.793476:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793498:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d19119e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d816b expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793516:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d816b expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.793548:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:1.0:1787397701.793551:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397701.793554:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74000, rc 0) 00000100:00100000:1.0:1787397701.793610:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681198464:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 372us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.794429:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1345 00000100:00100000:0.0:1787397701.798303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.800701:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198592 00000100:00100000:2.0:1787397701.800715:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198592 00000100:00100000:2.0:1787397701.800892:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1346 00000100:00100000:2.0:1787397701.800903:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681198592:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787397701.800922:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.800945:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d1911ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8172 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801021:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801034:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801047:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801078:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801085:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801092:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801175:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801182:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801189:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397701.801225:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397701.801229:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397701.801249:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801262:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801268:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801274:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801289:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801295:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397701.801299:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801306:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801317:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:2.0:1787397701.801320:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.801324:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801331:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1911b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801345:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801351:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801356:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801361:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397701.801363:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801379:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801387:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a817ea6e00) 00010000:00010000:2.0:1787397701.801389:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.801392:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801398:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d1911ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801633:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d1911ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801648:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.801655:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:2.0:1787397701.801657:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397701.801659:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62400, rc 0) 00000100:00100000:2.0:1787397701.801719:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71907:x1874218681198592:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 818us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.801726:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1346 00000100:00100000:0.0:1787397701.805443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.805543:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198848 00000100:00100000:3.0:1787397701.805554:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198848 00000100:00100000:3.0:1787397701.805625:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1347 00000100:00100000:3.0:1787397701.805643:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71907:x1874218681198848:12345-192.168.204.60@tcp:36:mkdir.0 00000100:00100000:3.0:1787397701.805763:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701069952:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.805819:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.805872:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.805887:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701069952 00000100:00100000:1.0:1787397701.805893:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701069952 00000100:00100000:1.0:1787397701.805962:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1787397701.805970:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701069952:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397701.806063:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701069952:12345-0@lo:1000:mdt00_005.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.806071:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1787397701.806140:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701069952:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.806181:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070080:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.806204:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.806226:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.806330:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070080 00000100:00100000:0.0:1787397701.806335:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070080 00000100:00100000:0.0:1787397701.806369:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1787397701.806376:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701070080:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.806459:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701070080:12345-0@lo:1000:mdt00_005.0 Request processed in 84us (254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397701.806466:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:3.0:1787397701.806550:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070080:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787397701.806597:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.806608:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.806743:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.806756:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070208:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787397701.806781:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.806806:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.807596:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070208 00000100:00100000:2.0:1787397701.807604:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070208 00000100:00100000:2.0:1787397701.807653:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1787397701.807661:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701070208:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397701.807673:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.807704:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d1911c8 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.807732:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.807742:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.807771:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.807786:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 7 pid: 66176 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397701.807800:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1874218701070336:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397701.807888:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397701.811847:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.811862:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24380 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8446:1874218701070336:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397701.811900:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.811913:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:3.0:1787397701.811916:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397701.811920:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.811929:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1c00, rc 0) 00000100:00100000:3.0:1787397701.812013:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:77740:x1874218701070208:12345-0@lo:101:mdt00_005.0 Request processed in 4352us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.812022:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1787397701.812091:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070208:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397701.812110:0:77740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681198976 00010000:00010000:2.0:1787397701.812123:0:77740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812125:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681198976 00010000:00010000:0.0:1787397701.812157:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 8 pid: 66176 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812194:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2620 00000100:00100000:0.0:1787397701.812202:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681198976:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397701.812215:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397701.812226:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 8 pid: 66176 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812237:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 8 pid: 66176 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812256:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d1911c1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8172 expref: 8 pid: 66176 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812267:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:0.0:1787397701.812272:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812281:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812289:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.812318:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812330:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6509:1874218701070464:0@lo:105: 00000100:00100000:0.0:1787397701.812362:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.812393:0:6509:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397701.812503:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070464 00000100:00100000:3.0:1787397701.812508:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070464 00000100:00100000:3.0:1787397701.812585:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787397701.812592:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6509:x1874218701070464:12345-0@lo:105: 00010000:00010000:3.0:1787397701.812602:0:6506:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812623:0:6506:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812632:0:6506:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812640:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812646:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812654:0:6506:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.812678:0:6506:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a800031400) 00000100:00100000:3.0:1787397701.812710:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6509:x1874218701070464:12345-0@lo:105: Request processed in 119us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.812726:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:2.0:1787397701.812848:0:77740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.812870:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812890:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6509:1874218701070464:0@lo:105: 00000004:00080000:2.0:1787397701.812891:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1787397701.812907:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397701.812929:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.812938:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.812947:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.812953:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681198976:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 749us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.812967:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070592:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787397701.812971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2620 00000100:00100000:2.0:1787397701.813014:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.813036:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.813090:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070592 00000100:00100000:0.0:1787397701.813095:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070592 00000100:00100000:0.0:1787397701.813128:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1787397701.813135:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:77740:x1874218701070592:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787397701.813151:0:23942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397701.813166:0:23942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d1911d6 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.813183:0:23942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 11 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.813193:0:23942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 11 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.813200:0:23942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397701.813202:0:23942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.813205:0:23942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1000, rc 0) 00000100:00100000:0.0:1787397701.813242:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070592:12345-0@lo:101:mdt00_005.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.813248:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1787397701.813299:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070592:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397701.813312:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.813322:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397701.813333:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:2.0:1787397701.813362:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070720:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397701.813385:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.813415:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397701.813573:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070720 00000100:00100000:3.0:1787397701.813577:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070720 00000100:00100000:3.0:1787397701.813607:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1787397701.813613:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070720:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.813674:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070720:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.813680:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1787397701.815110:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070720:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.815192:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070848:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.815238:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.815273:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.815464:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070848 00000100:00100000:1.0:1787397701.815471:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070848 00000100:00100000:1.0:1787397701.815542:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:1.0:1787397701.815552:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070848:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397701.815657:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070848:12345-0@lo:1000:mdt00_005.0 Request processed in 106us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397701.815680:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1787397701.816241:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070848:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.816339:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070976:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.816372:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.816400:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.816580:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701070976 00000100:00100000:1.0:1787397701.816585:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701070976 00000100:00100000:1.0:1787397701.816620:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:1.0:1787397701.816628:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070976:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397701.816920:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701070976:12345-0@lo:1000:mdt00_005.0 Request processed in 291us (545us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397701.816929:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1787397701.816993:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701070976:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397701.817060:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071104:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397701.817088:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.817388:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397701.818157:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071104 00000100:00100000:0.0:1787397701.818165:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071104 00000100:00100000:0.0:1787397701.818220:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:0.0:1787397701.818231:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071104:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.818315:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071104:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.818322:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:0.0:1787397701.818359:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071104:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.818413:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071232:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.818444:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.818455:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787397701.823287:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071232 00000100:00100000:3.0:1787397701.823304:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071232 00000100:00100000:3.0:1787397701.823369:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1787397701.823379:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071232:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.825944:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071232:12345-0@lo:1000:mdt00_005.0 Request processed in 2560us (7490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.825958:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:0.0:1787397701.826085:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071232:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.826167:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071360:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397701.826207:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.826231:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.826289:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071360 00000100:00100000:1.0:1787397701.826295:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071360 00000100:00100000:1.0:1787397701.826342:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1787397701.826350:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071360:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397701.826422:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701071360:12345-0@lo:1000:mdt00_005.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.826429:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1787397701.826691:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701071360:0@lo:1000:mdt00_005.0 00000040:00080000:3.0:1787397701.827155:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].5, 968 off38288 00000040:00080000:3.0:1787397701.827214:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].5, 1120 off39024 00000004:00080000:3.0:1787397701.827220:0:77740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a835b9e9c0 with version 14 00000004:00080000:0.0:1787397701.827757:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 14 rpc_version 14 00000020:00100000:0.0:1787397701.827784:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787397701.827793:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a828413800 x1874218701071616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397701.828216:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701071616:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397701.828268:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.828299:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397701.828367:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071616 00000100:00100000:3.0:1787397701.828373:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071616 00000100:00100000:3.0:1787397701.828426:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:3.0:1787397701.828652:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75622:x1874218701071616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397701.829059:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75622:x1874218701071616:12345-0@lo:1000:osp_up0-1.0 Request processed in 624us (789us total) trans 115964117000 rc 0/0 00000100:00100000:3.0:1787397701.829067:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1787397701.832862:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701071616:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787397701.833117:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833133:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833146:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397701.833165:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c5f3e08 reply state 00000000368b36cd transno 81604378755 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833176:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833184:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:3.0:1787397701.833187:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397701.833191:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787397701.833196:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:3.0:1787397701.833205:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1787397701.833217:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833226:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833233:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833256:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787397701.833261:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1787397701.833266:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.833288:0:77740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833583:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397701.833589:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833597:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787397701.833603:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397701.833611:0:56853:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833646:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833653:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397701.833685:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833693:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800031400/0x274786fe0d1911c8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1911cf expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833711:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397701.833712:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397701.833714:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397701.833722:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397701.833736:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701071744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397701.833782:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.833836:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071744 00000100:00100000:0.0:1787397701.833850:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071744 00000100:00100000:0.0:1787397701.833893:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1787397701.833901:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3648:x1874218701071744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397701.833914:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397701.833928:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1c00/0x274786fe0d1911cf lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1911c8 expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.833942:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a817ea6600) 00010000:00010000:0.0:1787397701.833951:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397701.833978:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3648:x1874218701071744:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.833984:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1787397701.834035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701071744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397701.834152:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71907:x1874218681198848:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 28512us (28716us total) trans 81604378755 rc 0/0 00000100:00100000:3.0:1787397701.834161:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1347 00000100:00100000:2.0:1787397701.870040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397701.870344:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681199104 00000100:00100000:0.0:1787397701.870355:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681199104 00000100:00100000:0.0:1787397701.870766:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1348 00000100:00100000:0.0:1787397701.870779:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71908:x1874218681199104:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397701.870800:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397701.870835:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1911eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8179 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870898:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870913:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870924:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870952:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870960:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.870966:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872152:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872169:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872178:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397701.872235:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397701.872239:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397701.872277:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872292:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872298:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872304:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872325:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872331:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.872336:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872344:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872356:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397701.872359:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.872363:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872369:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1911f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872384:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872390:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872395:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872400:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.872404:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872419:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872428:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a82ebb1500) 00010000:00010000:0.0:1787397701.872710:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.872714:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872721:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1911f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872760:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1911eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8179 expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872773:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8179 expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.872781:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:0.0:1787397701.872783:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787397701.872786:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0200, rc 0) 00000100:00100000:0.0:1787397701.872923:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71908:x1874218681199104:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 2145us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.872933:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1348 00000100:00100000:1.0:1787397701.879410:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.879656:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681199232 00000100:00100000:3.0:1787397701.879669:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681199232 00000100:00100000:2.0:1787397701.880112:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1349 00000100:00100000:2.0:1787397701.880125:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71908:x1874218681199232:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397701.880146:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.880169:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d191207 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8180 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880237:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880253:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880266:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880278:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880289:0:74374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191189 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880297:0:74374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.880331:0:74374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191189 expref: 10 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397701.880368:0:74374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:74374:1874218701071872:0@lo:104: 00000100:00100000:2.0:1787397701.880421:0:74374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.880512:0:74374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.880692:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701071872 00000100:00100000:1.0:1787397701.880697:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701071872 00000100:00100000:1.0:1787397701.880906:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1787397701.880916:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:74374:x1874218701071872:12345-0@lo:104: 00010000:00010000:1.0:1787397701.880929:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.881040:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397701.881046:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:74374:x1874218701071872:12345-0@lo:104: Request processed in 133us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.881065:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787397701.881180:0:74374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:74374:1874218701071872:0@lo:104: 00010000:00010000:2.0:1787397701.881200:0:74374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.881342:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397701.881350:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.881360:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787397701.881372:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397701.881382:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.881413:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.881420:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397701.881475:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701072000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397701.881513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.881599:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072000 00000100:00100000:3.0:1787397701.881604:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072000 00010000:00010000:3.0:1787397701.881627:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x274786fe0d191189 expref: 11 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.881655:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:3.0:1787397701.881662:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8197d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3650:x1874218701072000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397701.881672:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397701.882041:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.882051:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a800030600/0x274786fe0d191189 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191190 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.882073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397701.882075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397701.882077:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787397701.885594:0:92415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00010000:00010000:3.0:1787397701.887751:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d191190 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191189 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.887777:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff89a817ea6200) 00010000:00010000:3.0:1787397701.887782:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.887793:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.887801:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.887946:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397701.888035:0:74374:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.888044:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397701.888160:0:74374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:74374:1874218701072128:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787397701.888163:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8197d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701072000:12345-0@lo:103:ldlm_bl.0 Request processed in 6501us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.888173:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1787397701.888197:0:74374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397701.888224:0:74374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.888272:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701072000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397701.888412:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072128 00000100:00100000:0.0:1787397701.888419:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072128 00000100:00100000:0.0:1787397701.888455:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1787397701.888462:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:74374:x1874218701072128:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787397701.888683:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:74374:x1874218701072128:12345-0@lo:1000:mdt00_004.0 Request processed in 221us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.888690:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:2.0:1787397701.888893:0:74374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:74374:1874218701072128:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787397701.888942:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.888955:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.888964:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397701.889010:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889023:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889030:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889037:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889043:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397701.889047:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889054:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889065:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:2.0:1787397701.889068:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.889072:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889078:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0a00/0x274786fe0d19120e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889089:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889095:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889108:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889113:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397701.889116:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889123:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889131:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff89a817ea6200) 00010000:00010000:2.0:1787397701.889133:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397701.889136:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889142:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0000/0x274786fe0d191215 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889184:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d191207 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8180 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889197:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8180 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.889204:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a817ea6700) 00010000:00010000:2.0:1787397701.889206:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397701.889208:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1a00, rc 0) 00000100:00100000:2.0:1787397701.889302:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71908:x1874218681199232:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 9180us (9902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.889319:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1349 00000100:00100000:1.0:1787397701.900170:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.901724:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681199360 00000100:00100000:2.0:1787397701.901739:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681199360 00000100:00100000:2.0:1787397701.902052:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1350 00000100:00100000:2.0:1787397701.902064:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71908:x1874218681199360:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397701.902094:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.902117:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191223 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8187 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.902183:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0000/0x274786fe0d19122a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.902199:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0000/0x274786fe0d19122a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.902210:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0000/0x274786fe0d19122a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397701.902267:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787397701.902271:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787397701.902307:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191223 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8187 expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.902325:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0000/0x274786fe0d19122a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8187 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.902334:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:2.0:1787397701.902337:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787397701.902354:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0000, rc 0) 00000100:00100000:2.0:1787397701.902420:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71908:x1874218681199360:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 359us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.902428:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1350 00000100:00100000:0.0:1787397701.909173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.909266:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681199616 00000100:00100000:2.0:1787397701.909277:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681199616 00000100:00100000:2.0:1787397701.909333:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1351 00000100:00100000:2.0:1787397701.909342:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71908:x1874218681199616:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397701.909363:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.909385:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d191231 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d818e expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397701.909483:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787397701.909735:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d191231 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d818e expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.909761:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:2.0:1787397701.909765:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397701.909769:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d191231 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d818e expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.909856:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0a00, rc 0) 00000100:00100000:2.0:1787397701.909948:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71908:x1874218681199616:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 606us (786us total) trans 81604378756 rc 301/301 00000100:00100000:2.0:1787397701.909955:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1351 00000100:00100000:1.0:1787397701.913026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.913113:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681199872 00000100:00100000:3.0:1787397701.913123:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681199872 00000100:00100000:3.0:1787397701.913176:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1352 00000100:00100000:3.0:1787397701.913197:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71908:x1874218681199872:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:3.0:1787397701.913256:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397701.913283:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0000/0x274786fe0d19122a lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8187 expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.913301:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:3.0:1787397701.913306:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397701.913325:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.913337:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.913346:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397701.913498:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001395f41e reply state 00000000873fd9ea transno 81604378757 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.913512:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.914043:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:3.0:1787397701.914046:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1787397701.914049:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787397701.914058:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1787397701.914184:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71908:x1874218681199872:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 999us (1167us total) trans 81604378757 rc 0/0 00000100:00100000:3.0:1787397701.914204:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1352 00000100:00100000:1.0:1787397701.916661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.917008:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681200128 00000100:00100000:2.0:1787397701.917018:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681200128 00000100:00100000:2.0:1787397701.917112:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 237 00000100:00100000:2.0:1787397701.917137:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71908:x1874218681200128:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787397701.917370:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71908:x1874218681200128:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 235us (720us total) trans 81604378758 rc 0/0 00000100:00100000:2.0:1787397701.917379:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 237 00000100:00100000:0.0:1787397701.933864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.933957:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681200256 00000100:00100000:3.0:1787397701.933967:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681200256 00000100:00100000:3.0:1787397701.934037:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1353 00000100:00100000:3.0:1787397701.934047:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71909:x1874218681200256:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397701.934068:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397701.934090:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d191246 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8195 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934160:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934175:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934201:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934213:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934222:0:77740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934245:0:77740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.934279:0:77740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397701.934293:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:77740:1874218701072256:0@lo:104: 00000100:00100000:3.0:1787397701.934340:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397701.934385:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397701.934727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072256 00000100:00100000:1.0:1787397701.934734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072256 00000100:00100000:1.0:1787397701.934781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1787397701.934790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:77740:x1874218701072256:12345-0@lo:104: 00010000:00010000:1.0:1787397701.934804:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.934868:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397701.934874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:77740:x1874218701072256:12345-0@lo:104: Request processed in 86us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397701.934881:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1787397701.934904:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397701.934911:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.934919:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0600 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397701.934924:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397701.934933:0:56852:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.934970:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.934976:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397701.935007:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.935016:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8016a0600/0x274786fe0d1911d6 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1911dd expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397701.935039:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397701.935041:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397701.935043:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397701.935057:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701072384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397701.935089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.935172:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072384 00000100:00100000:0.0:1787397701.935181:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072384 00010000:00010000:0.0:1787397701.935216:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 8 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.935247:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1787397701.935254:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701072384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397701.935263:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397701.935855:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397701.935862:0:8451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.935872:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.935879:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.935896:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397701.935936:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701072384:12345-0@lo:103:ldlm_bl.0 Request processed in 681us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.935943:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00010000:00010000:0.0:1787397701.935982:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1911dd lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1911d6 expref: 7 pid: 23942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.936011:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:77740:1874218701072256:0@lo:104: 00010000:00010000:0.0:1787397701.936029:0:77740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.936039:0:77740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.936052:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397701.936157:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:77740:1874218701072512:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397701.936505:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701072384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397701.936988:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397701.937056:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787397701.937090:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072512 00000100:00100000:3.0:1787397701.937096:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072512 00000100:00100000:3.0:1787397701.937167:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1787397701.937175:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:77740:x1874218701072512:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397701.937411:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:77740:x1874218701072512:12345-0@lo:1000:mdt00_005.0 Request processed in 236us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397701.937419:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1787397701.937511:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:77740:1874218701072512:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1787397701.937897:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.937979:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.937992:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397701.938024:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938040:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938047:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938053:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938059:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938065:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.938080:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938087:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938097:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:0.0:1787397701.938100:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.938104:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938111:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d19124d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938124:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938129:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938135:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938140:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397701.938142:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938148:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938154:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397701.938156:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397701.938164:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938169:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191254 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938357:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d191246 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8195 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938372:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8195 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397701.938379:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a8132c5b00) 00010000:00010000:0.0:1787397701.938382:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397701.938383:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0600, rc 0) 00000100:00100000:0.0:1787397701.938472:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71909:x1874218681200256:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 4427us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397701.938480:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1353 00000100:00100000:0.0:1787397701.941562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.941728:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681200384 00000100:00100000:2.0:1787397701.941740:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681200384 00000100:00100000:2.0:1787397701.941807:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1354 00000100:00100000:2.0:1787397701.941817:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71909:x1874218681200384:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397701.941844:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397701.941862:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d191262 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d819c expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.941932:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191269 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.941945:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191269 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.941956:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191269 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397701.942015:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787397701.942019:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787397701.942059:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d191262 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d819c expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.942076:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191269 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d819c expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.942103:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:2.0:1787397701.942106:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787397701.942110:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1800, rc 0) 00000100:00100000:2.0:1787397701.942170:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71909:x1874218681200384:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 354us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397701.942177:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1354 00000100:00100000:1.0:1787397701.949517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.949786:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681200640 00000100:00100000:3.0:1787397701.949796:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681200640 00000100:00100000:3.0:1787397701.949857:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1355 00000100:00100000:3.0:1787397701.949867:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:71909:x1874218681200640:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397701.949887:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397701.949921:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d191270 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81a3 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397701.950040:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787397701.950145:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d191270 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81a3 expref: 16 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.950172:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a806066e00) 00010000:00010000:3.0:1787397701.950175:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397701.950181:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d191270 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81a3 expref: 16 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397701.950405:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22800, rc 0) 00000100:00100000:3.0:1787397701.950516:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:71909:x1874218681200640:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 650us (1008us total) trans 81604378759 rc 301/301 00000100:00100000:3.0:1787397701.950565:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1355 00000100:00100000:0.0:1787397701.954481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397701.954866:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681200896 00000100:00100000:2.0:1787397701.954876:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681200896 00000100:00100000:2.0:1787397701.955033:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1356 00000100:00100000:2.0:1787397701.955045:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:71909:x1874218681200896:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:2.0:1787397701.955105:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397701.955134:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1800/0x274786fe0d191269 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d819c expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.955154:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:2.0:1787397701.955159:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397701.955179:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.955205:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.955214:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397701.955352:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f3caf7 reply state 00000000a3710509 transno 81604378760 ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.955384:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397701.955391:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:2.0:1787397701.955393:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1787397701.955396:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787397701.955403:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1787397701.955577:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:71909:x1874218681200896:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 534us (1105us total) trans 81604378760 rc 0/0 00000100:00100000:2.0:1787397701.955585:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1356 00000100:00100000:1.0:1787397701.958123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397701.958216:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201152 00000100:00100000:3.0:1787397701.958226:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201152 00000100:00100000:3.0:1787397701.958279:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 238 00000100:00100000:3.0:1787397701.958288:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:71909:x1874218681201152:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397701.958489:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:71909:x1874218681201152:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 201us (374us total) trans 81604378761 rc 0/0 00000100:00100000:3.0:1787397701.958498:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 238 00010000:00010000:1.0:1787397702.500885:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787397702.750232:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378761 is committed 00010000:00010000:2.0:1787397702.750257:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750269:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750278:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750284:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.750289:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750297:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750316:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:2.0:1787397702.750319:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397702.750323:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750346:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191197 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750367:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750372:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750377:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750381:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.750384:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750390:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750398:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:2.0:1787397702.750400:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397702.750403:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750409:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d1911e4 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750419:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750425:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750436:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750442:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.750445:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750450:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750457:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a806066500) 00010000:00010000:2.0:1787397702.750460:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397702.750463:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750467:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19123f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750486:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750492:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750497:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750502:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.750504:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750537:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750547:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a806066800) 00010000:00010000:2.0:1787397702.750549:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397702.750552:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.750558:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a0a00/0x274786fe0d19127e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397702.839472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397702.840042:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201280 00000100:00100000:2.0:1787397702.840054:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201280 00000100:00100000:2.0:1787397702.840153:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1357 00000100:00100000:2.0:1787397702.840164:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71918:x1874218681201280:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397702.840214:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445036032 avail 1298796544 00000100:00100000:2.0:1787397702.840291:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71918:x1874218681201280:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 129us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397702.840300:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1357 00000100:00100000:1.0:1787397702.844758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397702.845869:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201408 00000100:00100000:0.0:1787397702.845881:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201408 00000100:00100000:0.0:1787397702.845954:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1358 00000100:00100000:0.0:1787397702.845964:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71918:x1874218681201408:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397702.846016:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397702.846082:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71918:x1874218681201408:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 119us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397702.846089:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1358 00000100:00100000:1.0:1787397702.852500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397702.852555:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201536 00000100:00100000:1.0:1787397702.852564:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201536 00000100:00100000:1.0:1787397702.852628:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2055 00000100:00100000:1.0:1787397702.852644:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71918:x1874218681201536:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397702.852677:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397702.852738:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71918:x1874218681201536:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397702.852745:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2055 00000100:00100000:1.0:1787397702.859479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397702.859713:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201664 00000100:00100000:3.0:1787397702.859723:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201664 00000100:00100000:3.0:1787397702.859770:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4981 00000100:00100000:3.0:1787397702.859778:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2401:x1874218681201664:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:3.0:1787397702.859815:0:26164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:3.0:1787397702.859842:0:26164:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d191285 00002000:00100000:3.0:1787397702.859854:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a709123800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397702.859878:0:26164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397702.859962:0:26164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787397702.860000:0:26164:0:(import.c:65:import_set_state_nolock()) ffff89a709121800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397702.860072:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681201664:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 293us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397702.860080:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4981 00000100:00100000:0.0:1787397702.862391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397702.862764:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681201792 00000100:00100000:3.0:1787397702.862774:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681201792 00000100:00100000:3.0:1787397702.862834:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2056 00000100:00100000:3.0:1787397702.862844:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71918:x1874218681201792:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397702.862866:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397702.863056:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71918:x1874218681201792:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 212us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397702.863064:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2056 00000100:00080000:0.0:1787397702.865893:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397702.949300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397702.949695:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202048 00000100:00100000:3.0:1787397702.949705:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202048 00000100:00100000:3.0:1787397702.949761:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1359 00000100:00100000:3.0:1787397702.949770:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71925:x1874218681202048:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:3.0:1787397702.949841:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397702.949870:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d1911a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d816b expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.949887:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:3.0:1787397702.949891:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397702.949952:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.949990:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950001:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950017:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950025:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950032:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950430:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950439:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950445:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950451:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950456:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397702.950460:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950468:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950483:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:3.0:1787397702.950485:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397702.950490:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950496:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19128c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397702.950508:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb42d627 reply state 000000008b0bef9b transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950538:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397702.950545:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d500) 00010000:00010000:3.0:1787397702.950548:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397702.950550:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397702.950639:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71925:x1874218681202048:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 869us (1345us total) trans 115964117001 rc 0/0 00000100:00100000:3.0:1787397702.950648:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1359 00000100:00100000:2.0:1787397702.975769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397702.975852:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202176 00000100:00100000:0.0:1787397702.975863:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202176 00000100:00100000:0.0:1787397702.975924:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1360 00000100:00100000:0.0:1787397702.975934:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71928:x1874218681202176:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397702.975965:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397702.976001:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d19129a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81aa expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976066:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976090:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976100:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397702.976146:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397702.976149:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397702.976168:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976190:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d19129a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81aa expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976207:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81aa expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.976235:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397702.976238:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397702.976242:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1200, rc 0) 00000100:00100000:0.0:1787397702.976310:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71928:x1874218681202176:12345-192.168.204.60@tcp:101:rm.0 Request processed in 377us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397702.976317:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1360 00000100:00100000:0.0:1787397702.981116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397702.981251:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202304 00000100:00100000:2.0:1787397702.981263:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202304 00000100:00100000:2.0:1787397702.981315:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1361 00000100:00100000:2.0:1787397702.981324:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71928:x1874218681202304:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397702.981347:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397702.981368:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d1912a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81b1 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981454:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981469:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981481:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981491:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981498:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981504:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981615:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981622:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981629:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397702.981674:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:2.0:1787397702.981678:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397702.981697:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981717:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981737:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981745:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981751:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981757:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981763:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.981767:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981774:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981786:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:2.0:1787397702.981788:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397702.981793:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981799:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d1912af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981811:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981822:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981828:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981834:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397702.981837:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981842:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981849:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d500) 00010000:00010000:2.0:1787397702.981852:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397702.981855:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981860:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1e00/0x274786fe0d1912b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981886:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d1912a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b1 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981899:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b1 expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397702.981906:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397702.981908:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397702.981915:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0200, rc 0) 00000100:00100000:2.0:1787397702.981988:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71928:x1874218681202304:12345-192.168.204.60@tcp:101:rm.0 Request processed in 653us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397702.981996:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1361 00000100:00100000:2.0:1787397702.984931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397702.985657:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202560 00000100:00100000:0.0:1787397702.985669:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202560 00000100:00100000:0.0:1787397702.985722:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1362 00000100:00100000:0.0:1787397702.985852:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71928:x1874218681202560:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397702.985909:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787397702.985936:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1912bd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b1 expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.985954:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:0.0:1787397702.985971:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81aa expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.985993:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397702.985996:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397702.986016:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986030:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986058:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986071:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986090:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986097:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986182:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986190:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986197:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986381:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986391:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986399:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986406:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986434:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986440:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986461:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397702.986479:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986485:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986492:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986498:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397702.986502:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986510:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986559:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff89a82ebb1800) 00010000:00010000:0.0:1787397702.986563:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397702.986567:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986573:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912d2 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986590:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986602:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986608:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986614:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986618:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397702.986621:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986627:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986635:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397702.986637:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397702.986640:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986646:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397702.986655:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056f66593 reply state 0000000070dbea15 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986665:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397702.986670:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d500) 00010000:00010000:0.0:1787397702.986678:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397702.986681:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397702.986770:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71928:x1874218681202560:12345-192.168.204.60@tcp:36:rm.0 Request processed in 920us (1849us total) trans 115964117002 rc 0/0 00010000:00010000:1.0:1787397702.987182:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397702.987190:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397702.987197:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397702.987201:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397702.987208:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397702.987218:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff89a82ebb1800) 00010000:00010000:1.0:1787397702.987220:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397702.987223:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397702.987228:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912d9 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397702.987241:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397702.987243:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397702.987244:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397702.987790:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1362 00010000:00010000:0.0:1787397703.525173:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397703.958413:0:93315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd7d5ba060 00000020:00000080:3.0:1787397703.958847:0:93315:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1787397703.958857:0:93315:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:1.0:1787397704.550261:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397704.676852:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701072768:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.676922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.676968:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701073280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.676994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677009:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701073792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677051:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787397704.677057:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701072640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677084:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701073152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677143:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701073664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677174:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701074176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677193:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397704.677222:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072768 00000100:00100000:0.0:1787397704.677229:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072768 00000100:00100000:0.0:1787397704.677275:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073152 00000100:00100000:0.0:1787397704.677278:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073152 00000100:00100000:0.0:1787397704.677294:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073664 00000100:00100000:0.0:1787397704.677297:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073664 00000100:00100000:0.0:1787397704.677319:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074176 00000100:00100000:0.0:1787397704.677321:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074176 00000100:00100000:0.0:1787397704.677333:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1787397704.677341:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701072768:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397704.677363:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a26a00 x1874218701072768/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:145/0 lens 224/224 e 0 to 0 dl 1787397715 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397704.677404:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701072768:12345-0@lo:400:kworker.0 Request processed in 63us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397704.677412:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1787397704.677432:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1787397704.677437:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701073152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.677461:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701073152:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397704.677467:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1787397704.677477:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1787397704.677482:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701073664:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397704.677491:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a25880 x1874218701073664/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:145/0 lens 224/224 e 0 to 0 dl 1787397715 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397704.677514:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701073664:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397704.677541:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1787397704.677553:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1787397704.679134:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701072896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679213:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679241:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701073408:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679296:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701073920:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679352:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787397704.679359:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701073024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679383:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679396:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701073536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679432:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701074048:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.679453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.679492:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073280 00000100:00100000:1.0:1787397704.679500:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073280 00000100:00100000:1.0:1787397704.680684:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073792 00000100:00100000:1.0:1787397704.680693:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073792 00000100:00100000:1.0:1787397704.680724:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1787397704.680733:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701073280:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787397704.680763:0:23942:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a26d80 x1874218701073280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:145/0 lens 224/224 e 0 to 0 dl 1787397715 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397704.680808:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701073280:12345-0@lo:400:kworker.0 Request processed in 77us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.680815:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1787397704.680835:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1787397704.680842:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.680882:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701073792:12345-0@lo:400:kworker.0 Request processed in 41us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.680889:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1787397704.680913:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073408 00000100:00100000:1.0:1787397704.680916:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073408 00000100:00100000:1.0:1787397704.680957:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073920 00000100:00100000:1.0:1787397704.680961:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073920 00000100:00100000:1.0:1787397704.680984:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073536 00000100:00100000:1.0:1787397704.680987:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073536 00000100:00100000:1.0:1787397704.681005:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1787397704.681011:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701073408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.681042:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701073408:12345-0@lo:400:kworker.0 Request processed in 32us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.681047:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1787397704.681057:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074048 00000100:00100000:1.0:1787397704.681060:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074048 00000100:00100000:1.0:1787397704.681083:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1787397704.681089:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.681113:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701073920:12345-0@lo:400:kworker.0 Request processed in 26us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.681119:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1787397704.681129:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1787397704.681134:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701073536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.681160:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701073536:12345-0@lo:400:kworker.0 Request processed in 26us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.681165:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1787397704.681175:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1787397704.681188:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701074048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.681216:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701074048:12345-0@lo:400:kworker.0 Request processed in 30us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.681221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1787397704.681249:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397704.681260:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701074304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397704.681303:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.681346:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074304 00000100:00100000:1.0:1787397704.681350:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074304 00000100:00100000:1.0:1787397704.681372:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1787397704.681377:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701074304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397704.681391:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397704.681420:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701074304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.681425:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1787397704.681445:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397704.681454:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701074432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397704.681480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.681542:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701074304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397704.682056:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701074560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397704.682088:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397704.682115:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074432 00000100:00100000:1.0:1787397704.682120:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074432 00000100:00100000:1.0:1787397704.682138:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074560 00000100:00100000:1.0:1787397704.682141:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074560 00000100:00100000:1.0:1787397704.682152:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1787397704.682158:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701074432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397704.682189:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445036032 avail 1298796544 00010000:00000080:1.0:1787397704.682203:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9f480 x1874218701074432/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:145/0 lens 224/368 e 0 to 0 dl 1787397715 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397704.682235:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701074432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.682242:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1787397704.682255:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1787397704.682260:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701074560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397704.682277:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397704.682301:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701074560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397704.682306:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1787397704.682334:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701074560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397704.682347:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701074432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397704.682379:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701073536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.682390:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701074048:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.682401:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701073408:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.682411:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701073920:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.684190:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072640 00000100:00100000:0.0:1787397704.684204:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072640 00000100:00100000:0.0:1787397704.684263:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787397704.684272:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701072640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397704.684657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397704.684663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397704.684666:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397704.684669:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397704.684681:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701072896 00000100:00100000:3.0:1787397704.684685:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701072896 00000100:00100000:3.0:1787397704.684713:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701073024 00000100:00100000:3.0:1787397704.684720:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701073024 00000100:00100000:3.0:1787397704.684735:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1787397704.684740:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397704.684786:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701072896:12345-0@lo:400:kworker.0 Request processed in 46us (5573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397704.684793:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1787397704.684808:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1787397704.684813:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701073024:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397704.684823:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a706f9dc00 x1874218701073024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:145/0 lens 224/224 e 0 to 0 dl 1787397715 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397704.684845:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701073024:12345-0@lo:400:kworker.0 Request processed in 33us (5462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397704.684851:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00080000:3.0:1787397704.684869:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397704.684871:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397704.684920:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701072640:12345-0@lo:400:kworker.0 Request processed in 649us (7835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397704.684928:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787397704.685743:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701072640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685759:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701073152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685769:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701073664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685779:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701072768:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685790:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701073280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685799:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701073792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397704.685835:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701074176:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397704.686394:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bb8a80 x1874218701074176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:145/0 lens 224/224 e 0 to 0 dl 1787397715 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397704.686455:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701074176:12345-0@lo:400:kworker.0 Request processed in 8896us (9261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397704.686464:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1787397704.686793:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701074176:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.688298:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701073024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397704.688318:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701072896:0@lo:400:kworker.0 00000100:00100000:0.0:1787397705.189843:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397705.189869:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701074688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397705.189950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397705.190035:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074688 00000100:00100000:3.0:1787397705.190044:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074688 00000100:00100000:3.0:1787397705.190104:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1787397705.190113:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701074688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397705.190150:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397705.190194:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701074688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397705.190212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1787397705.190379:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701074688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787397705.573697:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397705.700711:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397705.700735:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701074816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397705.700807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397705.700875:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074816 00000100:00100000:1.0:1787397705.700882:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074816 00000100:00100000:1.0:1787397705.700950:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1787397705.700959:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701074816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397705.700983:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397705.701029:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701074816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397705.701036:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1787397705.701081:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701074816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397705.701473:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397705.701491:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397705.701552:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397705.701653:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701074944 00000100:00100000:0.0:1787397705.701658:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701074944 00000100:00100000:0.0:1787397705.701694:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1787397705.701718:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701074944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397705.701738:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397705.701773:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701074944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397705.701779:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1787397705.702317:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397706.502867:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397706.502926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397706.502970:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397706.502996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397706.503022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397706.503059:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203200 00000100:00100000:1.0:1787397706.503068:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203200 00000100:00100000:1.0:1787397706.503122:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203072 00000100:00100000:1.0:1787397706.503126:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203072 00000100:00100000:1.0:1787397706.503151:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2582 00000100:00100000:1.0:1787397706.503162:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681203200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397706.503233:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681203200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397706.503240:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2582 00000100:00100000:1.0:1787397706.503259:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2583 00000100:00100000:1.0:1787397706.503278:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681203072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397706.503306:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681203072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397706.503312:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2583 00000100:00100000:1.0:1787397706.503331:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202944 00000100:00100000:1.0:1787397706.503335:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202944 00000100:00100000:1.0:1787397706.503360:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202816 00000100:00100000:1.0:1787397706.503363:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202816 00000100:00100000:1.0:1787397706.503384:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1330 00000100:00100000:1.0:1787397706.503389:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681202944:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397706.503415:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681202944:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397706.503421:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1330 00000100:00100000:1.0:1787397706.503433:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1331 00000100:00100000:1.0:1787397706.503439:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681202816:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787397706.503456:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a27100 x1874218681202816/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:147/0 lens 224/224 e 0 to 0 dl 1787397717 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397706.503477:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681202816:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397706.503483:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1331 00000100:00080000:1.0:1787397706.503502:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397706.503506:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397706.503508:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397706.503510:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397706.503865:0:92422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202688 00000100:00100000:3.0:1787397706.503870:0:92422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202688 00000100:00100000:3.0:1787397706.503926:0:92422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 172 00000100:00100000:3.0:1787397706.503933:0:92422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681202688:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397706.503971:0:92422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681202688:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397706.503977:0:92422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 172 00010000:00010000:1.0:1787397706.600709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397707.621664:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397708.644699:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787397708.777008:0:92415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:2.0:1787397708.777675:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777690:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777698:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777705:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397708.777710:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777718:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777736:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d500) 00010000:00010000:2.0:1787397708.777740:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397708.777744:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777763:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191293 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777782:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777789:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777795:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777801:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397708.777804:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777810:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777819:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d500) 00010000:00010000:2.0:1787397708.777821:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397708.777824:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397708.777830:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787397708.780010:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:02000400:1.0:1787397709.099266:0:93611:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1787397709.180983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.182842:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203328 00000100:00100000:0.0:1787397709.182867:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203328 00000100:00100000:0.0:1787397709.182954:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1363 00000100:00100000:0.0:1787397709.182964:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71995:x1874218681203328:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.182983:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.183004:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81b8 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183070:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183084:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183096:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397709.183140:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787397709.183143:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397709.183177:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183202:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0e00/0x274786fe0d1912e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b8 expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183239:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b8 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.183247:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8191cdc00) 00010000:00010000:0.0:1787397709.183250:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397709.183255:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1000, rc 0) 00010000:00000080:0.0:1787397709.183265:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a24700 x1874218681203328/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:150/0 lens 576/688 e 0 to 0 dl 1787397720 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397709.183328:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71995:x1874218681203328:12345-192.168.204.60@tcp:101:touch.0 Request processed in 366us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.183337:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1363 00000100:00080000:1.0:1787397709.183389:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397709.193253:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.193374:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203456 00000100:00100000:0.0:1787397709.193384:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203456 00000100:00100000:0.0:1787397709.193439:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1364 00000100:00100000:0.0:1787397709.193449:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71995:x1874218681203456:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.193470:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.193489:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912ee lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81bf expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193598:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193613:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193625:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193652:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193659:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193667:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193725:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193734:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193741:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397709.193761:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193774:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193781:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193787:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.193794:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194036:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397709.194040:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194048:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194060:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:0.0:1787397709.194063:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397709.194067:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194073:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0a00/0x274786fe0d1912f5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194085:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194091:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194096:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194101:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397709.194104:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194110:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194129:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397709.194131:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397709.194134:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194139:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0c00/0x274786fe0d1912fc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194171:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1200/0x274786fe0d1912ee lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81bf expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194183:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81bf expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.194190:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a817ea6700) 00010000:00010000:0.0:1787397709.194192:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397709.194194:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030600, rc 0) 00010000:00000080:0.0:1787397709.194202:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af24380 x1874218681203456/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:150/0 lens 576/584 e 0 to 0 dl 1787397720 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397709.194264:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71995:x1874218681203456:12345-192.168.204.60@tcp:101:touch.0 Request processed in 817us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.194271:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1364 00000100:00100000:1.0:1787397709.197416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.197481:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203584 00000100:00100000:0.0:1787397709.197492:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203584 00000100:00100000:0.0:1787397709.197592:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1365 00000100:00100000:0.0:1787397709.197602:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:71995:x1874218681203584:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.197621:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.197650:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d19130a lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81c6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397709.197663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397709.197707:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191311 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.197721:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191311 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.197732:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191311 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397709.197776:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1787397709.197780:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787397709.197837:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030e00/0x274786fe0d19130a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81c6 expref: 7 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.197864:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191311 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81c6 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.197873:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:0.0:1787397709.197876:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787397709.197880:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031c00, rc 0) 00000100:00100000:0.0:1787397709.197937:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71995:x1874218681203584:12345-192.168.204.60@tcp:101:touch.0 Request processed in 337us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.197945:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1365 00000100:00100000:3.0:1787397709.198757:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.199151:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203712 00000100:00100000:0.0:1787397709.199159:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203712 00000100:00100000:0.0:1787397709.199244:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 668 00000100:00100000:0.0:1787397709.199253:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681203712:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397709.199274:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397709.199293:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030600/0x274786fe0d191303 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81bf expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.199308:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a817ea6700) 00010000:00010000:0.0:1787397709.199311:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397709.199353:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681203712:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 101us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.199359:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 668 00000100:00100000:1.0:1787397709.204628:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.204663:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681203968 00000100:00100000:1.0:1787397709.204680:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681203968 00000100:00100000:1.0:1787397709.204736:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1366 00000100:00100000:1.0:1787397709.204746:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:71995:x1874218681203968:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397709.204768:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397709.204787:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d191318 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81cd expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.204916:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.204933:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.204944:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.204959:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.205194:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.205214:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397709.205921:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701075072:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787397709.205971:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397709.205999:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a810c4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397709.206024:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075072 00000100:00100000:1.0:1787397709.206028:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075072 00000100:00100000:1.0:1787397709.206061:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1787397709.206067:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66177:x1874218701075072:12345-0@lo:1000:mdt00_001.0 00010000:00000080:1.0:1787397709.206103:0:8446:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a24e00 x1874218701075072/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:150/0 lens 328/4320 e 0 to 0 dl 1787397720 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397709.206141:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66177:x1874218701075072:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397709.206148:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1787397709.206196:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701075072:0@lo:1000:mdt00_001.0 00000004:00080000:1.0:1787397709.208937:0:66177:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xd1:0x0], count =369 00000004:00080000:1.0:1787397709.208950:0:66177:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xd1:0x0]+369 in llog 00000004:00080000:1.0:1787397709.208960:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:1.0:1787397709.209141:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d19132d lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209156:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d19132d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209168:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d19132d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209217:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209225:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209231:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209237:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209243:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397709.209246:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209253:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209266:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:1.0:1787397709.209269:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397709.209274:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209280:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d19131f lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397709.209294:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008045fa65 reply state 00000000fea7dc93 transno 81604378762 ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209303:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209318:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff89a81ab06300) 00010000:00010000:1.0:1787397709.209320:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397709.209323:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397709.209361:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d191318 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81cd expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209378:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d19132d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81cd expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.209386:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a81ab06600) 00010000:00010000:1.0:1787397709.209389:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397709.209391:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00000100:00100000:1.0:1787397709.212076:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71995:x1874218681203968:12345-192.168.204.60@tcp:101:touch.0 Request processed in 7319us (7444us total) trans 81604378762 rc 0/0 00000100:00100000:1.0:1787397709.212090:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1366 00000100:00100000:0.0:1787397709.217388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397709.217568:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204224 00000100:00100000:2.0:1787397709.217579:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204224 00000100:00100000:0.0:1787397709.217700:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1367 00000100:00100000:0.0:1787397709.217708:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71995:x1874218681204224:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:0.0:1787397709.217758:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397709.217782:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d19132d lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81cd expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.217812:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a81ab06600) 00010000:00010000:0.0:1787397709.217824:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397709.217885:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.217898:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.217907:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397709.217997:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7bd1105 reply state 0000000046a715bc transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.218014:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.218020:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:0.0:1787397709.218023:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397709.218025:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397709.218108:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71995:x1874218681204224:12345-192.168.204.60@tcp:36:touch.0 Request processed in 400us (728us total) trans 81604378763 rc 0/0 00000100:00100000:0.0:1787397709.218115:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1367 00000100:00100000:3.0:1787397709.223973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397709.224109:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204352 00000100:00100000:2.0:1787397709.224121:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204352 00000100:00100000:2.0:1787397709.224182:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1368 00000100:00100000:2.0:1787397709.224193:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71995:x1874218681204352:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397709.224220:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397709.224241:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1e00/0x274786fe0d191342 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81d4 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397709.224303:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1e00/0x274786fe0d191342 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81d4 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397709.224319:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1e00/0x274786fe0d191342 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81d4 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397709.224338:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:2.0:1787397709.224341:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397709.224345:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1e00, rc 0) 00000100:00100000:2.0:1787397709.224413:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71995:x1874218681204352:12345-192.168.204.60@tcp:101:touch.0 Request processed in 222us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.224421:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1368 00000100:00100000:3.0:1787397709.228606:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.228690:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204480 00000100:00100000:0.0:1787397709.228701:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204480 00000100:00100000:0.0:1787397709.228772:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4982 00000100:00100000:0.0:1787397709.228783:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681204480:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:0.0:1787397709.229015:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681204480:12345-192.168.204.60@tcp:2:touch.0 Request processed in 234us (419us total) trans 4294968729 rc 0/0 00000100:00100000:0.0:1787397709.229025:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4982 00000100:00080000:3.0:1787397709.229159:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397709.239433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.239549:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204736 00000100:00100000:1.0:1787397709.239560:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204736 00000100:00100000:1.0:1787397709.239619:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 239 00000100:00100000:1.0:1787397709.239629:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71995:x1874218681204736:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:1.0:1787397709.239930:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71995:x1874218681204736:12345-192.168.204.60@tcp:35:touch.0 Request processed in 300us (505us total) trans 81604378764 rc 0/0 00000100:00100000:1.0:1787397709.239938:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 239 00000100:00100000:1.0:1787397709.257648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.257925:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204864 00000100:00100000:0.0:1787397709.257936:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204864 00000100:00100000:0.0:1787397709.257996:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1369 00000100:00100000:0.0:1787397709.258007:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71996:x1874218681204864:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.258029:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.258051:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d191349 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81db expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258127:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258153:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258166:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258182:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258190:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258196:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258260:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258269:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258277:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397709.258298:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258312:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258319:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258335:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258342:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258348:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397709.258352:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258360:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258371:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:0.0:1787397709.258374:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397709.258378:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258384:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030200/0x274786fe0d191350 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258397:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258403:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258409:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258414:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397709.258424:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258431:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258439:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff89a82ebb1400) 00010000:00010000:0.0:1787397709.258442:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397709.258445:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258450:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191357 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258483:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031400/0x274786fe0d191349 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81db expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258496:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81db expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.258503:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a8132c5b00) 00010000:00010000:0.0:1787397709.258506:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397709.258509:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030e00, rc 0) 00010000:00000080:0.0:1787397709.258516:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a705a24380 x1874218681204864/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:150/0 lens 576/584 e 0 to 0 dl 1787397720 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397709.258615:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71996:x1874218681204864:12345-192.168.204.60@tcp:101:touch.0 Request processed in 609us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.258622:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1369 00000100:00100000:1.0:1787397709.262176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.262221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.262746:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681205120 00000100:00100000:1.0:1787397709.262767:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681205120 00000100:00100000:1.0:1787397709.262834:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 669 00000100:00100000:1.0:1787397709.262843:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681205120:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397709.262871:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397709.262895:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d19135e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81db expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.262912:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a8132c5b00) 00010000:00010000:1.0:1787397709.262918:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397709.262974:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681205120:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 132us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397709.262984:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 669 00000100:00100000:0.0:1787397709.263801:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681204992 00000100:00100000:0.0:1787397709.263817:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681204992 00000100:00100000:0.0:1787397709.263877:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1370 00000100:00100000:0.0:1787397709.263887:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71996:x1874218681204992:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.263906:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.263928:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1200/0x274786fe0d191365 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81e2 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.263985:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0c00/0x274786fe0d19136c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.263997:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0c00/0x274786fe0d19136c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.264008:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0c00/0x274786fe0d19136c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397709.264051:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787397709.264055:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787397709.264091:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f1200/0x274786fe0d191365 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e2 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.264108:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0c00/0x274786fe0d19136c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e2 expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.264116:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:0.0:1787397709.264119:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787397709.264122:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f0c00, rc 0) 00000100:00100000:0.0:1787397709.264164:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71996:x1874218681204992:12345-192.168.204.60@tcp:101:touch.0 Request processed in 279us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397709.264181:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1370 00000100:00100000:3.0:1787397709.272095:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397709.272183:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681205376 00000100:00100000:0.0:1787397709.272194:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681205376 00000100:00100000:0.0:1787397709.272258:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1371 00000100:00100000:0.0:1787397709.272268:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:71996:x1874218681205376:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397709.272290:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397709.272312:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0e00/0x274786fe0d191373 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81e9 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272430:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272444:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272454:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272480:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272489:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.272497:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787397709.272919:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00010000:00010000:0.0:1787397709.273063:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d191388 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273079:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d191388 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273086:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d191388 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273123:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273130:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 2/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273136:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273142:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397709.273146:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273159:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273171:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:0.0:1787397709.273174:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397709.273178:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273184:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0a00/0x274786fe0d19137a lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397709.273197:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003fe028a0 reply state 00000000de8573ec transno 81604378765 ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273214:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273220:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff89a82ebb1400) 00010000:00010000:0.0:1787397709.273222:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397709.273225:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787397709.273258:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0e00/0x274786fe0d191373 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e9 expref: 16 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273271:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d191388 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e9 expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397709.273278:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a82ebb1900) 00010000:00010000:0.0:1787397709.273280:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397709.273283:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00000100:00100000:0.0:1787397709.273355:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:71996:x1874218681205376:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1087us (1270us total) trans 81604378765 rc 0/0 00000100:00100000:0.0:1787397709.273363:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1371 00000100:00100000:0.0:1787397709.278840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.278970:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681205632 00000100:00100000:1.0:1787397709.278981:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681205632 00000100:00100000:1.0:1787397709.279041:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1372 00000100:00100000:1.0:1787397709.279051:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:71996:x1874218681205632:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:1.0:1787397709.279111:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397709.279140:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031000/0x274786fe0d191388 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e9 expref: 16 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.279159:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a82ebb1900) 00010000:00010000:1.0:1787397709.279169:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397709.279243:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.279257:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.279283:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397709.279390:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8f88ccf reply state 0000000064eb793a transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.279403:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.279408:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:1.0:1787397709.279411:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397709.279413:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397709.279597:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:71996:x1874218681205632:12345-192.168.204.60@tcp:36:touch.0 Request processed in 547us (765us total) trans 81604378766 rc 0/0 00000100:00100000:1.0:1787397709.279605:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1372 00000100:00100000:0.0:1787397709.281827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.281972:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681205760 00000100:00100000:1.0:1787397709.281982:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681205760 00000100:00100000:1.0:1787397709.282043:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1373 00000100:00100000:1.0:1787397709.282053:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:71996:x1874218681205760:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397709.282079:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397709.282100:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75600/0x274786fe0d19139d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81f0 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.282151:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75600/0x274786fe0d19139d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f0 expref: 18 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.282164:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75600/0x274786fe0d19139d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f0 expref: 18 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397709.282218:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:1.0:1787397709.282221:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787397709.282224:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75600, rc 0) 00000100:00100000:1.0:1787397709.282352:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:71996:x1874218681205760:12345-192.168.204.60@tcp:101:touch.0 Request processed in 300us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397709.282360:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1373 00000100:00100000:1.0:1787397709.294184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397709.294245:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681205888 00000100:00100000:1.0:1787397709.294257:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681205888 00000100:00100000:1.0:1787397709.294311:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4983 00000100:00100000:1.0:1787397709.294321:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681205888:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:1.0:1787397709.295785:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681205888:12345-192.168.204.60@tcp:2:touch.0 Request processed in 1456us (1602us total) trans 4294968730 rc 0/0 00000100:00100000:1.0:1787397709.295798:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4983 00000100:00100000:0.0:1787397709.305868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397709.305949:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206144 00000100:00100000:3.0:1787397709.305960:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206144 00000100:00100000:3.0:1787397709.306018:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 240 00000100:00100000:3.0:1787397709.306029:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:71996:x1874218681206144:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:3.0:1787397709.306354:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:71996:x1874218681206144:12345-192.168.204.60@tcp:35:touch.0 Request processed in 325us (502us total) trans 81604378767 rc 0/0 00000100:00100000:3.0:1787397709.306364:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 240 00010000:00010000:0.0:1787397709.668906:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397709.797953:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701075200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397709.798026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.798077:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701075328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397709.798105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.798139:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075200 00000100:00100000:2.0:1787397709.798146:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075200 00000100:00100000:2.0:1787397709.798185:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1787397709.798200:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701075200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397709.798235:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445036032 avail 1298796544 00010000:00000080:2.0:1787397709.798250:0:8445:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70698d180 x1874218701075200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:150/0 lens 224/368 e 0 to 0 dl 1787397720 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397709.798292:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701075200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.798300:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1787397709.798323:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075328 00000100:00100000:2.0:1787397709.798327:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075328 00000100:00100000:2.0:1787397709.798362:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1787397709.798369:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701075328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397709.798389:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397709.798421:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701075328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.798427:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1787397709.798481:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701075200:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787397709.798502:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397709.798546:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701075328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397709.799885:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701075456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.799944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.799990:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701075968:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800018:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800039:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701076480:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800094:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787397709.800100:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701075840:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800141:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701076352:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800194:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701075584:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800217:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800233:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701076096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800271:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701076608:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800306:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397709.800311:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701075712:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800347:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701076224:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800381:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701076736:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.800399:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.800429:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075968 00000100:00100000:2.0:1787397709.800436:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075968 00000100:00100000:1.0:1787397709.800573:0:92421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075456 00000100:00100000:1.0:1787397709.800578:0:92421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075456 00000100:00100000:1.0:1787397709.800859:0:92421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787397709.800870:0:92421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701075456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397709.800927:0:92421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701075456:12345-0@lo:400:kworker.0 Request processed in 58us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397709.800934:0:92421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787397709.801877:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701076864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397709.801923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397709.801990:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075840 00000100:00100000:2.0:1787397709.801996:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075840 00000100:00100000:2.0:1787397709.802018:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076352 00000100:00100000:2.0:1787397709.802022:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076352 00000100:00100000:2.0:1787397709.802034:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075584 00000100:00100000:2.0:1787397709.802037:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075584 00000100:00100000:2.0:1787397709.802049:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701075712 00000100:00100000:2.0:1787397709.802059:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701075712 00000100:00100000:2.0:1787397709.802076:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076736 00000100:00100000:2.0:1787397709.802078:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076736 00000100:00100000:2.0:1787397709.802091:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1787397709.802097:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701075968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.802137:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701075968:12345-0@lo:400:kworker.0 Request processed in 39us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802143:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1787397709.802157:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1787397709.802163:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701075840:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397709.802173:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678d500 x1874218701075840/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:150/0 lens 224/224 e 0 to 0 dl 1787397720 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397709.802196:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701075840:12345-0@lo:400:kworker.0 Request processed in 35us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802201:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1787397709.802210:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1787397709.802215:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701076352:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397709.802224:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678f480 x1874218701076352/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:150/0 lens 224/224 e 0 to 0 dl 1787397720 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397709.802244:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701076352:12345-0@lo:400:kworker.0 Request processed in 29us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802249:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1787397709.802258:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1787397709.802264:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701075584:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397709.802273:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af25f80 x1874218701075584/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:150/0 lens 224/224 e 0 to 0 dl 1787397720 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397709.802325:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701075584:12345-0@lo:400:kworker.0 Request processed in 61us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802332:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1787397709.802345:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1787397709.802350:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701075712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.802378:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701075712:12345-0@lo:400:kworker.0 Request processed in 28us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802384:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1787397709.802394:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1787397709.802400:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701076736:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397709.802410:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a806b5ea00 x1874218701076736/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:150/0 lens 224/224 e 0 to 0 dl 1787397720 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397709.802433:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701076736:12345-0@lo:400:kworker.0 Request processed in 34us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.802438:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1787397709.803631:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701075712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397709.803660:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701076736:0@lo:400:kworker.0 00000100:00100000:1.0:1787397709.803672:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701075584:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.803893:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076480 00000100:00100000:2.0:1787397709.803899:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076480 00000100:00100000:2.0:1787397709.803946:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076864 00000100:00100000:2.0:1787397709.803949:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076864 00000100:00100000:2.0:1787397709.803966:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1787397709.803973:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701076480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.804044:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701076480:12345-0@lo:400:kworker.0 Request processed in 71us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.804051:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1787397709.804066:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:2.0:1787397709.804080:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701076864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397709.804106:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397709.804147:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701076864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.804153:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:2.0:1787397709.804190:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076096 00000100:00100000:2.0:1787397709.804193:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076096 00000100:00100000:2.0:1787397709.804223:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076608 00000100:00100000:2.0:1787397709.804225:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076608 00000100:00100000:2.0:1787397709.804245:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076224 00000100:00100000:2.0:1787397709.804248:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076224 00000100:00100000:2.0:1787397709.804270:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1787397709.804277:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.804316:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701076096:12345-0@lo:400:kworker.0 Request processed in 39us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.804322:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1787397709.804333:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1787397709.804339:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.804366:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701076608:12345-0@lo:400:kworker.0 Request processed in 27us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.804372:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1787397709.804381:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:2.0:1787397709.804387:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.804416:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701076224:12345-0@lo:400:kworker.0 Request processed in 29us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397709.804421:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00080000:2.0:1787397709.804453:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397709.804979:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701076864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397709.805017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701075840:0@lo:400:kworker.0 00000100:00100000:3.0:1787397709.805030:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701076352:0@lo:400:kworker.0 00000100:00100000:3.0:1787397709.805040:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701075456:0@lo:400:kworker.0 00000100:00100000:3.0:1787397709.805050:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701075968:0@lo:400:kworker.0 00000100:00100000:3.0:1787397709.805058:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701076480:0@lo:400:kworker.0 00000100:00080000:2.0:1787397709.805680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397709.805683:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397709.805686:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397709.805720:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701076224:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.805731:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701076096:0@lo:400:kworker.0 00000100:00100000:2.0:1787397709.805740:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701076608:0@lo:400:kworker.0 00000100:00100000:1.0:1787397710.309541:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397710.309566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701076992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397710.309637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397710.309730:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701076992 00000100:00100000:3.0:1787397710.309739:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701076992 00000100:00100000:3.0:1787397710.311246:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1787397710.311268:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701076992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397710.311309:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397710.311389:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701076992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397710.311397:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1787397710.312281:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701076992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787397710.694724:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787397710.806248:0:93708:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787397710.806307:0:93708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.806322:0:93708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.806345:0:93708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.806353:0:93708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.806377:0:93708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787397710.806382:0:93708:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787397710.806410:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397710.806414:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787397710.806419:0:93708:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787397710.806442:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397710.806475:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701077120:0@lo:39:umount.0 00000100:00100000:0.0:1787397710.806561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397710.806989:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077120 00000100:00100000:2.0:1787397710.806999:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077120 00000100:00100000:2.0:1787397710.807050:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1787397710.807059:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701077120:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397710.807086:0:74374:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190d0d 00000100:00080000:2.0:1787397710.807102:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a8037dc800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1787397710.807127:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bba680 x1874218701077120/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:151/0 lens 224/224 e 0 to 0 dl 1787397721 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397710.807175:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218701077120:12345-0@lo:39:umount.0 Request processed in 117us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397710.807182:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000020:00000080:2.0:1787397710.807194:0:74374:0:(genops.c:906:class_export_put()) final put ffff89a8037da800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1787397710.807271:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787397710.807282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701077120:0@lo:39:umount.0 00000100:00080000:0.0:1787397710.807455:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397710.807458:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787397710.807462:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787397710.808784:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397710.808797:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.808809:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397710.808814:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.808836:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397710.808844:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397710.808850:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787397710.808853:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787397710.808857:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787397710.808894:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.808901:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397710.808926:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.808948:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f0800/0x274786fe0d1910a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910a9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.808961:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.808963:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.808964:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.808970:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397710.809328:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8037da800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1787397710.810311:0:93708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810325:0:93708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810333:0:93708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810340:0:93708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810364:0:93708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397710.810377:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397710.810382:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810389:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397710.810393:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810402:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397710.810409:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397710.810415:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397710.810417:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787397710.810442:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810448:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397710.810459:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810465:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1910b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1910b7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810479:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.810481:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.810489:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.810503:0:93708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810512:0:93708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810518:0:93708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810546:0:93708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810561:0:93708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397710.810571:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397710.810576:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810582:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397710.810586:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810593:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397710.810600:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397710.810605:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397710.810607:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787397710.810609:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787397710.810635:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.810641:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1787397710.810962:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8037dc800 for lustre-MDT0000 00010000:00010000:0.0:1787397710.811943:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.811954:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a000/0x274786fe0d190c11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190c18 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.811968:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.811970:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.811972:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397710.812142:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397710.812164:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701077504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397710.812212:0:93708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812221:0:93708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812228:0:93708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812235:0:93708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.812236:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397710.812259:0:93708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397710.812269:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397710.812274:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812281:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397710.812296:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.812302:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077504 00010000:00010000:0.0:1787397710.812306:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.812312:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077504 10000000:00010000:0.0:1787397710.812315:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397710.812323:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787397710.812325:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787397710.812327:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787397710.812353:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812360:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397710.812367:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00010000:00010000:0.0:1787397710.812374:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.812382:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b000/0x274786fe0d190be0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190be7 expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.812385:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701077504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397710.812401:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.812404:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397710.812405:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397710.812407:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397710.812847:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1400/0x274786fe0d190c18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190c11 expref: 24 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397710.812864:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397710.812902:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701077504:12345-0@lo:103:ldlm_bl.0 Request processed in 518us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397710.812910:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1787397710.812937:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701077632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397710.812963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397710.812995:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701077504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397710.813019:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077632 00000100:00100000:2.0:1787397710.813022:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077632 00000100:00100000:2.0:1787397710.813049:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1787397710.813055:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701077632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397710.813063:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397710.813073:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1c00/0x274786fe0d190be7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190be0 expref: 23 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397710.813082:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397710.813107:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701077632:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397710.813112:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1787397710.813133:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701077632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397710.813816:0:93708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.813839:0:93708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.813846:0:93708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.813866:0:93708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.813884:0:93708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787397710.813890:0:93708:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787397710.813894:0:93708:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787397710.813934:0:93708:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787397710.813939:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787397710.813943:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787397710.813949:0:93708:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1787397710.814736:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.814925:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787397710.814933:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397710.814935:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.814946:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397710.814950:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.814960:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397710.814968:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.814984:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:1.0:1787397710.814984:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787397710.814990:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787397710.814993:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1787397710.814997:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.815026:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.815029:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397710.815039:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787397710.815048:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787397710.815052:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.815059:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.815073:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f1800/0x274786fe0d190b07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d190b0e expref: -99 pid: 92414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397710.815087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397710.815087:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.815091:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.815094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397710.815120:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077376 00000100:00100000:2.0:1787397710.815124:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077248 00000100:00100000:1.0:1787397710.815127:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077376 00000100:00100000:2.0:1787397710.815130:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077248 00000100:00100000:2.0:1787397710.815174:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077760 00000100:00100000:2.0:1787397710.815177:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077760 00000100:00100000:1.0:1787397710.815842:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1787397710.815855:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8197d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701077248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.815868:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397710.815885:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75e00/0x274786fe0d1910a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910a2 expref: 24 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397710.815899:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397710.815946:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8197d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701077248:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.815953:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1787397710.816239:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1787397710.816250:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1787397710.816252:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701077376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.816263:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787397710.816265:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701077760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397710.816275:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0400/0x274786fe0d1910b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910b0 expref: 22 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397710.816277:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397710.816289:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397710.816293:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63e00/0x274786fe0d190b0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190b07 expref: 21 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397710.816307:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397710.816319:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218701077376:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397710.816341:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218701077760:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.816341:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1787397710.816352:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1787397710.817144:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397710.817156:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397710.817163:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701077376:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1787397710.819284:0:93708:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1787397710.819744:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1787397710.819754:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a706d36800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397710.819772:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397710.819776:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7050a3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397710.819782:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7090fb000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:3.0:1787397710.819787:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a837bc0000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117000 stale:0 00000020:00080000:3.0:1787397710.819791:0:93708:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a829b93380) has exports, disconnecting them 00000020:00080000:3.0:1787397710.819796:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a706d36800), last request at 1787397684 00000020:00000080:3.0:1787397710.819802:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190d06 00000100:00080000:3.0:1787397710.819810:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a706d32000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397710.819841:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a706d36800): rc 0 00000020:00000080:3.0:1787397710.819843:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a706d36800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787397710.819859:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b1f000), last request at 1787397709 00000020:00000080:3.0:1787397710.819863:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190cff 00000100:00080000:3.0:1787397710.819866:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a829b18800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397710.819881:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1f000): rc 0 00000020:00000080:3.0:1787397710.819883:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787397710.819888:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7050a3000), last request at 1787397709 00000020:00000080:3.0:1787397710.819892:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190cf8 00000100:00080000:3.0:1787397710.819896:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a7050a2800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787397710.819930:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d36800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397710.819993:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397710.820011:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706d32000 for lustre-MDT0000 00000020:00000080:2.0:1787397710.820016:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b18800 for lustre-MDT0000 00000020:00080000:3.0:1787397710.820147:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7050a3000): rc 0 00000020:00000080:3.0:1787397710.820150:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7050a3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787397710.820158:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a7090fb000), last request at 1787397709 00000020:00000080:3.0:1787397710.820165:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b62 00000020:00010000:3.0:1787397710.820177:0:93708:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7090fb000: total 1 00000100:00080000:3.0:1787397710.820180:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a829b1e800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787397710.820204:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7090fb000: total 1 00010000:00010000:0.0:1787397710.820209:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.820251:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7090fb000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1787397710.820289:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0200/0x274786fe0d191200 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8179 expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.820328:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f1000/0x274786fe0d1912e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81b8 expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.820342:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345f0600/0x274786fe0d19125b lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8195 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.820359:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19121c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8180 expref: 5 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397710.820373:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7090fb000, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1787397710.820459:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397710.822186:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397710.822238:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7050a2800 for lustre-MDT0000 00000020:00080000:3.0:1787397710.822303:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a7090fb000): rc 0 00000020:00080000:3.0:1787397710.822308:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a837bc0000), last request at 1787397678 00000020:00000080:3.0:1787397710.822314:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b5b 00000020:00010000:3.0:1787397710.822337:0:93708:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a837bc0000: total 0 00000100:00080000:3.0:1787397710.822341:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a8037dd000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397710.822364:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a837bc0000): rc 0 00000004:00000080:3.0:1787397710.822370:0:93708:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe40d7fae0 00000100:00080000:3.0:1787397710.822389:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397710.822393:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1787397710.822468:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a837bc0000: total 0 00010000:00010000:2.0:1787397710.822552:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a837bc0000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787397710.822588:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d190e09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 2 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397710.822625:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a837bc0000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787397710.822638:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.822647:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397710.822712:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397710.822782:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397710.823438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701077888 00000100:00100000:1.0:1787397710.823448:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701077888 00000100:00100000:1.0:1787397710.823494:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1787397710.823503:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701077888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397710.823876:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397710.824392:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701077888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 441us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.824403:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1787397710.824463:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701077888:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397710.831717:0:93708:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787397710.831751:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a8364e1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787397710.831916:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701078144:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787397710.831932:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397710.831938:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968730 gen 3 00000004:00080000:3.0:1787397710.831950:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397710.831996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397710.832036:0:93708:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787397710.832046:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a703c37800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787397710.832053:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787397710.832056:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968728 gen 3 00000100:00100000:1.0:1787397710.832056:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078144 00000100:00100000:1.0:1787397710.832065:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078144 00000004:00080000:3.0:1787397710.832068:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397710.832120:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1787397710.832129:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701078144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397710.832162:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397710.832203:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701078144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.832211:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1787397710.832235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078016:0@lo:39:umount.0 00000100:00100000:1.0:1787397710.832270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397710.832287:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078272:0@lo:9:umount.0 00000100:00100000:1.0:1787397710.832305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397710.832329:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078272 00000100:00100000:1.0:1787397710.832332:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078272 00000100:00100000:1.0:1787397710.832355:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4984 00000100:00100000:1.0:1787397710.832362:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701078272:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787397710.832380:0:26168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190baf 00000100:00080000:1.0:1787397710.832388:0:26168:0:(import.c:65:import_set_state_nolock()) ffff89a7037c1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397710.832424:0:26168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968731 00000100:00080000:3.0:1787397710.832550:0:93708:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787397710.832565:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a828782800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787397710.832566:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701078272:12345-0@lo:9:umount.0 Request processed in 202us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.832577:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4984 00000100:00100000:1.0:1787397710.832627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701078144:0@lo:13:osp-pre-1-1.0 00000020:00080000:3.0:1787397710.832632:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a829b93380) has no exports 00000100:00100000:1.0:1787397710.832650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078400:0@lo:9:umount.0 00000100:00100000:1.0:1787397710.832676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397710.832686:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078016 00000100:00100000:3.0:1787397710.832692:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078016 00000100:00080000:1.0:1787397710.832703:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a703c37800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787397710.832714:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787397710.832716:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397710.832719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078272:0@lo:9:umount.0 00000100:00100000:3.0:1787397710.832727:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1787397710.832736:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701078016:12345-0@lo:39:umount.0 00000100:00100000:1.0:1787397710.832744:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078400 00000100:00100000:1.0:1787397710.832748:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078400 00000020:00000080:3.0:1787397710.832754:0:23942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190ba1 00000100:00080000:3.0:1787397710.832760:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a83879f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787397710.832776:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4985 00000001:00000004:3.0:1787397710.832783:0:23942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378767 00000100:00100000:1.0:1787397710.832784:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701078400:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787397710.832800:0:26158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190bcb 00000100:00080000:1.0:1787397710.832806:0:26158:0:(import.c:65:import_set_state_nolock()) ffff89a8037d8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787397710.832851:0:26158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968730 00000100:00100000:1.0:1787397710.832920:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701078400:12345-0@lo:9:umount.0 Request processed in 137us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397710.832926:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4985 00010000:00010000:1.0:1787397710.832953:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.832958:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397710.832971:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828782800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787397710.832977:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787397710.832979:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397710.832981:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078400:0@lo:9:umount.0 00000100:00100000:3.0:1787397710.833131:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218701078016:12345-0@lo:39:umount.0 Request processed in 395us (858us total) trans 81604378768 rc 0/0 00000100:00100000:3.0:1787397710.833138:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00010000:00010000:3.0:1787397710.833164:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397710.833437:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364e1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787397710.833444:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701078016:0@lo:39:umount.0 00000020:00080000:3.0:1787397710.835416:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a829b93380) has no exports 00000020:00000080:0.0:1787397710.887966:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a7090fb000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397710.888189:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fb000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0000 00000020:00000080:1.0:1787397710.888259:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1e800 for lustre-MDT0000 00010000:00010000:1.0:1787397710.888271:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.888273:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397710.888276:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787397710.913550:0:56852:0:(genops.c:906:class_export_put()) final put ffff89a837bc0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787397710.915737:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787397710.915811:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8037dd000 for lustre-MDT0000 00010000:00010000:0.0:1787397710.916595:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.916600:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397710.916603:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397710.943978:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b77 00000020:00000080:3.0:1787397710.943994:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a817ecf800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787397710.944069:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787397710.944126:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787397710.944155:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397710.944168:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787397710.944172:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a829b94d40) has no exports 00000020:00000080:1.0:1787397710.944733:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b70 00000020:00000080:1.0:1787397710.944739:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7054c4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397710.945007:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397710.945075:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397710.945084:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787397710.945087:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a806907800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787397710.945090:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a806907800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787397710.945094:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1787397710.945227:0:93708:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259c960 - data ffff89a827d600d8/ffff89a835e76800 00000020:01000000:1.0:1787397710.945423:0:93708:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259cba0 - data ffff89a83fc2b438/ffff89a818181c00 00000100:00080000:2.0:1787397711.000291:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397711.000300:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397711.000315:0:93708:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a70350b800 x1874218701078016/t81604378768(81604378768) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397720 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397711.000352:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787397711.004420:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397711.004428:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968730 gen 4 00000004:00080000:2.0:1787397711.004718:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397711.004722:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787397711.005113:0:92432:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787397711.005119:0:92432:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:3.0:1787397711.005131:0:92432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:2.0:1787397711.006059:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397711.006063:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968728 gen 4 00000004:00080000:2.0:1787397711.006107:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397711.006110:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787397711.006325:0:92434:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787397711.006329:0:92434:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:3.0:1787397711.006349:0:92434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:2.0:1787397711.007715:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b31 00000020:00000080:2.0:1787397711.007726:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7090fa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397711.009769:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397711.009951:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b46 00000020:00000080:2.0:1787397711.009961:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a837bc3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787397711.010010:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787397711.010017:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397711.010029:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397711.010033:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a829b90000) has no exports 00000004:01000000:2.0:1787397711.010243:0:93708:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787397711.010253:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190bc4 00000020:00000080:2.0:1787397711.010258:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a828783800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.010317:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397711.010496:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787397711.010501:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397711.010510:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787397711.010513:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a703f5b380) has no exports 00000020:00000080:2.0:1787397711.010622:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190bbd 00000020:00000080:2.0:1787397711.010628:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7090fd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397711.010661:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828783800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1787397711.011175:0:93708:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787397711.011180:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397711.011184:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968728 gen 5 00000004:00080000:2.0:1787397711.011189:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787397711.011192:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397711.011225:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397711.011311:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.011321:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397711.011327:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190ba8 00000020:00000080:2.0:1787397711.011413:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7054c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.011444:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828782800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787397711.011450:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a817ecc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.011452:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787397711.011458:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787397711.011716:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397711.011793:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787397711.011831:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397711.011839:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787397711.011842:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a703f58000) has no exports 00000020:00000080:1.0:1787397711.011848:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b9a 00000020:00000080:1.0:1787397711.011852:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a703c33000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787397711.012245:0:93708:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787397711.012250:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397711.012253:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968730 gen 5 00000004:00080000:1.0:1787397711.012258:0:93708:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397711.012260:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397711.012601:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c33000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397711.012708:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397711.012716:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787397711.012729:0:93708:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787397711.012735:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b8c 00000020:00000080:1.0:1787397711.012740:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7090fd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.012759:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a703c37800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787397711.012765:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a7090fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.012775:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787397711.012780:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397711.012901:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787397711.012906:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397711.012913:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787397711.012916:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a83b9d0000) has no exports 00000020:00000080:1.0:1787397711.012922:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b85 00000020:00000080:1.0:1787397711.012925:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a803902000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397711.012946:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787397711.014982:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803902000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787397711.017583:0:93708:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787397711.017591:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397711.017596:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397711.017603:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397711.017699:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.017713:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397711.017739:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.017743:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397711.017749:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a80570d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397711.017753:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a80570d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397711.017760:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397711.017871:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b4d 00000020:00000080:2.0:1787397711.017878:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a837bc4800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787397711.017949:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8364e1000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787397711.017955:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a7090fc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397711.017957:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787397711.017961:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787397711.018047:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787397711.018051:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397711.018057:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397711.018061:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a829b919c0) has no exports 00000020:00000080:2.0:1787397711.018079:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.018082:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787397711.018086:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190b54 00000020:00000080:2.0:1787397711.018090:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a837bc1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787397711.018095:0:93708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad28000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787397711.018098:0:93708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad28000 3 00000020:01000004:2.0:1787397711.018101:0:93708:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70ad28000 from lustre-MDT0000 00000020:00000080:2.0:1787397711.018117:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.018120:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787397711.018123:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a7090f8800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787397711.018125:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090f8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787397711.018130:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787397711.018158:0:93708:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787397711.018170:0:93708:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787397711.018173:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787397711.018175:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397711.018178:0:93708:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787397711.018185:0:93708:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a70374b800 e5696550-1ffc-466d-b13d-359d59b5fc5f 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397711.018191:0:93708:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a70ad2c800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397711.018195:0:93708:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a83b9d4d40) has exports, disconnecting them 00000020:00080000:2.0:1787397711.018199:0:93708:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a70374b800), last request at 1787397680 00000020:00000080:2.0:1787397711.018218:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190cd5 00000020:00010000:2.0:1787397711.018222:0:93708:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a70374b800: total 2 00000100:00080000:2.0:1787397711.018226:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a703749000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397711.018238:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a70374b800): rc 0 00000020:00080000:2.0:1787397711.018241:0:93708:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a70ad2c800), last request at 1787397678 00000020:00000080:2.0:1787397711.018277:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190af2 00000020:00010000:2.0:1787397711.018280:0:93708:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a70ad2c800: total 2 00000100:00080000:2.0:1787397711.018282:0:93708:0:(import.c:65:import_set_state_nolock()) ffff89a70ad2a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397711.018289:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a70ad2c800): rc 0 00000020:00080000:2.0:1787397711.018293:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a83b9d4d40) has no exports 00000100:00100000:3.0:1787397711.018383:0:92422:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a704509400:92422] 2 exiting: rc = 0 00000020:00000080:3.0:1787397711.018618:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787397711.018622:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a7090ff000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787397711.018624:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090ff000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787397711.018656:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787397711.018697:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787397711.024646:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a70374b800: total 0 00010000:00010000:1.0:1787397711.024713:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a70374b800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1787397711.024750:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23000/0x274786fe0d190cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80d8 expref: 5 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.024767:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031200/0x274786fe0d191104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8148 expref: 4 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.024872:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1e00/0x274786fe0d190cea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d80e6 expref: 3 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.024899:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1600/0x274786fe0d191127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d814f expref: 2 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.024908:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a70374b800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1787397711.024928:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a70374b800/e5696550-1ffc-466d-b13d-359d59b5fc5f 00000020:00010000:1.0:1787397711.024988:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a70ad2c800: total 1 00010000:00010000:1.0:1787397711.025010:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a70ad2c800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787397711.025026:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f0000/0x274786fe0d191112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19110b expref: 14 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025038:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a800/0x274786fe0d190c88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190c81 expref: 13 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025047:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75800/0x274786fe0d1910e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910da expref: 12 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025056:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031600/0x274786fe0d191120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191119 expref: 11 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025065:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63400/0x274786fe0d1910ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910e8 expref: 10 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025074:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030000/0x274786fe0d1910fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910f6 expref: 9 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025083:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63000/0x274786fe0d190c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190c2d expref: 8 pid: 92419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025094:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b600/0x274786fe0d190cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190cab expref: 7 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025113:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63c00/0x274786fe0d190cc0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190cb9 expref: 6 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025125:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63a00/0x274786fe0d190c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190c49 expref: 5 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025135:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22400/0x274786fe0d190c5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190c57 expref: 4 pid: 92424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025147:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62000/0x274786fe0d1910d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910cc expref: 3 pid: 92422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025155:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75c00/0x274786fe0d1910c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1910be expref: 2 pid: 92421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397711.025165:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a70ad2c800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787397711.025179:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a70ad2c800/99b57a74-e5dc-42df-b087-b10fad741506 00000020:00000080:3.0:1787397711.025213:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70374b800/e5696550-1ffc-466d-b13d-359d59b5fc5f for MGS 00000020:00000080:3.0:1787397711.025255:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a703749000 for MGS 00010000:00010000:1.0:1787397711.025353:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397711.025356:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397711.025358:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397711.025366:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397711.025414:0:92419:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a835732a00:92419] 0 exiting: rc = 1 00000100:00100000:1.0:1787397711.025641:0:92421:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a704509e00:92421] 1 exiting: rc = 0 00000100:00100000:1.0:1787397711.025696:0:92424:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a834582000:92424] 3 exiting: rc = 0 00000020:00000080:2.0:1787397711.025968:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2c800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000100:00100000:3.0:1787397711.026075:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026085:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026092:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026098:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026104:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026110:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026116:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026122:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026127:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026133:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026138:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026142:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026147:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026154:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026170:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026175:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026180:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026185:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026192:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026197:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026202:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026208:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026213:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026219:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026225:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026230:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026235:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026240:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026245:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026251:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026257:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026262:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026267:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026273:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026279:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026284:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026290:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026295:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026301:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026307:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026312:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026317:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026322:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026327:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026332:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026349:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026355:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026360:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026365:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026379:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026385:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026391:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026396:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026401:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026406:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026414:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026420:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026425:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026440:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026447:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026453:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026459:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026463:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397711.026468:0:93708:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787397711.027198:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70ad2a000 for MGS 00000020:01000000:2.0:1787397711.027938:0:93708:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a8114186c0 - data ffff89a83fef5438/ffff89a829b51000 00000020:01000000:2.0:1787397711.028053:0:93708:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a83622ac60 - data ffff89a83fd37288/ffff89a8356cac00 00000020:00000080:3.0:1787397711.028874:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190aeb 00000020:00000080:3.0:1787397711.028885:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a70ad2d800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787397711.028903:0:93708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70ad28000 from MGS, refs=2 00000020:01000004:3.0:1787397711.028907:0:93708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad28000 2 00000020:01000004:3.0:1787397711.028910:0:93708:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70ad28000 from MGS 00000020:00000080:3.0:1787397711.028931:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397711.028939:0:93708:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787397711.028941:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a70ad2e000/MGS 00000020:00000080:3.0:1787397711.028944:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2e000/MGS for MGS 00000020:01000000:3.0:1787397711.028950:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787397711.029027:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787397711.029031:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397711.029040:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787397711.029047:0:93708:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a829b1b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397711.029052:0:93708:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a7033a3380) has exports, disconnecting them 00000020:00080000:3.0:1787397711.029057:0:93708:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a829b1b000), last request at 1787397678 00000020:00000080:3.0:1787397711.029060:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190c03 00000020:00080000:3.0:1787397711.029071:0:93708:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1b000): rc 0 00000020:00000080:3.0:1787397711.029087:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a829b1b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787397711.030053:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397711.030064:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787397711.030599:0:93708:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787397711.030605:0:93708:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397711.030609:0:93708:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397711.030615:0:93708:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397711.030702:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787397711.030922:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.030934:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787397711.030939:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a829b1d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787397711.030950:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787397711.030963:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787397711.031038:0:93708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70ad28000 1 00000020:00000080:2.0:1787397711.031043:0:93708:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190add 00000020:00000080:2.0:1787397711.031049:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a70ad2b000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787397711.031067:0:93708:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787397711.031071:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397711.031075:0:93708:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397711.031078:0:93708:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a83b9d3380) has no exports 00000020:00000080:1.0:1787397711.031203:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397711.127485:0:93708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397711.127500:0:93708:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787397711.127506:0:93708:0:(genops.c:906:class_export_put()) final put ffff89a70ad2e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787397711.127511:0:93708:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70ad2e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787397711.127537:0:93708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787397711.127852:0:93708:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a70ad2c000 00000020:02000400:2.0:1787397711.129911:0:93708:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000400:00000100:1.0:1787397711.642895:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681206272 offset 0 length 224: 4 00000100:00100000:1.0:1787397711.642938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397711.642969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397711.642990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397711.643019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397711.643055:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206656 00000100:00100000:1.0:1787397711.643065:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206656 00000100:00100000:1.0:1787397711.643118:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206784 00000100:00100000:1.0:1787397711.643121:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206784 00000100:00100000:1.0:1787397711.643146:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2587 00000100:00100000:1.0:1787397711.643156:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681206656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397711.643228:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681206656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397711.643235:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2587 00000100:00100000:1.0:1787397711.643252:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2588 00000100:00100000:1.0:1787397711.643259:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681206784:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397711.643281:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681206784:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397711.643287:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2588 00000100:00100000:2.0:1787397711.644690:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206400 00000100:00100000:2.0:1787397711.644700:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206400 00000100:00100000:2.0:1787397711.644755:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206528 00000100:00100000:2.0:1787397711.644758:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206528 00000100:00100000:2.0:1787397711.644788:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1338 00000100:00100000:2.0:1787397711.644799:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2404:x1874218681206528:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397711.644880:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2404:x1874218681206528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397711.644889:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1338 00000100:00100000:2.0:1787397711.644904:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1375 00000100:00100000:2.0:1787397711.644909:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1874218681206400:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:2.0:1787397711.644914:0:66178:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:2.0:1787397711.644933:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1874218681206400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (1996us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787397711.644951:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1375 00000100:00080000:2.0:1787397711.644971:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397711.644975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397711.644977:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397711.656379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397711.656455:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681206912 00000100:00100000:2.0:1787397711.656466:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681206912 00000100:00100000:2.0:1787397711.656516:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1376 00000100:00100000:2.0:1787397711.656547:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681206912:12345-192.168.204.60@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1787397711.656574:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397711.656647:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681206912:12345-192.168.204.60@tcp:38:ptlrpcd_01_01.0 Request processed in 101us (278us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397711.656655:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1376 00010000:00010000:2.0:1787397711.719145:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397712.743827:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397713.765690:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397714.788841:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397714.917620:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701078528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397714.917730:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397714.918108:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078528 00000100:00100000:3.0:1787397714.918130:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078528 00000100:00100000:3.0:1787397714.918176:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1787397714.918702:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1874218701078528:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787397714.918715:0:8445:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397714.918803:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3649:x1874218701078528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1073us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397714.918813:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:02020000:3.0:1787397714.918874:0:3649:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1787397714.922642:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701078912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397714.922758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397714.923586:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078912 00000100:00100000:0.0:1787397714.923600:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078912 00000100:00100000:0.0:1787397714.923682:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1787397714.923694:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701078912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397714.923798:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701078912:12345-0@lo:400:kworker.0 Request processed in 106us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397714.923807:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:0.0:1787397714.923845:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397714.923976:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701078912:0@lo:400:kworker.0 00000100:00100000:2.0:1787397714.923987:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701079424:0@lo:400:kworker.0 00000100:00100000:2.0:1787397714.924030:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397714.924070:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787397714.924084:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701079040:0@lo:400:kworker.0 00000100:00100000:2.0:1787397714.924111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397714.924131:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701079552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397714.924152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.925724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701078656:0@lo:400:kworker.0 00000400:00000100:1.0:1787397714.925801:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701078656 offset 0 length 224: 4 00000100:00100000:1.0:1787397714.925845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701079168:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.925880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.925919:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787397714.925945:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701078784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.925970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.925991:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701079296:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.926018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.926058:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079040 00000100:00100000:1.0:1787397714.926067:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079040 00000100:00100000:1.0:1787397714.926105:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079552 00000100:00100000:1.0:1787397714.926108:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079552 00000100:00100000:1.0:1787397714.926118:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079168 00000100:00100000:1.0:1787397714.926120:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079168 00000100:00100000:1.0:1787397714.926150:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078784 00000100:00100000:1.0:1787397714.926152:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078784 00000100:00100000:1.0:1787397714.926165:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1787397714.926173:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701079168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.926244:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701079168:12345-0@lo:400:kworker.0 Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397714.926252:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1787397714.926275:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1787397714.926280:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218701079040:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397714.926286:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397714.926322:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218701079040:12345-0@lo:400:kworker.0 Request processed in 41us (2210us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397714.926328:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1787397714.926340:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1787397714.926344:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218701079552:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397714.926349:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397714.926371:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874218701079552:12345-0@lo:400:kworker.0 Request processed in 25us (2218us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397714.926387:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1787397714.926399:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1787397714.926404:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874218701078784:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787397714.926409:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397714.926429:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874218701078784:12345-0@lo:400:kworker.0 Request processed in 24us (458us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397714.926435:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00080000:1.0:1787397714.926546:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397714.926552:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397714.926557:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397714.926564:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397714.926568:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3563 00000100:00080000:1.0:1787397714.926575:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397714.926656:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350a300 x1874218701079680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397714.926684:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701078784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.926702:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701079168:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.926728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701079680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397714.926772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.926872:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079680 00000100:00100000:1.0:1787397714.926877:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079680 00000100:00100000:1.0:1787397714.926897:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1787397714.926902:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701079680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787397714.926924:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397714.926961:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701079680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (188us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397714.926967:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00080000:1.0:1787397714.926995:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397714.927000:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397714.927002:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701079680:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787397714.927091:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397714.927095:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397714.927098:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397714.927102:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397714.927105:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3563 00000100:00080000:1.0:1787397714.927110:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397714.927124:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350a300 x1874218701079808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397714.927139:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701079040:0@lo:400:kworker.0 00000100:00080000:1.0:1787397714.927175:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397714.927178:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397714.927181:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787397714.927184:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397714.927187:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3563 00000100:00080000:1.0:1787397714.927192:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397714.927206:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915f80 x1874218701079936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397714.927229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701079552:0@lo:400:kworker.0 00000100:00100000:1.0:1787397714.927250:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701079808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397714.927278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.927295:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701079936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787397714.927316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397714.927339:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079808 00000100:00100000:1.0:1787397714.927344:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079808 00000100:00100000:1.0:1787397714.927360:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079936 00000100:00100000:1.0:1787397714.927362:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079936 00000100:00100000:1.0:1787397714.927373:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1787397714.927377:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701079808:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787397714.927387:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397714.927417:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701079808:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (139us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397714.927424:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1787397714.927436:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1787397714.927440:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701079936:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787397714.927449:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397714.927473:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701079936:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (157us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397714.927479:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00080000:1.0:1787397714.927500:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397714.927504:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397714.927506:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701079808:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1787397714.927550:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397714.927554:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397714.927556:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701079936:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1787397714.927623:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397714.927629:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a83879e800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787397714.927652:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968730 is committed 00000020:00000080:1.0:1787397714.927671:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83879e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000100:00100000:0.0:1787397714.927838:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079424 00000100:00100000:0.0:1787397714.927843:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079424 00000100:00100000:0.0:1787397714.927886:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701079296 00000100:00100000:0.0:1787397714.927889:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701079296 00000100:00100000:0.0:1787397714.927915:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1787397714.927922:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701079424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397714.927974:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701079424:12345-0@lo:400:kworker.0 Request processed in 53us (3943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397714.927981:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1787397714.927994:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1787397714.928001:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701079296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397714.928045:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701079296:12345-0@lo:400:kworker.0 Request processed in 45us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397714.928051:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00080000:0.0:1787397714.928117:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397714.928122:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397714.928125:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397714.928155:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701079296:0@lo:400:kworker.0 00000100:00100000:0.0:1787397714.928184:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701079424:0@lo:400:kworker.0 00000020:00000080:1.0:1787397714.928685:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8037d8000 for lustre-OST0001 00000001:00100000:0.0:1787397714.928799:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397714.928813:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378768 is committed 00000020:00000080:0.0:1787397714.928817:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a838798800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397714.928848:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378767 is committed 00000020:00000080:2.0:1787397714.928862:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838798800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787397714.928910:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879f800 for lustre-MDT0001 00010000:00010000:1.0:1787397714.928963:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.928977:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.928986:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.928993:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397714.928998:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929007:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929027:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff89a81ab06300) 00010000:00010000:1.0:1787397714.929031:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397714.929036:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929042:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d191326 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929078:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929086:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929091:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929097:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397714.929100:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929106:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929114:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:1.0:1787397714.929116:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397714.929119:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929125:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800030600/0x274786fe0d19133b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929137:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929143:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929149:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929160:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397714.929163:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929169:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929177:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff89a82ebb1400) 00010000:00010000:1.0:1787397714.929482:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397714.929489:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929497:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031400/0x274786fe0d191381 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929518:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929561:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929567:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929573:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397714.929576:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929582:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929603:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:1.0:1787397714.929605:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397714.929609:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397714.929614:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d191396 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787397714.932978:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397714.932989:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397714.932995:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397714.933014:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397714.933021:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3563 00000100:00080000:3.0:1787397714.933034:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397714.933095:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705388e00 x1874218701080064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397714.933167:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701080064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787397714.933273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397714.933394:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080064 00000100:00100000:2.0:1787397714.933405:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080064 00000100:00100000:2.0:1787397714.933461:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:2.0:1787397714.933470:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701080064:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787397714.933496:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397714.934503:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701080064:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 1027us (1223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397714.934517:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00080000:1.0:1787397714.934968:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397714.934975:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397714.934980:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701080064:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1787397715.812854:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397715.941371:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701080192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397715.941491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397715.941604:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080192 00000100:00100000:0.0:1787397715.941617:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080192 00000100:00100000:0.0:1787397715.941695:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1787397715.941710:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701080192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397715.941776:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397715.941854:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701080192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397715.941867:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1787397715.941941:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701080192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397715.942212:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397715.942223:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701080320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397715.942308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397715.942507:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080320 00000100:00100000:1.0:1787397715.942517:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080320 00000100:00100000:1.0:1787397715.942578:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1787397715.942586:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701080320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397715.942609:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397715.942700:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701080320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397715.942713:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1787397715.943339:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701080320:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1787397716.471664:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397716.471674:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a7037c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397716.471795:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787397716.471851:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7037c1800 for lustre-OST0000 00000400:00000100:2.0:1787397716.741115:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681207040 offset 0 length 224: 4 00000100:00100000:2.0:1787397716.741878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397716.743181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397716.743440:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207168 00000100:00100000:3.0:1787397716.743457:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207168 00000100:00100000:3.0:1787397716.743518:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207296 00000100:00100000:3.0:1787397716.743545:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207296 00000100:00100000:3.0:1787397716.743601:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1341 00000100:00100000:3.0:1787397716.743612:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681207296:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397716.743721:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681207296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 97us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397716.743747:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1341 00000100:00100000:3.0:1787397716.743767:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1383 00000100:00100000:3.0:1787397716.743772:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681207168:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397716.743800:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397716.743839:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681207168:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 65us (1965us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397716.743846:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1383 00000100:00080000:3.0:1787397716.743865:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397716.744490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397716.744564:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207424 00000100:00100000:0.0:1787397716.744574:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207424 00000100:00100000:0.0:1787397716.744634:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2591 00000100:00100000:0.0:1787397716.744641:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681207424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397716.744681:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681207424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397716.744688:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2591 00000100:00080000:2.0:1787397716.745426:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397716.745725:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397716.745844:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207552 00000100:00100000:2.0:1787397716.745855:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207552 00000100:00080000:0.0:1787397716.745996:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397716.746141:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2592 00000100:00100000:2.0:1787397716.746154:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681207552:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397716.755166:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681207552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 8990us (9421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397716.755181:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2592 00010000:00010000:2.0:1787397716.837559:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397717.864724:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397718.890201:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397719.909716:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397720.036975:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397720.036985:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397720.036989:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397720.037020:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3594 00000100:00100000:0.0:1787397720.037026:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701080448:0@lo:400:kworker.0 00000100:00080000:1.0:1787397720.037027:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397720.037036:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397720.037064:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70261b100 x1874218701080576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397720.037094:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397720.037098:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397720.037100:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397720.037103:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3594 00000100:00080000:1.0:1787397720.037106:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397720.037110:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000400:00000100:0.0:1787397720.037113:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701080448 offset 0 length 224: 4 00000100:00100000:1.0:1787397720.037121:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702619500 x1874218701080832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397720.037149:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397720.037153:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397720.037154:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397720.037159:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3594 00000100:00080000:1.0:1787397720.037161:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397720.037165:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397720.037177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397720.037179:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70350a300 x1874218701081088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397720.037182:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701080704:0@lo:400:kworker.0 00000100:00080000:1.0:1787397720.037203:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397720.037206:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397720.037208:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397720.037218:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3594 00000100:00080000:1.0:1787397720.037221:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787397720.037223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397720.037225:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397720.037237:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83b520700 x1874218701081472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397720.037246:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701081344:0@lo:400:kworker.0 00000100:00100000:0.0:1787397720.037272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397720.037290:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701080576:0@lo:38:kworker.0 00000100:00100000:1.0:1787397720.037323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397720.037323:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080704 00000100:00100000:0.0:1787397720.037332:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080704 00000100:00100000:1.0:1787397720.037340:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701080832:0@lo:38:kworker.0 00000100:00100000:1.0:1787397720.037359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397720.037372:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701081088:0@lo:38:kworker.0 00000100:00100000:0.0:1787397720.037394:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080576 00000100:00100000:0.0:1787397720.037397:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080576 00000100:00100000:1.0:1787397720.037407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397720.037414:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080832 00000100:00100000:0.0:1787397720.037416:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080832 00000100:00100000:1.0:1787397720.037428:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701081472:0@lo:38:kworker.0 00000100:00100000:0.0:1787397720.037434:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1787397720.037447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397720.037453:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701080704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397720.037472:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081088 00000100:00100000:1.0:1787397720.037475:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081088 00000100:00100000:1.0:1787397720.037500:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1787397720.037506:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701081088:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397720.037519:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701080704:12345-0@lo:400:kworker.0 Request processed in 69us (296us total) trans 0 rc 0/0 00010000:00020000:1.0:1787397720.037547:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397720.037547:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1787397720.037564:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081472 00000100:00100000:0.0:1787397720.037567:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081472 00000100:00100000:0.0:1787397720.037579:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1787397720.037581:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701081088:12345-0@lo:38:kworker.0 Request processed in 75us (173us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397720.037583:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701080576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787397720.037589:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00010000:00020000:0.0:1787397720.037592:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397720.037610:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1787397720.037616:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701080832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787397720.037616:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701080576:12345-0@lo:38:kworker.0 Request processed in 32us (293us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397720.037622:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00010000:00020000:1.0:1787397720.037625:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397720.037631:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1787397720.037635:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701081472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397720.037655:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397720.037669:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701080832:12345-0@lo:38:kworker.0 Request processed in 52us (308us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397720.037674:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701081472:12345-0@lo:38:kworker.0 Request processed in 37us (226us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397720.037676:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:0.0:1787397720.037679:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1787397720.037706:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701080960:0@lo:400:kworker.0 00000100:00080000:1.0:1787397720.037724:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397720.037729:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397720.037733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397720.037734:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701080576:0@lo:38:kworker.0 00000100:00080000:1.0:1787397720.037746:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397720.037749:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397720.037754:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701080832:0@lo:38:kworker.0 00000100:00100000:0.0:1787397720.037756:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397720.037762:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701081216:0@lo:400:kworker.0 00000100:00080000:1.0:1787397720.037764:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397720.037767:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397720.037769:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701081088:0@lo:38:kworker.0 00000100:00080000:1.0:1787397720.037778:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397720.037781:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397720.037784:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701081472:0@lo:38:kworker.0 00000100:00100000:3.0:1787397720.037795:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081344 00000100:00100000:0.0:1787397720.037797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397720.037802:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081344 00000100:00100000:3.0:1787397720.037848:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081216 00000100:00100000:3.0:1787397720.037851:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081216 00000100:00100000:2.0:1787397720.037927:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701080960 00000100:00100000:2.0:1787397720.037932:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701080960 00000100:00100000:2.0:1787397720.037980:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1787397720.037987:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701080960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397720.038035:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701080960:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397720.038041:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1787397720.038323:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1787397720.038337:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397720.038388:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701081344:12345-0@lo:400:kworker.0 Request processed in 56us (1114us total) trans 0 rc 0/0 00000100:00080000:1.0:1787397720.038393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397720.038398:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00080000:1.0:1787397720.038401:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397720.038406:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397720.038420:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1787397720.038428:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397720.038438:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701081344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397720.038457:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701080704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397720.038470:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701081216:12345-0@lo:400:kworker.0 Request processed in 41us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397720.038477:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1787397720.038503:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701081216:0@lo:400:kworker.0 00000100:00100000:1.0:1787397720.038548:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701080960:0@lo:400:kworker.0 00010000:00010000:1.0:1787397720.933035:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397721.061806:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397721.061828:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701081600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397721.061925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397721.062023:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081600 00000100:00100000:0.0:1787397721.062034:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081600 00000100:00100000:0.0:1787397721.062111:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1787397721.062145:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701081600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397721.062185:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397721.062241:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701081600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397721.062250:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1787397721.063349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701081600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397721.063646:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701081728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397721.063711:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397721.063799:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081728 00000100:00100000:2.0:1787397721.063809:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081728 00000100:00100000:2.0:1787397721.063863:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1787397721.063872:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701081728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397721.063902:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397721.067387:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701081728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3499us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397721.067409:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1787397721.070902:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701081728:0@lo:13:osp-pre-1-1.0 00000400:00000100:3.0:1787397721.863877:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681207680 offset 0 length 224: 4 00000100:00100000:3.0:1787397721.863935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397721.864009:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397721.864136:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208192 00000100:00100000:0.0:1787397721.864164:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207936 00000100:00100000:1.0:1787397721.864167:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208192 00000100:00100000:0.0:1787397721.864175:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207936 00000100:00100000:1.0:1787397721.864339:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2595 00000100:00100000:0.0:1787397721.864363:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1344 00000100:00100000:1.0:1787397721.864364:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681208192:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397721.864387:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681207936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397721.864496:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681208192:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 142us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397721.864506:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2595 00000100:00100000:0.0:1787397721.864926:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681207936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 547us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397721.864935:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1344 00000100:00080000:2.0:1787397721.865191:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397721.865200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397721.872650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397721.872829:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208064 00000100:00100000:2.0:1787397721.872842:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208064 00000100:00100000:2.0:1787397721.872959:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2596 00000100:00100000:2.0:1787397721.872974:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681208064:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397721.873085:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681208064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 115us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397721.873095:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2596 00000100:00080000:1.0:1787397721.873415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397721.878177:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397721.878313:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681207808 00000100:00100000:2.0:1787397721.878331:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681207808 00000100:00100000:2.0:1787397721.878409:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1387 00000100:00100000:2.0:1787397721.878419:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681207808:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397721.878452:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397721.878640:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681207808:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 208us (461us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397721.878651:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1387 00010000:00010000:2.0:1787397721.956817:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397722.981595:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397724.008304:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397725.028849:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397725.156731:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397725.156738:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397725.156742:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787397725.156975:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397725.156991:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701081856:0@lo:400:kworker.0 00000400:00000100:0.0:1787397725.157043:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701081856 offset 0 length 224: 4 00000100:00080000:1.0:1787397725.157113:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3599 00000100:00080000:1.0:1787397725.157119:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397725.157125:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397725.157148:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915f80 x1874218701081984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397725.157437:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701081984:0@lo:38:kworker.0 00000100:00100000:0.0:1787397725.157474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397725.157783:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397725.157787:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397725.157790:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397725.157794:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3599 00000100:00080000:1.0:1787397725.157797:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397725.157802:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397725.157819:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702618700 x1874218701082240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397725.157867:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701082112:0@lo:400:kworker.0 00000100:00100000:3.0:1787397725.157917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397725.157955:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701081984 00000100:00100000:3.0:1787397725.157964:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701081984 00000100:00100000:3.0:1787397725.157997:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082112 00000100:00100000:3.0:1787397725.158000:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082112 00000100:00100000:3.0:1787397725.158041:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1787397725.158052:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701082112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397725.158102:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701082112:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397725.158109:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1787397725.158125:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1787397725.158130:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701081984:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397725.158148:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1787397725.158623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397725.159917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701082240:0@lo:38:kworker.0 00000100:00100000:0.0:1787397725.159984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397725.160484:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082240 00000100:00100000:2.0:1787397725.160493:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082240 00000100:00100000:2.0:1787397725.160568:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1787397725.160576:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701082240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397725.160604:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397725.160651:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701082240:12345-0@lo:38:kworker.0 Request processed in 74us (665us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397725.160658:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00080000:1.0:1787397725.160826:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397725.160830:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397725.160833:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397725.160839:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3599 00000100:00080000:1.0:1787397725.160844:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397725.160849:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397725.160870:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70261b100 x1874218701082496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397725.161042:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397725.161044:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397725.161046:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397725.161050:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3599 00000100:00080000:1.0:1787397725.161053:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397725.161057:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397725.161068:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1aa680 x1874218701082880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397725.161112:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701082752:0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.161150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397725.161243:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701082624:0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.161375:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701082368:0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.161402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397725.161434:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082368 00000100:00100000:1.0:1787397725.161439:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082368 00000100:00100000:1.0:1787397725.161488:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1787397725.161496:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.161568:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701082368:12345-0@lo:400:kworker.0 Request processed in 73us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397725.161575:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00080000:1.0:1787397725.161596:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397725.161628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701082368:0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.161651:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397725.162202:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701081984:12345-0@lo:38:kworker.0 Request processed in 4067us (4724us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397725.162211:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1787397725.162254:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701082112:0@lo:400:kworker.0 00000100:00080000:0.0:1787397725.162498:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397725.162504:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397725.162507:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701081984:0@lo:38:kworker.0 00000100:00100000:0.0:1787397725.162550:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701082496:0@lo:38:kworker.0 00000100:00100000:0.0:1787397725.162601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397725.162630:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701082880:0@lo:38:kworker.0 00000100:00100000:0.0:1787397725.162652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397725.162676:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397725.162680:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397725.162683:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701082240:0@lo:38:kworker.0 00000100:00100000:3.0:1787397725.162752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082496 00000100:00100000:3.0:1787397725.162758:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082496 00000100:00100000:3.0:1787397725.162793:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1787397725.162800:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701082496:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397725.162818:0:8446:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397725.162855:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701082496:12345-0@lo:38:kworker.0 Request processed in 53us (252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397725.162872:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00080000:3.0:1787397725.162910:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397725.162915:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397725.162917:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701082496:0@lo:38:kworker.0 00000100:00100000:3.0:1787397725.162946:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082880 00000100:00100000:3.0:1787397725.162949:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082880 00000100:00100000:3.0:1787397725.162971:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1787397725.162976:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701082880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397725.162986:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397725.163016:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701082880:12345-0@lo:38:kworker.0 Request processed in 38us (362us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397725.163022:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00080000:3.0:1787397725.163047:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397725.163050:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397725.163053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701082880:0@lo:38:kworker.0 00000100:00100000:2.0:1787397725.163400:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082752 00000100:00100000:2.0:1787397725.163405:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082752 00000100:00100000:2.0:1787397725.163457:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701082624 00000100:00100000:2.0:1787397725.163461:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701082624 00000100:00100000:2.0:1787397725.163483:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1787397725.163489:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701082752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397725.163565:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701082752:12345-0@lo:400:kworker.0 Request processed in 76us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397725.163572:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1787397725.163586:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1787397725.163591:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701082624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397725.163624:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701082624:12345-0@lo:400:kworker.0 Request processed in 33us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397725.163638:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00080000:1.0:1787397725.163793:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397725.163797:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397725.163824:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701082752:0@lo:400:kworker.0 00000100:00100000:1.0:1787397725.163850:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701082624:0@lo:400:kworker.0 00010000:00010000:1.0:1787397726.052824:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397726.180879:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397726.180895:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701083008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397726.181046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397726.181096:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083008 00000100:00100000:1.0:1787397726.181104:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083008 00000100:00100000:1.0:1787397726.181228:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:1.0:1787397726.181246:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701083008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397726.181278:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397726.181328:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701083008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397726.181335:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1787397726.181823:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397726.181834:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701083136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397726.181869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397726.182000:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083136 00000100:00100000:2.0:1787397726.182005:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083136 00000100:00100000:2.0:1787397726.187396:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1787397726.187417:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701083136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397726.187452:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397726.187561:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701083136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (5689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397726.187569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1787397726.187678:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701083136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397726.188847:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701083008:0@lo:13:osp-pre-1-1.0 00000400:00000100:1.0:1787397726.982866:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681208320 offset 0 length 520: 4 00000100:00100000:1.0:1787397726.983046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397726.983093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397726.983129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397726.983156:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208448 00000100:00100000:1.0:1787397726.983165:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208448 00000100:00100000:1.0:1787397726.983210:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1391 00000100:00100000:1.0:1787397726.983219:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681208448:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397726.983243:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397726.983307:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681208448:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 88us (262us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397726.983316:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1391 00000100:00100000:1.0:1787397726.983728:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208704 00000100:00100000:1.0:1787397726.983735:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208704 00000100:00100000:1.0:1787397726.983784:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208832 00000100:00100000:1.0:1787397726.983787:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208832 00000100:00100000:1.0:1787397726.983907:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2599 00000100:00100000:1.0:1787397726.983984:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681208832:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397726.984032:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681208832:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 52us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397726.984052:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2599 00000100:00100000:1.0:1787397726.984068:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4986 00000100:00100000:1.0:1787397726.984074:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681208704:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:1.0:1787397726.984091:0:26167:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190e3a 00000100:00080000:1.0:1787397726.984101:0:26167:0:(import.c:65:import_set_state_nolock()) ffff89a8310ab000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787397726.984617:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787397726.984634:0:26167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968731 00000100:00100000:1.0:1787397726.984770:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681208704:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 693us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397726.984777:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4986 00000100:00100000:0.0:1787397726.985386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:0.0:1787397726.985638:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397726.985644:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397726.986567:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208576 00000100:00100000:3.0:1787397726.986579:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208576 00000100:00100000:3.0:1787397726.986692:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1347 00000100:00100000:3.0:1787397726.986704:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681208576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:0.0:1787397726.986882:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397726.987383:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681208576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 680us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397726.987393:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1347 00010000:00010000:0.0:1787397727.081832:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397728.103205:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397729.126325:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397730.154058:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397730.277056:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397730.277064:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397730.277077:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397730.277086:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3604 00000100:00080000:0.0:1787397730.277092:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397730.277098:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397730.277122:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a807639f80 x1874218701083392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397730.277149:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397730.277152:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397730.277153:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397730.277156:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3604 00000100:00080000:0.0:1787397730.277159:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397730.277162:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397730.277201:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a807639500 x1874218701083648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397730.277223:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397730.277227:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397730.277228:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397730.277232:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3604 00000100:00080000:0.0:1787397730.277234:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397730.277238:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397730.277250:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80763b800 x1874218701083904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397730.277269:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397730.277271:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397730.277273:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397730.277276:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3604 00000100:00080000:0.0:1787397730.277278:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397730.277281:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397730.277290:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a807639180 x1874218701084288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397730.277343:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701083520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397730.277548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787397730.277555:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701083264:0@lo:400:kworker.0 00000400:00000100:0.0:1787397730.277576:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701083264 offset 0 length 224: 4 00000100:00100000:0.0:1787397730.277595:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701084160:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277628:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397730.277657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701083776:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397730.277693:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397730.277698:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701084032:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397730.277746:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084160 00000100:00100000:0.0:1787397730.277753:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084160 00000100:00100000:0.0:1787397730.277799:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084032 00000100:00100000:0.0:1787397730.277802:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084032 00000100:00100000:0.0:1787397730.277820:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1787397730.277829:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701084160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277877:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701084160:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397730.277884:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1787397730.277899:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1787397730.277905:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701084032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.277935:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701084032:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397730.277941:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00080000:0.0:1787397730.277959:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397730.277963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397730.277991:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701084032:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.278015:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701084160:0@lo:400:kworker.0 00000100:00000400:2.0:1787397730.278233:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397714/real 1787397714] req@ffff89a806b5c380 x1874218701078656/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397730.278252:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a806b5c380 x1874218701078656/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397730.278261:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787397730.278265:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787397730.278268:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787397730.278270:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787397730.278274:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a806b5c380 x1874218701078656/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397730.278281:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a70261aa00 x1874218701080448/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397730.278299:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83b523b80 x1874218701081856/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397730.278307:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a807638e00 x1874218701083264/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397746 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787397730.278328:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787397730.278331:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787397730.278332:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787397730.278333:0:3650:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1787397730.278353:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701081856:0@lo:400:kworker.0 00000100:00100000:2.0:1787397730.278357:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701078656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397730.278517:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701083264:0@lo:400:kworker.0 00000100:00080000:2.0:1787397730.278562:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397730.278565:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787397730.278567:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397730.278571:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3558 00000100:00080000:2.0:1787397730.278576:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397730.278593:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b66a00 x1874218701084416/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397730.279756:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701083392:0@lo:38:kworker.0 00000100:00100000:3.0:1787397730.279833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397730.279870:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701083648:0@lo:38:kworker.0 00000100:00100000:3.0:1787397730.279894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397730.279922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701083904:0@lo:38:kworker.0 00000100:00100000:0.0:1787397730.280286:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701080448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.280361:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083520 00000100:00100000:0.0:1787397730.280368:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083520 00000100:00100000:0.0:1787397730.280958:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083776 00000100:00100000:0.0:1787397730.280963:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083776 00000100:00100000:0.0:1787397730.280985:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083392 00000100:00100000:0.0:1787397730.280988:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083392 00000100:00100000:0.0:1787397730.280999:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083648 00000100:00100000:0.0:1787397730.281011:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083648 00000100:00100000:0.0:1787397730.281028:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1787397730.281036:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.281115:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701083520:12345-0@lo:400:kworker.0 Request processed in 79us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397730.281122:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1787397730.281139:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1787397730.281144:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701083776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397730.281173:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701083776:12345-0@lo:400:kworker.0 Request processed in 29us (3493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397730.281179:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1787397730.281190:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1787397730.281194:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701083392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397730.281213:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397730.281542:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1787397730.281550:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701083648:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397730.281561:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397730.281598:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701083648:12345-0@lo:38:kworker.0 Request processed in 48us (1703us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397730.281605:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00080000:2.0:1787397730.281670:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397730.281898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397730.281941:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701084288:0@lo:38:kworker.0 00000100:00100000:3.0:1787397730.281973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397730.281991:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701084416:0@lo:250:kworker.0 00000400:00000100:3.0:1787397730.282009:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701084416 offset 0 length 520: 4 00000100:00080000:3.0:1787397730.282051:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397730.282056:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397730.282060:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701083648:0@lo:38:kworker.0 00000100:00100000:1.0:1787397730.282123:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701083520:0@lo:400:kworker.0 00000100:00100000:3.0:1787397730.282149:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084288 00000100:00100000:3.0:1787397730.282155:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084288 00000100:00100000:1.0:1787397730.282171:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701083776:0@lo:400:kworker.0 00000100:00100000:2.0:1787397730.282190:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701083904 00000100:00100000:2.0:1787397730.282195:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701083904 00000100:00100000:2.0:1787397730.282225:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:2.0:1787397730.282231:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701083904:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397730.282233:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1787397730.282238:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701084288:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397730.282250:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1787397730.282252:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397730.282287:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701084288:12345-0@lo:38:kworker.0 Request processed in 46us (311us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397730.282287:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701083904:12345-0@lo:38:kworker.0 Request processed in 54us (389us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397730.282294:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1787397730.282302:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00080000:1.0:1787397730.283408:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397730.283418:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397730.283423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701083904:0@lo:38:kworker.0 00000100:00080000:1.0:1787397730.283434:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397730.283452:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397730.283457:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701084288:0@lo:38:kworker.0 00000100:00100000:0.0:1787397730.314346:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701083392:12345-0@lo:38:kworker.0 Request processed in 33139us (34501us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397730.314362:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00080000:0.0:1787397730.314732:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397730.314738:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397730.314742:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701083392:0@lo:38:kworker.0 00010000:00010000:2.0:1787397731.173923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397731.300723:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397731.300750:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701084544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397731.300822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397731.301325:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084544 00000100:00100000:1.0:1787397731.301332:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084544 00000100:00100000:1.0:1787397731.301392:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1787397731.301403:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701084544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397731.301456:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397731.301507:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701084544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397731.301515:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1787397731.301582:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701084544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397731.301713:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701084672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397731.301746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397731.301871:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084672 00000100:00100000:1.0:1787397731.301876:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084672 00000100:00100000:1.0:1787397731.301907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:1.0:1787397731.301914:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701084672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397731.301931:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397731.301972:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701084672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397731.301980:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1787397731.302267:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701084672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397732.101425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397732.101466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397732.101506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397732.101590:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209088 00000100:00100000:1.0:1787397732.101601:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209088 00000100:00100000:1.0:1787397732.101664:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681208960 00000100:00100000:1.0:1787397732.101667:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681208960 00000100:00100000:1.0:1787397732.101685:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1350 00000100:00100000:1.0:1787397732.101696:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681209088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397732.101783:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681209088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397732.101791:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1350 00000100:00100000:1.0:1787397732.101809:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1395 00000100:00100000:1.0:1787397732.101813:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681208960:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787397732.101834:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397732.101876:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681208960:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 62us (410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397732.101883:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1395 00000100:00100000:3.0:1787397732.102174:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209216 00000100:00100000:3.0:1787397732.102179:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209216 00000100:00100000:3.0:1787397732.102225:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4987 00000100:00100000:3.0:1787397732.102233:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681209216:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787397732.102254:0:26168:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191285 00000100:00080000:3.0:1787397732.102263:0:26168:0:(import.c:65:import_set_state_nolock()) ffff89a709121800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787397732.102307:0:26168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968730 00000100:00100000:3.0:1787397732.102460:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681209216:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 227us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397732.102467:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4987 00010000:00010000:3.0:1787397732.102488:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397732.102827:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397732.102833:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397732.198015:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787397732.535948:0:94327:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787397732.535955:0:94327:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787397732.535956:0:94327:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787397732.536075:0:94327:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a70a901000 00000020:01000004:0.0:1787397732.536091:0:94327:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787397732.536105:0:94327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787397732.536120:0:94327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a703c8cd40) 00000020:00000080:0.0:1787397732.536138:0:94327:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787397732.628710:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787397732.628939:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787397732.640559:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.640756:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787397732.641081:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.641358:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787397732.641643:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787397732.641859:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.642444:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.642767:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.643007:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787397732.643362:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787397732.643636:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787397732.643847:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787397732.645370:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.647037:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.647386:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.647659:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.647863:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.648072:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.648673:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.648938:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.649157:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.649451:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.649681:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.649882:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.650205:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.650572:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.650783:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.651022:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.651606:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.651877:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.652125:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.652405:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.652634:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.652818:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.653085:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.653510:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.653857:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.654083:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.654357:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.654622:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.655137:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.655431:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.655733:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.655969:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787397732.656380:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787397732.656701:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.656731:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.656767:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.657124:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.657950:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.658226:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.658771:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.658992:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787397732.659249:0:94327:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787397732.660024:0:94327:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787397732.660242:0:94327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787397732.660266:0:94327:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787397732.660278:0:94327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1913ab 00000020:01000004:3.0:1787397732.660285:0:94327:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787397732.660297:0:94327:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787397732.660302:0:94327:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70a901000 from MGS 00000020:01000004:3.0:1787397732.660306:0:94327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787397732.660316:0:94327:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a703f58000) 00000020:00000080:3.0:1787397732.660329:0:94327:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1787397732.660403:0:94327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a901000 from MGS, refs=2 00080000:01000000:3.0:1787397732.660409:0:94327:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787397732.660415:0:94327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1913b9 00010000:00010000:3.0:1787397732.660573:0:94327:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1787397732.665065:0:94327:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787397732.672910:0:94331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787397732.672989:0:94327:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787397732.673059:0:94327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397732.674417:0:94327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787397732.674752:0:94327:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397732.674908:0:94327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787397732.674914:0:94327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787397732.676234:0:94327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787397732.676245:0:94327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787397732.676766:0:94327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787397732.676773:0:94327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787397732.677284:0:94327:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787397732.677309:0:94327:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1787397732.677311:0:94327:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1787397732.677314:0:94327:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1787397732.677319:0:94327:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 69, was 0): CONNECTING 00000100:00100000:1.0:1787397732.677325:0:94327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000001:00100000:0.0:1787397732.847296:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397732.847384:0:8429:0:(genops.c:906:class_export_put()) final put ffff89a8310ad000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787397732.852219:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310ad000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:3.0:1787397732.852307:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8310ab000 for lustre-OST0000 00010000:00010000:2.0:1787397733.220914:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397734.246306:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397735.269140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397735.396716:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397735.396723:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397735.396726:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397735.396730:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397735.396734:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397735.396741:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3609 00000100:00080000:2.0:1787397735.396745:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397735.396752:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397735.396787:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b65180 x1874218701084800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397735.396831:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397735.396834:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397735.396836:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397735.396840:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3609 00000100:00080000:2.0:1787397735.396842:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397735.396846:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397735.396857:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b65f80 x1874218701085056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397735.396883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397735.396899:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701084928:0@lo:400:kworker.0 00000100:00080000:2.0:1787397735.396953:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397735.396957:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397735.396959:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397735.396964:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3609 00000100:00080000:2.0:1787397735.396967:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1787397735.396985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787397735.396990:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397735.397006:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b64380 x1874218701085312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397735.397037:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397735.397040:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397735.397042:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397735.397045:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3609 00000100:00080000:2.0:1787397735.397047:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397735.397050:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397735.397059:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5d880 x1874218701085696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397735.397134:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701084800:0@lo:38:kworker.0 00000100:00100000:0.0:1787397735.397169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397735.397189:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701085056:0@lo:38:kworker.0 00000100:00100000:0.0:1787397735.397227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397735.397245:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701085312:0@lo:38:kworker.0 00000100:00100000:0.0:1787397735.397270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397735.397300:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084928 00000100:00100000:0.0:1787397735.397308:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084928 00000100:00100000:0.0:1787397735.397374:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701084800 00000100:00100000:0.0:1787397735.397378:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701084800 00000100:00100000:0.0:1787397735.397394:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085056 00000100:00100000:0.0:1787397735.397398:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085056 00000100:00100000:0.0:1787397735.397419:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1787397735.397428:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1787397735.397430:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701084928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.397439:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701084800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397735.397462:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397735.397492:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701084928:12345-0@lo:400:kworker.0 Request processed in 63us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397735.397500:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1787397735.397508:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701084800:12345-0@lo:38:kworker.0 Request processed in 70us (337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397735.397517:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1787397735.397558:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1787397735.397565:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701085056:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1787397735.397573:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:0.0:1787397735.397579:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397735.397612:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085312 00000100:00100000:0.0:1787397735.397612:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701085056:12345-0@lo:38:kworker.0 Request processed in 45us (383us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397735.397617:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085312 00000100:00100000:2.0:1787397735.397641:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:2.0:1787397735.397646:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701085312:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397735.397658:0:8445:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397735.397685:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701085312:12345-0@lo:38:kworker.0 Request processed in 37us (413us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397735.397701:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:2.0:1787397735.397743:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397735.397751:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701085568:0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.397802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397735.397843:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085568 00000100:00100000:2.0:1787397735.397847:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085568 00000100:00100000:0.0:1787397735.398337:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1787397735.398377:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701085696:0@lo:38:kworker.0 00000100:00080000:3.0:1787397735.398388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397735.398422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397735.398466:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397735.398471:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397735.398475:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701084800:0@lo:38:kworker.0 00000100:00080000:0.0:1787397735.398485:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397735.398488:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397735.398491:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701085056:0@lo:38:kworker.0 00000100:00080000:0.0:1787397735.398500:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397735.398502:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397735.398505:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701085312:0@lo:38:kworker.0 00000100:00100000:0.0:1787397735.398558:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085696 00000100:00100000:0.0:1787397735.398562:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085696 00000100:00100000:0.0:1787397735.398585:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1787397735.398590:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701085696:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397735.398603:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397735.398714:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701085696:12345-0@lo:38:kworker.0 Request processed in 121us (292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397735.398733:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00080000:0.0:1787397735.398762:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397735.398766:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397735.398768:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701085696:0@lo:38:kworker.0 00000100:00100000:2.0:1787397735.399175:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1787397735.399188:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701085568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399364:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701085568:12345-0@lo:400:kworker.0 Request processed in 181us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397735.399372:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1787397735.399414:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701085568:0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399447:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701085184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397735.399496:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397735.399502:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701085440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397735.399567:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085184 00000100:00100000:2.0:1787397735.399571:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085184 00000100:00100000:2.0:1787397735.399603:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1787397735.399609:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701085184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399644:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701085184:12345-0@lo:400:kworker.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397735.399651:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1787397735.399676:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701085184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399723:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085440 00000100:00100000:2.0:1787397735.399728:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085440 00000100:00100000:2.0:1787397735.399754:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1787397735.399760:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701085440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397735.399804:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701085440:12345-0@lo:400:kworker.0 Request processed in 42us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397735.399809:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1787397735.399836:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701085440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397735.400731:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701084928:0@lo:400:kworker.0 00000100:00080000:3.0:1787397735.400759:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397735.400763:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787397736.292662:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397736.420998:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397736.421022:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701085952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397736.421256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397736.421472:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397736.421485:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701085824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397736.423105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397736.423187:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085952 00000100:00100000:3.0:1787397736.423195:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085952 00000100:00100000:3.0:1787397736.423251:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701085824 00000100:00100000:3.0:1787397736.423255:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701085824 00000100:00100000:3.0:1787397736.423283:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1787397736.423292:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701085952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397736.423332:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397736.423402:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701085952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397736.423410:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1787397736.423428:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1787397736.423434:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701085824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397736.423450:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397736.423481:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701085824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397736.423487:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1787397736.423550:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701085952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397736.423729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701085824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397737.235300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397737.235431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397737.236892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397737.236993:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209600 00000100:00100000:1.0:1787397737.237003:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209600 00000100:00100000:1.0:1787397737.237054:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787397737.237063:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874218681209600:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:1.0:1787397737.237094:0:94333:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp t0 exp 0000000000000000 cur 3616 last 0 00000020:00000080:1.0:1787397737.237126:0:94333:0:(genops.c:1406:class_connect()) connect: client e5696550-1ffc-466d-b13d-359d59b5fc5f, cookie 0x274786fe0d1913c0 00000100:00080000:1.0:1787397737.237574:0:94333:0:(import.c:65:import_set_state_nolock()) ffff89a83670e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397737.237653:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:2401:x1874218681209600:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 590us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397737.237662:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:3.0:1787397737.238135:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209344 00000100:00100000:3.0:1787397737.238142:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209344 00000100:00100000:3.0:1787397737.238586:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209472 00000100:00100000:3.0:1787397737.238592:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209472 00000100:00100000:2.0:1787397737.238609:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1399 00000100:00100000:2.0:1787397737.238617:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681209344:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397737.238639:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397737.238646:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1353 00000100:00100000:3.0:1787397737.238657:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681209472:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397737.238690:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681209344:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 71us (3399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397737.238697:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1399 00000100:00080000:1.0:1787397737.238971:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397737.239699:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681209472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1041us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397737.239713:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1353 00010000:00010000:0.0:1787397737.316937:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787397737.459021:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397737.459034:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a709123800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397737.459227:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709123800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:0.0:1787397737.459290:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a709121800 for lustre-OST0001 00010000:00010000:2.0:1787397738.340851:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397738.757980:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397738.758160:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209728 00000100:00100000:3.0:1787397738.758176:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209728 00000100:00100000:3.0:1787397738.758264:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:3.0:1787397738.758286:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:70888:x1874218681209728:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397738.758311:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397738.758340:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81f7 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397738.758377:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 6 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397738.758391:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 6 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397738.758401:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:3.0:1787397738.758491:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681209728:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 217us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397738.758511:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:2.0:1787397738.763482:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397738.763693:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209856 00000100:00100000:1.0:1787397738.763704:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209856 00000100:00100000:1.0:1787397738.763763:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:1.0:1787397738.763774:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681209856:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397738.763866:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681209856:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 94us (394us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397738.763875:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787397738.780621:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397738.780722:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681209984 00000100:00100000:2.0:1787397738.780733:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681209984 00000100:00100000:2.0:1787397738.780793:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:2.0:1787397738.780815:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681209984:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397738.780834:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397738.780859:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d81fe expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397738.780905:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 7 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397738.780919:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 7 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397738.780928:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1a00, rc 0) 00000100:00100000:2.0:1787397738.780995:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681209984:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397738.781003:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:2.0:1787397738.786362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397738.786646:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210112 00000100:00100000:3.0:1787397738.786658:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210112 00000100:00100000:3.0:1787397738.786719:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:3.0:1787397738.786730:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681210112:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787397738.791086:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787397738.791572:0:94335:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 120 20000000:01000000:3.0:1787397738.792852:0:94338:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787397738.792858:0:94338:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787397738.792861:0:94338:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787397738.792863:0:94338:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787397738.792878:0:94338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:0.0:1787397738.798026:0:94335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787397738.798461:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681210112:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 11726us (12101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397738.798479:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:2.0:1787397738.802397:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397738.802455:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210240 00000100:00100000:1.0:1787397738.802466:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210240 00000100:00100000:1.0:1787397738.802559:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:1.0:1787397738.802570:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681210240:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397738.802752:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681210240:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 183us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397738.802762:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:2.0:1787397738.812932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397738.813747:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210368 00000100:00100000:0.0:1787397738.813764:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210368 00000100:00100000:0.0:1787397738.813840:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787397738.813851:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681210368:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397738.813867:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397738.813894:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030200/0x274786fe0d1913d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8205 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.813922:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030200/0x274786fe0d1913d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8205 expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.813933:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030200/0x274786fe0d1913d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8205 expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.813963:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030200, rc 0) 00000100:00100000:0.0:1787397738.814041:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210368:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397738.814048:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787397738.820382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397738.820571:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210496 00000100:00100000:2.0:1787397738.820584:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210496 00000100:00100000:2.0:1787397738.820645:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:2.0:1787397738.820655:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210496:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397738.820934:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210496:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 270us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397738.820943:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787397738.832782:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397738.833129:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210624 00000100:00100000:1.0:1787397738.833146:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210624 00000100:00100000:1.0:1787397738.833296:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:1.0:1787397738.833307:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210624:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397738.833474:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210624:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 168us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397738.833481:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787397738.846581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397738.846720:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210752 00000100:00100000:3.0:1787397738.846739:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210752 00000100:00100000:3.0:1787397738.846897:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787397738.846911:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681210752:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397738.849686:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397738.850593:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d820c expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.850654:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.850669:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397738.850679:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00000100:00100000:0.0:1787397738.850781:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681210752:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 3872us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397738.850792:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:2.0:1787397738.856380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397738.856581:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681210880 00000100:00100000:1.0:1787397738.856592:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681210880 00000100:00100000:1.0:1787397738.856662:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:1.0:1787397738.856680:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681210880:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397738.856933:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681210880:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 253us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397738.856941:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00010000:00010000:1.0:1787397739.365088:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397740.389756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397740.516665:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397740.516676:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397740.516680:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397740.516683:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397740.516687:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397740.516695:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3614 00000100:00080000:2.0:1787397740.516700:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397740.516708:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397740.516759:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5f800 x1874218701086080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397740.516810:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397740.516814:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397740.516815:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397740.516833:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3614 00000100:00080000:2.0:1787397740.516836:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397740.516839:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397740.516852:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5f480 x1874218701086336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397740.516877:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397740.516880:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397740.516882:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397740.516886:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3614 00000100:00080000:2.0:1787397740.516889:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397740.516921:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397740.516936:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5f100 x1874218701086592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397740.516965:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397740.516968:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397740.516970:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397740.516974:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3614 00000100:00080000:2.0:1787397740.516976:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787397740.516979:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397740.516990:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829b40e00 x1874218701086976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397740.517040:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701086848:0@lo:400:kworker.0 00000100:00100000:2.0:1787397740.517126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.517164:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397740.517170:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701086208:0@lo:400:kworker.0 00000100:00100000:0.0:1787397740.517172:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397730/real 1787397730] req@ffff89a835b66a00 x1874218701084416/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397740.517194:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a835b66a00 x1874218701084416/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397740.517206:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701086080:0@lo:38:kworker.0 00000100:00100000:0.0:1787397740.517251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.517275:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701086336:0@lo:38:kworker.0 00000100:00100000:0.0:1787397740.517306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.517323:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701086592:0@lo:38:kworker.0 00000100:00100000:0.0:1787397740.517345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.517361:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701086976:0@lo:38:kworker.0 00000100:00100000:0.0:1787397740.517381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.517517:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086848 00000100:00100000:3.0:1787397740.517539:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086848 00000100:00100000:3.0:1787397740.517598:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1787397740.517609:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701086848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.517658:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701086848:12345-0@lo:400:kworker.0 Request processed in 52us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.517665:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1787397740.518026:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701086464:0@lo:400:kworker.0 00000100:00100000:2.0:1787397740.518078:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086592 00000100:00100000:2.0:1787397740.518083:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086592 00000100:00100000:2.0:1787397740.518427:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1787397740.518433:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701086592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397740.518455:0:23942:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397740.518492:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701086592:12345-0@lo:38:kworker.0 Request processed in 57us (1145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397740.518498:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00080000:3.0:1787397740.518604:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397740.518624:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701086720:0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.518655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.518699:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086720 00000100:00100000:3.0:1787397740.518703:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086720 00000100:00100000:3.0:1787397740.519008:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1787397740.519018:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701086720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.519070:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701086720:12345-0@lo:400:kworker.0 Request processed in 55us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.519077:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00080000:3.0:1787397740.519097:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397740.519134:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701086720:0@lo:400:kworker.0 00000100:00080000:0.0:1787397740.534349:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397740.534381:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787397740.534400:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701084416:0@lo:250:kworker.0 00000100:00080000:0.0:1787397740.534449:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397740.534453:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397740.534456:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701086592:0@lo:38:kworker.0 00000100:00100000:1.0:1787397740.537255:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086080 00000100:00100000:1.0:1787397740.537271:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086080 00000100:00080000:1.0:1787397740.537296:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397740.537301:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787397740.537305:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397740.537312:0:83690:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3609 00000100:00080000:1.0:1787397740.537317:0:83690:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397740.537322:0:83690:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397740.537360:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1aaa00 x1874218701087104/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1787397740.537428:0:94327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1787397740.537448:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537461:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537468:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787397740.537483:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537493:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720b800/0x274786fe0d190cb9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190cc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537512:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537565:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537571:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537575:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537579:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62a00/0x274786fe0d1910be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1910c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537589:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537596:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537601:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537604:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537608:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62c00/0x274786fe0d1910cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1910d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537616:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537623:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537628:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537631:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537634:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d1910da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1910e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537653:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537659:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537664:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537667:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537671:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d1910e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1910ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537680:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537686:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537691:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537694:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537697:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1910f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1910fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537706:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537712:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537717:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537727:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537731:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800030a00/0x274786fe0d19110b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d191112 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537742:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537747:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537752:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537755:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537758:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d191119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d191120 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537770:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537775:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537780:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537783:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537787:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d190c2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190c34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537798:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537804:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537820:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397740.537824:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537827:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d190c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190c50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537840:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537846:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537851:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397740.537854:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537857:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720a200/0x274786fe0d190c57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190c5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537866:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537872:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537877:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397740.537880:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537883:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d190c81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190c88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.537890:0:94327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397740.537906:0:94327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397740.537912:0:94327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787397740.537915:0:94327:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787397740.537919:0:94327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8345f1a00/0x274786fe0d190cab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d190cb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787397740.537934:0:94327:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 70, was 0): CONNECTING 00000100:00080000:1.0:1787397740.537938:0:94327:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1787397740.538018:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086336 00000100:00100000:1.0:1787397740.538023:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086336 00000100:00100000:1.0:1787397740.538041:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086976 00000100:00100000:1.0:1787397740.538044:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086976 00000100:00100000:1.0:1787397740.538074:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1787397740.538081:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086080:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397740.538119:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397740.538194:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086080:12345-0@lo:38:kworker.0 Request processed in 111us (20954us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397740.538201:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1787397740.538218:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1787397740.538223:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397740.538232:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397740.538271:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086336:12345-0@lo:38:kworker.0 Request processed in 47us (20964us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397740.538277:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:1.0:1787397740.538296:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1787397740.538301:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397740.538309:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397740.538332:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701086976:12345-0@lo:38:kworker.0 Request processed in 31us (20951us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397740.538337:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1787397740.538381:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.538430:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701086848:0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.538456:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086208 00000100:00100000:1.0:1787397740.538459:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086208 00000100:00100000:1.0:1787397740.538499:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1787397740.538506:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.538578:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701086208:12345-0@lo:400:kworker.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.538583:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1787397740.538611:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701086208:0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.538629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.538658:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701086464 00000100:00100000:1.0:1787397740.538662:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701086464 00000100:00100000:1.0:1787397740.538687:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1787397740.538693:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.538724:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701086464:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.538729:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1787397740.538754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701086464:0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.538785:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701087104:0@lo:250:kworker.0 00000100:00100000:1.0:1787397740.538844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397740.538879:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397740.538884:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397740.538887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701086080:0@lo:38:kworker.0 00000100:00080000:1.0:1787397740.538896:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397740.538899:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397740.538901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701086336:0@lo:38:kworker.0 00000100:00080000:1.0:1787397740.538909:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397740.538912:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397740.538914:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701086976:0@lo:38:kworker.0 00000100:00100000:1.0:1787397740.538949:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087104 00000100:00100000:1.0:1787397740.538953:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087104 00000100:00100000:1.0:1787397740.538974:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787397740.538978:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3647:x1874218701087104:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1787397740.538995:0:94335:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3619 last 0 00000020:00000080:1.0:1787397740.539022:0:94335:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d1913e3 00000100:00080000:1.0:1787397740.539166:0:94335:0:(import.c:65:import_set_state_nolock()) ffff89a709123800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787397740.539174:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397740.539205:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218701087104:12345-0@lo:250:kworker.0 Request processed in 225us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.539212:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787397740.539253:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 10000000:01000000:1.0:1787397740.539263:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1787397740.539266:0:3647:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x274786fe0d1913e3 00000100:00080000:1.0:1787397740.551602:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1787397740.551617:0:3647:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1787397740.552425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701087104:0@lo:250:kworker.0 00000100:00080000:2.0:1787397740.552577:0:94339:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.160@tcp to MGS@0@lo 00000100:00100000:2.0:1787397740.552583:0:94339:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787397740.552587:0:94339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1787397740.552599:0:94339:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1787397740.552604:0:94339:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1787397740.552606:0:94339:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787397740.552639:0:94339:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1787397740.552643:0:94339:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) MGC192.168.204.160@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:0.0:1787397740.552905:0:83690:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:0.0:1787397740.552929:0:83690:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1787397740.552932:0:83690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397740.552934:0:83690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397740.552935:0:83690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.552936:0:83690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.552938:0:83690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.552939:0:83690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.552940:0:83690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397740.552942:0:83690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.552944:0:83690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397740.553000:0:83690:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397740.553008:0:83690:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1787397740.553010:0:83690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397740.553011:0:83690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397740.553012:0:83690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.553013:0:83690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.553014:0:83690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.553016:0:83690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.553023:0:83690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397740.553024:0:83690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.553026:0:83690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397740.553046:0:83690:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1787397740.553051:0:83690:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1787397740.553053:0:83690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1787397740.553055:0:83690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397740.553056:0:83690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.553057:0:83690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.553058:0:83690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.553060:0:83690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.553061:0:83690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397740.553062:0:83690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.553063:0:83690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1787397740.553073:0:83690:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1787397740.553090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397740.553101:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701087232:0@lo:253:kworker.0 00000100:00100000:0.0:1787397740.553101:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701087360:0@lo:253:kworker.0 00000100:00080000:3.0:1787397740.553205:0:94327:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1787397740.553215:0:94327:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787397740.553262:0:94327:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787397740.553268:0:94327:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787397740.553375:0:94327:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787397740.553398:0:94327:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787397740.553402:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787397740.553403:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397740.553405:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397740.553406:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397740.553407:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397740.553408:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397740.553409:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397740.553410:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397740.553411:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397740.553412:0:94327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397740.553415:0:94327:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787397740.553417:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787397740.553418:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397740.553419:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397740.553420:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397740.553421:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397740.553422:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397740.553423:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397740.553424:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397740.553425:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397740.553426:0:94327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397740.553443:0:94327:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787397740.553453:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701087616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397740.560062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.560117:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397740.560131:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701087488:0@lo:253:kworker.0 00000100:00100000:0.0:1787397740.560182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.560215:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087360 00000100:00100000:0.0:1787397740.560223:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087360 00000100:00100000:0.0:1787397740.560282:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087488 00000100:00100000:0.0:1787397740.560285:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087488 00000100:00100000:0.0:1787397740.560301:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397740.560308:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+6:3648:x1874218701087360:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397740.560341:0:94333:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787397740.560354:0:94333:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787397740.560478:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397740.560486:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:3648:x1874218701087488:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787397740.560501:0:94334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787397740.568835:0:94333:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397740.569005:0:94333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787397740.571015:0:94334:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397740.571323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.571384:0:94335:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1787397740.571391:0:94335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1787397740.571484:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087232 00000100:00100000:2.0:1787397740.571491:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087232 00000100:00100000:2.0:1787397740.571594:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787397740.571603:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+7:3650:x1874218701087232:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787397740.571631:0:94340:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787397740.571676:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787397740.571680:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787397740.571699:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.571717:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.571726:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.571760:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.571787:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 9 pid: 94335 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.571801:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701087744:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397740.572167:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:3648:x1874218701087360:12345-0@lo:253:kworker.0 Request processed in 11857us (12111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.572257:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000004:0.0:1787397740.572317:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397740.572319:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397740.572321:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.572322:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.572323:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.572324:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.572326:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397740.572328:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.572329:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397740.572332:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701087360:0@lo:253:kworker.0 00000100:00100000:2.0:1787397740.572639:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.572809:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.575315:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087616 00000100:00100000:3.0:1787397740.575327:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087616 00000100:00100000:3.0:1787397740.575378:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787397740.575387:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:94327:x1874218701087616:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397740.575633:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7f00 going to sleep for 11 seconds 20000000:01000000:3.0:1787397740.578875:0:94335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397740.578879:0:94335:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787397740.578883:0:94335:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1787397740.578899:0:94335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787397740.582303:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:94327:x1874218701087616:12345-0@lo:253:mount.lustre.0 Request processed in 6906us (9482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.582320:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397740.582555:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701087616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397740.582571:0:94327:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787397740.582574:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397740.582576:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787397740.582577:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397740.582579:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397740.582580:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397740.582581:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397740.582582:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397740.582584:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787397740.582585:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397740.582587:0:94327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397740.582613:0:94327:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70a901000 from lustre-MDT0000 10000000:01000000:2.0:1787397740.582643:0:94327:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787397740.582647:0:94327:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397740.582655:0:94327:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a70a901000 10000000:01000000:2.0:1787397740.582659:0:94327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787397740.582665:0:94327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a70a901000 10000000:01000000:2.0:1787397740.582668:0:94327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787397740.582671:0:94327:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a70a901000 from 1 10000000:01000000:2.0:1787397740.582674:0:94327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787397740.582720:0:94327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.582733:0:94327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.582756:0:94327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.582776:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701087872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397740.582811:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.582846:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60e180 going to sleep for 11 seconds 20000000:01000000:0.0:1787397740.583102:0:94334:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397740.583107:0:94334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787397740.584343:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:3648:x1874218701087488:12345-0@lo:253:kworker.0 Request processed in 23852us (24155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.584356:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397740.584398:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701087872 00000100:00100000:0.0:1787397740.584405:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701087872 00000100:00100000:0.0:1787397740.584439:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397740.584447:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:94327:x1874218701087872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.584460:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397740.584480:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030600/0x274786fe0d1913f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1913f1 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.584505:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030600/0x274786fe0d1913f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1913f1 expref: 7 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.584517:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030600/0x274786fe0d1913f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1913f1 expref: 7 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.584556:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030600, rc 0) 00000100:00100000:0.0:1787397740.584586:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:94327:x1874218701087872:12345-0@lo:101:mount.lustre.0 Request processed in 139us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.584592:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000004:0.0:1787397740.584637:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1787397740.584640:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787397740.584641:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.584642:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.584644:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.584645:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.584646:0:3648:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397740.584647:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.584649:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787397740.584652:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701087488:0@lo:253:kworker.0 20000000:01000000:2.0:1787397740.585359:0:94340:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397740.585512:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701087872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397740.585553:0:94327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.585564:0:94327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.585581:0:94327:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787397740.585598:0:94327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.585606:0:94327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.585614:0:94327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787397740.585619:0:94327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787397740.585625:0:94327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a70a901000 10000000:01000000:2.0:1787397740.585627:0:94327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787397740.585631:0:94327:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787397740.585633:0:94327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787397740.585669:0:94327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.585677:0:94327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.585686:0:94327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397740.587565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397740.587642:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397740.587702:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.587752:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.587900:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211008 00000100:00100000:3.0:1787397740.587909:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211008 00010000:00010000:3.0:1787397740.587946:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 10 pid: 94335 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397740.587991:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2623 00000100:00100000:3.0:1787397740.588001:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681211008:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397740.588018:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397740.588025:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 10 pid: 94335 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588042:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 10 pid: 94335 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588064:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588086:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787397740.588102:0:8451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016422465s 00010000:00010000:3.0:1787397740.588107:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588114:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588120:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588126:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588132:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397740.588137:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588145:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588154:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.588167:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397740.588231:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681211008:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 231us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.588253:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2623 00010000:00010000:1.0:1787397740.589386:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23c00/0x274786fe0d1913c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f7 expref: 9 pid: 94335 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397740.589408:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701087744:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787397740.589433:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.589442:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.589448:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.589454:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8016a1c00/0x274786fe0d1913ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397740.589638:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088000 00000100:00100000:0.0:1787397740.589645:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088000 00000100:00100000:0.0:1787397740.589687:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397740.589696:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+7:94327:x1874218701088000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.589721:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397740.589736:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1913ff expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.589757:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1913ff expref: 8 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.589767:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1913ff expref: 8 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.589774:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031200, rc 0) 00000100:00100000:0.0:1787397740.589840:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:94327:x1874218701088000:12345-0@lo:101:mount.lustre.0 Request processed in 145us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.589847:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397740.589916:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.589929:0:94327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.589937:0:94327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397740.590010:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397740.590042:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.590066:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.590595:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088128 00000100:00100000:3.0:1787397740.590601:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088128 00000100:00100000:3.0:1787397740.590642:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397740.590651:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:94327:x1874218701088128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397740.590795:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701088128:12345-0@lo:501:mount.lustre.0 Request processed in 145us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.590803:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787397740.591449:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397740.591489:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397740.591565:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.591589:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.591665:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088256 00000100:00100000:0.0:1787397740.591669:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088256 00000100:00100000:0.0:1787397740.591709:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787397740.591716:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701088256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397740.591822:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701088256:12345-0@lo:503:mount.lustre.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.591829:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397740.592143:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701088256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397740.593914:0:94341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701088384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397740.593989:0:94341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.594023:0:94341:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397740.594198:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088384 00000100:00100000:2.0:1787397740.594204:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088384 00000100:00100000:2.0:1787397740.594260:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397740.594269:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:94341:x1874218701088384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397740.595393:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:94341:x1874218701088384:12345-0@lo:502:llog_process_th.0 Request processed in 1120us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.595403:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787397740.595694:0:94341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701088384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397740.595740:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397740.595751:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.595761:0:94341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787397740.595768:0:94341:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787397740.595771:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397740.595784:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a703c899c0) 00000020:00000080:0.0:1787397740.595809:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1787397740.595815:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787397740.596083:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787397740.596093:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d191414 20000000:01000000:2.0:1787397740.596302:0:94340:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397740.596320:0:94340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787397740.596470:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397740.596475:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397740.596497:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596512:0:94337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397740.596547:0:94337:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016422465s 00010000:00010000:1.0:1787397740.596552:0:94337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596559:0:94337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596578:0:94337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596586:0:94337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596592:0:94337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397740.596597:0:94337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596606:0:94337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596618:0:94337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596625:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.596631:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74200/0x274786fe0d19141b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.597141:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218701087232:12345-0@lo:253:kworker.0 Request processed in 25536us (25818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.597159:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:0.0:1787397740.597372:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787397740.597381:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397740.597385:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.597387:0:94341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787397740.597390:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397740.597395:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.597396:0:94341:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787397740.597400:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397740.597409:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a703c88000) 00000020:00000080:0.0:1787397740.597428:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1787397740.597432:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787397740.597434:0:94341:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787397740.597437:0:94341:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787397740.597442:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787397740.597503:0:94341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a901000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787397740.597515:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a703c8b380) 00000020:00000080:0.0:1787397740.597544:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1787397740.597601:0:94341:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787397740.597607:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d191430 00000020:00000080:0.0:1787397740.597701:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787397740.597720:0:94341:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787397740.597725:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d191437 00080000:01000000:0.0:1787397740.597730:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787397740.597735:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d19143e 00000020:01000004:1.0:1787397740.611008:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397740.611016:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397740.611018:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397740.611019:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397740.611020:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397740.611023:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397740.611025:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397740.611027:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397740.611028:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397740.611035:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701087232:0@lo:253:kworker.0 00010000:00010000:2.0:1787397740.700680:0:94341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787397740.701261:0:94341:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149700 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:2.0:1787397740.701314:0:94341:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:2.0:1787397740.701341:0:94341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:2.0:1787397740.701462:0:94341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787397740.701518:0:94341:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80a8e9240: xid 1874218701069696, transno 115964116999, client gen 21, slot idx 0 00000001:00080000:2.0:1787397740.701720:0:94341:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a70311d9c0: xid 1874218701071616, transno 115964117000, client gen 21, slot idx 1 00000001:00080000:2.0:1787397740.701726:0:94341:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a70311d540: xid 1874218681197824, transno 115964116998, client gen 23, slot idx 2 00000001:00080000:2.0:1787397740.701730:0:94341:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a70311d780: xid 1874218681197440, transno 115964116997, client gen 23, slot idx 3 00000020:00000080:2.0:1787397740.702186:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a83b9d3380) 00000020:00000080:2.0:1787397740.702206:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1787397740.702305:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787397740.702313:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d19145a 00000020:00000080:3.0:1787397740.705210:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397740.711988:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d191461 00000020:00000080:3.0:1787397740.714260:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787397740.714274:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397740.714283:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.714285:0:94341:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787397740.714290:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397740.714293:0:94341:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787397740.714295:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397740.714297:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397740.714298:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397740.714300:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.714301:0:94341:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397740.714303:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397740.714308:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.714309:0:94341:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787397740.714313:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787397740.714368:0:94341:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787397740.714385:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397740.714388:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.714389:0:94341:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787397740.714392:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397740.714395:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.714396:0:94341:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787397740.714414:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397740.714420:0:94341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:3.0:1787397740.714444:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397740.714460:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a703f5b380) 00000020:00000080:3.0:1787397740.714481:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787397740.714486:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787397740.714569:0:94341:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787397740.714575:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787397740.714583:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d19146f 00010000:00080000:3.0:1787397740.714615:0:94341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a810dbd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397740.718609:0:94341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787397740.723700:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397740.723723:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787397740.723775:0:94341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787397740.723802:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d191476 00000100:00080000:0.0:1787397740.723813:0:94341:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397740.723819:0:94341:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a810dbd800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397740.724072:0:94341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b65180 x1874218701088512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397740.724097:0:94341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787397740.724161:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397740.724165:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.724167:0:94341:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787397740.724170:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397740.724173:0:94341:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787397740.724175:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397740.724176:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397740.724178:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397740.724181:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.724182:0:94341:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397740.724185:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397740.724189:0:94341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787397740.724192:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397740.724194:0:94341:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787397740.724196:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397740.724200:0:94341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787397740.724221:0:94341:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787397740.724224:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397740.724249:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a702478000) 00000020:00000080:0.0:1787397740.724265:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787397740.724271:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397740.724330:0:94341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787397740.724336:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787397740.724349:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d191484 00010000:00080000:0.0:1787397740.724379:0:94341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a817efe800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397740.724593:0:94341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1787397740.724654:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701088512:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397740.724736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.724798:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088512 00000100:00100000:1.0:1787397740.724805:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088512 00000100:00100000:1.0:1787397740.724838:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:1.0:1787397740.724846:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701088512:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787397740.724870:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3620 last 0 00000020:00000080:1.0:1787397740.724918:0:8446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d19148b 00000004:00100000:1.0:1787397740.724932:0:8446:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397740.724993:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397740.724998:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397740.725001:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397740.725008:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3619 00000100:00080000:3.0:1787397740.725011:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397740.725016:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397740.725033:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5f480 x1874218701088768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397740.725047:0:8446:0:(import.c:65:import_set_state_nolock()) ffff89a836491800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787397740.725056:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397740.725060:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397740.725061:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397740.725065:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3619 00000100:00080000:3.0:1787397740.725067:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397740.725070:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397740.725083:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5ca80 x1874218701089024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397740.725105:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701088512:12345-0@lo:38:llog_process_th.0 Request processed in 256us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.725116:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00080000:3.0:1787397740.725134:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397740.725138:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397740.725141:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397740.725146:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3619 00000100:00080000:3.0:1787397740.725149:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1787397740.725154:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701088640:0@lo:400:kworker.0 00000100:00080000:3.0:1787397740.725155:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397740.725174:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806b5f100 x1874218701089280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397740.725196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397740.725203:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397740.725207:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397740.725210:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397740.725214:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3619 00000100:00080000:3.0:1787397740.725217:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397740.725221:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397740.725224:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701089536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.725242:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee4a80 x1874218701089664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397740.725269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.725277:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701088896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.725306:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088640 00000100:00100000:1.0:1787397740.725312:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088640 00000100:00100000:3.0:1787397740.725319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.725358:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397740.725363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701088768:0@lo:38:kworker.0 00000100:00100000:1.0:1787397740.725370:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218701088640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397740.725424:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701089408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397740.725585:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088896 00000100:00100000:0.0:1787397740.725589:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088896 00000100:00100000:0.0:1787397740.725620:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1787397740.725627:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701088896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.726663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.726710:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701089024:0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.726761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.726780:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701089280:0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.726818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.726836:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701089664:0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.727056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.727097:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397740.727107:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1787397740.727116:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787397740.727122:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787397740.727126:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a810dbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787397740.727133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701088512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397740.727175:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701089152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.727202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.727271:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701088768 00000100:00100000:3.0:1787397740.727277:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701088768 00000100:00100000:3.0:1787397740.727295:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089024 00000100:00100000:3.0:1787397740.727297:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089024 00000100:00100000:3.0:1787397740.727304:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089664 00000100:00100000:3.0:1787397740.727306:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089664 00000100:00100000:3.0:1787397740.727313:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089152 00000100:00100000:3.0:1787397740.727315:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089152 00000100:00100000:3.0:1787397740.727334:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1787397740.727342:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701089152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397740.727388:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701089152:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.727395:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1787397740.727413:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1787397740.727417:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701088768:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.727459:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701088768:12345-0@lo:38:kworker.0 Request processed in 40us (801us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397740.727475:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1787397740.727486:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1787397740.727490:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701089024:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.727540:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701089024:12345-0@lo:38:kworker.0 Request processed in 29us (760us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397740.727546:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1787397740.727557:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1787397740.727561:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701089664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.727587:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701089664:12345-0@lo:38:kworker.0 Request processed in 25us (531us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397740.727593:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1787397740.727612:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089280 00000100:00100000:3.0:1787397740.727615:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089280 00000100:00100000:3.0:1787397740.727635:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1787397740.727640:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701089280:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.727668:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701089280:12345-0@lo:38:kworker.0 Request processed in 27us (849us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397740.727674:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1787397740.727730:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701089152:0@lo:400:kworker.0 00000100:00080000:3.0:1787397740.727763:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397740.727767:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397740.727770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701088768:0@lo:38:kworker.0 00000100:00080000:3.0:1787397740.727780:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397740.727783:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397740.727786:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701089024:0@lo:38:kworker.0 00000100:00080000:3.0:1787397740.727808:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397740.727811:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397740.727814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701089280:0@lo:38:kworker.0 00000100:00080000:3.0:1787397740.727821:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397740.727824:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397740.727826:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701089664:0@lo:38:kworker.0 00000100:00100000:3.0:1787397740.728091:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701089792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397740.728121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.728163:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089792 00000100:00100000:3.0:1787397740.728168:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089792 00000100:00100000:3.0:1787397740.728193:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1787397740.728199:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701089792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397740.728224:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397740.728271:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701089792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.728278:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1787397740.728310:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701089792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397740.728450:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218701088640:12345-0@lo:400:kworker.0 Request processed in 3082us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.728461:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787397740.728568:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089536 00000100:00100000:3.0:1787397740.728582:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701088640:0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.728583:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089536 00000100:00100000:1.0:1787397740.728623:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:1.0:1787397740.728631:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.728683:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701089536:12345-0@lo:400:kworker.0 Request processed in 53us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.728690:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:3.0:1787397740.729064:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701089536:0@lo:400:kworker.0 00000040:01000000:3.0:1787397740.730917:0:94341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787397740.730952:0:94341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787397740.731651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.731794:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089408 00000100:00100000:1.0:1787397740.731803:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089408 00000100:00100000:1.0:1787397740.731860:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1787397740.731870:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397740.731942:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701089408:12345-0@lo:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.731950:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1787397740.732129:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701089408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397740.733693:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701088896:12345-0@lo:400:kworker.0 Request processed in 8058us (8367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.733716:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000040:00080000:2.0:1787397740.733752:0:94341:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000100:00100000:1.0:1787397740.733818:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701088896:0@lo:400:kworker.0 00000040:00080000:2.0:1787397740.734769:0:94341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397740.734801:0:94341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:2.0:1787397740.735106:0:94341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1787397740.737730:0:94347:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:2.0:1787397740.737739:0:94347:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787397740.738135:0:94347:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1787397740.738160:0:94347:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787397740.738338:0:94347:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1787397740.738342:0:94347:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787397740.738991:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787397740.739004:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787397740.739043:0:94341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787397740.739077:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d191492 00000100:00080000:3.0:1787397740.739087:0:94341:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787397740.739093:0:94341:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397740.739127:0:94341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee4380 x1874218701089920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397740.739160:0:94341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787397740.739201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701089920:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1787397740.739231:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397740.739246:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.739248:0:94341:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787397740.739252:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787397740.739255:0:94341:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787397740.739257:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397740.739258:0:94341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787397740.739260:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787397740.739263:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.739265:0:94341:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787397740.739268:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787397740.739273:0:94341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787397740.739277:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.739279:0:94341:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787397740.739282:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787397740.739286:0:94341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000100:00100000:0.0:1787397740.739299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787397740.739307:0:94341:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787397740.739312:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787397740.739324:0:94341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a703f599c0) 00000020:00000080:3.0:1787397740.739341:0:94341:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787397740.739346:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787397740.739368:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701089920 00000100:00100000:0.0:1787397740.739376:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701089920 00000100:00100000:0.0:1787397740.739413:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988 00000004:00080000:3.0:1787397740.739419:0:94341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000100:00100000:0.0:1787397740.739422:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701089920:12345-0@lo:8:llog_process_th.0 00080000:01000000:3.0:1787397740.739427:0:94341:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787397740.739434:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d1914a0 00010000:00080000:0.0:1787397740.739453:0:26167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3620 last 0 00010000:00080000:3.0:1787397740.739470:0:94341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a830a0f800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00000020:00000080:0.0:1787397740.739480:0:26167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1914a7 00002000:00100000:0.0:1787397740.739495:0:26167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a817efd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787397740.739500:0:26167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787397740.739502:0:26167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397740.739597:0:26167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787397740.739620:0:26167:0:(import.c:65:import_set_state_nolock()) ffff89a817eff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397740.739673:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701089920:12345-0@lo:8:llog_process_th.0 Request processed in 251us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.739681:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988 00010000:00010000:3.0:1787397740.739703:0:94341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1787397740.739748:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397740.739763:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397740.739771:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000040:01000000:3.0:1787397740.739774:0:94341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1787397740.739777:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787397740.739781:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:3.0:1787397740.739790:0:94341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000004:00080000:0.0:1787397740.739790:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397740.739798:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701089920:0@lo:8:llog_process_th.0 00000040:00080000:3.0:1787397740.741103:0:94341:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000004:00080000:2.0:1787397740.742026:0:94347:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787397740.742081:0:94347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3620032558602ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787397740.742086:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00080000:00080000:2.0:1787397740.742090:0:94347:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1787397740.742108:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701090048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397740.742179:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.742275:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090048 00000100:00100000:2.0:1787397740.742283:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090048 00000100:00100000:2.0:1787397740.742349:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:2.0:1787397740.742357:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701090048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397740.742387:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787397740.742387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397740.742443:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701090048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.742450:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1787397740.742520:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701090048:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787397740.744463:0:94341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397740.744494:0:94341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:0.0:1787397740.744680:0:94341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000004:00080000:0.0:1787397740.745725:0:94328:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1787397740.747831:0:94349:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:1.0:1787397740.747839:0:94349:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787397740.749532:0:94349:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:1.0:1787397740.749573:0:94349:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787397740.750303:0:94349:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1787397740.750310:0:94349:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787397740.750785:0:94341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397740.750798:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787397740.750878:0:94341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787397740.750909:0:94341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1914ae 00000100:00080000:1.0:1787397740.750926:0:94341:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397740.750931:0:94341:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397740.750968:0:94341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a9180 x1874218701090176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397740.750996:0:94341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787397740.751058:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397740.751062:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751064:0:94341:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787397740.751068:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397740.751072:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751074:0:94341:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787397740.751077:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787397740.751080:0:94341:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787397740.751116:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701090176:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397740.751187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787397740.751209:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397740.751213:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751214:0:94341:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787397740.751227:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397740.751230:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751231:0:94341:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787397740.751244:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787397740.751250:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397740.751252:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751254:0:94341:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1787397740.751256:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397740.751260:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.751261:0:94341:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1787397740.751264:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00000100:00100000:2.0:1787397740.751289:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090176 00000100:00100000:2.0:1787397740.751296:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090176 00020000:01000000:1.0:1787397740.751302:0:94341:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1787397740.751349:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989 00000100:00100000:2.0:1787397740.751357:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701090176:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787397740.751385:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3620 last 0 00000020:00000080:2.0:1787397740.751413:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1914b5 00002000:00100000:2.0:1787397740.751425:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a83ae97000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787397740.751429:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787397740.751432:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397740.751494:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787397740.751517:0:8435:0:(import.c:65:import_set_state_nolock()) ffff89a83ae92000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397740.751582:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701090176:12345-0@lo:8:llog_process_th.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.751589:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989 00000100:00100000:0.0:1787397740.751678:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397740.751686:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787397740.751693:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787397740.751698:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787397740.751700:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787397740.751721:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787397740.751727:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701090176:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397740.751859:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701090304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397740.751892:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.751976:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090304 00000100:00100000:2.0:1787397740.751981:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090304 00000100:00100000:2.0:1787397740.752027:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1787397740.752034:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701090304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397740.752053:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397740.752087:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701090304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.752094:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00080000:0.0:1787397740.752152:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397740.752178:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701090304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397740.752210:0:94341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701090432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397740.752469:0:94341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.752501:0:94341:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa300 going to sleep for 11 seconds 00000004:00080000:1.0:1787397740.752518:0:94349:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787397740.752611:0:94349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3620043087827ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397740.752630:0:94349:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787397740.753082:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090432 00000100:00100000:2.0:1787397740.753089:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090432 00000100:00100000:2.0:1787397740.753135:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787397740.753143:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:94341:x1874218701090432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397740.753259:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:94341:x1874218701090432:12345-0@lo:502:llog_process_th.0 Request processed in 115us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.753267:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787397740.754625:0:94341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701090432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397740.754674:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397740.754690:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.754692:0:94341:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:1.0:1787397740.754697:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397740.754703:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.754704:0:94341:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1787397740.754708:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1787397740.754726:0:94341:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1787397740.755357:0:94341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701090560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397740.755427:0:94341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.755474:0:94341:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.755480:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090560 00000100:00100000:3.0:1787397740.755488:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090560 00000100:00100000:3.0:1787397740.755559:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787397740.755569:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:94341:x1874218701090560:12345-0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787397740.755578:0:94351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a901000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787397740.755584:0:94351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 4 00000100:00100000:3.0:1787397740.755691:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:94341:x1874218701090560:12345-0@lo:502:llog_process_th.0 Request processed in 123us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.755700:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397740.755860:0:94341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94341:1874218701090560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397740.755883:0:94341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397740.755889:0:94341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397740.755891:0:94341:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397740.755895:0:94341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1787397740.756052:0:94327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:2.0:1787397740.756074:0:94327:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787397740.756095:0:94327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.756106:0:94327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.756114:0:94327:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 1 10000000:01000000:2.0:1787397740.756117:0:94327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397740.756145:0:94327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.756154:0:94327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.756170:0:94327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.756184:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397740.756214:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.756252:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.756561:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090688 00000100:00100000:0.0:1787397740.756566:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090688 00000100:00100000:0.0:1787397740.756606:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787397740.756614:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:94327:x1874218701090688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.756624:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397740.756638:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1914bc expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.756660:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1914bc expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.756669:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914bc expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.756679:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00000100:00100000:0.0:1787397740.756857:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701090688:12345-0@lo:101:mount.lustre.0 Request processed in 242us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.756864:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787397740.756958:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397740.756980:0:94327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.756989:0:94327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397740.757922:0:94328:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787397740.758012:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090816:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787397740.758064:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.758476:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daa300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.759226:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090816 00000100:00100000:3.0:1787397740.759247:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090816 00000100:00100000:3.0:1787397740.759341:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397740.759351:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701090816:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787397740.759374:0:94333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787397740.759394:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787397740.759398:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787397740.759401:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787397740.759403:0:94333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:3.0:1787397740.759539:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701090816:12345-0@lo:256:mount.lustre.0 Request processed in 170us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.759548:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787397740.759648:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090816:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787397740.760285:0:94327:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397740.760310:0:94327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.760320:0:94327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.760328:0:94327:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a70a901000 from 1 10000000:01000000:2.0:1787397740.760331:0:94327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397740.760368:0:94327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.760376:0:94327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.760385:0:94327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.760403:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397740.760442:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.762137:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397740.762273:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701090944 00000100:00100000:1.0:1787397740.762281:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701090944 00000100:00100000:1.0:1787397740.762341:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397740.762349:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:94327:x1874218701090944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397740.762365:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397740.762383:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74200/0x274786fe0d1914d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1914ca expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.762410:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74200/0x274786fe0d1914d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1914ca expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.762422:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74200/0x274786fe0d1914d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914ca expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.762431:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74200, rc 0) 00000100:00100000:1.0:1787397740.762489:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701090944:12345-0@lo:101:mount.lustre.0 Request processed in 141us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.762496:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397740.762578:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701090944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397740.762595:0:94327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.762603:0:94327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397740.762673:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397740.762880:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.762915:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397740.762929:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091072 00000100:00100000:1.0:1787397740.762933:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091072 00000100:00100000:1.0:1787397740.762951:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397740.762957:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701091072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397740.763066:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701091072:12345-0@lo:501:mount.lustre.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.763073:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397740.763106:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397740.763132:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397740.763172:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.763184:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397740.763196:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091200 00000100:00100000:1.0:1787397740.763199:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091200 00000100:00100000:1.0:1787397740.763215:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397740.763220:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701091200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397740.763299:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701091200:12345-0@lo:503:mount.lustre.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.763306:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397740.763345:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397740.766193:0:94352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94352:1874218701091328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397740.766294:0:94352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.766340:0:94352:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397740.766559:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091328 00000100:00100000:1.0:1787397740.766567:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091328 00000100:00100000:1.0:1787397740.766610:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787397740.766620:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94352:x1874218701091328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397740.768410:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:94352:x1874218701091328:12345-0@lo:502:llog_process_th.0 Request processed in 1782us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.768426:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397740.768517:0:94352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94352:1874218701091328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397740.768874:0:94352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397740.768885:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.768888:0:94352:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787397740.768894:0:94352:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70a901000 00000020:00000080:3.0:1787397740.768897:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787397740.768905:0:94352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397740.768907:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.768909:0:94352:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787397740.768911:0:94352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397740.768913:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.768915:0:94352:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787397740.768918:0:94352:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70a901000 00000020:00000080:3.0:1787397740.768920:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787397740.769061:0:94352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94352:1874218701091456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397740.769122:0:94352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.769167:0:94352:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.769230:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091456 00000100:00100000:0.0:1787397740.769247:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091456 00000100:00100000:0.0:1787397740.769298:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787397740.769307:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:94352:x1874218701091456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397740.769447:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:94352:x1874218701091456:12345-0@lo:502:llog_process_th.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.769454:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787397740.769584:0:94352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94352:1874218701091456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397740.769605:0:94352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397740.769609:0:94352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397740.769611:0:94352:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787397740.769614:0:94352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787397740.769827:0:94327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787397740.769852:0:94327:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397740.769874:0:94327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.769886:0:94327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.769945:0:94327:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787397740.769948:0:94327:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a70a901000 10000000:01000000:2.0:1787397740.769951:0:94327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a70a901000 10000000:01000000:2.0:1787397740.769955:0:94327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787397740.769962:0:94327:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70a901000 from 1 10000000:01000000:2.0:1787397740.769964:0:94327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397740.769991:0:94327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.770000:0:94327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.770009:0:94327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.770026:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397740.770057:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.770078:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.770152:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091584 00000100:00100000:0.0:1787397740.770157:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091584 00000100:00100000:0.0:1787397740.770192:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397740.770199:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:94327:x1874218701091584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.770213:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397740.770226:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1914d8 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.770256:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 11 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.770267:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 11 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.770277:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030e00, rc 0) 00000100:00100000:0.0:1787397740.770311:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701091584:12345-0@lo:101:mount.lustre.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.770318:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397740.770353:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397740.770366:0:94327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.770376:0:94327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397740.770427:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397740.770449:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.770465:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.770478:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091712 00000100:00100000:0.0:1787397740.770482:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091712 00000100:00100000:0.0:1787397740.770502:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397740.770507:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701091712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397740.770673:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701091712:12345-0@lo:501:mount.lustre.0 Request processed in 165us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.770681:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397740.770716:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397740.772206:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397740.772294:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.772404:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397740.783611:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091840 00000100:00100000:2.0:1787397740.783626:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091840 00000100:00100000:3.0:1787397740.783768:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787397740.783780:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701091840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397740.783954:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701091840:12345-0@lo:503:mount.lustre.0 Request processed in 176us (11659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.783965:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787397740.784027:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701091840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397740.786775:0:94355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701091968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397740.786848:0:94355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.786884:0:94355:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7057460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.790093:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701091968 00000100:00100000:0.0:1787397740.790107:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701091968 00000100:00100000:0.0:1787397740.790164:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397740.790174:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701091968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397740.790350:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701091968:12345-0@lo:502:llog_process_th.0 Request processed in 177us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.790371:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397740.790432:0:94355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701091968:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787397740.790493:0:94355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787397740.790511:0:94355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a7020799c0) 00000020:00000080:0.0:1787397740.790553:0:94355:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787397740.790710:0:94355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a901000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787397740.790715:0:94355:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a901000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787397740.790717:0:94355:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 4 00010000:00080000:0.0:1787397740.790746:0:94355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a828a58000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397740.792391:0:94355:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1787397740.792510:0:94355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787397740.792574:0:94355:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397740.792593:0:94355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d1914ed 00000100:00080000:0.0:1787397740.792604:0:94355:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397740.792610:0:94355:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a828a58000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397740.792655:0:94355:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a807639180 x1874218701092096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397740.792688:0:94355:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787397740.792724:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701092096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397740.792923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.793085:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092096 00000100:00100000:3.0:1787397740.793099:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092096 00000100:00100000:3.0:1787397740.793140:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1787397740.793147:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701092096:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397740.793205:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701092096:12345-0@lo:38:llog_process_th.0 Request processed in 57us (282us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787397740.793211:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1787397740.793375:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397740.793383:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397740.793387:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787397740.793391:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701092096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397740.794441:0:94355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701092224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397740.794508:0:94355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.794905:0:94355:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.796811:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092224 00000100:00100000:3.0:1787397740.796826:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092224 00000100:00100000:3.0:1787397740.796925:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397740.796936:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701092224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397740.797262:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701092224:12345-0@lo:502:llog_process_th.0 Request processed in 327us (2752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.797270:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787397740.798639:0:94355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701092224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397740.798728:0:94355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701092352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397740.799815:0:94355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.799854:0:94355:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.799902:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092352 00000100:00100000:3.0:1787397740.799909:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092352 00000100:00100000:3.0:1787397740.799964:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787397740.799973:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701092352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397740.800110:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:94355:x1874218701092352:12345-0@lo:502:llog_process_th.0 Request processed in 138us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.800118:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787397740.800275:0:94355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:94355:1874218701092352:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787397740.800302:0:94355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1787397740.801335:0:94327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:3.0:1787397740.801368:0:94327:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397740.801393:0:94327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.801405:0:94327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787397740.801479:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787397740.801482:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397740.801483:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397740.801484:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397740.801486:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397740.801487:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397740.801488:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397740.801490:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397740.801492:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397740.801493:0:94327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787397740.801497:0:94327:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787397740.801499:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787397740.801501:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397740.801502:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397740.801503:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397740.801504:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397740.801505:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397740.801507:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397740.801508:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397740.801509:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397740.801510:0:94327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787397740.801551:0:94327:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787397740.801569:0:94327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701092480:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787397740.801635:0:94327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397740.801669:0:94327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397740.801700:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092480 00000100:00100000:3.0:1787397740.801706:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092480 00000100:00100000:3.0:1787397740.801742:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787397740.801749:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701092480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787397740.802028:0:94333:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787397740.802045:0:94333:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787397740.811324:0:94333:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397740.811346:0:94333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787397740.811368:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397740.811374:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397740.811402:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.811427:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.811506:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.811638:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397740.811659:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397740.811675:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701092608:0@lo:104: 00000100:00100000:1.0:1787397740.811733:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397740.811840:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706daaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397740.811856:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092608 00000100:00100000:0.0:1787397740.811864:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092608 00000100:00100000:0.0:1787397740.811906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787397740.811915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701092608:12345-0@lo:104: 00010000:00010000:0.0:1787397740.811928:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397740.812145:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787397740.812152:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701092608:12345-0@lo:104: Request processed in 238us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397740.812159:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787397740.812221:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701092608:0@lo:104: 00010000:00010000:1.0:1787397740.812251:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813012:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397740.813021:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813031:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397740.813035:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813044:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397740.813052:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397740.813058:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397740.813110:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813117:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787397740.813259:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701092736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397740.813308:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813316:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d1914bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914c3 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.813336:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397740.813349:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397740.813351:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397740.813614:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:94327:x1874218701092480:12345-0@lo:253:mount.lustre.0 Request processed in 11862us (11977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397740.813624:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787397740.813735:0:94327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:94327:1874218701092480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397740.813747:0:94327:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787397740.813750:0:94327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397740.813752:0:94327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397740.813753:0:94327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397740.813754:0:94327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397740.813755:0:94327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397740.813757:0:94327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397740.813758:0:94327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397740.813759:0:94327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397740.813761:0:94327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397740.813762:0:94327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787397740.813774:0:94327:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787397740.817271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397740.817466:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092736 00000100:00100000:2.0:1787397740.817476:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092736 00010000:00010000:2.0:1787397740.817519:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397740.817581:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1787397740.817590:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+11:3650:x1874218701092736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397740.817605:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397740.817611:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817624:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817642:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031000/0x274786fe0d1914c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1914bc expref: 11 pid: 94334 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817660:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817668:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397740.817685:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016422465s 00010000:00010000:2.0:1787397740.817690:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817696:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817719:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817726:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817732:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397740.817737:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817744:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817772:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397740.817785:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397740.817827:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+10:3650:x1874218701092736:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.817835:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00010000:00010000:3.0:1787397740.817907:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.817915:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397740.817922:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74a00/0x274786fe0d1914f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397740.818110:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701092736:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787397740.827356:0:94327:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:3.0:1787397740.828073:0:94327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787397740.828399:0:94360:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787397740.828623:0:94327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787397740.829396:0:94360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397740.831115:0:94360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787397740.831206:0:94360:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1787397740.831803:0:94359:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:1.0:1787397740.831809:0:94359:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000100:00100000:0.0:1787397740.833039:0:94361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701092864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397740.833120:0:94361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1787397740.833593:0:94327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787397740.833639:0:94327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787397740.835478:0:94361:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806079a80 going to sleep for 11 seconds 00000004:00000080:3.0:1787397740.835995:0:94327:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787397740.836013:0:94327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787397740.836107:0:94327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397740.837989:0:94327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787397740.838288:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092864 00000100:00100000:1.0:1787397740.838299:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092864 00000100:00100000:1.0:1787397740.838410:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1787397740.838422:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701092864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397740.838575:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701092864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 156us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397740.838584:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1787397740.838671:0:94361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701092864:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787397740.838714:0:94361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787397740.838769:0:94361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701092992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397740.838813:0:94361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787397740.839098:0:94327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787397740.839141:0:94327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787397740.839270:0:94327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787397740.839986:0:94327:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00010000:00080000:3.0:1787397740.844030:0:94327:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117000 00000100:00100000:0.0:1787397740.844358:0:94361:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806079a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397740.845098:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701092992 00000100:00100000:2.0:1787397740.845109:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701092992 00000100:00100000:2.0:1787397740.845162:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1787397740.845171:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701092992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787397740.845356:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701092992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 185us (6542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.845378:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1787397740.845899:0:94361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701092992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397740.846013:0:94361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701093120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787397740.846059:0:94361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397740.846086:0:94361:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806079a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397740.847017:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093120 00000100:00100000:2.0:1787397740.847028:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093120 00000100:00100000:2.0:1787397740.847070:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1787397740.847078:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701093120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787397740.847171:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94361:x1874218701093120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397740.847179:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1787397740.847268:0:94361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94361:1874218701093120:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787397740.847326:0:94361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397740.849143:0:94361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787397740.849247:0:94361:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787397740.849252:0:94361:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1787397740.853140:0:94362:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94362 00010000:02000000:0.0:1787397740.853162:0:94362:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1787397740.853348:0:94327:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787397740.853853:0:94327:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787397740.853876:0:94327:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787397740.853902:0:94327:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787397740.860793:0:94327:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397740.861477:0:94327:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1787397740.874389:0:94362:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787397740.874395:0:94362:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1787397741.412933:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397741.544928:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701093248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397741.544997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397741.545074:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093248 00000100:00100000:1.0:1787397741.545621:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093248 00000100:00100000:1.0:1787397741.545892:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:1.0:1787397741.545904:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701093248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397741.545930:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397741.545993:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701093248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397741.546002:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1787397741.546089:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701093376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397741.546137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397741.546238:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701093248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397741.548830:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093376 00000100:00100000:2.0:1787397741.548844:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093376 00000100:00100000:2.0:1787397741.548896:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1787397741.548906:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701093376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397741.548929:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397741.549010:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701093376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397741.549018:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1787397741.549075:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701093376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397741.706137:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397741.706257:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211136 00000100:00100000:1.0:1787397741.706267:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211136 00000100:00100000:1.0:1787397741.706331:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:1.0:1787397741.706342:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681211136:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397741.706358:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397741.706379:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8213 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397741.706408:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397741.706419:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397741.706429:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00000100:00100000:1.0:1787397741.706491:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681211136:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397741.706498:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:0.0:1787397741.710597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397741.710651:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211264 00000100:00100000:1.0:1787397741.710662:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211264 00000100:00100000:1.0:1787397741.710723:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:1.0:1787397741.710734:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681211264:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397741.710762:0:94334:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1787397741.710781:0:94334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397741.710785:0:94334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787397741.710789:0:94334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1787397741.710804:0:94334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1787397741.710807:0:94334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:1.0:1787397741.721957:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681211264:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 11210us (11354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397741.721972:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787397741.731139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397741.731307:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211392 00000100:00100000:3.0:1787397741.731317:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211392 00000100:00100000:3.0:1787397741.731361:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1407 00000100:00100000:3.0:1787397741.731370:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681211392:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1787397741.731405:0:74374:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a829b19800, cookie 0x274786fe0d19144c 00010000:00080000:3.0:1787397741.731411:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t115964117001 exp ffff89a829b19800 cur 3621 last 1787397740 00010000:02000400:3.0:1787397741.731420:0:74374:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1787397741.731425:0:74374:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787397741.731454:0:74374:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787397741.731609:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397741.731679:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681211392:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 Request processed in 309us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397741.731686:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1407 00000100:00100000:0.0:1787397741.735306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397741.735380:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202048 00000100:00100000:1.0:1787397741.735389:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202048 00000100:00100000:1.0:1787397741.735443:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1408 00000100:00100000:1.0:1787397741.735454:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681202048:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:1.0:1787397741.735477:0:67264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 115964117001, current: 115964117001, replaying 00000100:00100000:1.0:1787397741.735497:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681202048:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 46us (199us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397741.735513:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1408 00010000:00080000:3.0:1787397741.735939:0:94362:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:1.0:1787397742.116615:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787397742.116624:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 124 10000000:01000000:1.0:1787397742.116629:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397742.116675:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.116687:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.116706:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397742.116731:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.116801:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.116849:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.116911:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093504 00000100:00100000:2.0:1787397742.116919:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093504 00000100:00100000:2.0:1787397742.116975:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787397742.116985:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218701093504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.116999:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397742.117012:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191502 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.117059:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191502 expref: 11 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.117070:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191502 expref: 11 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.117080:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1c00, rc 0) 00000100:00100000:2.0:1787397742.117117:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701093504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.117124:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787397742.117460:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397742.117474:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.117482:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397742.117556:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.117592:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.117609:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.117670:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093632 00000100:00100000:2.0:1787397742.117674:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093632 00000100:00100000:2.0:1787397742.117696:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397742.117702:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701093632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397742.117715:0:94333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787397742.117730:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397742.117733:0:94333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:2.0:1787397742.117798:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701093632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.117805:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787397742.118249:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787397742.118296:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787397742.118303:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.118312:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397742.118320:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397742.118322:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 58 10000000:01000000:1.0:1787397742.118329:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397742.118351:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.118358:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.118366:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397742.118380:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.118407:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.118440:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.118491:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093760 00000100:00100000:3.0:1787397742.118496:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093760 00000100:00100000:3.0:1787397742.118686:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397742.118695:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701093760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.118704:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.118716:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191510 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.118735:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191510 expref: 12 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.118757:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191510 expref: 12 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.118765:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23800, rc 0) 00000100:00100000:3.0:1787397742.118800:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701093760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.118808:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787397742.118863:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397742.118874:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.118882:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397742.119219:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.119252:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.119275:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.119314:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701093888 00000100:00100000:3.0:1787397742.119318:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701093888 00000100:00100000:3.0:1787397742.119345:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397742.119351:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701093888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.119464:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701093888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.119471:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397742.119606:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701093888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.119637:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.119675:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.119692:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.119710:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094016 00000100:00100000:1.0:1787397742.119713:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094016 00000100:00100000:1.0:1787397742.119740:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397742.119746:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701094016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.119823:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701094016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.119830:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397742.119869:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397742.121330:0:94428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1787397742.121739:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1787397742.121764:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397742.121774:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.121785:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397742.121794:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787397742.121797:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 121 10000000:01000000:1.0:1787397742.121800:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787397742.121833:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.121841:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.121851:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397742.121874:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.122273:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.122354:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.122405:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094144 00000100:00100000:3.0:1787397742.122412:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094144 00000100:00100000:3.0:1787397742.122491:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397742.122500:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701094144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.122514:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.122553:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19151e expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.122574:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19151e expref: 13 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.122584:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19151e expref: 13 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.122598:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23e00, rc 0) 00000100:00100000:3.0:1787397742.122636:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701094144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.122643:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787397742.122722:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.122736:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.122751:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.122812:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.122846:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.122877:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.122924:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094272 00000100:00100000:0.0:1787397742.122933:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094272 00000100:00100000:0.0:1787397742.123129:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787397742.123138:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701094272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397742.123346:0:94333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787397742.123363:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397742.123367:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1787397742.123369:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1787397742.123372:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1787397742.123374:0:94333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1787397742.123513:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701094272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 376us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.123641:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787397742.123712:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397742.123720:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.123728:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.123736:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397742.123738:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1787397742.123740:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397742.123761:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.123768:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.123776:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.123790:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.123819:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.123844:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.123900:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787397742.123928:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094400 00000100:00100000:0.0:1787397742.123932:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094400 00000100:00100000:0.0:1787397742.123958:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787397742.123964:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701094400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397742.124118:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397742.124131:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19152c expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.124218:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19152c expref: 14 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.124231:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19152c expref: 14 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.124240:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030a00, rc 0) 00000100:00100000:0.0:1787397742.124372:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 407us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.124387:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397742.124754:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.124769:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.124779:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397742.125113:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.125221:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397742.125303:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.125343:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094528 00000100:00100000:2.0:1787397742.125353:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094528 00000100:00100000:2.0:1787397742.125428:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787397742.125436:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.125632:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.125641:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787397742.125723:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.125756:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.125795:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397742.125880:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.125906:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094656 00000100:00100000:3.0:1787397742.125910:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094656 00000100:00100000:3.0:1787397742.125940:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397742.125947:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.126403:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 455us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.126411:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397742.126834:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397742.128154:0:94430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:0.0:1787397742.128331:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:0.0:1787397742.128353:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787397742.128363:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.128375:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397742.128385:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1787397742.128387:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:0.0:1787397742.128390:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787397742.128422:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.128430:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.128439:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397742.128468:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.128669:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397742.128734:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83b286c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.128768:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094784 00000100:00100000:3.0:1787397742.128776:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094784 00000100:00100000:3.0:1787397742.128847:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787397742.128856:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701094784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.128868:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.128881:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22a00/0x274786fe0d191541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19153a expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.128913:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22a00/0x274786fe0d191541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19153a expref: 15 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.128924:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22a00/0x274786fe0d191541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19153a expref: 15 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.128933:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22a00, rc 0) 00000100:00100000:3.0:1787397742.129139:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701094784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.129146:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787397742.129231:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.129245:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.129254:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.129269:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787397742.129273:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.129280:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.129287:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787397742.129289:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:2.0:1787397742.129291:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397742.129306:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.129313:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.129331:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.129344:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.129371:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.129423:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.129451:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701094912 00000100:00100000:3.0:1787397742.129455:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701094912 00000100:00100000:3.0:1787397742.129482:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787397742.129488:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701094912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.129494:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.129502:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22600/0x274786fe0d19154f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191548 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.129514:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22600/0x274786fe0d19154f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191548 expref: 16 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.129564:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22600/0x274786fe0d19154f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191548 expref: 16 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.129571:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22600, rc 0) 00000100:00100000:3.0:1787397742.129598:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701094912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.129604:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787397742.129714:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701094912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.129724:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.129732:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.129778:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.129801:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397742.129819:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095040 00000100:00100000:2.0:1787397742.129822:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.129824:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095040 00000100:00100000:1.0:1787397742.129858:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397742.129865:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701095040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.130246:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701095040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.130255:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787397742.130411:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.130441:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.130485:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.130508:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.130579:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095168 00000100:00100000:0.0:1787397742.130584:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095168 00000100:00100000:0.0:1787397742.130646:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787397742.130654:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701095168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.130736:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701095168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.130743:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.130743:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000040:00080000:0.0:1787397742.131883:0:94431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787397742.132238:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787397742.132263:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397742.132273:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.132308:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.132317:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397742.132319:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 58 10000000:01000000:2.0:1787397742.132322:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397742.132352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.132360:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.132369:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.132389:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.132438:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.132475:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.132561:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095296 00000100:00100000:0.0:1787397742.132567:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095296 00000100:00100000:0.0:1787397742.132602:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787397742.132611:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701095296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397742.132622:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397742.132635:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191556 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.132655:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191556 expref: 17 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.132664:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191556 expref: 17 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.132672:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00000100:00100000:0.0:1787397742.132810:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.132823:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787397742.132881:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.132896:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.132905:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.132956:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.132983:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.133109:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.133142:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095424 00000100:00100000:2.0:1787397742.133146:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095424 00000100:00100000:2.0:1787397742.133203:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787397742.133225:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.133359:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.133366:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397742.133418:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.133445:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.133480:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.133555:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.133594:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095552 00000100:00100000:2.0:1787397742.133598:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095552 00000100:00100000:2.0:1787397742.133626:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397742.133637:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.133701:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.133708:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787397742.133768:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397742.134912:0:94432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1787397742.135138:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1787397742.135161:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397742.135170:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.135182:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.135191:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787397742.135194:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787397742.135196:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397742.135236:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.135245:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.135255:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.135274:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.135322:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.135357:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.135404:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095680 00000100:00100000:3.0:1787397742.135409:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095680 00000100:00100000:3.0:1787397742.135446:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787397742.135454:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701095680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.135465:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.135477:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191564 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.135496:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191564 expref: 18 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.135543:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191564 expref: 18 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.135553:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23400, rc 0) 00000100:00100000:3.0:1787397742.135588:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701095680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.135594:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787397742.135678:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.135697:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.135706:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.135749:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.135770:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.135783:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.135824:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095808 00000100:00100000:3.0:1787397742.135828:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095808 00000100:00100000:3.0:1787397742.135854:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397742.135859:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701095808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.135979:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701095808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.135985:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787397742.136120:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.136146:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.136183:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.136203:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f60ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.136255:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701095936 00000100:00100000:3.0:1787397742.136259:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701095936 00000100:00100000:3.0:1787397742.136310:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787397742.136316:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701095936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.137178:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701095936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 859us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.137189:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787397742.137313:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701095936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397742.138283:0:94433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1787397742.138453:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787397742.138473:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787397742.138482:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.138508:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397742.138516:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397742.138690:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a702023000 from 7 10000000:01000000:3.0:1787397742.138694:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397742.138724:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.138732:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.138742:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.138763:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.138809:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.138872:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.139428:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096064 00000100:00100000:0.0:1787397742.139438:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096064 00000100:00100000:0.0:1787397742.139544:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787397742.139554:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701096064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397742.139568:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397742.139584:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a800031600/0x274786fe0d191579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191572 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.139618:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a800031600/0x274786fe0d191579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191572 expref: 19 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.139629:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a800031600/0x274786fe0d191579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191572 expref: 19 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.139638:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031600, rc 0) 00000100:00100000:0.0:1787397742.139733:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.139741:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397742.139921:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.139936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.139945:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.140009:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.140109:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.140180:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.140226:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096192 00000100:00100000:0.0:1787397742.140231:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096192 00000100:00100000:0.0:1787397742.140257:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787397742.140263:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.140362:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.140369:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787397742.140394:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.140424:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.140455:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397742.140468:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.140513:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096320 00000100:00100000:3.0:1787397742.140517:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096320 00000100:00100000:3.0:1787397742.140898:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787397742.140906:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.140990:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.140997:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787397742.141154:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397742.142401:0:94434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787397742.142643:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787397742.142667:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397742.142678:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.142690:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.142700:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397742.142702:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 58 10000000:01000000:2.0:1787397742.142705:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397742.142737:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.142753:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.142763:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.142785:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.142838:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.142879:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819136e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.143394:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096448 00000100:00100000:3.0:1787397742.143401:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096448 00000100:00100000:3.0:1787397742.143452:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787397742.143461:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701096448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.143474:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397742.143488:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191580 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.143510:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191580 expref: 20 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.143553:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191580 expref: 20 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.143563:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:3.0:1787397742.143607:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.143615:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787397742.143799:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.143813:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.143822:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.143883:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.144138:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.144169:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819136e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.144265:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096576 00000100:00100000:1.0:1787397742.144271:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096576 00000100:00100000:1.0:1787397742.144307:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787397742.144314:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.144434:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.144441:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787397742.144779:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.144811:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.144866:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.144906:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.144956:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096704 00000100:00100000:1.0:1787397742.144960:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096704 00000100:00100000:1.0:1787397742.145018:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787397742.145026:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.145112:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.145119:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397742.145437:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397742.146824:0:94435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1787397742.147228:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1787397742.147253:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397742.147263:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.147275:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397742.147285:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787397742.147287:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787397742.147290:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397742.147322:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.147330:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.147341:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.147362:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.147413:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.147484:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.147643:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096832 00000100:00100000:1.0:1787397742.147650:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096832 00000100:00100000:1.0:1787397742.147740:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787397742.147750:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701096832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397742.147762:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397742.147775:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19158e expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.147797:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19158e expref: 21 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.147809:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19158e expref: 21 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.147817:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75a00, rc 0) 00000100:00100000:1.0:1787397742.147862:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701096832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.147868:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787397742.147969:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.147984:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.148003:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.148058:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.148086:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.148347:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397742.148420:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701096960 00000100:00100000:2.0:1787397742.148426:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701096960 00000100:00100000:2.0:1787397742.148464:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787397742.148472:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701096960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.148637:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701096960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.148651:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787397742.148686:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701096960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.148714:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.148755:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.148774:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097088 00000100:00100000:2.0:1787397742.148778:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097088 00000100:00100000:2.0:1787397742.148793:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787397742.148799:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701097088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.149178:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819136e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397742.151181:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701097088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2372us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.151194:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787397742.151225:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397742.152182:0:94436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1787397742.152487:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1787397742.152515:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787397742.152553:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.152565:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397742.152574:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397742.152577:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a836577000 from 7 10000000:01000000:3.0:1787397742.152580:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397742.152630:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.152639:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.152649:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.152685:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.152732:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.152770:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.152918:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097216 00000100:00100000:1.0:1787397742.152934:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097216 00000100:00100000:1.0:1787397742.153111:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787397742.153121:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701097216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397742.153134:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397742.153159:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74400/0x274786fe0d1915a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19159c expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.153180:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74400/0x274786fe0d1915a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19159c expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.153192:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74400/0x274786fe0d1915a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19159c expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.153225:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:1.0:1787397742.153273:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.153280:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787397742.153567:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397742.153581:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.153590:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.153647:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.153675:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.153747:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.154484:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097344 00000100:00100000:0.0:1787397742.154492:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097344 00000100:00100000:0.0:1787397742.154570:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787397742.154580:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.154716:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.154723:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787397742.154839:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.154880:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.154958:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.154986:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819136000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.155103:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097472 00000100:00100000:1.0:1787397742.155108:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097472 00000100:00100000:1.0:1787397742.155144:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787397742.155201:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397742.155297:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.155304:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787397742.155330:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787397742.156327:0:94437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397742.156664:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397742.156690:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397742.156700:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.156713:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397742.156723:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1787397742.156725:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:3.0:1787397742.156728:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787397742.156760:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.156782:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397742.156792:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397742.156813:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397742.156870:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397742.156908:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685000 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.157107:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097600 00000100:00100000:0.0:1787397742.157114:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097600 00000100:00100000:0.0:1787397742.157161:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787397742.157170:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701097600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397742.157182:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397742.157196:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345f1a00/0x274786fe0d1915b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1915aa expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.157231:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345f1a00/0x274786fe0d1915b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1915aa expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.157241:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345f1a00/0x274786fe0d1915b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1915aa expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397742.157249:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345f1a00, rc 0) 00000100:00100000:0.0:1787397742.157303:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701097600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397742.157309:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787397742.157391:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.157408:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.157417:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.157446:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787397742.157450:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.157457:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397742.157464:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787397742.157466:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:2.0:1787397742.157468:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787397742.157483:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.157490:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.157497:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.157509:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.157564:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.157583:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8191360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397742.157634:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097728 00000100:00100000:1.0:1787397742.157639:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097728 00000100:00100000:1.0:1787397742.157670:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787397742.157676:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701097728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397742.157682:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397742.157690:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1915b8 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.157703:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.157711:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397742.157718:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75200, rc 0) 00000100:00100000:1.0:1787397742.157754:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701097728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397742.157761:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787397742.157890:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397742.157902:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.157909:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397742.157967:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397742.158107:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397742.158128:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8191360c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397742.158144:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097856 00000100:00100000:0.0:1787397742.158148:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097856 00000100:00100000:0.0:1787397742.158177:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787397742.158183:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701097856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397742.158269:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701097856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (161us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397742.158278:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787397742.158995:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701097856:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787397742.159109:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787397742.159116:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397742.159125:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397742.341553:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397742.341606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397742.341672:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211648 00000100:00100000:3.0:1787397742.341687:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211648 00000100:00100000:3.0:1787397742.341780:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1358 00000100:00100000:3.0:1787397742.341792:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681211648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397742.341906:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681211648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397742.341915:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1358 00000100:00080000:0.0:1787397742.342357:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397742.342547:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211520 00000100:00100000:2.0:1787397742.342555:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211520 00000100:00100000:2.0:1787397742.342603:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787397742.342612:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681211520:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397742.342657:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681211520:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 47us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397742.342665:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00010000:00010000:1.0:1787397742.436698:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397743.461313:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397744.485231:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397745.264973:0:94613:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787397745.509923:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397746.110920:0:94665:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397746.111150:0:94665:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1787397746.149299:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397746.149306:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397746.149309:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397746.149323:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702321000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397746.149347:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8179a3100 x1874218701098240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397746.149372:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397746.149376:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397746.149377:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397746.149381:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a7033bb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397746.149392:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8179a1f80 x1874218701098496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397746.149405:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397746.149408:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397746.149409:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397746.149414:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397746.149425:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8179a3480 x1874218701098752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397746.149443:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397746.149453:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397746.149455:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397746.149460:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397746.149475:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70698f800 x1874218701099136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397746.149500:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787397746.149504:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397746.149505:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397746.149510:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a828a58000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397746.149547:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705388000 x1874218701099648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397746.149576:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701097984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397746.149645:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149692:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701099008:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149744:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787397746.149749:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701098368:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149789:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701099264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149808:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149836:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701098112:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149892:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701098880:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149941:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701099520:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.149968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.149988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787397746.149994:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701098624:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.150017:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150035:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701099392:0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.150056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701098240:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.150116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701098496:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.150164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150176:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701098752:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.150194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701099136:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.150228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150243:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701099648:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.150261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.150289:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701097984 00000100:00100000:1.0:1787397746.150297:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701097984 00000100:00100000:1.0:1787397746.150332:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099264 00000100:00100000:1.0:1787397746.150335:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099264 00000100:00100000:1.0:1787397746.150344:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098752 00000100:00100000:1.0:1787397746.150346:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098752 00000100:00100000:1.0:1787397746.150357:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1787397746.150364:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701097984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397746.150398:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397746.150450:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701097984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.150456:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1787397746.150476:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1787397746.150482:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.150509:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701099264:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.150515:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1787397746.150545:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1787397746.150549:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701098752:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.150569:0:23942:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a829b1e800, cookie 0x274786fe0d191445 00010000:00080000:1.0:1787397746.150574:0:23942:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964116999 exp ffff89a829b1e800 cur 3625 last 1787397740 00000004:00100000:1.0:1787397746.150592:0:23942:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397746.150713:0:23942:0:(import.c:65:import_set_state_nolock()) ffff89a7054c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397746.150760:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701098752:12345-0@lo:38:kworker.0 Request processed in 208us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.150766:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1787397746.150788:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099008 00000100:00100000:1.0:1787397746.150791:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099008 00000100:00100000:1.0:1787397746.150820:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098880 00000100:00100000:1.0:1787397746.150822:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098880 00000100:00100000:1.0:1787397746.150836:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099520 00000100:00100000:1.0:1787397746.150838:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099520 00000100:00100000:1.0:1787397746.150853:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099392 00000100:00100000:1.0:1787397746.150855:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099392 00000100:00100000:1.0:1787397746.150871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1787397746.150877:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701099008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.150917:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701099008:12345-0@lo:400:kworker.0 Request processed in 40us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.150922:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1787397746.150936:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1787397746.150942:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701098880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.150970:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701098880:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.150975:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1787397746.150985:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1787397746.150989:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.151012:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701099520:12345-0@lo:400:kworker.0 Request processed in 22us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1787397746.151026:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1787397746.151031:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701099392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.151055:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701099392:12345-0@lo:400:kworker.0 Request processed in 23us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151060:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1787397746.151078:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098368 00000100:00100000:1.0:1787397746.151081:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098368 00000100:00100000:1.0:1787397746.151097:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098624 00000100:00100000:1.0:1787397746.151099:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098624 00000100:00100000:1.0:1787397746.151109:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098240 00000100:00100000:1.0:1787397746.151111:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098240 00000100:00100000:1.0:1787397746.151118:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098496 00000100:00100000:1.0:1787397746.151120:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098496 00000100:00100000:1.0:1787397746.151140:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099136 00000100:00100000:1.0:1787397746.151148:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099136 00000100:00100000:1.0:1787397746.151160:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099648 00000100:00100000:1.0:1787397746.151162:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099648 00000100:00100000:1.0:1787397746.151171:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1787397746.151177:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.151206:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701098368:12345-0@lo:400:kworker.0 Request processed in 30us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151211:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1787397746.151222:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1787397746.151227:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701098624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397746.151252:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701098624:12345-0@lo:400:kworker.0 Request processed in 25us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151258:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1787397746.151268:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1787397746.151272:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701098240:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.151285:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3625 last 0 00000020:00000080:1.0:1787397746.151315:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d1915c6 00000004:00100000:1.0:1787397746.151322:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397746.151342:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a837bc3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397746.151368:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701098240:12345-0@lo:38:kworker.0 Request processed in 95us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151374:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1787397746.151387:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1787397746.151390:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701098496:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.151403:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3625 last 0 00000020:00000080:1.0:1787397746.151425:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d1915cd 00000004:00100000:1.0:1787397746.151438:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397746.151455:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397746.151485:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701098496:12345-0@lo:38:kworker.0 Request processed in 93us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151492:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1787397746.151506:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1787397746.151509:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701099136:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.151544:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3625 last 0 00000020:00000080:1.0:1787397746.151570:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d1915d4 00000004:00100000:1.0:1787397746.151577:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397746.151593:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a828a59800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397746.151623:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701099136:12345-0@lo:38:kworker.0 Request processed in 112us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151629:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1787397746.151642:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1787397746.151646:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701099648:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.151658:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3625 last 0 00000020:00000080:1.0:1787397746.151680:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d1915db 00000004:00100000:1.0:1787397746.151686:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787397746.151700:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a835595800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787397746.151725:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701099648:12345-0@lo:38:kworker.0 Request processed in 78us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.151731:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00010000:00080000:1.0:1787397746.151780:0:94362:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787397746.151786:0:94362:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 115964117001 00000020:00080000:1.0:1787397746.151791:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397746.151801:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117001, next_transno: 115964117001 00010000:00080000:1.0:1787397746.151805:0:94362:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117001) 00000020:00080000:1.0:1787397746.151807:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397746.151818:0:94362:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681202048 t115964117001 from 192.168.204.60@tcp req@ffff89a807638e00 x1874218681202048/t0(115964117001) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:182/0 lens 528/0 e 0 to 0 dl 1787397752 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397746.151928:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a8179a3100 x1874218701098240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.151943:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:0.0:1787397746.153928:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701098112 00000100:00100000:0.0:1787397746.153939:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701098112 00000100:00100000:0.0:1787397746.154084:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397746.154093:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154171:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701098112:12345-0@lo:400:kworker.0 Request processed in 80us (4302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397746.154178:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787397746.154228:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397746.154233:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397746.154235:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397746.154288:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701098624:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701099392:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154312:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701098112:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154336:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701098880:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701099520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154392:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701098368:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154403:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701099264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397746.154418:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701097984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397746.154430:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701099008:0@lo:400:kworker.0 00000004:00080000:3.0:1787397746.159442:0:94362:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7572us 00000100:00080000:1.0:1787397746.163393:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a8179a3100 x1874218701098240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.163409:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397746.163415:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397746.163421:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397746.163428:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701098240:0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.163490:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a8179a1f80 x1874218701098496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.163506:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:1.0:1787397746.168368:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a8179a1f80 x1874218701098496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.168384:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397746.168390:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397746.168397:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397746.168405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701098496:0@lo:38:kworker.0 00000100:00100000:1.0:1787397746.168452:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:1.0:1787397746.168467:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116999 committed transno 115964117000 00000020:00080000:1.0:1787397746.168473:0:3647:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a835b9e780 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:1.0:1787397746.168478:0:3647:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a806250f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a835b9ed80 00000020:00080000:1.0:1787397746.168482:0:3647:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].4 00000020:00080000:1.0:1787397746.168484:0:3647:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a806250b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a7048fd800 00000020:00080000:1.0:1787397746.168487:0:3647:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].4 00000004:00080000:1.0:1787397746.168533:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000020:00080000:1.0:1787397746.168537:0:3647:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a835b9ef00 refcount 2 committed 0 result 0 batchid 77309411389 00000020:00080000:1.0:1787397746.168540:0:3647:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a806250500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a835b9e9c0 00000020:00080000:1.0:1787397746.168543:0:3647:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].5 00000020:00080000:1.0:1787397746.168544:0:3647:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a806250800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a817ddfe00 00000020:00080000:1.0:1787397746.168547:0:3647:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].5 00000100:00080000:1.0:1787397746.168564:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1787397746.168576:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787397746.168581:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1787397746.168584:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000100:00080000:1.0:1787397746.168587:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 115964117000 last 0 00000100:00080000:1.0:1787397746.168590:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:1.0:1787397746.168602:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411389 committed batchid 77309411387 00000020:00080000:1.0:1787397746.169921:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:1.0:1787397746.171812:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701098752:0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.171854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70698f800 x1874218701099136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.171871:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000020:00080000:2.0:1787397746.173365:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411389 batchid updated 00000001:00100000:2.0:1787397746.173384:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1787397746.173396:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:2.0:1787397746.173454:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a70305c240 with version 15 00000020:00080000:2.0:1787397746.173474:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x2000088d1:0x2:0x0].4: rc = 0 00000020:00080000:2.0:1787397746.173562:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a0:0x2:0x0].4: rc = 0 00000004:00080000:2.0:1787397746.173588:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a80607dcc0 with version 16 00000020:00080000:2.0:1787397746.173592:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411389 cancel update log [0x2000088d1:0x2:0x0].5: rc = 0 00000020:00080000:2.0:1787397746.173612:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411389 cancel update log [0x2400090a0:0x2:0x0].5: rc = 0 00000020:00080000:2.0:1787397746.173618:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:2.0:1787397746.173627:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 15 rpc_version 15 00000020:00100000:2.0:1787397746.173657:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787397746.174208:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a829b42680 x1874218701099904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397746.174233:0:75622:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_LOCKS) req@ffff89a829b42680 x1874218701099904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397746.174242:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74480 going to sleep for 0 seconds 00010000:00080000:2.0:1787397746.174590:0:94671:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1787397746.174595:0:94671:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1787397746.174600:0:94671:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1787397746.174989:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a70698f800 x1874218701099136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397771 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.175008:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787397746.175013:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397746.175018:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787397746.175023:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701099136:0@lo:38:kworker.0 00010000:00080000:1.0:1787397746.175059:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705388000 x1874218701099648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.176188:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:1.0:1787397746.176273:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787397746.176281:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787397746.176285:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787397746.176293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701099648:0@lo:38:kworker.0 00010000:00010000:2.0:1787397746.176403:0:94671:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d190e09 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787397746.176432:0:94671:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1787397746.176492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701100032:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787397746.176586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.176632:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100032 00000100:00100000:1.0:1787397746.176640:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100032 00000100:00100000:1.0:1787397746.177810:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:1.0:1787397746.177823:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701100032:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397746.177848:0:23942:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a706f9c380 x1874218701100032/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:187/0 lens 328/0 e 0 to 0 dl 1787397757 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397746.177858:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701100032:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 40us (1274us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397746.177864:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00010000:00010000:3.0:1787397746.185553:0:94362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.185575:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.185591:0:94362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.185617:0:94362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.185625:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.185633:0:94362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186205:0:94362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186216:0:94362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186223:0:94362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186229:0:94362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397746.186233:0:94362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186241:0:94362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186253:0:94362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a817be7100) 00010000:00010000:3.0:1787397746.186257:0:94362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397746.186261:0:94362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186267:0:94362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1915e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397746.186292:0:94362:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b342764b reply state 00000000669ca3f0 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186305:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.186311:0:94362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817be7e00) 00010000:00010000:3.0:1787397746.186314:0:94362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397746.186317:0:94362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397746.186426:0:94362:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397746.186450:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.186454:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000020:00080000:3.0:1787397746.186458:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.186461:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000001:00080000:2.0:1787397746.194510:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117001 is committed 00000100:00100000:3.0:1787397746.194907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397746.195416:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681202560 00000100:00100000:2.0:1787397746.195429:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681202560 00000100:00100000:2.0:1787397746.195494:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1413 00000100:00100000:2.0:1787397746.195505:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681202560:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:2.0:1787397746.195551:0:74374:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 115964117002, current: 115964117002, replaying 00000100:00100000:2.0:1787397746.195573:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681202560:12345-192.168.204.60@tcp:36:rm.0 Request processed in 71us (670us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397746.195579:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1413 00000020:00080000:3.0:1787397746.195660:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.195844:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117002, next_transno: 115964117002 00010000:00080000:3.0:1787397746.195848:0:94362:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (115964117002) 00000020:00080000:3.0:1787397746.195852:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.195862:0:94362:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681202560 t115964117002 from 192.168.204.60@tcp req@ffff89a704ee7100 x1874218681202560/t0(115964117002) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:187/0 lens 512/0 e 0 to 0 dl 1787397757 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397746.195958:0:94362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.195973:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.195985:0:94362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196004:0:94362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196013:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196020:0:94362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196217:0:94362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196226:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196233:0:94362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196472:0:94362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196480:0:94362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196486:0:94362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196491:0:94362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397746.196495:0:94362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.196503:0:94362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200115:0:94362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff89a70229d700) 00010000:00010000:3.0:1787397746.200124:0:94362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397746.200144:0:94362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200155:0:94362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d1915fe lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200201:0:94362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200208:0:94362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200214:0:94362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200220:0:94362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397746.200223:0:94362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200230:0:94362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200245:0:94362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70229dd00) 00010000:00010000:3.0:1787397746.200247:0:94362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397746.200250:0:94362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200256:0:94362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1915f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397746.200290:0:94362:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fb14d52 reply state 000000009d045997 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200302:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.200308:0:94362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817be7e00) 00010000:00010000:3.0:1787397746.200310:0:94362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397746.200313:0:94362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1787397746.200414:0:94362:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1787397746.200436:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.200439:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000020:00080000:3.0:1787397746.200443:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1787397746.200445:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00010000:00010000:0.0:1787397746.202853:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202870:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202878:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202884:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397746.202888:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202896:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202917:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a817be7e00) 00010000:00010000:0.0:1787397746.202921:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397746.202926:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.202944:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1915e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397746.211556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397746.211746:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211776 00000100:00100000:0.0:1787397746.211756:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211776 00000100:00100000:0.0:1787397746.211813:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1361 00000100:00100000:0.0:1787397746.211821:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681211776:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787397746.211845:0:67264:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a704ee6680 x1874218681211776/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:187/0 lens 224/0 e 0 to 0 dl 1787397757 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397746.211868:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681211776:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 48us (354us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397746.211875:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1361 00000020:00080000:2.0:1787397746.211926:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397746.211931:0:94362:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117003 00010000:00080000:2.0:1787397746.211934:0:94362:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1787397746.211936:0:94362:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397746.211942:0:94362:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1787397746.211944:0:94362:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1787397746.211951:0:94362:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff89a706f9c380 x1874218701100032/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:187/0 lens 328/0 e 0 to 0 dl 1787397757 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787397746.211970:0:94362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397746.212002:0:94362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d191605 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190de6 expref: -99 pid: 94362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.212026:0:94362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d191605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 7 pid: 94362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.212042:0:94362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d191605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 7 pid: 94362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.212051:0:94362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62a00, rc 0) 00010000:00080000:2.0:1787397746.212139:0:94362:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1787397746.212155:0:94362:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1787397746.212177:0:3647:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191605 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787397746.212188:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787397746.212214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701100032:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1787397746.212234:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701100160:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1787397746.212265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397746.212335:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100160 00000100:00100000:3.0:1787397746.212338:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100160 00000100:00100000:3.0:1787397746.212373:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:3.0:1787397746.212380:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874218701100160:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1787397746.212394:0:8445:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a807639180 x1874218701100160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:187/0 lens 224/0 e 0 to 0 dl 1787397757 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397746.212414:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874218701100160:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 35us (148us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397746.212419:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00010000:00080000:0.0:1787397746.212457:0:94362:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787397746.212599:0:94362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:2.0:1787397746.215362:0:94328:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787397746.215372:0:94328:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:2.0:1787397746.215400:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:0.0:1787397746.215561:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215574:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215597:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215603:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397746.215608:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215616:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215634:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.215641:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1915f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94362 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397746.215705:0:94362:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1787397746.215740:0:94362:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1787397746.215754:0:94362:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a704ee6680 x1874218681211776/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:187/0 lens 224/0 e 0 to 0 dl 1787397757 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787397746.215857:0:94362:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a807639180 x1874218701100160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:187/0 lens 224/0 e 0 to 0 dl 1787397757 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397746.215919:0:94362:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1787397746.217831:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787397746.217860:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a80763a300 x1874218701100160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397762 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.217871:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a80763a300 x1874218701100160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397762 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.217878:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787397746.217896:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1787397746.217902:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006ad60635): req@ffff89a70538b480 x1874218701078528/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397730 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397746.217920:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008b992d98): req@ffff89a829b42680 x1874218701099904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397746.217931:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701100160:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1787397746.218708:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397746.218754:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397746.219021:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701099904 00000100:00100000:1.0:1787397746.219030:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701099904 00000100:00100000:1.0:1787397746.219592:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1787397746.219603:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701099904:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397746.219848:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701099904:12345-0@lo:1000:osp_up0-1.0 Request processed in 246us (1143us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1787397746.219858:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1787397746.219891:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397746.219903:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701100288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397746.219935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.219965:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100288 00000100:00100000:1.0:1787397746.219970:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100288 00000100:00100000:1.0:1787397746.219991:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1787397746.219997:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701100288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397746.220021:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397746.220066:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701100288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.220390:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1787397746.220434:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701100288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397746.220470:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701099904:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787397746.220483:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 16 rpc_version 16 00000020:00100000:1.0:1787397746.220500:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397746.220507:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a706f9df80 x1874218701100544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397746.220548:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701100544:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397746.220583:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.220599:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397746.220612:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100544 00000100:00100000:1.0:1787397746.220616:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100544 00000100:00100000:1.0:1787397746.220639:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1787397746.220646:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701100544:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397746.220765:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701100544:12345-0@lo:1000:osp_up0-1.0 Request processed in 120us (181us total) trans 120259084290 rc 0/0 00000100:00100000:1.0:1787397746.220772:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1787397746.220806:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701100544:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397746.222309:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.223320:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701078528 00000100:00100000:1.0:1787397746.223331:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701078528 00000100:00100000:1.0:1787397746.223390:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1787397746.223400:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701078528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397746.223428:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397746.223501:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701078528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397746.223508:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1787397746.223581:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701078528:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1787397746.285204:0:94362:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe41f73e10 00100000:10000000:3.0:1787397746.285221:0:94362:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1787397746.287271:0:94348:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000100:00100000:2.0:1787397746.287320:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701100672:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397746.287389:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397746.287418:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397746.287442:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100672 00000100:00100000:2.0:1787397746.287448:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100672 00000100:00100000:2.0:1787397746.287505:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:2.0:1787397746.287514:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701100672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787397746.287628:0:15073:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -94 00002000:02000040:2.0:1787397746.287633:0:15073:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1889) 00000004:00080000:1.0:1787397746.288335:0:94350:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:1.0:1787397746.288366:0:94350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701100800:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787397746.288404:0:94350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397746.288430:0:94350:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81147ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397746.289014:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100800 00000100:00100000:3.0:1787397746.289030:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100800 00000100:00100000:3.0:1787397746.289069:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:3.0:1787397746.289077:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:94350:x1874218701100800:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787397746.289098:0:26159:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -95 00002000:02000040:3.0:1787397746.289102:0:26159:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1889) 00002000:00010000:0.0:1787397746.317275:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.317290:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317307:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.317321:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.317326:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317342:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317352:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317359:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317382:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.317395:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.317401:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317408:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.317412:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317420:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317435:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317454:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1548e9/0x274786fe0d19160c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.317474:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.317476:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.317478:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.318367:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.318376:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318387:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.318391:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.318396:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318408:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318416:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318424:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318442:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.318459:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.318463:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318472:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.318476:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318485:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318497:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318503:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f41820b/0x274786fe0d191613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.318541:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.318543:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.318545:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.319345:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.319354:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319366:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.319369:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.319373:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319398:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319407:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319414:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319431:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.319440:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.319445:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319453:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.319456:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319463:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319474:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319481:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2760fa0/0x274786fe0d19161a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319504:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.319506:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.319508:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.319592:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.319597:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319605:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.319608:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.319612:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319620:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319628:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319635:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319649:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.319656:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.319907:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319927:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.319931:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319939:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319951:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.319959:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a727b07a/0x274786fe0d191621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.324276:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.324283:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.324287:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.325587:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.325599:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.325615:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.325620:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.325627:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.325642:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.325663:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326038:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326067:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.326211:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.326218:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326227:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.326230:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.326235:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326244:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326252:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326260:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326291:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397746.326301:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.326307:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326314:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.326319:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326328:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326345:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326352:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047e96d0b/0x274786fe0d191628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326374:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.326378:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326385:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.326388:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326407:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326418:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326426:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7df7f16/0x274786fe0d19162f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326439:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.326441:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.326443:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.326489:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.326495:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326503:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.326506:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.326510:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326519:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326549:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326563:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326578:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.326585:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.326590:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326597:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.326600:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326607:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326618:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326626:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000374568cf/0x274786fe0d191636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.326641:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.326643:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.326644:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.327400:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.327418:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327429:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.327432:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.327436:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327446:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327454:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327461:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327547:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.327613:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.327618:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327626:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.327628:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.327632:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327640:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327655:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.327660:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328299:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397746.328308:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328318:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397746.328323:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328332:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328349:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328356:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058c7b113/0x274786fe0d19163d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328379:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397746.328391:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328398:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397746.328402:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328408:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328419:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.328426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.328428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.328429:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.328550:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787397746.328557:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa14e5df/0x274786fe0d191644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397746.328637:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.328642:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328651:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.328654:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.328658:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328813:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328823:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328841:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328858:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.328867:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.328872:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328878:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.328882:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328892:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328903:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328910:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e838c6/0x274786fe0d19164b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328923:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.328925:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.328927:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.328970:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.328981:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.328989:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.328992:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.328996:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329005:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329013:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329021:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329033:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.329041:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.329044:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329051:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.329056:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329063:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329320:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329328:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263c852b/0x274786fe0d191652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329343:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.329345:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.329346:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.329391:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.329397:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329406:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.329409:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.329413:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329422:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329430:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329438:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329461:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.329498:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.329504:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329512:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.329515:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.329519:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329550:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329558:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329566:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329578:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397746.329584:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.329588:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329594:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.329603:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329612:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329623:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329630:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087887654/0x274786fe0d191659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329646:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.329649:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329655:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f1600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.329658:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329808:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329820:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329827:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005de836a/0x274786fe0d191660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329847:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.329849:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.329851:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.329894:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.329899:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329907:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.329910:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.329915:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329924:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329932:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329940:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329953:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.329959:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.329962:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329979:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345f0000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.329982:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.329990:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330001:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330009:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a9ccdb3/0x274786fe0d191667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330020:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.330022:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.330023:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.330067:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.330072:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.330351:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.330357:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.330390:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.330393:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.330397:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330407:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330421:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330428:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330482:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.330548:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.330554:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330561:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.330564:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.330567:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330576:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330583:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330590:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330612:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397746.330620:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.330624:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330630:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.330633:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330641:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330651:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330657:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d19166e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330686:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.330689:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330696:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.330699:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330716:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330726:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330734:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d191675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330745:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.330747:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.330749:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.330791:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.330796:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330804:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.330808:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.330812:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330820:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330827:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330839:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330854:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.330892:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.330900:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330909:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.330912:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.330915:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330923:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330930:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330937:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.330949:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397746.330984:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.330990:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331002:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.331005:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.331009:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331018:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331026:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331032:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331046:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787397746.331054:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397746.331057:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331064:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331066:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331074:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331119:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331136:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19167c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331152:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.331155:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331161:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331164:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331171:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331182:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331189:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d191683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331199:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.331202:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331214:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331216:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331222:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331231:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331237:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d19168a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331252:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331253:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331255:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.331298:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.331303:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331310:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.331312:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.331316:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331325:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331339:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331346:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331358:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.331365:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.331369:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331375:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331378:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331384:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331394:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331400:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d191691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331412:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331419:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331420:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787397746.331570:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787397746.331600:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.331606:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331613:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.331616:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.331621:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331629:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331637:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331644:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331657:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.331663:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.331667:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331674:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331677:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331692:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331703:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331710:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d191698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331724:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331726:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331728:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.331769:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.331775:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331783:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.331786:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.331790:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331798:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331805:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331817:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331829:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.331836:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.331840:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331846:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.331849:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331857:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331868:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331875:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d19169f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331889:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331891:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.331893:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.331937:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.331948:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331956:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.331959:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.331964:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331973:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331981:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.331988:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332002:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.332008:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.332011:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332019:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.332022:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332030:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332049:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332057:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1916a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.332071:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.332073:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.332075:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397746.334267:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.334395:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.334409:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334426:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.334430:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.334437:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334452:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334463:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334470:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334592:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.334714:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.334720:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334728:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.334731:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.334735:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334744:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334753:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.334762:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397746.336058:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.336070:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.336084:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.336088:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.336093:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.336108:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.336640:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.336650:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337839:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397746.337849:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337861:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397746.337865:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337875:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337896:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337902:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1916ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337936:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397746.337940:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337947:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397746.337950:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337958:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337968:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.337975:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397746.337976:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397746.337978:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.338573:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787397746.338583:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1916b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.338835:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.339149:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.339156:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.339175:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.339179:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.339185:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.339198:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.339207:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.339214:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.341354:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787397746.341475:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.341484:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.341500:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.341503:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.341509:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.341539:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.341569:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.341577:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341642:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397746.341652:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341674:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397746.341680:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341690:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341719:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341728:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1916c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341746:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397746.341751:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341758:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397746.341761:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341767:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341777:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341784:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397746.341787:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341793:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397746.341802:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341810:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341819:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397746.341826:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.341828:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.341830:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.341843:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397746.341849:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.343366:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397746.343379:0:26159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008772c6fe/0x274786fe0d1916bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343425:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.343837:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.343844:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343856:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.343860:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.343865:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343877:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343885:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343893:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343910:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.343917:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.343922:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343929:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.343940:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343949:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343963:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343970:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3c05277/0x274786fe0d1916d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.343983:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.343985:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.343987:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344056:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344061:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344069:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344072:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344075:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344084:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344104:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344110:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344135:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.344143:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.344148:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344155:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.344158:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344166:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344177:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344183:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bee47625/0x274786fe0d1916d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344195:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344204:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344247:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344252:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344259:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344262:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344266:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344274:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344281:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344288:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344302:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.344309:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.344313:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344320:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.344323:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344341:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344352:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344361:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b070af/0x274786fe0d1916de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344374:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344375:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344377:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344417:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344423:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344431:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344434:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344438:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344447:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344455:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344467:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344480:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.344487:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.344491:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344497:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.344500:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344507:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344518:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344545:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3540aa0/0x274786fe0d1916e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344557:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344559:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344560:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344602:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344612:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344620:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344622:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344626:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344634:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344641:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344648:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344660:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.344666:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.344670:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344677:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.344680:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344686:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344703:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344710:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce29c5dd/0x274786fe0d1916ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344722:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344724:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344726:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344768:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344774:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344781:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344784:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344788:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344796:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344804:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344811:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344834:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.344841:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.344845:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344851:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.344855:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344862:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344873:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344879:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e206b49d/0x274786fe0d1916f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344891:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344893:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.344895:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.344935:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.344941:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344949:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.344957:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.344961:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344970:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344978:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344985:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.344997:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.345004:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345008:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345015:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345018:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345026:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345036:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c526655b/0x274786fe0d1916fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345065:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345066:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345068:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.345107:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345113:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345120:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345135:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.345140:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345149:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345156:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345163:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345176:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.345189:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345193:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345199:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345203:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345210:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345220:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345227:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edcb4d34/0x274786fe0d191701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345240:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345242:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345243:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.345283:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345289:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345296:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345299:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.345303:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345321:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345329:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345337:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345350:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.345357:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345360:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345367:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345370:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345378:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345387:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345394:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc408c8/0x274786fe0d191708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345411:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397746.345412:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345414:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345415:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.345418:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d1916c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345441:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.345454:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345459:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345467:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345469:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.345473:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345481:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345489:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397746.345493:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345496:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345498:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345506:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345508:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.345508:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.345512:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345513:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345517:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345543:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345551:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345554:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345557:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345565:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345568:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345576:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345581:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.345583:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000307a69ce/0x274786fe0d19170f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345596:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345600:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345606:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345609:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397746.345615:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345616:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345620:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345626:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345627:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.345629:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.345634:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345639:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d191716 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345643:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.345650:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345652:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345654:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.345657:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345675:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.345719:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345724:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345731:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345735:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.345738:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345765:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345773:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345781:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345793:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.345806:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.345810:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345817:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.345821:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345829:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345840:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345846:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c54202a1/0x274786fe0d191724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345859:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345860:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.345862:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.345900:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.345905:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345913:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.345916:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.345920:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345938:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345946:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345953:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.345970:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397746.346009:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.346013:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346021:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.346024:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.346028:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346037:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346044:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346062:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346075:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397746.346082:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397746.346085:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346091:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.346095:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346102:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346113:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.346120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000594b6a1/0x274786fe0d19172b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346842:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.346847:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346862:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.346866:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.346874:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.346875:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346888:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346895:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008906df4e/0x274786fe0d191732 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346907:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.346909:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.346910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.346923:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397746.346979:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.346984:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.346993:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.346996:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.347001:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.347019:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.347028:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.347035:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.347049:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397746.347056:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.347060:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.347066:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.347069:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347194:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.347198:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347214:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.347218:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347226:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347237:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347244:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d191739 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.347258:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.347260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.347262:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.347268:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.348431:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348458:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348466:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d19171d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348491:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.348494:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.348495:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.348591:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.348597:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348606:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.348609:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.348614:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348624:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348632:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.348639:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787397746.348942:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787397746.349006:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.349012:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349022:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.349026:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.349030:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349135:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349144:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349151:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349186:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397746.349213:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397746.349254:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.349259:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349267:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.349270:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.349273:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349282:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349290:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349308:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349321:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397746.349330:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397746.349335:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349342:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.349347:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349356:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349368:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349376:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d191740 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349391:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397746.349395:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349412:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.349416:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349423:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349435:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349442:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046287df1/0x274786fe0d191747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349455:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.349458:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349465:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.349468:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349475:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349485:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349497:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc120154/0x274786fe0d19174e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349510:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.349512:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.349514:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.349573:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.349579:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349587:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.349590:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.349594:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349603:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349611:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349619:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349632:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.349646:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.349650:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349657:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.349660:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349668:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349679:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349685:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d191755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.349698:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.349699:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.349700:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.349863:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397746.349909:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.349914:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349932:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.349936:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397746.349939:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349947:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349954:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349961:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349974:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397746.349981:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397746.349984:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.349990:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.349993:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.350001:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.350022:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.350029:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19175c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.350042:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.350044:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.350046:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.350049:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.350055:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350063:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.350065:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.350069:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350087:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350094:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350102:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350114:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.350132:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.350136:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350144:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.350147:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350155:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350166:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350174:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d191763 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.350195:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.350197:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.350238:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.350243:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350251:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.350254:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.350258:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350267:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350274:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350282:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350294:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.350300:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.350303:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350323:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.350326:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350334:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350344:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350350:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091290fd3/0x274786fe0d19176a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350361:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.350363:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.350364:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.350404:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.350409:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350417:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.350420:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.350423:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350431:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350446:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350453:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350472:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397746.350512:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.350517:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350550:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.350553:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.350557:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350566:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350574:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350582:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350619:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397746.350659:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.350664:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350672:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.350675:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.350678:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350687:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350694:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350700:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350712:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787397746.350719:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397746.350722:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.350729:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.351082:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351092:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351104:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351111:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b3084a9/0x274786fe0d191771 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351137:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397746.351141:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351148:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.351151:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351158:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351169:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351176:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01bb0f7/0x274786fe0d191778 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351197:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.351201:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351208:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.351211:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351218:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351228:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351235:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001970d96b/0x274786fe0d19177f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351246:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351248:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351250:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.351303:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.351308:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351317:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.351326:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.351331:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351341:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351350:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351357:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351372:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.351379:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.351383:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351390:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.351393:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351399:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351409:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351426:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b42df0fd/0x274786fe0d191786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351438:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351440:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351441:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.351485:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.351490:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351496:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.351499:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.351503:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351511:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351518:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351544:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351556:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.351568:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.351571:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351578:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.351578:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351582:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.351583:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351589:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351600:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351608:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeadb6b/0x274786fe0d19178d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351621:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351623:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351625:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397746.351661:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.351666:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351674:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.351677:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.351681:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351700:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351707:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351714:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351726:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.351733:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.351809:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351818:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.351821:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351830:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351842:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351849:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdbb143/0x274786fe0d191794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351869:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351870:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.351872:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787397746.351888:0:15073:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00002000:00010000:3.0:1787397746.351913:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.351918:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351925:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.351927:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.351931:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351938:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351945:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351951:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.351962:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787397746.351972:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:94348:x1874218701100672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 64456us (64581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397746.351981:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00002000:00010000:3.0:1787397746.351994:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.351998:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352013:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.352016:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.352020:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352027:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397746.352034:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701100672:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397746.352048:0:94348:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x703:0x0] 00010000:00010000:3.0:1787397746.352110:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397746.352112:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701101056:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1787397746.352118:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352149:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787397746.352156:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397746.352178:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830e24600 going to sleep for 11 seconds 00002000:00010000:3.0:1787397746.352187:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397746.352189:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397746.352192:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352193:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352201:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:0.0:1787397746.352201:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.352204:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.352207:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352210:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352216:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352218:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352229:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352232:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352237:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d19179b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352240:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352252:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397746.352253:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397746.352256:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352258:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.352261:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352263:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397746.352266:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.352271:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352274:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352278:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352288:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352295:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352296:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006062dce6/0x274786fe0d1917a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397746.352303:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc85fe4c/0x274786fe0d1917a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352309:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352314:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352316:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.352319:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.352321:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.352323:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397746.352334:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701100928:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1787397746.352357:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1787397746.352362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397746.352363:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352370:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.352373:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.352377:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352384:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352392:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352399:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397746.352400:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101056 00000100:00100000:0.0:1787397746.352406:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101056 00010000:00010000:3.0:1787397746.352409:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.352415:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.352418:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352424:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.352427:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397746.352441:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992 00010000:00010000:3.0:1787397746.352444:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397746.352448:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:94348:x1874218701101056:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1787397746.352455:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352462:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d1917b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352473:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352475:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352476:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787397746.352482:0:26162:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00002000:00010000:3.0:1787397746.352516:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397746.352556:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352565:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:3.0:1787397746.352568:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397746.352572:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352580:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352587:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352602:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352613:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397746.352620:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.352624:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352630:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.352633:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352641:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352651:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352658:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc0205e9/0x274786fe0d1917b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.352670:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352672:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.352674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397746.352826:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397746.353705:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397746.353714:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353726:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:2.0:1787397746.353729:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397746.353810:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353822:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353832:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353839:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353857:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397746.353901:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397746.353906:0:26159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353914:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=3625s v=(0 0) 00010000:00010000:2.0:1787397746.353916:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397746.353920:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353927:0:26159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353934:0:26159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353950:0:26159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397746.353967:0:26159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787397746.354458:0:26159:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00000100:00100000:2.0:1787397746.354554:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:94350:x1874218701100800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65474us (66145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397746.354564:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000100:00100000:2.0:1787397746.354625:0:94350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701100800:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397746.354639:0:94350:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:2.0:1787397746.354700:0:94350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701101312:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787397746.354730:0:94350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397746.354838:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397746.354855:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354864:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.354868:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354877:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354891:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354898:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ef7b6c/0x274786fe0d1917be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354915:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397746.354918:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354924:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397746.354927:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354933:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354954:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354960:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1917c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397746.354973:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.354975:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397746.354977:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397746.355856:0:94350:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d743c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397746.355881:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701101184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397746.355915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397746.355953:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101312 00000100:00100000:2.0:1787397746.355959:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101312 00000100:00100000:2.0:1787397746.355994:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4993 00000100:00100000:2.0:1787397746.356001:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:94350:x1874218701101312:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787397746.356120:0:25908:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000100:00100000:2.0:1787397746.361029:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:94350:x1874218701101312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5021us (6291us total) trans 4294968731 rc 0/0 00000100:00100000:2.0:1787397746.361191:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4993 00000100:00100000:2.0:1787397746.361249:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701100928 00000100:00100000:2.0:1787397746.361258:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701100928 00000100:00100000:2.0:1787397746.361295:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101184 00000100:00100000:2.0:1787397746.361299:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101184 00000100:00100000:2.0:1787397746.361315:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1787397746.361322:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701100928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397746.361346:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397746.361390:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701100928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (9027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397746.361398:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1787397746.361410:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1787397746.361415:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701101184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397746.361425:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397746.361455:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701101184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397746.361460:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1787397746.361483:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701100928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397746.361486:0:94350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701101312:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397746.361497:0:94350:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00010000:00010000:0.0:1787397746.361630:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397746.361636:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397746.365218:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701101056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12761us (13052us total) trans 4294968732 rc 0/0 00000100:00100000:0.0:1787397746.365232:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992 00000100:00100000:2.0:1787397746.366215:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701101184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397746.366215:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701101056:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397746.366230:0:94348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00000100:00100000:0.0:1787397746.375386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397746.375429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397746.375455:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212032 00000100:00100000:0.0:1787397746.375464:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212032 00000100:00100000:0.0:1787397746.375541:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1362 00000100:00100000:0.0:1787397746.375551:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2403:x1874218681212032:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397746.375637:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2403:x1874218681212032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397746.375645:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1362 00000100:00080000:0.0:1787397746.376222:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397746.377869:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681211904 00000100:00100000:2.0:1787397746.377881:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681211904 00000100:00100000:2.0:1787397746.377936:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:2.0:1787397746.377946:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681211904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397746.378015:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681211904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 71us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397746.385188:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00010000:00010000:3.0:1787397746.532695:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397746.663385:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701101440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397746.663460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397746.663598:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101440 00000100:00100000:2.0:1787397746.663606:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101440 00000100:00100000:2.0:1787397746.663673:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1787397746.663682:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701101440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397746.663703:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397746.663758:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701101440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397746.663766:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:1.0:1787397746.664022:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701101440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397746.664415:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397746.678337:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701101568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397746.678424:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397746.678718:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101568 00000100:00100000:0.0:1787397746.678727:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101568 00000100:00100000:0.0:1787397746.678793:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1787397746.678803:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701101568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397746.678828:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 209216 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397746.678884:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701101568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397746.678891:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:1.0:1787397746.679141:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701101568:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1787397747.184387:0:94718:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397747.184912:0:94718:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397747.558965:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397748.580718:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397749.198324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397749.198823:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212160 00000100:00100000:2.0:1787397749.198834:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212160 00000100:00100000:2.0:1787397749.198929:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1414 00000100:00100000:2.0:1787397749.198940:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:72322:x1874218681212160:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397749.198963:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397749.198984:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1917cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d821a expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199086:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199101:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199116:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397749.199173:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397749.199191:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397749.199234:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199261:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1917cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d821a expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199278:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d821a expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397749.199288:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397749.199291:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397749.199295:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63400, rc 0) 00000100:00100000:2.0:1787397749.199364:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:72322:x1874218681212160:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 425us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397749.199371:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1414 00000100:00080000:0.0:1787397749.201769:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397749.208269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397749.208367:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212288 00000100:00100000:1.0:1787397749.208378:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212288 00000100:00100000:1.0:1787397749.208447:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1415 00000100:00100000:1.0:1787397749.208456:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:72322:x1874218681212288:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787397749.208509:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397749.208632:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:72322:x1874218681212288:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 176us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397749.208639:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1415 00000100:00100000:3.0:1787397749.211699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397749.211869:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212416 00000100:00100000:0.0:1787397749.211880:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212416 00000100:00100000:0.0:1787397749.211969:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1416 00000100:00100000:0.0:1787397749.211980:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:72322:x1874218681212416:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397749.212031:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397749.212117:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:72322:x1874218681212416:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 138us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397749.212124:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1416 00000100:00080000:2.0:1787397749.212332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397749.220047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397749.220269:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212544 00000100:00100000:2.0:1787397749.220281:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212544 00000100:00100000:2.0:1787397749.220324:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4994 00000100:00100000:2.0:1787397749.220333:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681212544:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:2.0:1787397749.220374:0:8501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3628 last 0 00000020:00000080:2.0:1787397749.220403:0:8501:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d1917da 00002000:00100000:2.0:1787397749.220415:0:8501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a83ae93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787397749.220432:0:8501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787397749.220502:0:8501:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787397749.220590:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a83ae90000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397749.220677:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681212544:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 343us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397749.220684:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4994 00000100:00100000:0.0:1787397749.227380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397749.227472:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212672 00000100:00100000:1.0:1787397749.227482:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212672 00000100:00100000:1.0:1787397749.227592:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2083 00000100:00100000:1.0:1787397749.227603:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:72322:x1874218681212672:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787397749.227632:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397749.227713:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:72322:x1874218681212672:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397749.227721:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2083 00000100:00080000:2.0:1787397749.228428:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397749.231367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397749.231486:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212800 00000100:00100000:0.0:1787397749.231515:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212800 00000100:00100000:0.0:1787397749.231598:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4995 00000100:00100000:0.0:1787397749.231607:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2401:x1874218681212800:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:0.0:1787397749.231644:0:26164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3628 last 0 00000020:00000080:0.0:1787397749.231673:0:26164:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d1917e1 00002000:00100000:0.0:1787397749.231828:0:26164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a803902000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397749.231848:0:26164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787397749.231914:0:26164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787397749.231956:0:26164:0:(import.c:65:import_set_state_nolock()) ffff89a7054c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397749.232111:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681212800:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 503us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397749.232119:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4995 00000100:00100000:3.0:1787397749.236384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397749.236498:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681212928 00000100:00100000:2.0:1787397749.236508:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681212928 00000100:00100000:2.0:1787397749.236621:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2084 00000100:00100000:2.0:1787397749.236632:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:72322:x1874218681212928:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397749.236660:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397749.236744:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:72322:x1874218681212928:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397749.236751:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2084 00000100:00080000:0.0:1787397749.238661:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397749.604837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397750.628764:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397751.269823:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701101696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397751.269898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701101824:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270239:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701102336:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270285:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701102848:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270323:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397751.270328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701101952:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270360:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701102464:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270416:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701102976:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.270438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397751.270481:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101824 00000100:00100000:0.0:1787397751.270489:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101824 00000100:00100000:1.0:1787397751.270968:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397751.270977:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701103360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397751.271023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.271060:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101696 00000100:00100000:1.0:1787397751.271065:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101696 00000100:00100000:1.0:1787397751.271088:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102848 00000100:00100000:1.0:1787397751.271090:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102848 00000100:00100000:1.0:1787397751.271100:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103360 00000100:00100000:1.0:1787397751.271102:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103360 00000100:00100000:1.0:1787397751.271114:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1787397751.271121:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701101696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397751.271157:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397751.271221:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701101696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397751.271228:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1787397751.271251:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1787397751.271256:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701102848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.271282:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701102848:12345-0@lo:400:kworker.0 Request processed in 27us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397751.271288:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1787397751.271298:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1787397751.271303:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701103360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397751.271315:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397751.271341:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701103360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397751.271346:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1787397751.271366:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102464 00000100:00100000:1.0:1787397751.271369:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102464 00000100:00100000:1.0:1787397751.271398:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102976 00000100:00100000:1.0:1787397751.271401:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102976 00000100:00100000:1.0:1787397751.271417:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1787397751.271422:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701102464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.271448:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701102464:12345-0@lo:400:kworker.0 Request processed in 26us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397751.271453:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1787397751.272052:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:1.0:1787397751.272065:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701102976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.272101:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701102976:12345-0@lo:400:kworker.0 Request processed in 41us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397751.272116:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00080000:1.0:1787397751.272144:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397751.272270:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701103360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397751.272306:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701102208:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.272338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.272363:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701102720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.272384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.272400:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701103232:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.272419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.272448:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701101696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397751.272749:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397751.272762:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701101824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.272803:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701101824:12345-0@lo:400:kworker.0 Request processed in 46us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.272809:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397751.272868:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102336 00000100:00100000:0.0:1787397751.272873:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102336 00000100:00100000:0.0:1787397751.272908:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701101952 00000100:00100000:0.0:1787397751.272911:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701101952 00000100:00100000:0.0:1787397751.272924:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102208 00000100:00100000:0.0:1787397751.272927:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102208 00000100:00100000:0.0:1787397751.272939:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102720 00000100:00100000:0.0:1787397751.272941:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102720 00000100:00100000:0.0:1787397751.272952:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103232 00000100:00100000:0.0:1787397751.272954:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103232 00000100:00100000:0.0:1787397751.272966:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1787397751.272971:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701102336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.273015:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701102336:12345-0@lo:400:kworker.0 Request processed in 33us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.273021:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1787397751.273043:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1787397751.273049:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701101952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.273075:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701101952:12345-0@lo:400:kworker.0 Request processed in 27us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.273088:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1787397751.273099:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1787397751.273104:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.273132:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701102208:12345-0@lo:400:kworker.0 Request processed in 28us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.273137:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1787397751.273148:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1787397751.273153:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701102720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.273391:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787397751.273404:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701102080:0@lo:400:kworker.0 00000100:00100000:2.0:1787397751.273519:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1787397751.273554:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701103232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.277742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.277797:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701102592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.277844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.278087:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701103104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.278115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397751.278160:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701102208:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.278323:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701102720:12345-0@lo:400:kworker.0 Request processed in 5167us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.278336:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1787397751.278372:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102080 00000100:00100000:0.0:1787397751.278378:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102080 00000100:00100000:0.0:1787397751.278421:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1787397751.278431:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701102080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.278494:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701102080:12345-0@lo:400:kworker.0 Request processed in 64us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.278501:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1787397751.278943:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701102720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397751.278989:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701102080:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279123:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701101952:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279138:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701102464:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279150:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701102976:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279160:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701101824:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279170:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701102336:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279203:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701102848:0@lo:400:kworker.0 00000100:00080000:0.0:1787397751.279363:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397751.279369:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397751.279392:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701102592 00000100:00100000:0.0:1787397751.279397:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701102592 00000100:00100000:0.0:1787397751.279445:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103104 00000100:00100000:0.0:1787397751.279448:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103104 00000100:00100000:0.0:1787397751.279487:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1787397751.279496:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701102592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279583:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701102592:12345-0@lo:400:kworker.0 Request processed in 88us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.279590:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1787397751.279603:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1787397751.279609:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701103104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279635:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701103104:12345-0@lo:400:kworker.0 Request processed in 26us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.279652:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00080000:0.0:1787397751.279668:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397751.279701:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701102592:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.279712:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701103104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397751.282723:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701103232:12345-0@lo:400:kworker.0 Request processed in 9161us (10291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397751.282738:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1787397751.283168:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701103232:0@lo:400:kworker.0 00000100:00100000:0.0:1787397751.559494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397751.559557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397751.559582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397751.559617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397751.559682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397751.559715:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213184 00000100:00100000:0.0:1787397751.559733:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213184 00000100:00100000:0.0:1787397751.559792:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213312 00000100:00100000:0.0:1787397751.559795:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213312 00000100:00100000:0.0:1787397751.559822:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1369 00000100:00100000:0.0:1787397751.559831:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681213184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397751.559905:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681213184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.559913:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1369 00000100:00100000:0.0:1787397751.559931:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1370 00000100:00100000:0.0:1787397751.559938:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681213312:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397751.559963:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681213312:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.559980:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1370 00000100:00100000:0.0:1787397751.560003:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213440 00000100:00100000:0.0:1787397751.560007:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213440 00000100:00100000:0.0:1787397751.560043:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213568 00000100:00100000:0.0:1787397751.560047:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213568 00000100:00100000:0.0:1787397751.560069:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2616 00000100:00100000:0.0:1787397751.560074:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681213440:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397751.560099:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681213440:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.560105:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2616 00000100:00100000:0.0:1787397751.560116:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2617 00000100:00100000:0.0:1787397751.560122:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681213568:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397751.560157:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681213568:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 34us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397751.560169:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2617 00000100:00080000:0.0:1787397751.560186:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397751.560189:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397751.560192:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397751.560194:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397751.560854:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213056 00000100:00100000:3.0:1787397751.560861:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213056 00000100:00100000:3.0:1787397751.560899:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397751.560906:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681213056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397751.561082:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681213056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 175us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397751.561091:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00010000:00010000:3.0:1787397751.652681:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397751.782996:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701103488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397751.783080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397751.783138:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103488 00000100:00100000:2.0:1787397751.783147:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103488 00000100:00100000:2.0:1787397751.783193:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1787397751.783202:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701103488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397751.783229:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397751.783274:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701103488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397751.783292:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1787397751.783344:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701103488:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787397751.790792:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:3.0:1787397751.790811:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968731 is committed 00000100:00100000:1.0:1787397751.793509:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701103872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397751.793593:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397751.793688:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103872 00000100:00100000:2.0:1787397751.793696:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103872 00000100:00100000:2.0:1787397751.793738:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1787397751.793746:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701103872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397751.793773:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397751.793852:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701103616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397751.793886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397751.793907:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397751.793914:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701103744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397751.793935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397751.793958:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103616 00000100:00100000:3.0:1787397751.793962:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103616 00000100:00100000:3.0:1787397751.793979:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701103744 00000100:00100000:3.0:1787397751.793982:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701103744 00000100:00100000:3.0:1787397751.793993:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1787397751.793999:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701103616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397751.794008:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397751.794049:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701103616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397751.794056:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1787397751.794073:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1787397751.794079:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701103744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397751.794089:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397751.794114:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701103744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397751.794120:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1787397751.794157:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701103744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397751.794171:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701103616:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787397751.794307:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:3.0:1787397751.794320:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968732 is committed 00000100:00100000:2.0:1787397751.795029:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701103872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1272us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397751.795038:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000001:00080000:2.0:1787397751.795799:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:1.0:1787397751.795880:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701103872:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787397752.678623:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397753.701443:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397754.725849:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397754.847164:0:94911:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1787397755.748835:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397756.390708:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397756.390741:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701104000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397756.390838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397756.390899:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104000 00000100:00100000:1.0:1787397756.390908:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104000 00000100:00100000:1.0:1787397756.390986:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1787397756.390996:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701104000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397756.391040:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397756.391089:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701104000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397756.391096:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1787397756.391143:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:1.0:1787397756.391150:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000100:00100000:3.0:1787397756.391426:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701104128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397756.391466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397756.391511:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104128 00000100:00100000:3.0:1787397756.391515:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104128 00000100:00100000:3.0:1787397756.391581:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:3.0:1787397756.391588:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701104128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397756.391612:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397756.391649:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701104128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397756.391656:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:3.0:1787397756.391698:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701104128:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1787397756.404827:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:1.0:1787397756.404901:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701104000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397756.405492:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701104256:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.405610:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.405680:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701104768:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.405713:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.405733:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701105280:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.405763:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.405793:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787397756.405800:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701104640:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.405823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.405841:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701105152:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.405862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.405897:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104256 00000100:00100000:2.0:1787397756.405906:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104256 00000100:00100000:2.0:1787397756.406001:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787397756.406011:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701104256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406074:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701104256:12345-0@lo:400:kworker.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.406082:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787397756.406124:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104768 00000100:00100000:2.0:1787397756.406128:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104768 00000100:00100000:2.0:1787397756.406170:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104640 00000100:00100000:2.0:1787397756.406173:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104640 00000100:00100000:2.0:1787397756.406388:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105152 00000100:00100000:2.0:1787397756.406393:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105152 00000100:00100000:2.0:1787397756.406416:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1787397756.406424:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701104768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406464:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701104768:12345-0@lo:400:kworker.0 Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.406471:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1787397756.406483:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1787397756.406489:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701104640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406515:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701104640:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.406547:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1787397756.406559:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1787397756.406564:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701105152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406592:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701105152:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.406598:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1787397756.406617:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105280 00000100:00100000:2.0:1787397756.406630:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105280 00000100:00100000:2.0:1787397756.406663:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1787397756.406670:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701105280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406700:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701105280:12345-0@lo:400:kworker.0 Request processed in 31us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.406705:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00080000:2.0:1787397756.406731:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397756.406736:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397756.406739:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397756.406783:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701104640:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406794:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701105152:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406804:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701104256:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406813:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701104768:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406823:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968732 gen 2 00000100:00100000:2.0:1787397756.406841:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701105280:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406870:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701104512:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406903:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.406924:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701105024:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.406966:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.406987:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701105536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.407012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.407034:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787397756.407041:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701104384:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.407064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.407089:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701104896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.407111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.407129:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701105408:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.407149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397756.407177:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104512 00000100:00100000:0.0:1787397756.407390:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105024 00000100:00100000:0.0:1787397756.407397:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105024 00000100:00100000:0.0:1787397756.407435:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104896 00000100:00100000:0.0:1787397756.407439:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104896 00000100:00100000:0.0:1787397756.407463:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105408 00000100:00100000:0.0:1787397756.407466:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105408 00000100:00100000:0.0:1787397756.407486:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1787397756.407493:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701105024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397756.407557:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701105024:12345-0@lo:400:kworker.0 Request processed in 64us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397756.407564:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1787397756.407580:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1787397756.407585:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701104896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397756.407613:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701104896:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397756.407619:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1787397756.407630:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1787397756.407636:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701105408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397756.407661:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701105408:12345-0@lo:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397756.407682:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1787397756.408353:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104512 00000100:00100000:2.0:1787397756.408409:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105536 00000100:00100000:2.0:1787397756.408413:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105536 00000100:00100000:2.0:1787397756.408431:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701104384 00000100:00100000:2.0:1787397756.408434:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701104384 00000100:00100000:2.0:1787397756.408456:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1787397756.408463:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408516:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701104512:12345-0@lo:400:kworker.0 Request processed in 53us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.408537:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1787397756.408553:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1787397756.408559:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701105536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408587:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701105536:12345-0@lo:400:kworker.0 Request processed in 28us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.408593:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1787397756.408602:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1787397756.408609:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701104384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408633:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701104384:12345-0@lo:400:kworker.0 Request processed in 26us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.408639:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00080000:2.0:1787397756.408683:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397756.408687:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397756.408698:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397756.408700:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397756.408748:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701104384:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408760:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701104896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408772:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968731 gen 2 00000100:00100000:2.0:1787397756.408788:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701105408:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408799:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701104512:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408810:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701105024:0@lo:400:kworker.0 00000100:00100000:2.0:1787397756.408820:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701105536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397756.688337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397756.688385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397756.688431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397756.688453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397756.688479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397756.688549:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214080 00000100:00100000:1.0:1787397756.688564:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214080 00000100:00100000:1.0:1787397756.688636:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214208 00000100:00100000:1.0:1787397756.688640:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214208 00000100:00100000:1.0:1787397756.688670:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2622 00000100:00100000:1.0:1787397756.688692:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681214080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397756.688805:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681214080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 116us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397756.688814:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2622 00000100:00100000:1.0:1787397756.688847:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2623 00000100:00100000:1.0:1787397756.688854:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681214208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397756.689405:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213824 00000100:00100000:2.0:1787397756.689414:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213824 00000100:00100000:2.0:1787397756.689460:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213952 00000100:00100000:2.0:1787397756.689463:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213952 00000100:00100000:2.0:1787397756.689490:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1377 00000100:00100000:2.0:1787397756.689499:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681213824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397756.689833:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681214208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 976us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397756.689843:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2623 00000100:00100000:2.0:1787397756.695470:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681213824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 5954us (7125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.695488:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1377 00000100:00100000:2.0:1787397756.695554:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1378 00000100:00100000:2.0:1787397756.695574:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2403:x1874218681213952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397756.695636:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2403:x1874218681213952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (7181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.695643:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1378 00000100:00100000:2.0:1787397756.695679:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681213696 00000100:00100000:2.0:1787397756.695699:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681213696 00000100:00100000:2.0:1787397756.695764:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787397756.695771:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681213696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397756.695816:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681213696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 45us (7384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397756.695943:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00080000:2.0:1787397756.696053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397756.696062:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397756.696066:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397756.696069:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787397756.782055:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397756.902658:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397756.902695:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701105664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397756.902804:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397756.903757:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105664 00000100:00100000:3.0:1787397756.903771:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105664 00000100:00100000:2.0:1787397756.904384:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397756.904410:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701105792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397756.904488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397756.904696:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105792 00000100:00100000:3.0:1787397756.904702:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105792 00000100:00100000:3.0:1787397756.904739:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1787397756.904751:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701105664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397756.904794:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397756.904871:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701105664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397756.904881:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1787397756.904908:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1787397756.904925:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701105792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397756.904944:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397756.904983:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701105792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397756.904990:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1787397756.905015:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701105920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397756.905053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397756.905075:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397756.905081:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397756.905130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397756.905163:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701105920 00000100:00100000:3.0:1787397756.905167:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701105920 00000100:00100000:3.0:1787397756.905188:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106048 00000100:00100000:3.0:1787397756.905191:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106048 00000100:00100000:3.0:1787397756.905209:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1787397756.905216:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701105920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397756.905235:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397756.905276:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701105920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397756.905283:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1787397756.905295:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1787397756.905302:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701106048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397756.905312:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397756.905338:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701106048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397756.905343:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1787397756.905395:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701105792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397756.905454:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701105664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397756.905574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397756.905595:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701105920:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1787397756.990232:0:94959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1787397757.797156:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397758.820846:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397758.875987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397758.876174:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214336 00000100:00100000:2.0:1787397758.876183:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214336 00000100:00100000:2.0:1787397758.876268:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1417 00000100:00100000:2.0:1787397758.876280:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:72792:x1874218681214336:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397758.876321:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:2.0:1787397758.876396:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:72792:x1874218681214336:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 119us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397758.876404:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1417 00000100:00080000:0.0:1787397758.876469:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397758.883683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397758.883821:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214464 00000100:00100000:2.0:1787397758.883831:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214464 00000100:00100000:2.0:1787397758.883932:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1418 00000100:00100000:2.0:1787397758.883943:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:72792:x1874218681214464:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397758.883989:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397758.884053:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:72792:x1874218681214464:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 113us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397758.884061:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1418 00000100:00080000:0.0:1787397758.884985:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397758.888575:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397758.889636:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214592 00000100:00100000:3.0:1787397758.889649:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214592 00000100:00100000:3.0:1787397758.889734:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2093 00000100:00100000:3.0:1787397758.889746:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:72792:x1874218681214592:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397758.889781:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397758.889871:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:72792:x1874218681214592:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 127us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397758.889889:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2093 00000100:00080000:0.0:1787397758.892004:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397758.895727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397758.895822:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214720 00000100:00100000:3.0:1787397758.895833:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214720 00000100:00100000:3.0:1787397758.895919:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2094 00000100:00100000:3.0:1787397758.895930:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:72792:x1874218681214720:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397758.895965:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397758.896045:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:72792:x1874218681214720:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397758.896054:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2094 00000100:00080000:0.0:1787397758.896459:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397758.937367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397758.939947:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214848 00000100:00100000:2.0:1787397758.939966:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214848 00000100:00100000:2.0:1787397758.940054:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1419 00000100:00100000:2.0:1787397758.940065:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:71685:x1874218681214848:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787397758.940087:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397758.940110:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d1917e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8221 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940180:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940195:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940207:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940221:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940228:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940234:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940402:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940412:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940418:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397758.940448:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397758.940451:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397758.940739:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940756:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940764:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940769:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940775:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940780:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397758.940785:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940792:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940903:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397758.940907:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397758.940911:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940918:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d1917ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940932:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940937:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940943:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940947:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397758.940950:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940955:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940961:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397758.940964:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397758.940966:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.940971:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1917f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.941015:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d1917e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8221 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.941028:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8221 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.941034:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:2.0:1787397758.941036:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397758.941039:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62800, rc 0) 00000100:00100000:2.0:1787397758.941116:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71685:x1874218681214848:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1052us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397758.941124:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1419 00000100:00100000:2.0:1787397758.955432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397758.955648:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681214976 00000100:00100000:0.0:1787397758.955659:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681214976 00000100:00100000:0.0:1787397758.955722:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1420 00000100:00100000:0.0:1787397758.955732:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:71685:x1874218681214976:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787397758.955752:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397758.955773:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191804 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8228 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956025:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956040:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956051:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956066:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956074:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.956097:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397758.956234:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66178:1874218701106176:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787397758.956300:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397758.956328:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397758.956695:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106176 00000100:00100000:1.0:1787397758.956701:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106176 00000100:00100000:1.0:1787397758.956752:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:1.0:1787397758.956763:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66178:x1874218701106176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787397758.956852:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66178:x1874218701106176:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397758.956860:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1787397758.956989:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66178:1874218701106176:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787397758.957034:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957046:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957056:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397758.957083:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957099:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957106:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957112:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957119:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957137:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397758.957141:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957149:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957164:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:0.0:1787397758.957167:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397758.957172:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957179:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d19180b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957206:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957212:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957218:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957223:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397758.957226:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957231:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957249:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff89a82250c200) 00010000:00010000:0.0:1787397758.957251:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397758.957254:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957260:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191812 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957297:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191804 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8228 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957309:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8228 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397758.957315:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82250c700) 00010000:00010000:0.0:1787397758.957317:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397758.957319:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aae00, rc 0) 00000100:00100000:0.0:1787397758.957365:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71685:x1874218681214976:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1636us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397758.957372:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1420 00000100:00100000:1.0:1787397758.964121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397758.964223:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215104 00000100:00100000:2.0:1787397758.964233:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215104 00000100:00100000:2.0:1787397758.964298:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1421 00000100:00100000:2.0:1787397758.964309:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71685:x1874218681215104:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787397758.964330:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397758.964350:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d191820 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d822f expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.964414:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62000/0x274786fe0d191827 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.964428:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62000/0x274786fe0d191827 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.964458:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62000/0x274786fe0d191827 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397758.964551:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787397758.964555:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787397758.964612:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d191820 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d822f expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.964632:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62000/0x274786fe0d191827 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d822f expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.964641:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:2.0:1787397758.964644:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787397758.964647:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:2.0:1787397758.964718:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71685:x1874218681215104:12345-192.168.204.60@tcp:101:bash.0 Request processed in 411us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397758.964727:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1421 00000100:00100000:1.0:1787397758.970796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397758.970849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397758.971043:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215232 00000100:00100000:3.0:1787397758.971053:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215232 00000100:00100000:3.0:1787397758.971121:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 675 00000100:00100000:3.0:1787397758.971132:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2403:x1874218681215232:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397758.971149:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397758.971173:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62000/0x274786fe0d191827 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d822f expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.971218:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:3.0:1787397758.971223:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397758.971278:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2403:x1874218681215232:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 147us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397758.971287:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 675 00000100:00100000:2.0:1787397758.971382:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215360 00000100:00100000:2.0:1787397758.971386:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215360 00000100:00100000:2.0:1787397758.971422:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1422 00000100:00100000:2.0:1787397758.971429:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71685:x1874218681215360:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787397758.971444:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397758.971457:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d19182e lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8236 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971519:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971586:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971597:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971614:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971621:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971628:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971709:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971718:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971726:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397758.971768:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787397758.971773:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397758.971793:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.971806:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972332:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972340:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972346:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972353:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972358:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397758.972363:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972370:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972380:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:2.0:1787397758.972383:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397758.972387:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972393:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d191835 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972406:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972413:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972426:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972431:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397758.972435:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972441:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972450:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397758.972453:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397758.972456:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972462:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d19183c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972498:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d19182e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8236 expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972511:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8236 expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.972517:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:2.0:1787397758.972519:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397758.973461:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62600, rc 0) 00000100:00100000:2.0:1787397758.975337:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71685:x1874218681215360:12345-192.168.204.60@tcp:101:bash.0 Request processed in 2391us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397758.975373:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1422 00000100:00100000:1.0:1787397758.982294:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397758.988755:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215488 00000100:00100000:1.0:1787397758.988772:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215488 00000100:00100000:1.0:1787397758.989074:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4996 00000100:00100000:1.0:1787397758.989101:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681215488:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:1.0:1787397758.989120:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397758.989144:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d19184a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d823d expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397758.989171:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x6a89864c, atime: 0x6a89864c, ctime: 0x6a89864c, blocks: 0x0 00010000:00010000:1.0:1787397758.989206:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=3638s v=(0 0) 00010000:00010000:1.0:1787397758.989211:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397758.989220:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d19184a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d823d expref: 6 pid: 26163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397758.989238:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d19184a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d823d expref: 6 pid: 26163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397758.989251:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74e00, rc 0) 00000100:00100000:1.0:1787397758.989333:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681215488:12345-192.168.204.60@tcp:101:bash.0 Request processed in 235us (7050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397758.989340:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4996 00000100:00100000:3.0:1787397758.995929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397758.996100:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215616 00000100:00100000:2.0:1787397758.996110:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215616 00000100:00100000:2.0:1787397758.996173:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1423 00000100:00100000:2.0:1787397758.996184:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:71685:x1874218681215616:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:2.0:1787397758.996205:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397758.996226:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d191851 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8244 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996298:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996313:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996323:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996338:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996346:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397758.996353:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397758.996469:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:77740:1874218701106304:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397758.996620:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397758.996671:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397758.997220:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106304 00000100:00100000:3.0:1787397758.997227:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106304 00000100:00100000:3.0:1787397758.997262:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1787397758.997270:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:77740:x1874218701106304:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397758.997356:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:77740:x1874218701106304:12345-0@lo:1000:mdt00_005.0 Request processed in 87us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397758.997364:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:2.0:1787397758.997485:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:77740:1874218701106304:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787397758.997681:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997695:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997705:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397758.997728:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997741:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997762:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997768:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997775:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997780:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397758.997784:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997792:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997804:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff89a82ebb1400) 00010000:00010000:3.0:1787397758.997806:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397758.997811:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.997817:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d191858 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998109:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998116:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998122:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998134:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397758.998138:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998145:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998155:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff89a82ebb1e00) 00010000:00010000:3.0:1787397758.998158:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397758.998161:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998167:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d19185f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998209:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d191851 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8244 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998222:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8244 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397758.998230:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82e43e200) 00010000:00010000:3.0:1787397758.998232:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397758.998235:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:3.0:1787397758.998346:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71685:x1874218681215616:12345-192.168.204.60@tcp:101:bash.0 Request processed in 2163us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397758.998354:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1423 00000100:00100000:2.0:1787397759.005043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397759.005147:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215744 00000100:00100000:0.0:1787397759.005158:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215744 00000100:00100000:0.0:1787397759.005234:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1424 00000100:00100000:0.0:1787397759.005246:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:71685:x1874218681215744:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787397759.005266:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397759.005288:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d19186d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d824b expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.005370:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa000/0x274786fe0d191874 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.005384:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa000/0x274786fe0d191874 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.005395:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa000/0x274786fe0d191874 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397759.005444:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787397759.005448:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787397759.005486:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d19186d lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d824b expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.005505:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa000/0x274786fe0d191874 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d824b expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.005514:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:0.0:1787397759.005517:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787397759.005563:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa000, rc 0) 00000100:00100000:0.0:1787397759.005624:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71685:x1874218681215744:12345-192.168.204.60@tcp:101:bash.0 Request processed in 381us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397759.005632:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1424 00000100:00100000:1.0:1787397759.013677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397759.016400:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397759.016780:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681215872 00000100:00100000:0.0:1787397759.016792:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681215872 00000100:00100000:0.0:1787397759.017034:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1425 00000100:00100000:0.0:1787397759.017046:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:71685:x1874218681215872:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787397759.017080:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397759.017101:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d19187b lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8252 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017163:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017178:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017281:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017299:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017307:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017314:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017389:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017398:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017405:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397759.017447:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:0.0:1787397759.017458:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397759.017479:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017491:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017501:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017508:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017514:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017841:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017849:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397759.017855:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017862:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017884:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:0.0:1787397759.017887:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397759.017892:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017899:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aac00/0x274786fe0d191882 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017924:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017930:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017935:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017940:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397759.017942:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017947:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017954:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff89a82250c200) 00010000:00010000:0.0:1787397759.017956:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397759.017958:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017964:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d191889 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.017999:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d19187b lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8252 expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.018014:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8252 expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.018033:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:0.0:1787397759.018036:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397759.018038:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab000, rc 0) 00000100:00100000:0.0:1787397759.018114:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:71685:x1874218681215872:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1071us (4450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397759.018122:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1425 00000100:00100000:3.0:1787397759.018314:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216000 00000100:00100000:3.0:1787397759.018326:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216000 00000100:00100000:3.0:1787397759.018372:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 676 00000100:00100000:3.0:1787397759.018380:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2403:x1874218681216000:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397759.018390:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397759.018404:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa000/0x274786fe0d191874 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d824b expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397759.018415:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:3.0:1787397759.018418:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397759.018456:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681216000:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 77us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397759.018463:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 676 00000100:00100000:2.0:1787397759.025391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397759.025498:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216128 00000100:00100000:0.0:1787397759.025508:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216128 00000100:00100000:0.0:1787397759.025595:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4997 00000100:00100000:0.0:1787397759.025606:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681216128:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:0.0:1787397759.025626:0:26166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397759.025648:0:26166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d191897 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8259 expref: -99 pid: 26166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397759.025676:0:26166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x6a89864c, atime: 0x6a89864c, ctime: 0x6a89864c, blocks: 0x0 00010000:00010000:0.0:1787397759.025696:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=3638s v=(0 0) 00010000:00010000:0.0:1787397759.025701:0:26166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397759.025710:0:26166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d191897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8259 expref: 7 pid: 26166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.025728:0:26166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d191897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8259 expref: 7 pid: 26166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397759.025741:0:26166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:0.0:1787397759.025837:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681216128:12345-192.168.204.60@tcp:101:bash.0 Request processed in 231us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397759.025845:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4997 00010000:00010000:1.0:1787397759.844708:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397760.868861:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397761.509050:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701106560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509160:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701107072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509207:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701107584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509228:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509254:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787397761.509260:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701106432:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509315:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701106944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509355:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701107456:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509393:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701107968:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701106816:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509516:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701107328:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509578:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701107840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509631:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787397761.509637:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701106688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509673:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701107200:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509693:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397761.509706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701107712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397761.509725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397761.509869:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106560 00000100:00100000:1.0:1787397761.509878:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106560 00000100:00100000:1.0:1787397761.509927:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106944 00000100:00100000:1.0:1787397761.509931:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106944 00000100:00100000:1.0:1787397761.509945:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107456 00000100:00100000:1.0:1787397761.509948:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107456 00000100:00100000:1.0:1787397761.509961:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107968 00000100:00100000:1.0:1787397761.509971:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107968 00000100:00100000:1.0:1787397761.509984:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106816 00000100:00100000:1.0:1787397761.509986:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106816 00000100:00100000:1.0:1787397761.509998:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106688 00000100:00100000:1.0:1787397761.510001:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106688 00000100:00100000:1.0:1787397761.510014:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1787397761.510022:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701106560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510080:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701106560:12345-0@lo:400:kworker.0 Request processed in 58us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510087:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1787397761.510109:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1787397761.510115:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701106944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510142:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701106944:12345-0@lo:400:kworker.0 Request processed in 28us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510148:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1787397761.510159:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1787397761.510165:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701107456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510191:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701107456:12345-0@lo:400:kworker.0 Request processed in 26us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510197:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1787397761.510209:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1787397761.510215:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701107968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510243:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701107968:12345-0@lo:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510249:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1787397761.510261:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1787397761.510266:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701106816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510302:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701106816:12345-0@lo:400:kworker.0 Request processed in 35us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510308:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1787397761.510321:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1787397761.510327:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701106688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510353:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701106688:12345-0@lo:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510359:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00080000:1.0:1787397761.510398:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397761.510403:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397761.510413:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701108096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397761.510437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397761.510474:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701106944:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510485:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701107456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510493:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701107968:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510503:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701106560:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510561:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107072 00000100:00100000:1.0:1787397761.510565:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107072 00000100:00100000:1.0:1787397761.510585:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107584 00000100:00100000:1.0:1787397761.510588:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107584 00000100:00100000:1.0:1787397761.510598:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108096 00000100:00100000:1.0:1787397761.510600:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108096 00000100:00100000:1.0:1787397761.510610:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:1.0:1787397761.510615:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701107072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510653:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701107072:12345-0@lo:400:kworker.0 Request processed in 37us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510667:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:1.0:1787397761.510681:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1787397761.510687:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701107584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510720:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701107584:12345-0@lo:400:kworker.0 Request processed in 33us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510725:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1787397761.510752:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:1.0:1787397761.510759:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701108096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397761.510783:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397761.510812:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701108096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.510818:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:1.0:1787397761.510857:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701108096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397761.510867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701107072:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510876:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701107584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.510951:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107328 00000100:00100000:1.0:1787397761.510955:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107328 00000100:00100000:1.0:1787397761.510987:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107840 00000100:00100000:1.0:1787397761.510989:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107840 00000100:00100000:1.0:1787397761.511027:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107200 00000100:00100000:1.0:1787397761.511030:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107200 00000100:00100000:1.0:1787397761.511047:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701107712 00000100:00100000:1.0:1787397761.511050:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701107712 00000100:00100000:1.0:1787397761.511069:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1787397761.511074:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701107328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.511114:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701107328:12345-0@lo:400:kworker.0 Request processed in 40us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.511121:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1787397761.511134:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1787397761.511140:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701107840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.511167:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701107840:12345-0@lo:400:kworker.0 Request processed in 27us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.511172:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1787397761.511182:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1787397761.511188:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701107200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.511214:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701107200:12345-0@lo:400:kworker.0 Request processed in 27us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.511220:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1787397761.511230:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1787397761.511236:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701107712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.511264:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701107712:12345-0@lo:400:kworker.0 Request processed in 29us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.511270:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00080000:1.0:1787397761.511289:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397761.511292:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397761.511417:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701106432 00000100:00100000:2.0:1787397761.511423:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701106432 00000100:00100000:2.0:1787397761.511460:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397761.511468:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701106432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397761.511509:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701106432:12345-0@lo:400:kworker.0 Request processed in 42us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397761.511514:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787397761.511602:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701106432:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513172:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701107712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513190:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701106816:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513203:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701107328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513214:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701107840:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513266:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701106688:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.513278:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701107200:0@lo:400:kworker.0 00000100:00100000:1.0:1787397761.522092:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397761.522124:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701108224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397761.522207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397761.523115:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108224 00000100:00100000:2.0:1787397761.523128:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108224 00000100:00100000:2.0:1787397761.523192:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:2.0:1787397761.523202:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701108224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397761.523240:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397761.523321:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701108224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397761.523328:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:0.0:1787397761.523415:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701108224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397761.801971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397761.802031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397761.802075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397761.802095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397761.802122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397761.802153:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216384 00000100:00100000:1.0:1787397761.802166:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216384 00000100:00100000:1.0:1787397761.802235:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216512 00000100:00100000:1.0:1787397761.802239:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216512 00000100:00100000:1.0:1787397761.802262:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1385 00000100:00100000:1.0:1787397761.802271:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2402:x1874218681216384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397761.802339:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2402:x1874218681216384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.802346:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1385 00000100:00100000:1.0:1787397761.802364:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1386 00000100:00100000:1.0:1787397761.802370:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681216512:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397761.802393:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681216512:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.802399:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1386 00000100:00100000:1.0:1787397761.802420:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216640 00000100:00100000:3.0:1787397761.802617:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216768 00000100:00100000:3.0:1787397761.802621:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216768 00000100:00100000:3.0:1787397761.802801:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2628 00000100:00100000:3.0:1787397761.802809:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681216768:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397761.802857:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681216768:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 48us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397761.802863:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2628 00000100:00100000:1.0:1787397761.803021:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216640 00000100:00100000:1.0:1787397761.803052:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2629 00000100:00100000:1.0:1787397761.803058:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681216640:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397761.803085:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681216640:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397761.803091:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2629 00000100:00080000:1.0:1787397761.803108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397761.803113:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397761.803115:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397761.803117:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397761.803319:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216256 00000100:00100000:2.0:1787397761.803324:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216256 00000100:00100000:2.0:1787397761.803352:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:2.0:1787397761.803358:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681216256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397761.803385:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681216256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397761.803398:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00010000:00010000:1.0:1787397761.892695:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397762.023307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397762.023330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701108352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397762.023405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397762.023472:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108352 00000100:00100000:3.0:1787397762.023481:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108352 00000100:00100000:3.0:1787397762.023554:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1787397762.023564:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701108352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397762.023609:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397762.023752:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701108352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397762.023760:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1787397762.023828:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701108352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397762.023959:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701108480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397762.023990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397762.024026:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108480 00000100:00100000:0.0:1787397762.024030:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108480 00000100:00100000:0.0:1787397762.024056:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1787397762.024064:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701108480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397762.024073:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397762.024103:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701108480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397762.024109:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1787397762.024137:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701108480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397762.026149:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701108608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397762.026213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397762.026268:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108608 00000100:00100000:0.0:1787397762.026275:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108608 00000100:00100000:0.0:1787397762.026316:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1787397762.026331:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701108608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397762.026361:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397762.026404:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701108608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397762.026411:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1787397762.026471:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701108608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397762.026994:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397762.027007:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701108736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397762.027038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397762.027122:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108736 00000100:00100000:3.0:1787397762.027127:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108736 00000100:00100000:3.0:1787397762.027163:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1787397762.027170:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701108736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397762.027183:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397762.027222:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701108736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397762.027228:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1787397762.027269:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701108736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397762.917588:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397763.941633:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397764.965742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397765.988773:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397766.628827:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397766.630282:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397766.630309:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701108992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397766.630401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397766.630554:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108992 00000100:00100000:3.0:1787397766.630562:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108992 00000100:00100000:3.0:1787397766.630613:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1787397766.630622:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701108992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397766.630666:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397766.630719:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701108992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397766.630737:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1787397766.630789:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701108992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397766.631094:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701108864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397766.631129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631464:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701109120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631499:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631553:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701109632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631598:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701110144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631621:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631650:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787397766.631657:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701109504:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631691:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701110016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631709:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397766.631745:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110144 00000100:00100000:0.0:1787397766.631750:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110144 00000100:00100000:0.0:1787397766.631792:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:0.0:1787397766.631799:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.631851:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701110144:12345-0@lo:400:kworker.0 Request processed in 53us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397766.631858:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:0.0:1787397766.631892:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701110144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397766.632019:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109120 00000100:00100000:3.0:1787397766.632024:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109120 00000100:00100000:3.0:1787397766.632060:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787397766.632067:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701109120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397766.632102:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701109120:12345-0@lo:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397766.632109:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787397766.632314:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109632 00000100:00100000:2.0:1787397766.632319:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109632 00000100:00100000:2.0:1787397766.632361:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109504 00000100:00100000:2.0:1787397766.632365:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109504 00000100:00100000:2.0:1787397766.632383:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1787397766.632390:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701109632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632425:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701109632:12345-0@lo:400:kworker.0 Request processed in 36us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.632431:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1787397766.632443:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110016 00000100:00100000:2.0:1787397766.632447:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110016 00000100:00100000:2.0:1787397766.632467:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1787397766.632472:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701109504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632499:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701109504:12345-0@lo:400:kworker.0 Request processed in 26us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.632505:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1787397766.632516:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1787397766.632547:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701110016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632574:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701110016:12345-0@lo:400:kworker.0 Request processed in 52us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.632580:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1787397766.632608:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701109376:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632800:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701109888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632823:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632840:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701110400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632874:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787397766.632881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701109248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632911:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701109760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632930:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632947:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701110272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.632965:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397766.632991:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109888 00000100:00100000:2.0:1787397766.632995:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109888 00000100:00100000:2.0:1787397766.633019:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109760 00000100:00100000:2.0:1787397766.633022:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109760 00000100:00100000:2.0:1787397766.633040:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110272 00000100:00100000:2.0:1787397766.633042:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110272 00000100:00100000:2.0:1787397766.633064:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1787397766.633070:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.633105:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701109888:12345-0@lo:400:kworker.0 Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.633112:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1787397766.633124:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1787397766.633131:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.633157:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701109760:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.633170:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1787397766.633182:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1787397766.633187:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701110272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.633214:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701110272:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.633219:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1787397766.633257:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109376 00000100:00100000:2.0:1787397766.633261:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109376 00000100:00100000:2.0:1787397766.633279:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110400 00000100:00100000:2.0:1787397766.633281:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110400 00000100:00100000:2.0:1787397766.633290:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701109248 00000100:00100000:2.0:1787397766.633292:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701109248 00000100:00100000:2.0:1787397766.633303:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1787397766.633308:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701109376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636491:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701109376:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.636517:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1787397766.636577:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1787397766.636590:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701110400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636749:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701110400:12345-0@lo:400:kworker.0 Request processed in 163us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.636756:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1787397766.636771:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1787397766.636780:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701109248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636809:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701109248:12345-0@lo:400:kworker.0 Request processed in 32us (3908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.636825:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1787397766.636901:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701109248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636914:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701109760:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636925:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701110272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636938:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701109376:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636950:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701109888:0@lo:400:kworker.0 00000100:00100000:2.0:1787397766.636960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701110400:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.637134:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701109504:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.637147:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701110016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.637155:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701109120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397766.637166:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701109632:0@lo:400:kworker.0 00000100:00100000:1.0:1787397766.637240:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701108864 00000100:00100000:1.0:1787397766.637247:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701108864 00000100:00100000:1.0:1787397766.637296:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1787397766.637303:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701108864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397766.637328:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397766.637450:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701108864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (6320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397766.637458:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00080000:1.0:1787397766.637486:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397766.637492:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397766.637494:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397766.637497:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397766.637612:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701108864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397766.917157:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397766.917214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397766.917239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397766.917262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397766.917284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397766.917423:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681216896 00000100:00100000:2.0:1787397766.917434:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681216896 00000100:00100000:2.0:1787397766.917509:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787397766.917539:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681216896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397766.917617:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681216896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.917627:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787397766.917661:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217152 00000100:00100000:2.0:1787397766.917666:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217152 00000100:00100000:2.0:1787397766.917704:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217024 00000100:00100000:2.0:1787397766.917708:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217024 00000100:00100000:2.0:1787397766.917743:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1393 00000100:00100000:2.0:1787397766.917750:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681217152:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397766.917782:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681217152:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.917789:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1393 00000100:00100000:2.0:1787397766.917817:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1394 00000100:00100000:2.0:1787397766.917824:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681217024:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397766.917851:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681217024:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397766.917857:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1394 00000100:00080000:2.0:1787397766.917877:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397766.917881:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397766.918283:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217408 00000100:00100000:1.0:1787397766.918289:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217408 00000100:00100000:1.0:1787397766.918336:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217280 00000100:00100000:1.0:1787397766.918347:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217280 00000100:00100000:1.0:1787397766.918371:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2634 00000100:00100000:1.0:1787397766.918378:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681217408:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397766.918411:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681217408:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397766.918417:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2634 00000100:00100000:1.0:1787397766.918432:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2635 00000100:00100000:1.0:1787397766.918438:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681217280:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397766.918474:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681217280:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397766.918481:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2635 00000100:00080000:2.0:1787397766.918701:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397766.918704:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787397767.017148:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397767.140653:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397767.140675:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701110528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397767.140759:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.140805:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110528 00000100:00100000:0.0:1787397767.140813:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110528 00000100:00100000:0.0:1787397767.140861:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1787397767.140870:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701110528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397767.140903:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397767.140949:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701110528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.140956:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1787397767.141003:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701110528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397767.141405:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397767.141417:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701110656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397767.141451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397767.141545:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110656 00000100:00100000:1.0:1787397767.141549:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110656 00000100:00100000:1.0:1787397767.141584:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1787397767.141592:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701110656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397767.141609:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787397767.141642:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701110656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397767.141649:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1787397767.141726:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701110656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397767.145249:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701110912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397767.145323:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397767.145357:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110912 00000100:00100000:1.0:1787397767.145366:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110912 00000100:00100000:2.0:1787397767.145371:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397767.145380:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701110784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397767.145415:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1787397767.145426:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701110912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397767.145448:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397767.145496:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701110912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397767.145517:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1787397767.145623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397767.145769:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701110912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397767.145803:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701110784 00000100:00100000:2.0:1787397767.145806:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701110784 00000100:00100000:2.0:1787397767.145834:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1787397767.145841:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701110784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397767.145852:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397767.146053:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701110784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397767.146070:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1787397767.146106:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701110784:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787397767.333459:0:95252:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdc1b3df20 00000020:00000080:1.0:1787397767.333476:0:95252:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787397767.333482:0:95252:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 4 00000020:00000080:1.0:1787397767.333510:0:95252:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffdc1b3df80 20000000:00000080:1.0:1787397767.333517:0:95252:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff89a828866800 uarg=0000000000000000 00000040:00100000:1.0:1787397767.334400:0:95252:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1787397767.334407:0:95252:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1787397767.334422:0:95252:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1787397767.335071:0:95253:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 43 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1787397767.335149:0:95253:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 43 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397767.335165:0:95253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:3.0:1787397767.335415:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:3.0:1787397767.335436:0:95252:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1787397767.335453:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:3.0:1787397767.335469:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:3.0:1787397767.335486:0:95252:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1787397767.336257:0:95254:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1787397767.336301:0:95254:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397767.336315:0:95254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:3.0:1787397767.336500:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:3.0:1787397767.336514:0:95252:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1787397767.337096:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:3.0:1787397767.337120:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:3.0:1787397767.337135:0:95252:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1787397767.338493:0:95255:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 45 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1787397767.338809:0:95255:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 45 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1787397767.338834:0:95255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:2.0:1787397767.339059:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:2.0:1787397767.339075:0:95252:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1787397767.339090:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:2.0:1787397767.339103:0:95252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:2.0:1787397767.339123:0:95252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787397767.339145:0:95252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339167:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339175:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339183:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1913ff expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339190:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339196:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191510 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339202:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19152c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339209:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191556 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339223:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191564 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339230:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339237:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19158e expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339243:0:95252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339250:0:95252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339292:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339308:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.339338:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111040:0@lo:104: 00000100:00100000:2.0:1787397767.339406:0:95252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397767.339462:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339470:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.339490:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111168:0@lo:104: 00000100:00100000:2.0:1787397767.339512:0:95252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397767.339760:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.339769:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.339778:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111296:0@lo:104: 00000100:00100000:2.0:1787397767.339802:0:95252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.340044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111040 00000100:00100000:3.0:1787397767.340052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111040 00000100:00100000:3.0:1787397767.340131:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111168 00000100:00100000:3.0:1787397767.340135:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111168 00000100:00100000:1.0:1787397767.340178:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787397767.340189:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95252:x1874218701111040:12345-0@lo:104: 00010000:00010000:1.0:1787397767.340203:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.340254:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397767.340260:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95252:x1874218701111040:12345-0@lo:104: Request processed in 74us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397767.340267:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787397767.340286:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787397767.340291:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95252:x1874218701111168:12345-0@lo:104: 00010000:00010000:1.0:1787397767.340299:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.340424:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787397767.340430:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95252:x1874218701111168:12345-0@lo:104: Request processed in 139us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397767.340437:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:1.0:1787397767.340452:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397767.340458:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.340465:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397767.340469:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.340477:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397767.340484:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397767.340489:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397767.340518:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340579:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397767.340585:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340592:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397767.340595:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340602:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397767.340608:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397767.340614:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.340629:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340634:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397767.340656:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340663:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d19158e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191595 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340674:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397767.340676:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397767.340678:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397767.340700:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701111552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.340755:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.340798:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111552 00000100:00100000:0.0:1787397767.340802:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111552 00010000:00010000:0.0:1787397767.340820:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.340842:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1787397767.340848:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701111552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.340858:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.340863:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340872:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.340888:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.340914:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701111552:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.340920:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1787397767.340956:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701111552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397767.341170:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397767.341190:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.341197:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d1915b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1915bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.341217:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397767.341218:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397767.341220:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397767.341291:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701111424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.341322:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.341369:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111424 00000100:00100000:0.0:1787397767.341373:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111424 00010000:00010000:0.0:1787397767.341387:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.341408:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1787397767.341423:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8197d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701111424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.341431:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.341437:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.341446:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 24 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.341457:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.341485:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8197d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701111424:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.341491:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1787397767.341578:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701111424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397767.341951:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.341963:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.341972:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111680:0@lo:104: 00010000:00010000:2.0:1787397767.341999:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342006:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 23 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342014:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111808:0@lo:104: 00010000:00010000:2.0:1787397767.342032:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342040:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342055:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111936:0@lo:104: 00010000:00010000:2.0:1787397767.342080:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342088:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342096:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112064:0@lo:104: 00010000:00010000:2.0:1787397767.342115:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342122:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 23 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342129:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112192:0@lo:104: 00010000:00010000:2.0:1787397767.342148:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342155:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 23 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342162:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112320:0@lo:104: 00010000:00010000:2.0:1787397767.342186:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342195:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 9 pid: 94335 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342216:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112448:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397767.342661:0:95252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397767.342671:0:95252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342681:0:95252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112576:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397767.342792:0:95252:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00010000:00010000:2.0:1787397767.342813:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75200/0x274786fe0d1915bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1915b8 expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342826:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111040:0@lo:104: 00010000:00010000:2.0:1787397767.342836:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75a00/0x274786fe0d191595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19158e expref: 22 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.342844:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111168:0@lo:104: 00000100:00100000:3.0:1787397767.343039:0:93049:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787397767.343061:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343088:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343110:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343119:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343127:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343134:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.343141:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111296 00000100:00100000:3.0:1787397767.343145:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111296 00000100:00100000:3.0:1787397767.343172:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111680 00000100:00100000:3.0:1787397767.343175:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111680 00000100:00100000:3.0:1787397767.343186:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111808 00000100:00100000:3.0:1787397767.343188:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111808 00000100:00100000:3.0:1787397767.343197:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701111936 00000100:00100000:3.0:1787397767.343200:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701111936 00000100:00100000:3.0:1787397767.343207:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112064 00000100:00100000:3.0:1787397767.343209:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112064 00000100:00100000:3.0:1787397767.343217:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112192 00000100:00100000:3.0:1787397767.343219:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112192 00000100:00100000:3.0:1787397767.343229:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112320 00000100:00100000:3.0:1787397767.343231:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112320 00000100:00100000:3.0:1787397767.343242:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787397767.343249:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+9:95252:x1874218701111296:12345-0@lo:104: 00010000:00010000:3.0:1787397767.343261:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.343317:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787397767.343331:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+9:95252:x1874218701111296:12345-0@lo:104: Request processed in 75us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.343339:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787397767.343399:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787397767.343406:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:95252:x1874218701111680:12345-0@lo:104: 00010000:00010000:3.0:1787397767.343414:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.343457:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787397767.343463:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:95252:x1874218701111680:12345-0@lo:104: Request processed in 57us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.343469:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787397767.343483:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787397767.343489:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+7:95252:x1874218701111808:12345-0@lo:104: 00010000:00010000:3.0:1787397767.343496:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.343928:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787397767.343935:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+7:95252:x1874218701111808:12345-0@lo:104: Request processed in 447us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.343942:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787397767.343957:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787397767.343964:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+6:95252:x1874218701111936:12345-0@lo:104: 00010000:00010000:3.0:1787397767.343973:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344009:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787397767.344014:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+6:95252:x1874218701111936:12345-0@lo:104: Request processed in 51us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.344020:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787397767.344032:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787397767.344039:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+5:95252:x1874218701112064:12345-0@lo:104: 00010000:00010000:3.0:1787397767.344046:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344088:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787397767.344093:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+5:95252:x1874218701112064:12345-0@lo:104: Request processed in 55us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.344099:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787397767.344114:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787397767.344120:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95252:x1874218701112192:12345-0@lo:104: 00010000:00010000:3.0:1787397767.344127:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344153:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787397767.344158:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95252:x1874218701112192:12345-0@lo:104: Request processed in 40us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.344164:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1787397767.344175:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787397767.344181:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95252:x1874218701112320:12345-0@lo:104: 00010000:00010000:3.0:1787397767.344188:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344214:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787397767.344219:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95252:x1874218701112320:12345-0@lo:104: Request processed in 39us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.344225:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:3.0:1787397767.344258:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787397767.344264:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344281:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397767.344286:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344294:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397767.344302:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397767.344308:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397767.344351:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344358:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397767.344380:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344387:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0c00/0x274786fe0d191580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344398:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787397767.344401:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344407:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397767.344410:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344427:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397767.344433:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397767.344438:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397767.344453:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344459:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397767.344466:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344472:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0400/0x274786fe0d191564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19156b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344482:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787397767.344485:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344491:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397767.344494:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.344500:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397767.344507:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397767.344518:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.344653:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787397767.344659:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344666:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397767.344669:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344676:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397767.344681:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397767.344686:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.344721:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344732:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397767.344748:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344755:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a1800/0x274786fe0d19152c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344768:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397767.344771:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344776:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397767.344779:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344786:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397767.344793:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397767.344799:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.344812:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344817:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397767.344823:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344829:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191517 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344844:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397767.344847:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344852:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397767.344855:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344862:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397767.344867:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397767.344872:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.344885:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344890:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397767.344895:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344901:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0200/0x274786fe0d1914d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1914df expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344910:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397767.344912:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344927:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397767.344930:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344936:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397767.344942:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397767.344946:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397767.344960:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344966:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397767.344971:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344977:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d1913ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191406 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.344986:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397767.344988:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397767.344989:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397767.345002:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397767.345016:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701113088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.345059:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.345095:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397767.345101:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701112960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.345137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.345168:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113088 00000100:00100000:0.0:1787397767.345175:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113088 00010000:00010000:0.0:1787397767.345199:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 22 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.345223:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112960 00000100:00100000:0.0:1787397767.345226:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112960 00010000:00010000:0.0:1787397767.345237:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.345256:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1787397767.345263:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701113088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.345273:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.345278:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.345288:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 23 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.345306:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.345335:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701113088:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.345341:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1787397767.345358:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1787397767.345364:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701112960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.345371:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.345376:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 22 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.345394:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 22 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.345404:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.345426:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701112960:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.345431:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1787397767.345479:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701112960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.345488:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701113088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.345583:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397767.345857:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111296:0@lo:104: 00000100:00100000:2.0:1787397767.345868:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111680:0@lo:104: 00000100:00100000:2.0:1787397767.345877:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111808:0@lo:104: 00010000:00010000:2.0:1787397767.345885:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030a00/0x274786fe0d191533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19152c expref: 21 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.345897:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701111936:0@lo:104: 00010000:00010000:2.0:1787397767.345907:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23800/0x274786fe0d191517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191510 expref: 20 pid: 94340 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397767.345924:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112064:0@lo:104: 00000100:00100000:2.0:1787397767.345935:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112192:0@lo:104: 00000100:00100000:2.0:1787397767.345943:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112320:0@lo:104: 00010000:00010000:3.0:1787397767.346292:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.346300:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397767.346333:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.346341:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0e00/0x274786fe0d191556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19155d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.346358:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397767.346360:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397767.346362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397767.346378:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701112704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397767.346432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.346475:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701113216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397767.346497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.346516:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397767.346556:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701112832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397767.346579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.346593:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701113344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397767.346612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397767.346640:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112704 00000100:00100000:3.0:1787397767.346646:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112704 00010000:00010000:3.0:1787397767.346670:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 20 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397767.346792:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113216 00000100:00100000:3.0:1787397767.346796:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113216 00010000:00010000:3.0:1787397767.346810:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 21 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397767.346825:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701112832 00000100:00100000:3.0:1787397767.346827:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701112832 00010000:00010000:3.0:1787397767.346838:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 22 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397767.346851:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113344 00000100:00100000:3.0:1787397767.346854:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113344 00010000:00010000:3.0:1787397767.346867:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 23 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397767.346885:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1787397767.346893:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701112704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397767.346903:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397767.346909:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.346919:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397767.346922:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.346938:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23c00/0x274786fe0d191587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191580 expref: 23 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.346951:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397767.346989:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701112704:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.347003:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1787397767.347010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701112704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397767.347025:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1787397767.347034:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701113216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397767.347042:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397767.347047:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 21 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347055:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 21 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347065:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030e00/0x274786fe0d1914df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1914d8 expref: 21 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347074:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397767.347113:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701113216:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.347119:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1787397767.347132:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1787397767.347138:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701112832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397767.347146:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397767.347151:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 19 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347160:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 19 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347170:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23400/0x274786fe0d19156b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191564 expref: 19 pid: 94333 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347190:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397767.347213:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701112832:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.347219:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1787397767.347231:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1787397767.347238:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+17:3648:x1874218701113344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397767.347245:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397767.347250:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 17 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347259:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 17 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347269:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031200/0x274786fe0d191406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1913ff expref: 17 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.347278:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397767.347298:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+16:3648:x1874218701113344:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397767.347304:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1787397767.347837:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701112832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397767.347847:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701113344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397767.347854:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701113216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.347950:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701113472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397767.347987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397767.348030:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113472 00000100:00100000:0.0:1787397767.348034:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113472 00010000:00010000:0.0:1787397767.348052:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 16 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.348078:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1787397767.348086:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834538850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701113472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.348096:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.348101:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 16 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.348109:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 16 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.348120:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031000/0x274786fe0d19155d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191556 expref: 16 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.348139:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.348168:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834538850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+15:3650:x1874218701113472:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.348174:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1787397767.348225:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701113472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397767.348595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397767.350090:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217536 00000100:00100000:1.0:1787397767.350103:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217536 00010000:00010000:1.0:1787397767.350145:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397767.350187:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2634 00000100:00100000:1.0:1787397767.350196:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681217536:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397767.350209:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397767.350214:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.350301:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397767.350376:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397767.350658:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030000/0x274786fe0d1913dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d820c expref: 10 pid: 94335 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397767.350674:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112448:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787397767.350909:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2404:x1874218681217536:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 713us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397767.350935:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2634 00000100:00100000:1.0:1787397767.355368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397767.355504:0:95252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95252:1874218701112576:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397767.355602:0:95252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.355971:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217664 00000100:00100000:0.0:1787397767.355980:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217664 00010000:00010000:0.0:1787397767.356021:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397767.356098:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2635 00000100:00100000:0.0:1787397767.356108:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2404:x1874218681217664:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397767.356123:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397767.356129:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356140:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356158:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1913ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81fe expref: 9 pid: 94334 timeout: 3746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356175:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356183:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356210:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356218:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356290:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356299:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356305:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397767.356309:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356317:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356345:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397767.356354:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397767.356418:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:2404:x1874218681217664:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 311us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397767.356427:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2635 00010000:00010000:3.0:1787397767.356482:0:95252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.356491:0:95252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397767.356496:0:95252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62c00/0x274786fe0d19189e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397768.036795:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397768.901388:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397768.901558:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217792 00000100:00100000:3.0:1787397768.901567:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217792 00000100:00100000:3.0:1787397768.901628:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787397768.901638:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681217792:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397768.901656:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397768.901676:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8260 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397768.901718:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397768.901731:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397768.901741:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74800, rc 0) 00000100:00100000:3.0:1787397768.901811:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681217792:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 173us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397768.901819:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:1.0:1787397768.907813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397768.908027:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681217920 00000100:00100000:2.0:1787397768.908037:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681217920 00000100:00100000:2.0:1787397768.908093:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:2.0:1787397768.908102:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681217920:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397768.908688:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681217920:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 576us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397768.908698:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:1.0:1787397768.917011:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397768.917089:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218048 00000100:00100000:3.0:1787397768.917116:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218048 00000100:00100000:3.0:1787397768.917189:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:3.0:1787397768.917201:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681218048:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397768.917363:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681218048:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397768.917371:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:0.0:1787397768.921004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397768.921112:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218176 00000100:00100000:1.0:1787397768.921123:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218176 00000100:00100000:1.0:1787397768.921193:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:1.0:1787397768.921204:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73275:x1874218681218176:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397768.921353:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73275:x1874218681218176:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 151us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397768.921363:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:1.0:1787397768.923592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397768.923675:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218304 00000100:00100000:3.0:1787397768.923694:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218304 00000100:00100000:3.0:1787397768.923747:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:3.0:1787397768.923757:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73275:x1874218681218304:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787397768.923908:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73275:x1874218681218304:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 152us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397768.923916:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 90 00000100:00100000:3.0:1787397768.934380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397768.935545:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218432 00000100:00100000:1.0:1787397768.935559:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218432 00000100:00100000:1.0:1787397768.935634:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:1.0:1787397768.935644:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681218432:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397768.935659:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397768.935688:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8267 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397768.935723:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397768.935735:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397768.935765:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75400, rc 0) 00000100:00100000:1.0:1787397768.935833:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681218432:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 189us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397768.935840:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:2.0:1787397768.939256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397768.939847:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218560 00000100:00100000:3.0:1787397768.939858:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218560 00000100:00100000:3.0:1787397768.939924:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:3.0:1787397768.939934:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681218560:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397768.940059:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681218560:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 126us (812us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397768.940066:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 92 00010000:00010000:0.0:1787397769.060722:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787397769.190216:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397769.190224:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70a901000 from 58 10000000:01000000:2.0:1787397769.190228:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397769.190275:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.190286:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.190297:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.190334:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.190416:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.190551:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113600 00000100:00100000:3.0:1787397769.190559:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113600 00000100:00100000:3.0:1787397769.190628:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787397769.190637:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701113600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397769.190660:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397769.190684:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918b3 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.190708:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 16 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.190719:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 16 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.190728:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:3.0:1787397769.200619:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701113600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 9973us (10193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.200633:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787397769.201112:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.201143:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.201167:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.201179:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.201265:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.201302:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.201326:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397769.201611:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113728 00000100:00100000:3.0:1787397769.201619:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113728 00000100:00100000:3.0:1787397769.201667:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787397769.201686:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701113728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.201834:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701113728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.201841:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787397769.202038:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.202070:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.202117:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.202147:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.202196:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113856 00000100:00100000:0.0:1787397769.202207:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113856 00000100:00100000:0.0:1787397769.202239:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787397769.202246:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701113856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.202338:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701113856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.202346:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787397769.202427:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701113856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.202914:0:95256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95256:1874218701113984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397769.202957:0:95256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397769.202985:0:95256:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.203028:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701113984 00000100:00100000:2.0:1787397769.203032:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701113984 00000100:00100000:2.0:1787397769.203064:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787397769.203071:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:95256:x1874218701113984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.203164:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:95256:x1874218701113984:12345-0@lo:502:llog_process_th.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.203171:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787397769.203248:0:95256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95256:1874218701113984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397769.203287:0:95256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95256:1874218701114112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397769.203321:0:95256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397769.203347:0:95256:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.203398:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114112 00000100:00100000:0.0:1787397769.203401:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114112 00000100:00100000:0.0:1787397769.203445:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787397769.203452:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:95256:x1874218701114112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.203545:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:95256:x1874218701114112:12345-0@lo:502:llog_process_th.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.203552:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787397769.203778:0:95256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95256:1874218701114112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787397769.203796:0:95256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1787397769.203976:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1787397769.204003:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397769.204013:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.204024:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397769.204034:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787397769.204036:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1787397769.204039:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787397769.204064:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.204072:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.204091:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397769.204105:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.204135:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.204164:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.204209:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114240 00000100:00100000:1.0:1787397769.204213:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114240 00000100:00100000:1.0:1787397769.204245:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787397769.204252:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701114240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397769.204261:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397769.204273:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918c1 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.204295:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 17 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.204317:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 17 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.204325:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:1.0:1787397769.204355:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.204361:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787397769.204700:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397769.204713:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.204721:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397769.204774:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.204799:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.204827:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.204839:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114368 00000100:00100000:0.0:1787397769.204842:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114368 00000100:00100000:0.0:1787397769.204874:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787397769.204881:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.204997:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.205003:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787397769.205033:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.205059:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.205100:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.205113:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.205127:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114496 00000100:00100000:0.0:1787397769.205130:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114496 00000100:00100000:0.0:1787397769.205146:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787397769.205151:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.205223:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.205230:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787397769.205267:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.206005:0:95257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95257:1874218701114624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.206066:0:95257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.206108:0:95257:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.206178:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114624 00000100:00100000:2.0:1787397769.206191:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114624 00000100:00100000:2.0:1787397769.206234:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787397769.206242:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:95257:x1874218701114624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.206347:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:95257:x1874218701114624:12345-0@lo:502:llog_process_th.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.206353:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787397769.206640:0:95257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95257:1874218701114624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397769.206667:0:95257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397769.206690:0:95257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397769.206692:0:95257:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1787397769.206698:0:95257:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1787397769.206716:0:95257:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1787397769.207245:0:95257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95257:1874218701114752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.207288:0:95257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.207320:0:95257:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705746a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.207371:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114752 00000100:00100000:2.0:1787397769.207376:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114752 00000100:00100000:2.0:1787397769.207411:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787397769.207419:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:95257:x1874218701114752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.207517:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+17:95257:x1874218701114752:12345-0@lo:502:llog_process_th.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.207561:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787397769.207722:0:95257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95257:1874218701114752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397769.207746:0:95257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397769.207752:0:95257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397769.207754:0:95257:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1787397769.207758:0:95257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:2.0:1787397769.207990:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:2.0:1787397769.208018:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787397769.208029:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.208040:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397769.208050:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397769.208053:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 58 10000000:01000000:2.0:1787397769.208055:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397769.208078:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.208085:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.208101:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.208115:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.208144:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.208172:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.208219:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701114880 00000100:00100000:1.0:1787397769.208224:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701114880 00000100:00100000:1.0:1787397769.208258:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787397769.208267:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701114880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397769.208275:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397769.208288:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918cf expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.208311:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918cf expref: 18 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.208321:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918cf expref: 18 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.208330:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00000100:00100000:1.0:1787397769.208365:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701114880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.208372:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000020:01000004:3.0:1787397769.208476:0:95258:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a901000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787397769.208485:0:95258:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 4 00000100:00100000:2.0:1787397769.208814:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701114880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.208827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.208836:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.208884:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.208911:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.208940:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.209001:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115008 00000100:00100000:0.0:1787397769.209006:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115008 00000100:00100000:0.0:1787397769.209040:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787397769.209048:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701115008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.209159:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701115008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.209166:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787397769.209252:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.209276:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.209323:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.209339:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.209376:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115136 00000100:00100000:1.0:1787397769.209379:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115136 00000100:00100000:1.0:1787397769.209405:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787397769.209410:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701115136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.209493:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701115136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.209499:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787397769.209658:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.211715:0:95259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95259:1874218701115264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397769.211795:0:95259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.211829:0:95259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.211963:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115264 00000100:00100000:0.0:1787397769.211970:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115264 00000100:00100000:0.0:1787397769.212028:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787397769.212036:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:95259:x1874218701115264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.212164:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:95259:x1874218701115264:12345-0@lo:502:llog_process_th.0 Request processed in 128us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.212172:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787397769.212260:0:95259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95259:1874218701115264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397769.212319:0:95259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95259:1874218701115392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397769.212355:0:95259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.212383:0:95259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.212430:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115392 00000100:00100000:0.0:1787397769.212434:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115392 00000100:00100000:0.0:1787397769.212474:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787397769.212481:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:95259:x1874218701115392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.212567:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:95259:x1874218701115392:12345-0@lo:502:llog_process_th.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.212573:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787397769.212732:0:95259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95259:1874218701115392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787397769.212751:0:95259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1787397769.215808:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1787397769.215852:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397769.215864:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.215892:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397769.215904:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397769.215907:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1787397769.215910:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397769.215946:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.215954:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.215965:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.215988:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.216053:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.216106:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.216576:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115520 00000100:00100000:0.0:1787397769.216593:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115520 00000100:00100000:0.0:1787397769.216645:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787397769.216653:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701115520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397769.216668:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397769.216691:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918dd expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.216715:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918dd expref: 19 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.216726:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918dd expref: 19 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.216735:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00000100:00100000:0.0:1787397769.216773:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701115520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.216788:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787397769.217013:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.217027:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.217036:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.217100:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.217131:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.217169:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.218790:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115648 00000100:00100000:0.0:1787397769.218803:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115648 00000100:00100000:0.0:1787397769.218864:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787397769.218873:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701115648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.219052:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701115648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.219060:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787397769.219154:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.219203:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.219253:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.219291:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.221648:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115776 00000100:00100000:0.0:1787397769.221663:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115776 00000100:00100000:0.0:1787397769.221734:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787397769.221744:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701115776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.221901:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701115776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.221908:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787397769.222095:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701115776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.224389:0:95260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95260:1874218701115904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.224468:0:95260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.224513:0:95260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.225191:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701115904 00000100:00100000:0.0:1787397769.225201:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701115904 00000100:00100000:0.0:1787397769.225260:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787397769.225269:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:95260:x1874218701115904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.225423:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:95260:x1874218701115904:12345-0@lo:502:llog_process_th.0 Request processed in 154us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.225431:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787397769.225561:0:95260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95260:1874218701115904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397769.225612:0:95260:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397769.225624:0:95260:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397769.225627:0:95260:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1787397769.225632:0:95260:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1787397769.225648:0:95260:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1787397769.225683:0:95260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95260:1874218701116032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397769.225724:0:95260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.225747:0:95260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d740c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.226030:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116032 00000100:00100000:0.0:1787397769.226034:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116032 00000100:00100000:0.0:1787397769.226071:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787397769.226079:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:95260:x1874218701116032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.226153:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:95260:x1874218701116032:12345-0@lo:502:llog_process_th.0 Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.226161:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787397769.227208:0:95260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95260:1874218701116032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397769.227250:0:95260:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397769.227257:0:95260:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397769.227259:0:95260:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1787397769.227264:0:95260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:2.0:1787397769.230985:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:2.0:1787397769.231033:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787397769.231045:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.231059:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397769.231070:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397769.231073:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 58 10000000:01000000:2.0:1787397769.231076:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397769.231118:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.231126:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.231137:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.231163:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.231231:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.231280:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.231568:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116160 00000100:00100000:0.0:1787397769.231575:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116160 00000100:00100000:0.0:1787397769.231633:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787397769.231642:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701116160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397769.231655:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397769.231668:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918eb expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.231700:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918eb expref: 20 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.231711:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918eb expref: 20 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.231721:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:0.0:1787397769.231758:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.231766:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787397769.231955:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.231969:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.231993:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.232052:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.232079:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.232110:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.233051:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116288 00000100:00100000:0.0:1787397769.233061:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116288 00000100:00100000:0.0:1787397769.233109:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787397769.233119:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.233278:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.233297:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787397769.233480:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.233561:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.233802:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.233825:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.234260:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116416 00000100:00100000:0.0:1787397769.234266:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116416 00000100:00100000:3.0:1787397769.234467:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787397769.234478:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.234622:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.234629:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787397769.234854:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.236913:0:95261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95261:1874218701116544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.236999:0:95261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.237044:0:95261:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.237106:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116544 00000100:00100000:2.0:1787397769.237113:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116544 00000100:00100000:2.0:1787397769.237157:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787397769.237166:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:95261:x1874218701116544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.237290:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:95261:x1874218701116544:12345-0@lo:502:llog_process_th.0 Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.237297:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787397769.238379:0:95261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95261:1874218701116544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.238455:0:95261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95261:1874218701116672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.238503:0:95261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.238563:0:95261:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111000 going to sleep for 11 seconds 00000100:00100000:3.0:1787397769.238961:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116672 00000100:00100000:3.0:1787397769.238969:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116672 00000100:00100000:3.0:1787397769.239019:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787397769.239027:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:95261:x1874218701116672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397769.239140:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:95261:x1874218701116672:12345-0@lo:502:llog_process_th.0 Request processed in 113us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.239153:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787397769.239422:0:95261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95261:1874218701116672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397769.239458:0:95261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1787397769.239772:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1787397769.239798:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397769.239807:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.239819:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397769.239827:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787397769.239830:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787397769.239840:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397769.239867:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.239875:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.239884:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397769.239900:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.239934:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.239957:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.240046:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116800 00000100:00100000:0.0:1787397769.240052:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116800 00000100:00100000:0.0:1787397769.240088:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787397769.240096:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701116800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397769.240104:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397769.240117:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1918f9 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.240139:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 21 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.240149:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 21 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.240158:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00000100:00100000:0.0:1787397769.240198:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701116800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.240214:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787397769.241543:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.241566:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.241774:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.241856:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.241907:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.241938:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.242065:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701116928 00000100:00100000:0.0:1787397769.242072:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701116928 00000100:00100000:0.0:1787397769.242121:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787397769.242131:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701116928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.242273:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701116928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.242280:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787397769.242824:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701116928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.242861:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.242907:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.243022:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.248415:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117056 00000100:00100000:1.0:1787397769.248432:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117056 00000100:00100000:0.0:1787397769.250289:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787397769.250301:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701117056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.250506:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701117056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (7597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.250514:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787397769.250703:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397769.251988:0:95262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1787397769.252366:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1787397769.252389:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787397769.252401:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.252413:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397769.252424:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397769.252426:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 58 10000000:01000000:2.0:1787397769.252429:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397769.256604:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.256624:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.256636:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397769.256665:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.256749:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.256792:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8191110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.256968:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117184 00000100:00100000:1.0:1787397769.256978:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117184 00000100:00100000:1.0:1787397769.257052:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787397769.257062:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701117184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397769.257076:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397769.257092:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191907 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.257118:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191907 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.257129:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191907 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.257139:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74a00, rc 0) 00000100:00100000:1.0:1787397769.257185:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.257202:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787397769.257473:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.257489:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.257508:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.257607:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.257637:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.257659:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.257796:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117312 00000100:00100000:0.0:1787397769.257801:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117312 00000100:00100000:0.0:1787397769.257840:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787397769.257848:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.257972:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397769.257980:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787397769.258554:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.258735:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.258789:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.258821:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16180 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.258872:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117440 00000100:00100000:1.0:1787397769.258877:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117440 00000100:00100000:1.0:1787397769.258908:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787397769.258917:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.259297:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 381us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.259571:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.259700:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787397769.268704:0:95263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95263:1874218701117568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397769.268810:0:95263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.268849:0:95263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.268967:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117568 00000100:00100000:1.0:1787397769.268974:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117568 00000100:00100000:1.0:1787397769.269024:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787397769.269033:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:95263:x1874218701117568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397769.269176:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:95263:x1874218701117568:12345-0@lo:502:llog_process_th.0 Request processed in 143us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.269184:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787397769.269478:0:95263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80763a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95263:1874218701117568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.269573:0:95263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95263:1874218701117696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397769.269820:0:95263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397769.269852:0:95263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.269897:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117696 00000100:00100000:1.0:1787397769.269902:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117696 00000100:00100000:1.0:1787397769.269936:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787397769.269944:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:95263:x1874218701117696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397769.270027:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:95263:x1874218701117696:12345-0@lo:502:llog_process_th.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397769.270034:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787397769.270108:0:95263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95263:1874218701117696:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787397769.270129:0:95263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1787397769.270287:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1787397769.270307:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397769.270317:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.270335:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397769.270343:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787397769.270346:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1787397769.270349:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787397769.270374:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.270381:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.270389:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397769.270403:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.270432:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397769.270464:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397769.270511:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117824 00000100:00100000:2.0:1787397769.270516:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117824 00000100:00100000:2.0:1787397769.270571:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787397769.270578:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701117824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.270594:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397769.270606:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191915 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.270639:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191915 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.270651:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191915 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.270659:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62e00, rc 0) 00000100:00100000:2.0:1787397769.270704:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701117824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397769.270710:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787397769.270956:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397769.270968:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.270977:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397769.271028:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.271055:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397769.271096:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397769.271378:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701117952 00000100:00100000:0.0:1787397769.271383:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701117952 00000100:00100000:0.0:1787397769.271413:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787397769.271420:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701117952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.271575:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701117952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.271705:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701117952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.271735:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.271776:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397769.271797:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118080 00000100:00100000:3.0:1787397769.271800:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118080 00000100:00100000:3.0:1787397769.271820:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787397769.271826:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701118080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397769.271893:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701118080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.271899:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787397769.271935:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74480 going to sleep for 11 seconds 00000100:00100000:3.0:1787397769.271945:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397769.272251:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000040:00080000:3.0:1787397769.273010:0:95264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1787397769.273161:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787397769.273183:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787397769.273192:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.273201:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397769.273209:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787397769.273211:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787397769.273214:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787397769.273241:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.273249:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397769.273258:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397769.273274:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.273318:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397769.273352:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397769.273741:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118208 00000100:00100000:3.0:1787397769.273757:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118208 00000100:00100000:3.0:1787397769.273789:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787397769.273796:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701118208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397769.273808:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397769.273820:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191923 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.273839:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191923 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.273848:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191923 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397769.273856:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75c00, rc 0) 00000100:00100000:3.0:1787397769.273900:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701118208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397769.273907:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787397769.273973:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397769.273987:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397769.273996:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397769.274047:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397769.274072:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397769.274099:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397769.274185:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118336 00000100:00100000:1.0:1787397769.274189:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118336 00000100:00100000:1.0:1787397769.274217:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787397769.274224:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701118336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397769.274294:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701118336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397769.274311:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787397769.274377:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807639180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701118336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787397769.274404:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787397769.274410:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397769.274419:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397770.086645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397771.110773:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397771.245312:0:95363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff67ba2270 00000020:00000080:3.0:1787397771.245329:0:95363:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787397771.245335:0:95363:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 4 00000020:00000080:3.0:1787397771.245344:0:95363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff67ba22d0 20000000:00000080:3.0:1787397771.245351:0:95363:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff89a828866800 uarg=0000000000000000 00000040:00100000:3.0:1787397771.246036:0:95363:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:3.0:1787397771.246044:0:95363:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:3.0:1787397771.246057:0:95363:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1787397771.246878:0:95364:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 40 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1787397771.246932:0:95364:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 40 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1787397771.246949:0:95364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:3.0:1787397771.247176:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:3.0:1787397771.247190:0:95363:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397771.247204:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:3.0:1787397771.247219:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:3.0:1787397771.247231:0:95363:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1787397771.247749:0:95365:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:0.0:1787397771.247785:0:95365:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:0.0:1787397771.247801:0:95365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:3.0:1787397771.248000:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:3.0:1787397771.248010:0:95363:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397771.248026:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:3.0:1787397771.248043:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:3.0:1787397771.248055:0:95363:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1787397771.248349:0:95366:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 42 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1787397771.248377:0:95366:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 42 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1787397771.248392:0:95366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:3.0:1787397771.248745:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:3.0:1787397771.248755:0:95363:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1787397771.248770:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:3.0:1787397771.248787:0:95363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:3.0:1787397771.248798:0:95363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787397771.248820:0:95363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248842:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248849:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248856:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248862:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248869:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918cf expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248875:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918dd expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248892:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918eb expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248899:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248904:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191907 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248910:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191915 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248916:0:95363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191923 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248922:0:95363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248968:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.248987:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 23 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249003:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118464:0@lo:104: 00000100:00100000:3.0:1787397771.249074:0:95363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397771.249183:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249202:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 23 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249211:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118592:0@lo:104: 00010000:00010000:3.0:1787397771.249242:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249250:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 23 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249257:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118720:0@lo:104: 00010000:00010000:3.0:1787397771.249277:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249284:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 23 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249290:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118848:0@lo:104: 00010000:00010000:3.0:1787397771.249308:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249314:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 23 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249320:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118976:0@lo:104: 00010000:00010000:3.0:1787397771.249341:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249358:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 23 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249367:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119104:0@lo:104: 00010000:00010000:3.0:1787397771.249396:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249404:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 23 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249412:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119232:0@lo:104: 00010000:00010000:3.0:1787397771.249447:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249455:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 23 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249463:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119360:0@lo:104: 00010000:00010000:3.0:1787397771.249483:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249490:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 23 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249497:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119488:0@lo:104: 00010000:00010000:3.0:1787397771.249562:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249583:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 9 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249592:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119616:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397771.249667:0:95363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.249675:0:95363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 9 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.249683:0:95363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119744:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397771.249706:0:95363:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397771.250098:0:93049:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787397771.250123:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.250182:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.250281:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.250319:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118464 00000100:00100000:0.0:1787397771.250327:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118464 00000100:00100000:0.0:1787397771.250365:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118592 00000100:00100000:0.0:1787397771.250368:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118592 00000100:00100000:0.0:1787397771.250378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118720 00000100:00100000:0.0:1787397771.250380:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118720 00000100:00100000:0.0:1787397771.250391:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787397771.250399:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:95363:x1874218701118464:12345-0@lo:104: 00010000:00010000:0.0:1787397771.250413:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250476:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787397771.250483:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+5:95363:x1874218701118464:12345-0@lo:104: Request processed in 85us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.250499:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787397771.250562:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787397771.250570:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:95363:x1874218701118592:12345-0@lo:104: 00010000:00010000:0.0:1787397771.250585:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250618:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787397771.250623:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:95363:x1874218701118592:12345-0@lo:104: Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.250629:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1787397771.250653:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787397771.250660:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:95363:x1874218701118720:12345-0@lo:104: 00010000:00010000:0.0:1787397771.250667:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250696:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787397771.250701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:95363:x1874218701118720:12345-0@lo:104: Request processed in 43us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.250706:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:0.0:1787397771.250723:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397771.250728:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250735:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397771.250739:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250748:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397771.250755:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397771.250766:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397771.250795:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250802:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397771.250819:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250827:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d191923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19192a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250839:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397771.250842:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250848:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397771.250851:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250857:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397771.250863:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397771.250868:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397771.250879:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250885:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397771.250908:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250915:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d191915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19191c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250924:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397771.250927:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250933:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397771.250936:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250942:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397771.250949:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397771.250954:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787397771.250966:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250971:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397771.250977:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250983:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa600/0x274786fe0d191907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d19190e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.250991:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397771.250998:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397771.251000:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397771.251007:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397771.251019:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701119872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397771.251051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.251087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701120128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397771.251110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.251128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397771.251133:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701120000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397771.251152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.251175:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701119872 00000100:00100000:0.0:1787397771.251179:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701119872 00010000:00010000:0.0:1787397771.251200:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 24 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397771.251218:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1787397771.251224:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701119872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397771.251234:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397771.251239:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 24 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251249:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 24 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251265:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397771.251291:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701119872:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.251298:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1787397771.251317:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120128 00000100:00100000:0.0:1787397771.251320:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120128 00010000:00010000:0.0:1787397771.251331:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 24 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397771.251349:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120000 00000100:00100000:0.0:1787397771.251351:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120000 00010000:00010000:0.0:1787397771.251360:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 25 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397771.251377:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1787397771.251382:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+25:3649:x1874218701120128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397771.251389:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397771.251393:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 25 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251400:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 25 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251409:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397771.251434:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+25:3649:x1874218701120128:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.251440:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1787397771.251451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:0.0:1787397771.251457:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701120000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397771.251464:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397771.251467:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 24 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251475:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 24 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397771.251491:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397771.251514:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701120000:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.251542:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:0.0:1787397771.251587:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701119872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397771.251611:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701120000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397771.251618:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701120128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397771.251890:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75c00/0x274786fe0d19192a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191923 expref: 23 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.251904:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118464:0@lo:104: 00010000:00010000:3.0:1787397771.251915:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62e00/0x274786fe0d19191c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191915 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.251923:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118592:0@lo:104: 00010000:00010000:3.0:1787397771.251930:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74a00/0x274786fe0d19190e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191907 expref: 21 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.251937:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118720:0@lo:104: 00000100:00100000:1.0:1787397771.252019:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.252030:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.252040:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.252049:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.252059:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118848 00000100:00100000:1.0:1787397771.252062:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118848 00000100:00100000:1.0:1787397771.252094:0:93049:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787397771.252112:0:93049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.252118:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701118976 00000100:00100000:1.0:1787397771.252121:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701118976 00000100:00100000:1.0:1787397771.252134:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701119104 00000100:00100000:1.0:1787397771.252136:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701119104 00000100:00100000:1.0:1787397771.252146:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701119232 00000100:00100000:1.0:1787397771.252148:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701119232 00000100:00100000:1.0:1787397771.252157:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701119360 00000100:00100000:1.0:1787397771.252159:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701119360 00000100:00100000:1.0:1787397771.252166:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701119488 00000100:00100000:1.0:1787397771.252168:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701119488 00000100:00100000:1.0:1787397771.252180:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787397771.252184:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:95363:x1874218701118848:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252194:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252248:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397771.252254:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+8:95363:x1874218701118848:12345-0@lo:104: Request processed in 70us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252271:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1787397771.252287:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787397771.252292:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+7:95363:x1874218701118976:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252299:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252334:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787397771.252339:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+7:95363:x1874218701118976:12345-0@lo:104: Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252345:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787397771.252356:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787397771.252362:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+6:95363:x1874218701119104:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252370:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252400:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787397771.252405:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+6:95363:x1874218701119104:12345-0@lo:104: Request processed in 44us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252411:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787397771.252423:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787397771.252429:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+5:95363:x1874218701119232:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252436:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252481:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787397771.252486:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+5:95363:x1874218701119232:12345-0@lo:104: Request processed in 58us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252498:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787397771.252513:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787397771.252518:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a837beb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95363:x1874218701119360:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252548:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252577:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787397771.252581:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a837beb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:95363:x1874218701119360:12345-0@lo:104: Request processed in 63us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252587:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787397771.252617:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787397771.252622:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95363:x1874218701119488:12345-0@lo:104: 00010000:00010000:1.0:1787397771.252628:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252663:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787397771.252668:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:95363:x1874218701119488:12345-0@lo:104: Request processed in 46us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.252673:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:1.0:1787397771.252691:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787397771.252695:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252701:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.252705:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252732:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.252739:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.252745:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.252767:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252773:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.252792:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252798:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe75a00/0x274786fe0d1918f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191900 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252811:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787397771.252813:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252819:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.252822:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252829:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.252835:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.252846:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.252861:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252866:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.252872:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252878:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d1918eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918f2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252887:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787397771.252890:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252895:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.252898:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252905:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.252911:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.252920:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.252932:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252937:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.252955:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252961:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1918dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252970:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787397771.252973:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252978:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.252980:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.252987:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.252993:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.252998:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.253011:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253016:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.253021:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253027:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d1918cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253036:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397771.253043:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253049:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.253051:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253058:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.253063:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.253068:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.253093:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253099:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.253104:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253109:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d1918c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918c8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253118:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397771.253120:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253126:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397771.253128:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253145:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397771.253151:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397771.253156:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397771.253169:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253174:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397771.253179:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253186:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63e00/0x274786fe0d1918b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1918ba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253200:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397771.253202:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397771.253203:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397771.253216:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701120512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.253259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253300:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397771.253306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701120640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.253329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253354:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120512 00000100:00100000:1.0:1787397771.253359:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120512 00010000:00010000:1.0:1787397771.253377:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 21 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.253409:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120640 00000100:00100000:1.0:1787397771.253412:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120640 00010000:00010000:1.0:1787397771.253424:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397771.253438:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1787397771.253443:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1787397771.253447:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701120512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.253448:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834538050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701120640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397771.253457:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397771.253457:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397771.253462:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.253463:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253472:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253487:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397771.253489:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.253514:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834538050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701120640:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.253539:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00010000:00010000:1.0:1787397771.253560:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397771.253566:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397771.253577:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.253602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253625:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.253654:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253673:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787397771.253678:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397771.253695:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397771.253696:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253718:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397771.253719:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701120512:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397771.253725:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1787397771.253736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.253756:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120256 00000100:00100000:1.0:1787397771.253759:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120256 00000100:00100000:2.0:1787397771.253760:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120768 00000100:00100000:2.0:1787397771.253763:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120768 00010000:00010000:2.0:1787397771.253773:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.253774:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397771.253790:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120384 00000100:00100000:3.0:1787397771.254048:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118848:0@lo:104: 00000100:00100000:3.0:1787397771.254058:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701118976:0@lo:104: 00010000:00010000:3.0:1787397771.254074:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aaa00/0x274786fe0d1918e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918dd expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.254085:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119104:0@lo:104: 00010000:00010000:3.0:1787397771.254093:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75800/0x274786fe0d1918d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918cf expref: 21 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.254104:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119232:0@lo:104: 00000100:00100000:3.0:1787397771.254113:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836693800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119360:0@lo:104: 00000100:00100000:3.0:1787397771.254125:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119488:0@lo:104: 00000100:00100000:1.0:1787397771.254178:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701120896 00000100:00100000:1.0:1787397771.254183:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120896 00010000:00010000:1.0:1787397771.254197:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 21 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.254211:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:2.0:1787397771.254217:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701120384 00000100:00100000:1.0:1787397771.254218:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701120768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397771.254226:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397771.254229:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 22 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.254230:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.254238:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397771.254243:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:2.0:1787397771.254248:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701120256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397771.254249:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75c00/0x274786fe0d1918c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918c1 expref: 22 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.254254:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397771.254257:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 21 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.254258:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397771.254265:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 21 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.254274:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa400/0x274786fe0d191900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918f9 expref: 21 pid: 94335 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.254286:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701120768:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (631us total) trans 0 rc 0/0 00010000:00010000:2.0:1787397771.254291:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397771.254291:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:1.0:1787397771.254304:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:1.0:1787397771.254310:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+19:3650:x1874218701120896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397771.254311:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+19:3650:x1874218701120256:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397771.254317:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00010000:00010000:1.0:1787397771.254322:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397771.254327:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 18 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397771.254329:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:2.0:1787397771.254334:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+18:3650:x1874218701120384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397771.254335:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 18 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.254339:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397771.254343:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 18 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.254344:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74c00/0x274786fe0d1918ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918b3 expref: 18 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.254351:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 18 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.254430:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397771.254437:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050abc00/0x274786fe0d1918f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1918eb expref: 17 pid: 94340 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397771.254446:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397771.254453:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701120896:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.254459:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1787397771.254462:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701120384:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397771.254467:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00010000:00010000:1.0:1787397771.254485:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397771.254510:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701120640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.254517:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701120512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397771.254575:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397771.254698:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.254705:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.254711:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397771.254716:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701120768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397771.255029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397771.255058:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397771.255108:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218688 00000100:00100000:1.0:1787397771.255112:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218688 00010000:00010000:1.0:1787397771.255131:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 10 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.255171:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218816 00000100:00100000:1.0:1787397771.255175:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218816 00010000:00010000:1.0:1787397771.255187:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 11 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.255206:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2645 00000100:00100000:1.0:1787397771.255214:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2404:x1874218681218688:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397771.255224:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397771.255229:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 11 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255239:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 11 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255252:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397771.255291:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+11:2404:x1874218681218688:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 77us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.255297:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2645 00000100:00100000:1.0:1787397771.255311:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2646 00000100:00100000:1.0:1787397771.255316:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681218816:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397771.255322:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397771.255327:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 10 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255336:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 10 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255358:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255367:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255381:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255388:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255395:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255401:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255406:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397771.255410:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255417:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255425:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397771.255434:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397771.255455:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681218816:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 138us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.255470:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2646 00010000:00010000:3.0:1787397771.255911:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75400/0x274786fe0d1918ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8267 expref: 9 pid: 94333 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.255924:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119616:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397771.255936:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74800/0x274786fe0d1918a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8260 expref: 8 pid: 94334 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397771.255943:0:95363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95363:1874218701119744:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397771.255981:0:95363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.255990:0:95363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.255997:0:95363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397771.256003:0:95363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74600/0x274786fe0d191931 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397771.749116:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701121024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397771.749204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397771.750223:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121024 00000100:00100000:2.0:1787397771.750245:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121024 00000100:00100000:2.0:1787397771.750301:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1787397771.750310:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701121024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397771.750559:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397771.750783:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397771.750805:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701121152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397771.750851:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397771.750899:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121152 00000100:00100000:1.0:1787397771.750904:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121152 00000100:00100000:1.0:1787397771.750930:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1787397771.750937:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701121152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397771.750955:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445060608 avail 1298821120 00000100:00100000:1.0:1787397771.750988:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701121152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.750995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1787397771.751040:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701121152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397771.751448:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701121664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.751480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.751499:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701122176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.751517:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.751550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787397771.751556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701121536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.751576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.751593:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701122048:0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.751638:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.751657:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701122560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.751676:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397771.751704:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121664 00000100:00100000:0.0:1787397771.751709:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121664 00000100:00100000:0.0:1787397771.751747:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122176 00000100:00100000:0.0:1787397771.751752:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122176 00000100:00100000:0.0:1787397771.751768:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121536 00000100:00100000:0.0:1787397771.751780:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121536 00000100:00100000:2.0:1787397771.752043:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701121024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 876us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397771.752052:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00080000:2.0:1787397771.752090:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397771.752095:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397771.752104:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122560 00000100:00100000:2.0:1787397771.752107:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122560 00000100:00100000:2.0:1787397771.752126:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1787397771.752133:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701121664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397771.752182:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701121664:12345-0@lo:400:kworker.0 Request processed in 49us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.753459:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122048 00000100:00100000:3.0:1787397771.753471:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122048 00000100:00100000:3.0:1787397771.753551:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:3.0:1787397771.753562:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701122048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397771.756748:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1787397771.756775:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701122176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758146:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701122048:12345-0@lo:400:kworker.0 Request processed in 4575us (6495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.758163:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00080000:3.0:1787397771.758228:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397771.758304:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1787397771.758319:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701122560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758391:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701122560:12345-0@lo:400:kworker.0 Request processed in 78us (6712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.758397:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1787397771.758429:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701121408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758468:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758500:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701121920:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758546:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758567:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701122432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758589:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758611:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787397771.758619:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701121280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758658:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758684:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701121792:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758704:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758738:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701122304:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758761:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397771.758791:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121920 00000100:00100000:3.0:1787397771.758799:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121920 00000100:00100000:3.0:1787397771.758857:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122432 00000100:00100000:3.0:1787397771.758860:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122432 00000100:00100000:3.0:1787397771.758879:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122304 00000100:00100000:3.0:1787397771.758881:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122304 00000100:00100000:3.0:1787397771.758909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:3.0:1787397771.758916:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701121920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.758956:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701121920:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.758962:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:3.0:1787397771.758973:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:3.0:1787397771.758978:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701122432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759003:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701122432:12345-0@lo:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.759009:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:3.0:1787397771.759018:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:3.0:1787397771.759023:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701122304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759046:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701122304:12345-0@lo:400:kworker.0 Request processed in 23us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.759051:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:3.0:1787397771.759068:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121280 00000100:00100000:3.0:1787397771.759071:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121280 00000100:00100000:3.0:1787397771.759096:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787397771.759102:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:3651:x1874218701121280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759139:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:3651:x1874218701121280:12345-0@lo:400:kworker.0 Request processed in 37us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.759145:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787397771.759168:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397771.759171:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397771.759178:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121408 00000100:00100000:3.0:1787397771.759181:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121408 00000100:00100000:3.0:1787397771.759199:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701121792 00000100:00100000:3.0:1787397771.759201:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701121792 00000100:00100000:3.0:1787397771.759213:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1787397771.759217:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701121408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759242:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701121408:12345-0@lo:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.759247:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1787397771.759258:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1787397771.759263:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701121792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759288:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701121792:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397771.759294:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:3.0:1787397771.759306:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397771.759309:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397771.759339:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701121280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759352:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701121792:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759360:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701122304:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759369:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701121408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759390:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701121920:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759398:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701122432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759449:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701121024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397771.759563:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701122048:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759576:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701122560:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.759587:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701121664:0@lo:400:kworker.0 00000100:00100000:2.0:1787397771.760037:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1787397771.763190:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701122176:12345-0@lo:400:kworker.0 Request processed in 6420us (11662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397771.763207:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1787397771.763511:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1787397771.763539:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701121536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397771.763589:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701121536:12345-0@lo:400:kworker.0 Request processed in 71us (12012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397771.763595:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1787397771.765491:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701121536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397771.765509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701122176:0@lo:400:kworker.0 00000100:00100000:2.0:1787397772.038152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.038198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.038238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.038270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.038295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.038338:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219328 00000100:00100000:2.0:1787397772.038348:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219328 00000100:00100000:2.0:1787397772.038403:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219456 00000100:00100000:2.0:1787397772.038406:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219456 00000100:00100000:2.0:1787397772.038430:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2640 00000100:00100000:2.0:1787397772.038440:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681219328:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397772.038510:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681219328:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.038518:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2640 00000100:00100000:1.0:1787397772.038687:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2641 00000100:00100000:1.0:1787397772.038698:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681219456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397772.038730:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681219456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.038749:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2641 00000100:00100000:0.0:1787397772.038947:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681218944 00000100:00100000:0.0:1787397772.038952:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681218944 00000100:00100000:0.0:1787397772.038993:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:0.0:1787397772.039000:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:2405:x1874218681218944:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397772.039035:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:2405:x1874218681218944:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.039042:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 132 00000100:00100000:3.0:1787397772.039673:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219072 00000100:00100000:3.0:1787397772.039679:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219072 00000100:00100000:3.0:1787397772.039723:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219200 00000100:00100000:3.0:1787397772.039727:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219200 00000100:00100000:3.0:1787397772.039756:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1401 00000100:00100000:3.0:1787397772.039764:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681219072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397772.039814:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681219072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 51us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.039822:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1401 00000100:00100000:3.0:1787397772.039839:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1402 00000100:00100000:3.0:1787397772.039845:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681219200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397772.039870:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681219200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.039888:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1402 00000100:00080000:3.0:1787397772.039911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397772.039915:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397772.039918:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397772.039920:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787397772.137935:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397772.261892:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701122688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397772.261983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.262087:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701122816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397772.262117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.262141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397772.262147:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701122944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397772.262168:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397772.262351:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397772.262377:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122688 00000100:00100000:3.0:1787397772.262385:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122688 00000100:00100000:3.0:1787397772.262418:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122816 00000100:00100000:3.0:1787397772.262420:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122816 00000100:00100000:3.0:1787397772.262431:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701122944 00000100:00100000:3.0:1787397772.262433:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701122944 00000100:00100000:3.0:1787397772.262445:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:3.0:1787397772.262452:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701122688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397772.262479:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397772.262517:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701122688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.262556:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:3.0:1787397772.262583:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1787397772.262647:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701122816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397772.262664:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397772.262699:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701122816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.262715:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1787397772.262728:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1787397772.262734:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701122944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397772.262744:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787397772.262768:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701122944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.262773:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1787397772.262811:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701122944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397772.262827:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701122816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397772.264095:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701122688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397772.264335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.265835:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123072 00000100:00100000:1.0:1787397772.265848:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123072 00000100:00100000:1.0:1787397772.265910:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1787397772.265921:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701123072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397772.265949:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397772.266028:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701123072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.266036:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:0.0:1787397772.266065:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397772.484966:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397772.485108:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219584 00000100:00100000:3.0:1787397772.485123:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219584 00000100:00100000:3.0:1787397772.485373:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:3.0:1787397772.485386:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681219584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397772.485410:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397772.485450:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d826e expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.485488:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d826e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.485501:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d826e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.485512:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74600, rc 0) 00000100:00100000:3.0:1787397772.485719:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681219584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 334us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.485748:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:0.0:1787397772.490813:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397772.490920:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219712 00000100:00100000:2.0:1787397772.490935:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219712 00000100:00100000:2.0:1787397772.491088:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00100000:2.0:1787397772.491102:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681219712:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.491756:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681219712:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 652us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.491768:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00100000:0.0:1787397772.499872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397772.503779:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219840 00000100:00100000:1.0:1787397772.506695:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219840 00000100:00100000:1.0:1787397772.506842:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00100000:1.0:1787397772.506864:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681219840:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.507408:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681219840:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 544us (7549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.507419:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00100000:3.0:1787397772.512423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397772.513457:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681219968 00000100:00100000:1.0:1787397772.513475:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681219968 00000100:00100000:1.0:1787397772.513605:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 136 00000100:00100000:1.0:1787397772.513628:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73293:x1874218681219968:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397772.513867:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73293:x1874218681219968:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 241us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.513888:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 136 00000100:00100000:0.0:1787397772.529111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397772.529666:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220096 00000100:00100000:1.0:1787397772.529681:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220096 00000100:00100000:1.0:1787397772.529763:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:1.0:1787397772.529776:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73293:x1874218681220096:12345-192.168.204.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787397772.530009:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:73293:x1874218681220096:12345-192.168.204.60@tcp:502:llog_process_th.0 Request processed in 236us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.530019:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:0.0:1787397772.539875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397772.540897:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220224 00000100:00100000:1.0:1787397772.540915:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220224 00000100:00100000:1.0:1787397772.541000:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:1.0:1787397772.541013:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681220224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.541039:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397772.541065:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8275 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.541105:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8275 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.541119:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8275 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.541132:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75a00, rc 0) 00000100:00100000:1.0:1787397772.541414:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681220224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 402us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.541423:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:0.0:1787397772.551660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397772.559311:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220352 00000100:00100000:1.0:1787397772.559336:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220352 00000100:00100000:1.0:1787397772.559748:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:1.0:1787397772.559765:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681220352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.559984:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681220352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 223us (8338us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397772.559994:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 139 10000000:01000000:2.0:1787397772.836677:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397772.836686:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70a901000 from 61 10000000:01000000:2.0:1787397772.836692:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397772.836749:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.836763:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.836775:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.836808:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.836892:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.836948:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.837208:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123200 00000100:00100000:0.0:1787397772.837228:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123200 00000100:00100000:0.0:1787397772.837293:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787397772.837303:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701123200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397772.837319:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397772.837350:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191946 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.837373:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191946 expref: 16 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.837383:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191946 expref: 16 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.837391:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa800, rc 0) 00000100:00100000:0.0:1787397772.837444:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.837451:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787397772.837827:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.837844:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.837854:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.837935:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.837966:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.838000:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.838022:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123328 00000100:00100000:3.0:1787397772.838027:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123328 00000100:00100000:3.0:1787397772.838112:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787397772.838121:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.838259:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.838266:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787397772.838309:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.838338:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.838380:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.848920:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.853025:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123456 00000100:00100000:1.0:1787397772.853046:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123456 00000100:00100000:1.0:1787397772.853142:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787397772.853152:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.853333:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (14953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.853341:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787397772.853422:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.854250:0:95368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95368:1874218701123584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.854309:0:95368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.854343:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123584 00000100:00100000:1.0:1787397772.854349:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123584 00000100:00100000:1.0:1787397772.854373:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787397772.854381:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:95368:x1874218701123584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.854473:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:95368:x1874218701123584:12345-0@lo:502:llog_process_th.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.854480:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787397772.854948:0:95368:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.854972:0:95368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95368:1874218701123584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.855019:0:95368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95368:1874218701123712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.855058:0:95368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.855069:0:95368:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397772.855314:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123712 00000100:00100000:2.0:1787397772.855319:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123712 00000100:00100000:2.0:1787397772.855361:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787397772.855369:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:95368:x1874218701123712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.855461:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:95368:x1874218701123712:12345-0@lo:502:llog_process_th.0 Request processed in 92us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.855468:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787397772.855940:0:95368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95368:1874218701123712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787397772.855963:0:95368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1787397772.856789:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1787397772.856820:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397772.856831:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.856843:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397772.856854:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787397772.856857:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1787397772.856860:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787397772.856906:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.856914:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.856923:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.856943:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.856989:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.857029:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.857791:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123840 00000100:00100000:1.0:1787397772.857808:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123840 00000100:00100000:1.0:1787397772.857859:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787397772.857868:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701123840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.857883:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397772.857900:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191954 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.857923:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191954 expref: 17 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.857935:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191954 expref: 17 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.857944:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75400, rc 0) 00000100:00100000:1.0:1787397772.858000:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701123840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.858006:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787397772.858371:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.858386:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.858395:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.858457:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.858487:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.858557:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.859081:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701123968 00000100:00100000:1.0:1787397772.859088:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701123968 00000100:00100000:1.0:1787397772.859140:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787397772.859150:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701123968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.859289:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701123968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.859297:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787397772.860047:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701123968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.860097:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.860163:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.860194:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.860307:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124096 00000100:00100000:1.0:1787397772.860312:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124096 00000100:00100000:1.0:1787397772.860422:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787397772.860433:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701124096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.860585:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701124096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.860594:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787397772.860695:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.860915:0:95369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95369:1874218701124224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.860953:0:95369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.868940:0:95369:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.869343:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124224 00000100:00100000:3.0:1787397772.869354:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124224 00000100:00100000:3.0:1787397772.869415:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787397772.869426:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:95369:x1874218701124224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.870255:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:95369:x1874218701124224:12345-0@lo:502:llog_process_th.0 Request processed in 827us (9297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.870266:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787397772.871272:0:95369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95369:1874218701124224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787397772.871321:0:95369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397772.871335:0:95369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397772.871337:0:95369:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1787397772.871343:0:95369:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1787397772.874639:0:95369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95369:1874218701124352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.874968:0:95369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.875012:0:95369:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.877334:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124352 00000100:00100000:3.0:1787397772.877367:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124352 00000100:00100000:3.0:1787397772.877425:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787397772.877433:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:95369:x1874218701124352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.877633:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:95369:x1874218701124352:12345-0@lo:502:llog_process_th.0 Request processed in 199us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.877641:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787397772.877947:0:95369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95369:1874218701124352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787397772.877982:0:95369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397772.877990:0:95369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397772.877992:0:95369:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1787397772.877997:0:95369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1787397772.878052:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:2.0:1787397772.878068:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787397772.878078:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.878090:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397772.878099:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397772.878102:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 61 10000000:01000000:2.0:1787397772.878105:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397772.878148:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.878157:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.878166:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.878184:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.878217:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.878246:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.882935:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124480 00000100:00100000:1.0:1787397772.882953:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124480 00000100:00100000:1.0:1787397772.883047:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787397772.883057:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701124480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.883075:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397772.883099:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191962 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.883188:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191962 expref: 18 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.883201:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191962 expref: 18 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.883210:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00000100:00100000:1.0:1787397772.883349:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701124480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.883357:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787397772.888028:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.888055:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.888068:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.888235:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.888296:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.888345:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.888405:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124608 00000100:00100000:3.0:1787397772.888411:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124608 00000100:00100000:3.0:1787397772.888458:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787397772.888466:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701124608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.888838:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701124608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.888846:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787397772.889038:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.889074:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.889200:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.889232:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.889291:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124736 00000100:00100000:0.0:1787397772.889296:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124736 00000100:00100000:0.0:1787397772.889332:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787397772.889340:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701124736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397772.889445:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701124736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.889452:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787397772.889559:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701124736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397772.890316:0:95370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95370:1874218701124864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397772.890363:0:95370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397772.890393:0:95370:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b20e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.890432:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124864 00000100:00100000:3.0:1787397772.890438:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124864 00000100:00100000:3.0:1787397772.890549:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787397772.890558:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:95370:x1874218701124864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.890677:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:95370:x1874218701124864:12345-0@lo:502:llog_process_th.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.890706:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787397772.890904:0:95370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95370:1874218701124864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397772.890942:0:95370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95370:1874218701124992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397772.890973:0:95370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.896211:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701124992 00000100:00100000:1.0:1787397772.896279:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701124992 00000100:00100000:1.0:1787397772.900357:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787397772.900386:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:95370:x1874218701124992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.900581:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:95370:x1874218701124992:12345-0@lo:502:llog_process_th.0 Request processed in 208us (9604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.900618:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787397772.900813:0:95370:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.900847:0:95370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95370:1874218701124992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787397772.900880:0:95370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1787397772.901053:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1787397772.901081:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397772.901094:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.901104:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397772.901135:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787397772.901138:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:3.0:1787397772.901141:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787397772.901173:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.901183:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.901191:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397772.901210:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.901247:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.901260:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397772.901811:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125120 00000100:00100000:2.0:1787397772.901820:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125120 00000100:00100000:2.0:1787397772.901893:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787397772.901902:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701125120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.901913:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397772.901926:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d191970 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.901947:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d191970 expref: 19 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.901956:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191970 expref: 19 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.901964:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63e00, rc 0) 00000100:00100000:2.0:1787397772.902000:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.902006:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787397772.906310:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.906340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.906357:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397772.906455:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.906516:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.910342:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397772.919238:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125248 00000100:00100000:2.0:1787397772.919255:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125248 00000100:00100000:2.0:1787397772.919323:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787397772.919339:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.919544:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (13027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.922867:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397772.922943:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397772.923024:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397772.923055:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.923082:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125376 00000100:00100000:0.0:1787397772.923088:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125376 00000100:00100000:2.0:1787397772.930008:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787397772.930201:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787397772.930219:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.930403:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.930411:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787397772.931027:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.934659:0:95371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95371:1874218701125504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.934763:0:95371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.934811:0:95371:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e43ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.935245:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125504 00000100:00100000:1.0:1787397772.935254:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125504 00000100:00100000:1.0:1787397772.935313:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787397772.935322:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:95371:x1874218701125504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.935468:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:95371:x1874218701125504:12345-0@lo:502:llog_process_th.0 Request processed in 146us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.935475:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787397772.935678:0:95371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95371:1874218701125504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397772.935723:0:95371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397772.935736:0:95371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397772.935739:0:95371:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1787397772.935743:0:95371:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1787397772.935860:0:95371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95371:1874218701125632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.935900:0:95371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.935936:0:95371:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397772.937544:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125632 00000100:00100000:2.0:1787397772.937558:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125632 00000100:00100000:2.0:1787397772.937634:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787397772.937646:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:95371:x1874218701125632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.937821:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:95371:x1874218701125632:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.937830:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787397772.938023:0:95371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95371:1874218701125632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787397772.938058:0:95371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397772.938066:0:95371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397772.938068:0:95371:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:3.0:1787397772.938081:0:95371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1787397772.939352:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1787397772.939394:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787397772.939412:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.939424:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397772.939435:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787397772.939438:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a702023000 from 61 10000000:01000000:2.0:1787397772.939440:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397772.939477:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.939486:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.939497:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.939553:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.939632:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.939676:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d743c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.940301:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125760 00000100:00100000:1.0:1787397772.940310:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125760 00000100:00100000:1.0:1787397772.940371:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787397772.940380:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701125760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.940393:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397772.940407:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19197e expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.940432:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19197e expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.940443:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19197e expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.940452:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74c00, rc 0) 00000100:00100000:1.0:1787397772.940510:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701125760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.940516:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787397772.940641:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397772.940657:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.940665:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397772.940727:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.940759:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.940789:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1787397772.941612:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701125888 00000100:00100000:2.0:1787397772.941621:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701125888 00000100:00100000:2.0:1787397772.941672:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787397772.941681:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701125888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.941833:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701125888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397772.941842:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787397772.942832:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701125888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.942887:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.942949:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.942992:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.943062:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126016 00000100:00100000:1.0:1787397772.943068:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126016 00000100:00100000:1.0:1787397772.943108:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787397772.943116:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701126016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.943227:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701126016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.943234:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787397772.943391:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836692a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.944266:0:95372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95372:1874218701126144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.944322:0:95372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.944360:0:95372:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.944619:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126144 00000100:00100000:1.0:1787397772.944625:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126144 00000100:00100000:1.0:1787397772.944668:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787397772.944676:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:95372:x1874218701126144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.944809:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:95372:x1874218701126144:12345-0@lo:502:llog_process_th.0 Request processed in 132us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.944824:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787397772.945242:0:95372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95372:1874218701126144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.945296:0:95372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95372:1874218701126272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397772.945332:0:95372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.945367:0:95372:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7057469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.945423:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126272 00000100:00100000:1.0:1787397772.945428:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126272 00000100:00100000:1.0:1787397772.945468:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787397772.945476:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:95372:x1874218701126272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.945588:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:95372:x1874218701126272:12345-0@lo:502:llog_process_th.0 Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.945596:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787397772.946440:0:95372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95372:1874218701126272:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787397772.946472:0:95372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1787397772.948591:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1787397772.948641:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787397772.948654:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.948668:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397772.948679:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787397772.948681:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1787397772.948684:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787397772.948725:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.948734:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.948745:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397772.948772:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.948855:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.948901:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.949677:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126400 00000100:00100000:0.0:1787397772.949690:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126400 00000100:00100000:0.0:1787397772.949747:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787397772.949756:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701126400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397772.949770:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397772.949788:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19198c expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.949815:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19198c expref: 21 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.949826:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19198c expref: 21 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.949848:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab400, rc 0) 00000100:00100000:0.0:1787397772.949919:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.949926:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787397772.950026:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.950043:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.950052:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.950117:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.950147:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.950178:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80627d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.950235:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126528 00000100:00100000:3.0:1787397772.950241:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126528 00000100:00100000:3.0:1787397772.950276:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787397772.950283:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.950425:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.950432:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787397772.950491:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.950570:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.950622:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.950638:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80627d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.950787:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126656 00000100:00100000:0.0:1787397772.950793:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126656 00000100:00100000:0.0:1787397772.950818:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787397772.950826:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397772.950920:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.950927:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787397772.950966:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397772.951722:0:95373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1787397772.951856:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787397772.951879:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787397772.951888:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.951898:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397772.951908:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787397772.951911:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a836577000 from 61 10000000:01000000:1.0:1787397772.951914:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787397772.951941:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.951949:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.951958:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397772.951974:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.952829:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.952889:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.952925:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126784 00000100:00100000:3.0:1787397772.952931:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126784 00000100:00100000:3.0:1787397772.952997:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787397772.953005:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701126784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397772.953016:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397772.953029:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1919a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19199a expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.953050:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1919a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19199a expref: 22 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.953060:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1919a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19199a expref: 22 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.953069:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75c00, rc 0) 00000100:00100000:3.0:1787397772.953113:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701126784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397772.953119:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787397772.953200:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397772.953212:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.953237:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.953299:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.953328:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.953562:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.953676:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701126912 00000100:00100000:1.0:1787397772.953684:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701126912 00000100:00100000:1.0:1787397772.953715:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787397772.953730:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701126912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.953844:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701126912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.953851:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787397772.953926:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701126912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.953956:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.953993:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.954050:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397772.954109:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127040 00000100:00100000:3.0:1787397772.954113:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127040 00000100:00100000:1.0:1787397772.954219:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787397772.954226:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701127040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.954300:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701127040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.954307:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787397772.954377:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.954805:0:95374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95374:1874218701127168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.954835:0:95374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.954894:0:95374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.954923:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127168 00000100:00100000:1.0:1787397772.954927:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127168 00000100:00100000:1.0:1787397772.954946:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787397772.954952:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:95374:x1874218701127168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.955058:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:95374:x1874218701127168:12345-0@lo:502:llog_process_th.0 Request processed in 105us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.955065:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787397772.955136:0:95374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95374:1874218701127168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.955240:0:95374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95374:1874218701127296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397772.955270:0:95374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.955317:0:95374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.955347:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127296 00000100:00100000:1.0:1787397772.955351:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127296 00000100:00100000:1.0:1787397772.955402:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787397772.955408:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:95374:x1874218701127296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397772.955557:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:95374:x1874218701127296:12345-0@lo:502:llog_process_th.0 Request processed in 149us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.955564:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787397772.955640:0:95374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:95374:1874218701127296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787397772.955657:0:95374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1787397772.955792:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1787397772.955817:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397772.955826:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.955847:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397772.955856:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787397772.955859:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1787397772.955861:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787397772.955883:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.955890:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397772.955899:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397772.955912:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397772.955939:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397772.955994:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397772.956050:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127424 00000100:00100000:0.0:1787397772.956055:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127424 00000100:00100000:0.0:1787397772.956819:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787397772.956829:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701127424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397772.956842:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397772.956858:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d1919af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1919a8 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.956885:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d1919af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1919a8 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.956897:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab200/0x274786fe0d1919af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1919a8 expref: 23 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397772.956906:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:0.0:1787397772.956984:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397772.956994:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787397772.957015:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397772.957042:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397772.957051:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397772.957113:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836690380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397772.957240:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397772.957279:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7057469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.957307:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127552 00000100:00100000:1.0:1787397772.957313:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127552 00000100:00100000:1.0:1787397772.957346:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787397772.957362:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.957475:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.957482:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787397772.957509:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836690380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.957574:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.957626:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.957658:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.957675:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127680 00000100:00100000:1.0:1787397772.957679:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127680 00000100:00100000:1.0:1787397772.957699:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787397772.957704:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.957779:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.957786:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787397772.957820:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397772.958407:0:95375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1787397772.958465:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787397772.958487:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787397772.958495:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958505:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397772.958514:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787397772.958545:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787397772.958548:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787397772.958573:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958581:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958590:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397772.958619:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.958652:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.958670:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.958685:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127808 00000100:00100000:1.0:1787397772.958689:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127808 00000100:00100000:1.0:1787397772.958711:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787397772.958734:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701127808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.958743:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397772.958755:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1919b6 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958771:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1919b6 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958780:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1919b6 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958788:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:1.0:1787397772.958819:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701127808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397772.958831:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787397772.958864:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397772.958875:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.958883:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397772.958921:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.958943:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397772.958954:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a803ed6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397772.958964:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701127936 00000100:00100000:1.0:1787397772.958966:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701127936 00000100:00100000:1.0:1787397772.958981:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787397772.958985:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701127936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397772.959037:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701127936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (93us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397772.959044:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787397772.959070:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701127936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787397772.959089:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787397772.959095:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397772.959102:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397773.159328:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397774.181747:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397775.205254:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397775.964732:0:95472:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 07:22:53 (1787397773) 00000100:00100000:0.0:1787397776.031669:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.031754:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220608 00000100:00100000:2.0:1787397776.031764:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220608 00000100:00100000:2.0:1787397776.031859:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1426 00000100:00100000:2.0:1787397776.031870:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:73471:x1874218681220608:12345-192.168.204.60@tcp:36:mkdir.0 00010000:00010000:2.0:1787397776.031924:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1787397776.031948:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787397776.031955:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d1917d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d821a expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.031975:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397776.031991:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.032054:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032068:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032077:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032091:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032098:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032104:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032668:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032680:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032688:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.032703:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eab56634 reply state 00000000008f52a6 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032715:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032732:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.032735:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.032739:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787397776.032745:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1787397776.032753:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032760:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032767:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032773:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.032777:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032785:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032793:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397776.032795:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.032799:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032805:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1919c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.032815:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eab56634 reply state 00000000008f52a6 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032834:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.032840:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a817ea6c00) 00010000:00010000:2.0:1787397776.032842:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.032845:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787397776.032938:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73471:x1874218681220608:12345-192.168.204.60@tcp:36:mkdir.0 Request processed in 1069us (1279us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1787397776.032946:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1426 00000100:00100000:0.0:1787397776.047127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.047264:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220736 00000100:00100000:3.0:1787397776.047275:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220736 00000100:00100000:3.0:1787397776.047335:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1427 00000100:00100000:3.0:1787397776.047345:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73473:x1874218681220736:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397776.047368:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.047389:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1919d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d827c expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047451:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047466:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047477:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397776.047557:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397776.047561:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397776.047596:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047621:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1919d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d827c expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047636:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d827c expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.047644:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397776.047647:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397776.047650:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74a00, rc 0) 00000100:00100000:3.0:1787397776.047718:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:73473:x1874218681220736:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 374us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.047725:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1427 00000100:00100000:3.0:1787397776.053191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.053407:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681220992 00000100:00100000:1.0:1787397776.053418:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681220992 00000100:00100000:1.0:1787397776.053486:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1428 00000100:00100000:1.0:1787397776.053497:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:73473:x1874218681220992:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397776.053547:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.053551:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787397776.053583:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1919e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d827c expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053602:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397776.053607:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397776.053620:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1919e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8283 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053746:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053758:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053768:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053778:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053793:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053800:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053866:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053874:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053880:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397776.053888:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1787397776.053898:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053905:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053912:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053917:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.053921:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053928:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053946:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.053949:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.053954:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053960:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1919fc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053976:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053983:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053988:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053994:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.053999:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.054001:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054007:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054013:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397776.054015:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.054017:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054033:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1919ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054044:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054050:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054056:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054061:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.054064:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054070:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054089:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a817ea6c00) 00010000:00010000:1.0:1787397776.054091:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.054094:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054100:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1919f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054123:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1919e7 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8283 expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054142:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397776.054144:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.054148:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1919e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8283 expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.054156:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:1.0:1787397776.054509:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73473:x1874218681220992:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1012us (1328us total) trans 0 rc 301/301 00000100:00100000:1.0:1787397776.054518:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1428 00000100:00100000:1.0:1787397776.073600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.076378:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681221120 00000100:00100000:2.0:1787397776.076392:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681221120 00000100:00100000:2.0:1787397776.076931:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1429 00000100:00100000:2.0:1787397776.076945:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73473:x1874218681221120:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397776.076967:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.076990:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d828a expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077060:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077087:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077100:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397776.077150:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397776.077153:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397776.077186:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077211:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d828a expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077227:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d828a expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.077236:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397776.077239:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397776.077244:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63400, rc 0) 00000100:00100000:2.0:1787397776.077312:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:73473:x1874218681221120:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 371us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.077319:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1429 00000100:00100000:3.0:1787397776.085898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.092242:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681221376 00000100:00100000:0.0:1787397776.092257:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681221376 00000100:00100000:0.0:1787397776.092342:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1430 00000100:00100000:0.0:1787397776.092352:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:73473:x1874218681221376:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397776.092373:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.092396:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191a11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8291 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092471:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092485:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092497:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092509:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092515:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092547:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397776.092667:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1787397776.092755:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092764:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092771:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092777:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092783:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397776.092788:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092795:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.092808:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397776.092810:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397776.092814:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093922:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093942:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093964:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093971:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093976:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397776.093980:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093987:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.093999:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a817ea6c00) 00010000:00010000:0.0:1787397776.094002:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397776.094005:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.094011:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.094061:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191a11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8291 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.097177:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397776.097192:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397776.097208:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191a11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8291 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.097262:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:0.0:1787397776.097364:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:73473:x1874218681221376:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 5012us (11478us total) trans 120259084292 rc 301/301 00000100:00100000:0.0:1787397776.097374:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1430 00000100:00100000:0.0:1787397776.107062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.107130:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681221632 00000100:00100000:3.0:1787397776.107141:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681221632 00000100:00100000:3.0:1787397776.107365:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1431 00000100:00100000:3.0:1787397776.107377:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:73473:x1874218681221632:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:3.0:1787397776.107583:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.107600:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.107613:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.107792:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000211b6ebd reply state 00000000091b692e transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.107807:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.107815:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.107818:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1787397776.107822:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787397776.107829:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:3.0:1787397776.107912:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:73473:x1874218681221632:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 537us (860us total) trans 120259084293 rc 0/0 00000100:00100000:3.0:1787397776.107919:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1431 00000100:00100000:0.0:1787397776.110213:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.110318:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681221888 00000100:00100000:3.0:1787397776.110328:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681221888 00000100:00100000:3.0:1787397776.110384:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 241 00000100:00100000:3.0:1787397776.110394:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:73473:x1874218681221888:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787397776.110893:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:73473:x1874218681221888:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 498us (686us total) trans 120259084294 rc 0/0 00000100:00100000:3.0:1787397776.110902:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 241 00000100:00100000:2.0:1787397776.122969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.123109:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681222016 00000100:00100000:0.0:1787397776.123119:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681222016 00000100:00100000:0.0:1787397776.123197:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1432 00000100:00100000:0.0:1787397776.123207:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:73477:x1874218681222016:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.123230:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.123249:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8298 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123310:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123324:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123335:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123346:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123353:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123370:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123468:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123477:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123484:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397776.123810:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1787397776.123815:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397776.123854:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123867:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123874:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123880:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123887:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123892:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397776.123896:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123911:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123923:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397776.123926:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397776.123931:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123936:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123949:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123954:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123960:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123965:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397776.123967:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123973:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.123980:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a817ea6c00) 00010000:00010000:0.0:1787397776.123982:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397776.123985:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.124000:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191a42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.124028:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191a34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8298 expref: 18 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.124042:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8298 expref: 17 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.124049:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397776.124051:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787397776.124054:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00000100:00100000:0.0:1787397776.124125:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:73477:x1874218681222016:12345-192.168.204.60@tcp:101:touch.0 Request processed in 919us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.124132:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1432 00000100:00100000:3.0:1787397776.129589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.129724:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681222272 00000100:00100000:1.0:1787397776.129736:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681222272 00000100:00100000:1.0:1787397776.129807:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1433 00000100:00100000:1.0:1787397776.129827:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:73477:x1874218681222272:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.129854:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.129882:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191a50 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d829f expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130008:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130024:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130036:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130063:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130252:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.130263:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397776.130674:0:74374:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x704:0x0], count =94 00000004:00080000:1.0:1787397776.130682:0:74374:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x704:0x0]+94 in llog 00000004:00080000:1.0:1787397776.130703:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x762:0x0], index 0: 0 00010000:00010000:1.0:1787397776.131294:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191a65 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131307:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191a65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131316:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191a65 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131351:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131364:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131369:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131375:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.131386:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131393:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131406:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.131409:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.131414:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131420:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191a57 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.131432:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e776690 reply state 000000003f4db900 transno 120259084295 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131442:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131448:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a818432b00) 00010000:00010000:1.0:1787397776.131450:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.131453:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.131487:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191a50 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d829f expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131500:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191a65 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d829f expref: 19 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.131508:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397776.131510:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.132773:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ba00, rc 0) 00000100:00100000:1.0:1787397776.132955:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:73477:x1874218681222272:12345-192.168.204.60@tcp:101:touch.0 Request processed in 3134us (3370us total) trans 120259084295 rc 0/0 00000100:00100000:1.0:1787397776.132965:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1433 00000100:00100000:0.0:1787397776.144207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.144376:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681222528 00000100:00100000:3.0:1787397776.144387:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681222528 00000100:00100000:3.0:1787397776.144610:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1434 00000100:00100000:3.0:1787397776.144624:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:73477:x1874218681222528:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.144696:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.144737:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191a65 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d829f expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.144757:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a818432300) 00010000:00010000:3.0:1787397776.144770:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.144834:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.144848:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.144860:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.144971:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000669c834b reply state 00000000390f3cd1 transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.144984:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.144989:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:3.0:1787397776.144992:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.144994:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.145095:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:73477:x1874218681222528:12345-192.168.204.60@tcp:36:touch.0 Request processed in 475us (906us total) trans 120259084296 rc 0/0 00000100:00100000:3.0:1787397776.147693:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1434 00000100:00100000:0.0:1787397776.155823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.155894:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681222656 00000100:00100000:3.0:1787397776.155904:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681222656 00000100:00100000:3.0:1787397776.155967:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1435 00000100:00100000:3.0:1787397776.155978:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:73477:x1874218681222656:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.156017:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.156041:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d191a7a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82a6 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.156100:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d191a7a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82a6 expref: 22 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.156116:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d191a7a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82a6 expref: 22 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.156136:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:3.0:1787397776.156140:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.156143:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75600, rc 0) 00000100:00100000:3.0:1787397776.156206:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:73477:x1874218681222656:12345-192.168.204.60@tcp:101:touch.0 Request processed in 228us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.156214:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1435 00000100:00100000:3.0:1787397776.161964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.162270:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681222784 00000100:00100000:0.0:1787397776.162280:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681222784 00000100:00100000:0.0:1787397776.162430:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4998 00000100:00100000:0.0:1787397776.162442:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681222784:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:0.0:1787397776.162702:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681222784:12345-192.168.204.60@tcp:2:touch.0 Request processed in 261us (745us total) trans 4294968733 rc 0/0 00000100:00100000:0.0:1787397776.162711:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4998 00000100:00080000:1.0:1787397776.163144:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397776.171468:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.171516:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681223040 00000100:00100000:0.0:1787397776.171558:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681223040 00000100:00100000:0.0:1787397776.171606:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 242 00000100:00100000:0.0:1787397776.171617:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:73477:x1874218681223040:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.171896:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:73477:x1874218681223040:12345-192.168.204.60@tcp:35:touch.0 Request processed in 280us (437us total) trans 120259084297 rc 0/0 00000100:00100000:0.0:1787397776.171905:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 242 00000100:00100000:0.0:1787397776.175706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.175745:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681223296 00000100:00100000:0.0:1787397776.175754:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681223296 00000100:00100000:0.0:1787397776.175816:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1436 00000100:00100000:0.0:1787397776.175826:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:73477:x1874218681223296:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.175850:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.175870:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191a81 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82ad expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176000:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176017:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176028:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176042:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176048:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176064:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787397776.176371:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x763:0x0], index 0: 0 00010000:00010000:0.0:1787397776.176512:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191a96 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176555:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191a96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176564:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191a96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176604:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176612:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176619:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176624:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176631:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397776.176635:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176642:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176667:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397776.176670:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397776.176676:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176683:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191a88 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397776.176700:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ecc5a9e reply state 000000009b0a7b87 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176717:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176723:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a82250cc00) 00010000:00010000:0.0:1787397776.176725:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397776.176728:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787397776.176762:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191a81 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ad expref: 26 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176776:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191a96 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ad expref: 25 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.176784:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82250c600) 00010000:00010000:0.0:1787397776.176787:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397776.176794:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa000, rc 0) 00000100:00100000:0.0:1787397776.176860:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+26:73477:x1874218681223296:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1034us (1162us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1787397776.176870:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1436 00000100:00100000:0.0:1787397776.182906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.183426:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681223552 00000100:00100000:3.0:1787397776.183568:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681223552 00000100:00100000:3.0:1787397776.183680:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1437 00000100:00100000:3.0:1787397776.183692:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+26:73477:x1874218681223552:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.183761:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.183790:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191a96 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ad expref: 26 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.183811:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82250c600) 00010000:00010000:3.0:1787397776.183825:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.183888:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.183902:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.183912:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.184031:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007875c23c reply state 000000000082b606 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.184044:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.184050:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397776.184052:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.184054:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.184161:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:73477:x1874218681223552:12345-192.168.204.60@tcp:36:touch.0 Request processed in 471us (1264us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1787397776.184168:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1437 00000100:00100000:1.0:1787397776.191374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.195570:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681223680 00000100:00100000:3.0:1787397776.196676:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681223680 00000100:00100000:3.0:1787397776.196770:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1438 00000100:00100000:3.0:1787397776.196780:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:73477:x1874218681223680:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.196805:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.196829:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d191aab lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82b4 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.196889:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d191aab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82b4 expref: 28 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.196924:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d191aab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82b4 expref: 28 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.196944:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397776.196948:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.196951:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74400, rc 0) 00000100:00100000:3.0:1787397776.197017:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+28:73477:x1874218681223680:12345-192.168.204.60@tcp:101:touch.0 Request processed in 238us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.197024:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1438 00000100:00100000:2.0:1787397776.199651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.199693:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681223808 00000100:00100000:3.0:1787397776.199704:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681223808 00000100:00100000:3.0:1787397776.199766:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4999 00000100:00100000:3.0:1787397776.199776:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681223808:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.200001:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681223808:12345-192.168.204.60@tcp:2:touch.0 Request processed in 226us (360us total) trans 4294968734 rc 0/0 00000100:00100000:3.0:1787397776.200010:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4999 00000100:00100000:3.0:1787397776.207901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.207974:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681224064 00000100:00100000:0.0:1787397776.207984:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681224064 00000100:00100000:0.0:1787397776.208043:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 243 00000100:00100000:0.0:1787397776.208054:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+28:73477:x1874218681224064:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.208353:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:73477:x1874218681224064:12345-192.168.204.60@tcp:35:touch.0 Request processed in 299us (457us total) trans 120259084300 rc 0/0 00000100:00100000:0.0:1787397776.208361:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 243 00000100:00100000:2.0:1787397776.217215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.217591:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681224320 00000100:00100000:3.0:1787397776.217603:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681224320 00000100:00100000:3.0:1787397776.217756:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1439 00000100:00100000:3.0:1787397776.217765:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:73477:x1874218681224320:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.217790:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.217810:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191ab2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82bb expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.217949:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.217963:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.217975:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.217990:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.217997:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.218004:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.218356:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x764:0x0], index 0: 0 00010000:00010000:3.0:1787397776.218849:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191ac7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.218861:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191ac7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.218870:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191ac7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219045:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219069:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219075:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219082:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397776.219086:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219094:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219108:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.219111:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397776.219115:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219121:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191ab9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.219136:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075b9190b reply state 0000000026bd8da2 transno 120259084301 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219148:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219154:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a82e43e500) 00010000:00010000:3.0:1787397776.219156:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.219159:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397776.219203:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191ab2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82bb expref: 32 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219226:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191ac7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82bb expref: 31 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.219233:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:3.0:1787397776.219235:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397776.219237:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:3.0:1787397776.219323:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:73477:x1874218681224320:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1558us (2120us total) trans 120259084301 rc 0/0 00000100:00100000:3.0:1787397776.219332:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1439 00000100:00100000:0.0:1787397776.223845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.224235:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681224576 00000100:00100000:1.0:1787397776.224246:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681224576 00000100:00100000:1.0:1787397776.224321:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1440 00000100:00100000:1.0:1787397776.224331:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:73477:x1874218681224576:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:1.0:1787397776.224392:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397776.224420:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191ac7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82bb expref: 32 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.224440:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:1.0:1787397776.224451:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397776.224510:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.225836:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.225856:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.226787:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a488dba reply state 00000000bcd344c5 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.226808:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.226816:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:2.0:1787397776.226819:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.226822:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.227333:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73477:x1874218681224576:12345-192.168.204.60@tcp:36:touch.0 Request processed in 2868us (3364us total) trans 120259084302 rc 0/0 00000100:00100000:2.0:1787397776.227346:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1440 00010000:00010000:0.0:1787397776.229757:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397776.230893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.230965:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681224704 00000100:00100000:3.0:1787397776.230973:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681224704 00000100:00100000:3.0:1787397776.231033:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1441 00000100:00100000:3.0:1787397776.231044:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73477:x1874218681224704:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.231070:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.231092:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75a00/0x274786fe0d191adc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82c2 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.231150:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75a00/0x274786fe0d191adc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c2 expref: 34 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.231166:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75a00/0x274786fe0d191adc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c2 expref: 34 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.231183:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397776.231199:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.231216:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75a00, rc 0) 00000100:00100000:3.0:1787397776.231272:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73477:x1874218681224704:12345-192.168.204.60@tcp:101:touch.0 Request processed in 230us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.231280:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1441 00000100:00100000:1.0:1787397776.235004:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.235124:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681224832 00000100:00100000:2.0:1787397776.235136:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681224832 00000100:00100000:2.0:1787397776.235355:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5000 00000100:00100000:2.0:1787397776.235367:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681224832:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.235643:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2404:x1874218681224832:12345-192.168.204.60@tcp:2:touch.0 Request processed in 277us (649us total) trans 4294968735 rc 0/0 00000100:00100000:2.0:1787397776.235650:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5000 00000100:00100000:0.0:1787397776.239912:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.240462:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681225088 00000100:00100000:2.0:1787397776.240474:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681225088 00000100:00100000:2.0:1787397776.240580:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 244 00000100:00100000:2.0:1787397776.240592:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73477:x1874218681225088:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.240895:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:73477:x1874218681225088:12345-192.168.204.60@tcp:35:touch.0 Request processed in 305us (1003us total) trans 120259084303 rc 0/0 00000100:00100000:2.0:1787397776.240904:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 244 00000100:00100000:0.0:1787397776.254219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.254384:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681225344 00000100:00100000:2.0:1787397776.254395:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681225344 00000100:00100000:2.0:1787397776.254456:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1442 00000100:00100000:2.0:1787397776.254467:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:73477:x1874218681225344:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.254492:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.254514:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191ae3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82c9 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.254670:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.254685:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.254714:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256170:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256189:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256201:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.256570:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x765:0x0], index 0: 0 00010000:00010000:2.0:1787397776.256721:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191af8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256731:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191af8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256739:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191af8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256772:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256779:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256786:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256792:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256811:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.256816:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256824:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256838:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.256842:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.256846:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256852:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191aea lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.256865:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eefd1c0e reply state 00000000813ac890 transno 120259084304 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256876:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256883:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a817ea6b00) 00010000:00010000:2.0:1787397776.256885:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.256888:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.256925:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191ae3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c9 expref: 38 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256941:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191af8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c9 expref: 37 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.256960:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397776.256962:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.256965:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:2.0:1787397776.257031:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:73477:x1874218681225344:12345-192.168.204.60@tcp:101:touch.0 Request processed in 2566us (2819us total) trans 120259084304 rc 0/0 00000100:00100000:2.0:1787397776.257040:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1442 00000100:00100000:1.0:1787397776.261486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.261673:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681225600 00000100:00100000:3.0:1787397776.261682:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681225600 00000100:00100000:3.0:1787397776.261745:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1443 00000100:00100000:3.0:1787397776.261755:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:73477:x1874218681225600:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.261816:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.261846:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191af8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c9 expref: 38 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.261864:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397776.261875:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.261924:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.261938:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.261948:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.262052:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a764c52 reply state 000000003cf566fc transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.262065:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.262072:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397776.262088:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.262091:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.262185:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:73477:x1874218681225600:12345-192.168.204.60@tcp:36:touch.0 Request processed in 431us (717us total) trans 120259084305 rc 0/0 00000100:00100000:3.0:1787397776.262193:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1443 00000100:00100000:0.0:1787397776.267635:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.268768:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681225728 00000100:00100000:3.0:1787397776.268780:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681225728 00000100:00100000:3.0:1787397776.268886:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1444 00000100:00100000:3.0:1787397776.268897:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:73477:x1874218681225728:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.268922:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.268942:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191b0d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82d0 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.268998:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191b0d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d0 expref: 40 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.269013:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191b0d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d0 expref: 40 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.269030:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397776.269033:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.269037:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00000100:00100000:3.0:1787397776.269100:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+40:73477:x1874218681225728:12345-192.168.204.60@tcp:101:touch.0 Request processed in 205us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.269109:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1444 00000100:00100000:0.0:1787397776.276892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.279981:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681225856 00000100:00100000:2.0:1787397776.279995:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681225856 00000100:00100000:2.0:1787397776.280224:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5001 00000100:00100000:2.0:1787397776.280236:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681225856:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.280580:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681225856:12345-192.168.204.60@tcp:2:touch.0 Request processed in 346us (3698us total) trans 4294968736 rc 0/0 00000100:00100000:2.0:1787397776.280589:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5001 00000100:00100000:1.0:1787397776.288590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.288724:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681226112 00000100:00100000:3.0:1787397776.288735:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681226112 00000100:00100000:3.0:1787397776.288798:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 245 00000100:00100000:3.0:1787397776.288824:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+40:73477:x1874218681226112:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:3.0:1787397776.289141:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:73477:x1874218681226112:12345-192.168.204.60@tcp:35:touch.0 Request processed in 318us (559us total) trans 120259084306 rc 0/0 00000100:00100000:3.0:1787397776.289162:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 245 00000100:00100000:1.0:1787397776.297014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.297124:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681226368 00000100:00100000:3.0:1787397776.297135:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681226368 00000100:00100000:3.0:1787397776.297383:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1445 00000100:00100000:3.0:1787397776.297394:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:73477:x1874218681226368:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.297419:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.297450:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d191b14 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82d7 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297614:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297630:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297642:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297658:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297665:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.297672:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.297988:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x766:0x0], index 0: 0 00010000:00010000:3.0:1787397776.298129:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b29 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298138:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b29 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298156:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b29 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298200:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298208:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298215:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298222:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397776.298226:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298233:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298246:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.298249:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397776.298253:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298269:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191b1b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.298284:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b16be964 reply state 000000006cd30baf transno 120259084307 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298295:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298302:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a82e43eb00) 00010000:00010000:3.0:1787397776.298304:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.298307:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397776.298342:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d191b14 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d7 expref: 44 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298357:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b29 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d7 expref: 43 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.298363:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397776.298366:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397776.298368:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23400, rc 0) 00000100:00100000:3.0:1787397776.298439:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:73477:x1874218681226368:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1046us (1434us total) trans 120259084307 rc 0/0 00000100:00100000:3.0:1787397776.298447:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1445 00000100:00100000:0.0:1787397776.302283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.302413:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681226624 00000100:00100000:3.0:1787397776.302424:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681226624 00000100:00100000:3.0:1787397776.302673:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1446 00000100:00100000:3.0:1787397776.302684:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:73477:x1874218681226624:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.302760:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.302787:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b29 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d7 expref: 44 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.302808:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397776.302819:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.302871:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.302885:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.302894:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.302993:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c6a7636 reply state 00000000b3305e2c transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.303004:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.303011:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:3.0:1787397776.303013:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.303016:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.303108:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+45:73477:x1874218681226624:12345-192.168.204.60@tcp:36:touch.0 Request processed in 425us (833us total) trans 120259084308 rc 0/0 00000100:00100000:3.0:1787397776.303117:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1446 00000100:00100000:1.0:1787397776.314891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.316915:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681226752 00000100:00100000:2.0:1787397776.316931:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681226752 00000100:00100000:3.0:1787397776.317983:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1447 00000100:00100000:3.0:1787397776.318003:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+45:73477:x1874218681226752:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.318048:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.318073:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d191b3e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82de expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.318151:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d191b3e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82de expref: 46 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.318167:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d191b3e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82de expref: 46 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.318186:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:3.0:1787397776.318189:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.318192:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23800, rc 0) 00000100:00100000:3.0:1787397776.318274:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+46:73477:x1874218681226752:12345-192.168.204.60@tcp:101:touch.0 Request processed in 279us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.318283:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1447 00000100:00100000:1.0:1787397776.322892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.322964:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681226880 00000100:00100000:3.0:1787397776.322973:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681226880 00000100:00100000:3.0:1787397776.323031:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5002 00000100:00100000:3.0:1787397776.323041:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681226880:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.323307:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2404:x1874218681226880:12345-192.168.204.60@tcp:2:touch.0 Request processed in 266us (424us total) trans 4294968737 rc 0/0 00000100:00100000:3.0:1787397776.323314:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5002 00000100:00100000:1.0:1787397776.331413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.332986:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681227136 00000100:00100000:0.0:1787397776.333002:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681227136 00000100:00100000:0.0:1787397776.333077:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 246 00000100:00100000:0.0:1787397776.333087:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+46:73477:x1874218681227136:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.333394:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+47:73477:x1874218681227136:12345-192.168.204.60@tcp:35:touch.0 Request processed in 307us (2002us total) trans 120259084309 rc 0/0 00000100:00100000:0.0:1787397776.333409:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 246 00000100:00100000:0.0:1787397776.339768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.339890:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681227392 00000100:00100000:1.0:1787397776.339901:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681227392 00000100:00100000:1.0:1787397776.339964:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1448 00000100:00100000:1.0:1787397776.339974:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+47:73477:x1874218681227392:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.339999:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.340020:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191b45 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82e5 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340126:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340143:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340166:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340181:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340189:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340196:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397776.340803:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x767:0x0], index 0: 0 00010000:00010000:1.0:1787397776.340964:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191b5a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340990:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191b5a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.340998:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191b5a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341041:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341047:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341054:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341061:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341066:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.341070:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341077:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341088:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.341092:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.341097:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341103:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191b4c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.341125:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d06fd617 reply state 00000000660b24a8 transno 120259084310 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.341136:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.342125:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a818432400) 00010000:00010000:1.0:1787397776.342132:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.342136:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.342467:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191b45 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82e5 expref: 50 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.342491:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191b5a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82e5 expref: 49 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.342498:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a818432000) 00010000:00010000:1.0:1787397776.342501:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.342503:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ba00, rc 0) 00000100:00100000:0.0:1787397776.343315:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+50:73477:x1874218681227392:12345-192.168.204.60@tcp:101:touch.0 Request processed in 3337us (3554us total) trans 120259084310 rc 0/0 00000100:00100000:0.0:1787397776.343344:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1448 00000100:00100000:2.0:1787397776.354118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.354172:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681227648 00000100:00100000:3.0:1787397776.354183:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681227648 00000100:00100000:2.0:1787397776.354391:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1449 00000100:00100000:2.0:1787397776.354402:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+50:73477:x1874218681227648:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.354469:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.354498:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191b5a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82e5 expref: 50 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.354638:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a818432000) 00010000:00010000:2.0:1787397776.354651:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.354721:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.354736:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.354747:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.354866:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000359b1496 reply state 000000007c3ced42 transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.354878:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.354884:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:2.0:1787397776.354887:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.354889:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.355309:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:73477:x1874218681227648:12345-192.168.204.60@tcp:36:touch.0 Request processed in 907us (1199us total) trans 120259084311 rc 0/0 00000100:00100000:2.0:1787397776.355318:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1449 00000100:00100000:0.0:1787397776.358032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.358118:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681227776 00000100:00100000:3.0:1787397776.358130:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681227776 00000100:00100000:0.0:1787397776.359048:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1450 00000100:00100000:0.0:1787397776.359059:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:73477:x1874218681227776:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.359083:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.359102:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191b6f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82ec expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.359356:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191b6f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ec expref: 52 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.359373:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191b6f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ec expref: 52 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.359393:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:0.0:1787397776.359397:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787397776.359473:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:0.0:1787397776.361626:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+52:73477:x1874218681227776:12345-192.168.204.60@tcp:101:touch.0 Request processed in 2557us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.361638:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1450 00000100:00100000:2.0:1787397776.368831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.368906:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681227904 00000100:00100000:3.0:1787397776.368916:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681227904 00000100:00100000:3.0:1787397776.368975:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5003 00000100:00100000:3.0:1787397776.368986:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2404:x1874218681227904:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.369191:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681227904:12345-192.168.204.60@tcp:2:touch.0 Request processed in 206us (368us total) trans 4294968738 rc 0/0 00000100:00100000:3.0:1787397776.369200:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5003 00000100:00100000:1.0:1787397776.389923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.390030:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681228160 00000100:00100000:3.0:1787397776.390042:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681228160 00000100:00100000:3.0:1787397776.390106:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 247 00000100:00100000:3.0:1787397776.390116:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+52:73477:x1874218681228160:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:3.0:1787397776.390423:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+53:73477:x1874218681228160:12345-192.168.204.60@tcp:35:touch.0 Request processed in 306us (508us total) trans 120259084312 rc 0/0 00000100:00100000:3.0:1787397776.390430:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 247 00000100:00100000:0.0:1787397776.395660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.395816:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681228416 00000100:00100000:3.0:1787397776.395828:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681228416 00000100:00100000:2.0:1787397776.395971:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1451 00000100:00100000:2.0:1787397776.395983:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+53:73477:x1874218681228416:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.396009:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.396033:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191b76 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82f3 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396156:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396190:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396202:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396219:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396226:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396232:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.396612:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x768:0x0], index 0: 0 00010000:00010000:2.0:1787397776.396755:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191b8b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396766:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191b8b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396773:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191b8b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396812:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396819:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396826:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396839:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.396844:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396851:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396866:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.396870:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.396875:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396881:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191b7d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.396895:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002756256 reply state 0000000029814332 transno 120259084313 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396905:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396910:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a817ea6e00) 00010000:00010000:2.0:1787397776.396912:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.396915:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.396944:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191b76 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82f3 expref: 56 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396957:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191b8b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82f3 expref: 55 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.396974:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:2.0:1787397776.396977:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.396979:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031200, rc 0) 00000100:00100000:2.0:1787397776.397064:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+56:73477:x1874218681228416:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1082us (1414us total) trans 120259084313 rc 0/0 00000100:00100000:2.0:1787397776.397073:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1451 00000100:00100000:2.0:1787397776.408030:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.408121:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681228672 00000100:00100000:3.0:1787397776.408131:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681228672 00000100:00100000:3.0:1787397776.408202:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1452 00000100:00100000:3.0:1787397776.408213:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+56:73477:x1874218681228672:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.408274:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.408301:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191b8b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82f3 expref: 56 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.408320:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:3.0:1787397776.408330:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.408400:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.408414:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.408425:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.408594:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a55b04e reply state 00000000bf5eec34 transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.408607:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.408613:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397776.408616:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.408618:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.408710:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:73477:x1874218681228672:12345-192.168.204.60@tcp:36:touch.0 Request processed in 497us (689us total) trans 120259084314 rc 0/0 00000100:00100000:3.0:1787397776.408718:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1452 00000100:00100000:1.0:1787397776.411349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.411957:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681228800 00000100:00100000:2.0:1787397776.411969:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681228800 00000100:00100000:2.0:1787397776.412042:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1453 00000100:00100000:2.0:1787397776.412053:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:73477:x1874218681228800:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.412079:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.412098:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d191ba0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d82fa expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.412162:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d191ba0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82fa expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.412181:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d191ba0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82fa expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.412200:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:2.0:1787397776.412203:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.412207:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030e00, rc 0) 00000100:00100000:2.0:1787397776.412267:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+58:73477:x1874218681228800:12345-192.168.204.60@tcp:101:touch.0 Request processed in 215us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.412287:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1453 00000100:00100000:0.0:1787397776.416494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.416642:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681228928 00000100:00100000:3.0:1787397776.416653:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681228928 00000100:00100000:3.0:1787397776.416712:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5004 00000100:00100000:3.0:1787397776.416722:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681228928:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.416936:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2404:x1874218681228928:12345-192.168.204.60@tcp:2:touch.0 Request processed in 215us (451us total) trans 4294968739 rc 0/0 00000100:00100000:3.0:1787397776.416944:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5004 00000100:00100000:0.0:1787397776.422691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.422785:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681229184 00000100:00100000:2.0:1787397776.422796:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681229184 00000100:00100000:2.0:1787397776.422856:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 248 00000100:00100000:2.0:1787397776.422867:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+58:73477:x1874218681229184:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.423205:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:73477:x1874218681229184:12345-192.168.204.60@tcp:35:touch.0 Request processed in 337us (521us total) trans 120259084315 rc 0/0 00000100:00100000:2.0:1787397776.423213:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 248 00000100:00100000:1.0:1787397776.427157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.427351:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681229440 00000100:00100000:2.0:1787397776.427361:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681229440 00000100:00100000:2.0:1787397776.427428:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1454 00000100:00100000:2.0:1787397776.427438:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:73477:x1874218681229440:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.427461:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.427480:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191ba7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8301 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.427930:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.427947:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.427960:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.427974:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.427999:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.428006:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.428882:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x769:0x0], index 0: 0 00010000:00010000:2.0:1787397776.429021:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bbc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429031:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bbc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429040:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bbc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429075:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429083:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429090:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429096:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.429099:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429105:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429130:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.429133:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.429137:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429156:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bae lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.429172:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057ff85e9 reply state 00000000c83a3750 transno 120259084316 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.429182:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.431781:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a817ea6a00) 00010000:00010000:2.0:1787397776.431787:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.431792:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.431860:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191ba7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8301 expref: 62 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.431889:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bbc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8301 expref: 61 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.431897:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397776.431899:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.431902:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:2.0:1787397776.431999:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+62:73477:x1874218681229440:12345-192.168.204.60@tcp:101:touch.0 Request processed in 4561us (4858us total) trans 120259084316 rc 0/0 00000100:00100000:2.0:1787397776.432009:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1454 00000100:00100000:0.0:1787397776.436630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.436757:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681229696 00000100:00100000:3.0:1787397776.436769:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681229696 00000100:00100000:3.0:1787397776.436847:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1455 00000100:00100000:3.0:1787397776.436856:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+62:73477:x1874218681229696:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.436921:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.436950:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bbc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8301 expref: 62 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.436968:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:3.0:1787397776.436979:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.437035:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.437048:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.437057:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.437170:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a92e4e2d reply state 00000000eb9ca823 transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.437182:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.437341:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:3.0:1787397776.437344:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.437347:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.437432:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:73477:x1874218681229696:12345-192.168.204.60@tcp:36:touch.0 Request processed in 577us (812us total) trans 120259084317 rc 0/0 00000100:00100000:3.0:1787397776.437439:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1455 00000100:00100000:1.0:1787397776.440767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.440888:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681229824 00000100:00100000:0.0:1787397776.440898:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681229824 00000100:00100000:0.0:1787397776.440971:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1456 00000100:00100000:0.0:1787397776.440981:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:73477:x1874218681229824:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.441004:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.441025:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d191bd1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8308 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.441084:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d191bd1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8308 expref: 64 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.441101:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d191bd1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8308 expref: 64 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.441120:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:0.0:1787397776.441123:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787397776.441127:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abe00, rc 0) 00000100:00100000:0.0:1787397776.441420:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+64:73477:x1874218681229824:12345-192.168.204.60@tcp:101:touch.0 Request processed in 439us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.441428:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1456 00000100:00100000:1.0:1787397776.444943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.445030:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681229952 00000100:00100000:3.0:1787397776.445053:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681229952 00000100:00100000:3.0:1787397776.445107:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5005 00000100:00100000:3.0:1787397776.445118:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2405:x1874218681229952:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.445344:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2405:x1874218681229952:12345-192.168.204.60@tcp:2:touch.0 Request processed in 228us (409us total) trans 4294968740 rc 0/0 00000100:00100000:3.0:1787397776.445353:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5005 00000100:00100000:2.0:1787397776.448357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.448447:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681230208 00000100:00100000:0.0:1787397776.448457:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681230208 00000100:00100000:0.0:1787397776.448562:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 249 00000100:00100000:0.0:1787397776.448573:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+64:73477:x1874218681230208:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.448864:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:73477:x1874218681230208:12345-192.168.204.60@tcp:35:touch.0 Request processed in 291us (517us total) trans 120259084318 rc 0/0 00000100:00100000:0.0:1787397776.448872:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 249 00000100:00100000:0.0:1787397776.452407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.452499:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681230464 00000100:00100000:2.0:1787397776.452553:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681230464 00000100:00100000:2.0:1787397776.452612:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1457 00000100:00100000:2.0:1787397776.452622:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:73477:x1874218681230464:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.452644:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.452666:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bd8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d830f expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452773:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452788:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452800:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452814:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452820:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.452827:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.453121:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76a:0x0], index 0: 0 00010000:00010000:2.0:1787397776.453254:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bed lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453280:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bed lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453287:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bed lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453324:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453331:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453337:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453343:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453349:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.453353:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453359:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453371:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.453374:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.453378:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453384:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191bdf lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.453403:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b67b3d0 reply state 0000000088bd6c48 transno 120259084319 ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453414:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453420:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a817ea6700) 00010000:00010000:2.0:1787397776.453423:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.453425:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.453453:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bd8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d830f expref: 68 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453466:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bed lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d830f expref: 67 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.453473:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6300) 00010000:00010000:2.0:1787397776.453475:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.453478:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030a00, rc 0) 00000100:00100000:2.0:1787397776.453598:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+68:73477:x1874218681230464:12345-192.168.204.60@tcp:101:touch.0 Request processed in 978us (1202us total) trans 120259084319 rc 0/0 00000100:00100000:2.0:1787397776.453606:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1457 00000100:00100000:1.0:1787397776.459067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.459172:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681230720 00000100:00100000:2.0:1787397776.459183:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681230720 00000100:00100000:2.0:1787397776.459594:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1458 00000100:00100000:2.0:1787397776.459605:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+68:73477:x1874218681230720:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.459708:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.459742:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191bed lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d830f expref: 68 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.459770:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6300) 00010000:00010000:2.0:1787397776.459782:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.459845:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.459860:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.459870:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.459975:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006765c5fa reply state 00000000e76c4f41 transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.459989:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.459996:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397776.459999:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.460001:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.460082:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+69:73477:x1874218681230720:12345-192.168.204.60@tcp:36:touch.0 Request processed in 479us (1029us total) trans 120259084320 rc 0/0 00000100:00100000:2.0:1787397776.460090:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1458 00000100:00100000:3.0:1787397776.468416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.468633:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681230848 00000100:00100000:2.0:1787397776.468643:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681230848 00000100:00100000:2.0:1787397776.468699:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1459 00000100:00100000:2.0:1787397776.468710:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+69:73477:x1874218681230848:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.468736:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.468778:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191c02 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8316 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.468837:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191c02 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8316 expref: 70 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.468852:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191c02 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8316 expref: 70 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.468870:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397776.468873:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.468877:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:2.0:1787397776.468941:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+70:73477:x1874218681230848:12345-192.168.204.60@tcp:101:touch.0 Request processed in 233us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.468949:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1459 00000100:00100000:0.0:1787397776.473466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.473735:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681230976 00000100:00100000:1.0:1787397776.473744:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681230976 00000100:00100000:1.0:1787397776.473800:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5006 00000100:00100000:1.0:1787397776.473810:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681230976:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:1.0:1787397776.474023:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2404:x1874218681230976:12345-192.168.204.60@tcp:2:touch.0 Request processed in 215us (566us total) trans 4294968741 rc 0/0 00000100:00100000:1.0:1787397776.474032:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5006 00000100:00100000:1.0:1787397776.480639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.480735:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681231232 00000100:00100000:3.0:1787397776.480746:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681231232 00000100:00100000:3.0:1787397776.480798:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 250 00000100:00100000:3.0:1787397776.480808:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+70:73477:x1874218681231232:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:3.0:1787397776.481128:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+71:73477:x1874218681231232:12345-192.168.204.60@tcp:35:touch.0 Request processed in 320us (500us total) trans 120259084321 rc 0/0 00000100:00100000:3.0:1787397776.481137:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 250 00000100:00100000:3.0:1787397776.485594:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.485724:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681231488 00000100:00100000:2.0:1787397776.485735:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681231488 00000100:00100000:2.0:1787397776.485796:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1460 00000100:00100000:2.0:1787397776.485807:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+71:73477:x1874218681231488:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.485831:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.485854:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191c09 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d831d expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.485959:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.485976:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.486006:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.486023:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.486031:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.486038:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.486913:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76b:0x0], index 0: 0 00010000:00010000:2.0:1787397776.487073:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c1e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487085:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c1e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487094:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c1e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487129:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487377:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487384:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487391:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487417:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.487421:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487428:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487657:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.487661:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.487666:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487674:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c10 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.487690:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fa534fb reply state 0000000072ee1515 transno 120259084322 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487701:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487707:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a817ea6300) 00010000:00010000:2.0:1787397776.487710:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.487712:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.487752:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191c09 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d831d expref: 74 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487767:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c1e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d831d expref: 73 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.487786:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:2.0:1787397776.487788:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.487790:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583000, rc 0) 00000100:00100000:2.0:1787397776.487922:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+74:73477:x1874218681231488:12345-192.168.204.60@tcp:101:touch.0 Request processed in 2116us (2337us total) trans 120259084322 rc 0/0 00000100:00100000:2.0:1787397776.487932:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1460 00000100:00100000:1.0:1787397776.494671:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.494845:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681231744 00000100:00100000:2.0:1787397776.494856:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681231744 00000100:00100000:2.0:1787397776.494917:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1461 00000100:00100000:2.0:1787397776.494928:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+74:73477:x1874218681231744:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.494984:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.495012:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c1e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d831d expref: 74 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.495031:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6200) 00010000:00010000:2.0:1787397776.495041:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.495094:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.497383:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.497475:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.497665:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f52a315d reply state 0000000090be106d transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.497701:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.497709:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397776.497712:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.497717:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.497841:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+75:73477:x1874218681231744:12345-192.168.204.60@tcp:36:touch.0 Request processed in 2911us (3178us total) trans 120259084323 rc 0/0 00000100:00100000:2.0:1787397776.497850:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1461 00000100:00100000:1.0:1787397776.505923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.506021:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681231872 00000100:00100000:2.0:1787397776.506033:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681231872 00000100:00100000:2.0:1787397776.506102:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1462 00000100:00100000:2.0:1787397776.506113:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+75:73477:x1874218681231872:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.506150:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.506173:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c33 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8324 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.506245:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8324 expref: 76 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.506261:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8324 expref: 76 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.506280:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397776.506284:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.506288:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583000, rc 0) 00000100:00100000:2.0:1787397776.506348:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+76:73477:x1874218681231872:12345-192.168.204.60@tcp:101:touch.0 Request processed in 236us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.506370:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1462 00000100:00100000:1.0:1787397776.510508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.510641:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681232000 00000100:00100000:2.0:1787397776.510652:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681232000 00000100:00100000:2.0:1787397776.510714:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5007 00000100:00100000:2.0:1787397776.510724:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2405:x1874218681232000:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.510951:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2405:x1874218681232000:12345-192.168.204.60@tcp:2:touch.0 Request processed in 229us (454us total) trans 4294968742 rc 0/0 00000100:00100000:2.0:1787397776.510960:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5007 00000100:00100000:1.0:1787397776.513961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.514126:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681232256 00000100:00100000:2.0:1787397776.514153:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681232256 00000100:00100000:2.0:1787397776.514216:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 251 00000100:00100000:2.0:1787397776.514227:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+76:73477:x1874218681232256:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.514905:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+77:73477:x1874218681232256:12345-192.168.204.60@tcp:35:touch.0 Request processed in 675us (950us total) trans 120259084324 rc 0/0 00000100:00100000:2.0:1787397776.514915:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 251 00000100:00100000:1.0:1787397776.519106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.519379:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681232512 00000100:00100000:2.0:1787397776.519390:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681232512 00000100:00100000:2.0:1787397776.519600:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1463 00000100:00100000:2.0:1787397776.519611:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+77:73477:x1874218681232512:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.519640:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.519665:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c3a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d832b expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519777:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519811:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519822:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519836:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519842:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.519849:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.520699:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76c:0x0], index 0: 0 00010000:00010000:2.0:1787397776.520846:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c4f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520859:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c4f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520868:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c4f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520901:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520908:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520915:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520928:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.520933:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520941:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520953:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.520956:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.520961:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520967:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c41 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.520982:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b98553ab reply state 000000001f0ddd6e transno 120259084325 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520993:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.520999:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a817ea6200) 00010000:00010000:2.0:1787397776.521002:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.521005:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.521035:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c3a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d832b expref: 80 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.521050:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c4f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d832b expref: 79 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.521068:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:2.0:1787397776.521070:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.521073:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583c00, rc 0) 00000100:00100000:2.0:1787397776.521629:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+80:73477:x1874218681232512:12345-192.168.204.60@tcp:101:touch.0 Request processed in 2017us (2529us total) trans 120259084325 rc 0/0 00000100:00100000:2.0:1787397776.521640:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1463 00000100:00100000:1.0:1787397776.525196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.525261:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681232768 00000100:00100000:2.0:1787397776.525272:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681232768 00000100:00100000:2.0:1787397776.525331:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1464 00000100:00100000:2.0:1787397776.525340:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+80:73477:x1874218681232768:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.525394:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.525431:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c4f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d832b expref: 80 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.525457:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1100) 00010000:00010000:2.0:1787397776.525468:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.525559:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.525574:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.525584:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.525691:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042128ef6 reply state 00000000f52dbab6 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.525724:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.525731:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397776.525734:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.525736:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.525830:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+81:73477:x1874218681232768:12345-192.168.204.60@tcp:36:touch.0 Request processed in 490us (652us total) trans 120259084326 rc 0/0 00000100:00100000:2.0:1787397776.525838:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1464 00000100:00100000:1.0:1787397776.528678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.528962:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681232896 00000100:00100000:2.0:1787397776.528973:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681232896 00000100:00100000:2.0:1787397776.529033:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1465 00000100:00100000:2.0:1787397776.529044:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+81:73477:x1874218681232896:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.529069:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.529093:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d191c64 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8332 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.529376:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d191c64 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8332 expref: 82 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.529393:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d191c64 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8332 expref: 82 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.529425:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397776.529428:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.529432:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583400, rc 0) 00000100:00100000:2.0:1787397776.529652:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+82:73477:x1874218681232896:12345-192.168.204.60@tcp:101:touch.0 Request processed in 609us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.529674:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1465 00000100:00100000:0.0:1787397776.533247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.533323:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681233024 00000100:00100000:2.0:1787397776.533335:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681233024 00000100:00100000:2.0:1787397776.533393:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5008 00000100:00100000:2.0:1787397776.533414:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2403:x1874218681233024:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.533677:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2403:x1874218681233024:12345-192.168.204.60@tcp:2:touch.0 Request processed in 265us (440us total) trans 4294968743 rc 0/0 00000100:00100000:2.0:1787397776.533685:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5008 00000100:00100000:1.0:1787397776.537648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.537892:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681233280 00000100:00100000:0.0:1787397776.537904:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681233280 00000100:00100000:0.0:1787397776.537968:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 252 00000100:00100000:0.0:1787397776.537978:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+82:73477:x1874218681233280:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.538285:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+83:73477:x1874218681233280:12345-192.168.204.60@tcp:35:touch.0 Request processed in 307us (646us total) trans 120259084327 rc 0/0 00000100:00100000:0.0:1787397776.538295:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 252 00000100:00100000:0.0:1787397776.543034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.543315:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681233536 00000100:00100000:2.0:1787397776.543326:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681233536 00000100:00100000:2.0:1787397776.543431:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1466 00000100:00100000:2.0:1787397776.543442:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+83:73477:x1874218681233536:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.543467:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.543486:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c6b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8339 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543638:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543654:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543666:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543681:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543707:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.543714:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.544027:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76d:0x0], index 0: 0 00010000:00010000:2.0:1787397776.544177:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191c80 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544186:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191c80 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544194:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191c80 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544228:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544235:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544240:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544247:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544252:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.544256:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544274:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544287:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.544290:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.544295:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544300:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191c72 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.544313:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015d51bcd reply state 00000000421e2848 transno 120259084328 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544323:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544328:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a82ebb1100) 00010000:00010000:2.0:1787397776.544330:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.544333:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.544362:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191c6b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8339 expref: 86 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544375:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191c80 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8339 expref: 85 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.544382:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1800) 00010000:00010000:2.0:1787397776.544384:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.544386:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00000100:00100000:2.0:1787397776.544458:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+86:73477:x1874218681233536:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1018us (1434us total) trans 120259084328 rc 0/0 00000100:00100000:2.0:1787397776.544466:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1466 00000100:00100000:1.0:1787397776.547127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.547593:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681233792 00000100:00100000:2.0:1787397776.547605:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681233792 00000100:00100000:2.0:1787397776.547714:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1467 00000100:00100000:2.0:1787397776.547725:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+86:73477:x1874218681233792:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.547787:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.547817:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191c80 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8339 expref: 86 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.547837:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1800) 00010000:00010000:2.0:1787397776.547848:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.547902:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.547914:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.547922:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.548034:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005db09758 reply state 00000000a26f3edc transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.548047:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.548053:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:2.0:1787397776.548069:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.548072:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.548169:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+87:73477:x1874218681233792:12345-192.168.204.60@tcp:36:touch.0 Request processed in 445us (1050us total) trans 120259084329 rc 0/0 00000100:00100000:2.0:1787397776.548177:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1467 00000100:00100000:0.0:1787397776.550737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.550824:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681233920 00000100:00100000:1.0:1787397776.550836:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681233920 00000100:00100000:1.0:1787397776.550894:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1468 00000100:00100000:1.0:1787397776.550905:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+87:73477:x1874218681233920:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.550929:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.550950:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191c95 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8340 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.551008:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191c95 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8340 expref: 88 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.551021:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191c95 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8340 expref: 88 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.551062:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:1.0:1787397776.551065:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787397776.551069:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ba00, rc 0) 00000100:00100000:1.0:1787397776.551136:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+88:73477:x1874218681233920:12345-192.168.204.60@tcp:101:touch.0 Request processed in 233us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397776.551404:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1468 00000100:00100000:1.0:1787397776.554054:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.554129:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681234048 00000100:00100000:3.0:1787397776.554140:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681234048 00000100:00100000:3.0:1787397776.554207:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5009 00000100:00100000:3.0:1787397776.554217:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2405:x1874218681234048:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.554448:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2405:x1874218681234048:12345-192.168.204.60@tcp:2:touch.0 Request processed in 223us (395us total) trans 4294968744 rc 0/0 00000100:00100000:3.0:1787397776.554456:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5009 00000100:00100000:1.0:1787397776.556929:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.557005:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681234304 00000100:00100000:2.0:1787397776.557013:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681234304 00000100:00100000:2.0:1787397776.557068:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 253 00000100:00100000:2.0:1787397776.557076:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+88:73477:x1874218681234304:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.557348:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+89:73477:x1874218681234304:12345-192.168.204.60@tcp:35:touch.0 Request processed in 272us (428us total) trans 120259084330 rc 0/0 00000100:00100000:2.0:1787397776.557356:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 253 00000100:00100000:2.0:1787397776.559893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.559974:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681234560 00000100:00100000:1.0:1787397776.559984:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681234560 00000100:00100000:1.0:1787397776.560040:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1469 00000100:00100000:1.0:1787397776.560049:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+89:73477:x1874218681234560:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.560073:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.560097:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191c9c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8347 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560216:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560232:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560243:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560256:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560280:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560287:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397776.560622:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76e:0x0], index 0: 0 00010000:00010000:1.0:1787397776.560770:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191cb1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560779:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191cb1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560786:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191cb1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560820:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560827:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560834:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560839:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.560844:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560851:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560877:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.560880:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.560885:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560892:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ca3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.560910:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097b31b0b reply state 0000000081dfddbc transno 120259084331 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560921:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560927:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a818432500) 00010000:00010000:1.0:1787397776.560929:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.560932:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.560961:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191c9c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8347 expref: 92 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560977:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191cb1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8347 expref: 91 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.560983:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a818432200) 00010000:00010000:1.0:1787397776.560986:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.560988:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:1.0:1787397776.561081:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+92:73477:x1874218681234560:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1032us (1196us total) trans 120259084331 rc 0/0 00000100:00100000:1.0:1787397776.561089:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1469 00000100:00100000:1.0:1787397776.564486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.564777:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681234816 00000100:00100000:3.0:1787397776.564786:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681234816 00000100:00100000:3.0:1787397776.564879:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1470 00000100:00100000:3.0:1787397776.564890:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+92:73477:x1874218681234816:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:3.0:1787397776.564965:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397776.564993:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191cb1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8347 expref: 92 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.565012:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a818432200) 00010000:00010000:3.0:1787397776.565022:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397776.565077:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.565089:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.565097:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.565220:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdb3724b reply state 000000002afe0bbf transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.565232:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.565238:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:3.0:1787397776.565241:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.565243:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397776.565349:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+93:73477:x1874218681234816:12345-192.168.204.60@tcp:36:touch.0 Request processed in 459us (871us total) trans 120259084332 rc 0/0 00000100:00100000:3.0:1787397776.565357:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1470 00000100:00100000:3.0:1787397776.568204:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.568344:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681234944 00000100:00100000:2.0:1787397776.568355:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681234944 00000100:00100000:2.0:1787397776.568416:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1471 00000100:00100000:2.0:1787397776.568426:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+93:73477:x1874218681234944:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.568461:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.568481:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191cc6 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d834e expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.568577:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191cc6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d834e expref: 94 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.568593:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191cc6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d834e expref: 94 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.568633:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:2.0:1787397776.568637:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.568642:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00000100:00100000:2.0:1787397776.568702:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+94:73477:x1874218681234944:12345-192.168.204.60@tcp:101:touch.0 Request processed in 276us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.568709:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1471 00000100:00100000:0.0:1787397776.572155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.572357:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681235072 00000100:00100000:2.0:1787397776.572367:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681235072 00000100:00100000:2.0:1787397776.572423:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5010 00000100:00100000:2.0:1787397776.572432:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2402:x1874218681235072:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.572696:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:2402:x1874218681235072:12345-192.168.204.60@tcp:2:touch.0 Request processed in 264us (554us total) trans 4294968745 rc 0/0 00000100:00100000:2.0:1787397776.572704:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5010 00000100:00100000:0.0:1787397776.575342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.575426:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681235328 00000100:00100000:3.0:1787397776.575436:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681235328 00000100:00100000:3.0:1787397776.575507:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 254 00000100:00100000:3.0:1787397776.575516:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+94:73477:x1874218681235328:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:3.0:1787397776.575838:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+95:73477:x1874218681235328:12345-192.168.204.60@tcp:35:touch.0 Request processed in 322us (505us total) trans 120259084333 rc 0/0 00000100:00100000:3.0:1787397776.575845:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 254 00000100:00100000:1.0:1787397776.578889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.579007:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681235584 00000100:00100000:2.0:1787397776.579018:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681235584 00000100:00100000:2.0:1787397776.579085:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1472 00000100:00100000:2.0:1787397776.579094:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+95:73477:x1874218681235584:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.579121:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.579146:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191ccd lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8355 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579432:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579458:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579486:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579502:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579509:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.579515:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397776.579956:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76f:0x0], index 0: 0 00010000:00010000:2.0:1787397776.580097:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191ce2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580108:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191ce2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580116:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191ce2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580152:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580159:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580165:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.580171:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397776.580183:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583493:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583516:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397776.583559:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397776.583566:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583575:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191cd4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.583801:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000510589ff reply state 00000000f804c4ef transno 120259084334 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583817:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583825:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a82ebb1800) 00010000:00010000:2.0:1787397776.583827:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.583831:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397776.583896:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191ccd lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8355 expref: 98 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583912:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191ce2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8355 expref: 97 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.583919:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397776.583921:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397776.583941:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582c00, rc 0) 00000100:00100000:2.0:1787397776.584081:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+98:73477:x1874218681235584:12345-192.168.204.60@tcp:101:touch.0 Request processed in 4986us (5203us total) trans 120259084334 rc 0/0 00000100:00100000:2.0:1787397776.584091:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1472 00000100:00100000:0.0:1787397776.587388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.587998:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681235840 00000100:00100000:2.0:1787397776.588009:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681235840 00000100:00100000:2.0:1787397776.588159:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1473 00000100:00100000:2.0:1787397776.588171:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+98:73477:x1874218681235840:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.588267:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.588296:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191ce2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8355 expref: 98 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.588317:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397776.588329:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.588383:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.588407:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.588417:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.588571:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd0b9f23 reply state 00000000679b6482 transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.588592:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.588599:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:2.0:1787397776.588608:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.588611:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.588708:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+99:73477:x1874218681235840:12345-192.168.204.60@tcp:36:touch.0 Request processed in 538us (1330us total) trans 120259084335 rc 0/0 00000100:00100000:2.0:1787397776.588716:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1473 00000100:00100000:1.0:1787397776.592009:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.592114:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681235968 00000100:00100000:2.0:1787397776.592124:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681235968 00000100:00100000:2.0:1787397776.592190:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1474 00000100:00100000:2.0:1787397776.592201:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+99:73477:x1874218681235968:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.592337:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.592366:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d191cf7 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d835c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.592503:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d191cf7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d835c expref: 100 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.592519:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d191cf7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d835c expref: 100 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.592572:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:2.0:1787397776.592743:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.592749:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583800, rc 0) 00000100:00100000:2.0:1787397776.593034:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+100:73477:x1874218681235968:12345-192.168.204.60@tcp:101:touch.0 Request processed in 834us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.593042:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1474 00000100:00100000:1.0:1787397776.595957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.596052:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681236096 00000100:00100000:2.0:1787397776.596062:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681236096 00000100:00100000:2.0:1787397776.596163:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5011 00000100:00100000:2.0:1787397776.596207:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:2405:x1874218681236096:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.596455:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2405:x1874218681236096:12345-192.168.204.60@tcp:2:touch.0 Request processed in 262us (501us total) trans 4294968746 rc 0/0 00000100:00100000:2.0:1787397776.596463:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5011 00000100:00100000:0.0:1787397776.600164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.600246:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681236352 00000100:00100000:3.0:1787397776.600257:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681236352 00000100:00100000:3.0:1787397776.600319:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 255 00000100:00100000:3.0:1787397776.600330:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+100:73477:x1874218681236352:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:1.0:1787397776.600964:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+101:73477:x1874218681236352:12345-192.168.204.60@tcp:35:touch.0 Request processed in 633us (816us total) trans 120259084336 rc 0/0 00000100:00100000:1.0:1787397776.600973:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 255 00000100:00100000:1.0:1787397776.603696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.603781:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681236608 00000100:00100000:3.0:1787397776.603790:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681236608 00000100:00100000:3.0:1787397776.603846:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1475 00000100:00100000:3.0:1787397776.603856:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+101:73477:x1874218681236608:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.603877:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.603895:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d191cfe lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8363 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604022:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604038:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604049:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604061:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604077:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.604083:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.604444:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x770:0x0], index 0: 0 00010000:00010000:1.0:1787397776.605133:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d13 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605243:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d13 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605253:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d13 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605295:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605303:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605309:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605315:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605322:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.605326:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605343:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605358:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.605362:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.605366:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605373:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191d05 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.605387:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fe68338 reply state 000000002138a4d1 transno 120259084337 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605398:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605405:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a82e43e100) 00010000:00010000:1.0:1787397776.605407:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.605410:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.605514:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d191cfe lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8363 expref: 104 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605658:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d13 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8363 expref: 103 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.605666:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a818432200) 00010000:00010000:1.0:1787397776.605668:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.605671:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:1.0:1787397776.605795:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+104:73477:x1874218681236608:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1939us (2107us total) trans 120259084337 rc 0/0 00000100:00100000:1.0:1787397776.605804:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1475 00000100:00100000:3.0:1787397776.609038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.609295:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681236864 00000100:00100000:2.0:1787397776.609304:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681236864 00000100:00100000:2.0:1787397776.609412:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1476 00000100:00100000:2.0:1787397776.609423:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+104:73477:x1874218681236864:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.609492:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.609568:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d13 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8363 expref: 104 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.609588:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a818432200) 00010000:00010000:2.0:1787397776.609600:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.609660:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.609673:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.609683:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.609794:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006db4526a reply state 00000000aaa4397f transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.609807:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.609832:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397776.609835:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.609839:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.609928:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+105:73477:x1874218681236864:12345-192.168.204.60@tcp:36:touch.0 Request processed in 507us (900us total) trans 120259084338 rc 0/0 00000100:00100000:2.0:1787397776.609936:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1476 00000100:00100000:1.0:1787397776.612046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.612639:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681236992 00000100:00100000:0.0:1787397776.612652:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681236992 00000100:00100000:0.0:1787397776.612718:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1477 00000100:00100000:0.0:1787397776.612728:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+105:73477:x1874218681236992:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.612753:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.612774:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191d28 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d836a expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.612832:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191d28 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d836a expref: 106 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.612846:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191d28 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d836a expref: 106 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.612887:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:0.0:1787397776.612890:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787397776.612894:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:0.0:1787397776.612952:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+106:73477:x1874218681236992:12345-192.168.204.60@tcp:101:touch.0 Request processed in 225us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.612959:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1477 00000100:00100000:3.0:1787397776.615797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.616015:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681237120 00000100:00100000:2.0:1787397776.616028:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681237120 00000100:00100000:2.0:1787397776.616122:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5012 00000100:00100000:2.0:1787397776.616148:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2404:x1874218681237120:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.616403:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:2404:x1874218681237120:12345-192.168.204.60@tcp:2:touch.0 Request processed in 271us (615us total) trans 4294968747 rc 0/0 00000100:00100000:2.0:1787397776.616411:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5012 00000100:00100000:0.0:1787397776.623719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.623813:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681237376 00000100:00100000:2.0:1787397776.623823:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681237376 00000100:00100000:2.0:1787397776.623917:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 256 00000100:00100000:2.0:1787397776.623929:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+106:73477:x1874218681237376:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.624322:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+107:73477:x1874218681237376:12345-192.168.204.60@tcp:35:touch.0 Request processed in 394us (612us total) trans 120259084339 rc 0/0 00000100:00100000:2.0:1787397776.624332:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 256 00000100:00100000:1.0:1787397776.627157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.627755:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681237632 00000100:00100000:3.0:1787397776.627768:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681237632 00000100:00100000:3.0:1787397776.627838:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1478 00000100:00100000:3.0:1787397776.627850:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+107:73477:x1874218681237632:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.627877:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.627899:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d191d2f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8371 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628003:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628017:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628028:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628044:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628065:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628073:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.628647:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x771:0x0], index 0: 0 00010000:00010000:3.0:1787397776.628797:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134a00/0x274786fe0d191d44 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628807:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134a00/0x274786fe0d191d44 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628815:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134a00/0x274786fe0d191d44 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628849:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628856:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628863:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628870:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397776.628874:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628881:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628906:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.628909:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397776.628914:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628919:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d191d36 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.628934:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000217ffd67 reply state 00000000cd5eeaf2 transno 120259084340 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628944:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628950:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a82e43ec00) 00010000:00010000:3.0:1787397776.628952:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.628955:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397776.628984:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d191d2f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8371 expref: 110 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.628998:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134a00/0x274786fe0d191d44 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8371 expref: 109 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.629006:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:3.0:1787397776.629008:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397776.629010:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134a00, rc 0) 00000100:00100000:3.0:1787397776.629072:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+110:73477:x1874218681237632:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1224us (1942us total) trans 120259084340 rc 0/0 00000100:00100000:3.0:1787397776.629080:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1478 00000100:00100000:1.0:1787397776.632983:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.633049:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681237888 00000100:00100000:2.0:1787397776.633059:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681237888 00000100:00100000:2.0:1787397776.633111:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1479 00000100:00100000:2.0:1787397776.633120:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+110:73477:x1874218681237888:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.633195:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.633234:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134a00/0x274786fe0d191d44 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8371 expref: 110 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.633253:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:2.0:1787397776.633265:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.633324:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.633336:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.633346:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.633696:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d164fe6 reply state 0000000006981c64 transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.633709:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.633716:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:2.0:1787397776.633719:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.633721:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.633889:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+111:73477:x1874218681237888:12345-192.168.204.60@tcp:36:touch.0 Request processed in 768us (912us total) trans 120259084341 rc 0/0 00000100:00100000:2.0:1787397776.633896:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1479 00000100:00100000:3.0:1787397776.636202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.636278:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681238016 00000100:00100000:1.0:1787397776.636290:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681238016 00000100:00100000:1.0:1787397776.636353:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1480 00000100:00100000:1.0:1787397776.636362:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+111:73477:x1874218681238016:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.636387:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.636407:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d191d59 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8378 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.636476:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d191d59 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8378 expref: 112 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.636491:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d191d59 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8378 expref: 112 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.636509:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:1.0:1787397776.636512:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787397776.636516:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b600, rc 0) 00000100:00100000:1.0:1787397776.637122:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+112:73477:x1874218681238016:12345-192.168.204.60@tcp:101:touch.0 Request processed in 759us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397776.637142:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1480 00000100:00100000:3.0:1787397776.639975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.640054:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681238144 00000100:00100000:0.0:1787397776.640064:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681238144 00000100:00100000:0.0:1787397776.640123:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5013 00000100:00100000:0.0:1787397776.640312:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:2404:x1874218681238144:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:0.0:1787397776.640569:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:2404:x1874218681238144:12345-192.168.204.60@tcp:2:touch.0 Request processed in 437us (605us total) trans 4294968748 rc 0/0 00000100:00100000:0.0:1787397776.640577:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5013 00000100:00100000:0.0:1787397776.643011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.643407:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681238400 00000100:00100000:1.0:1787397776.643433:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681238400 00000100:00100000:1.0:1787397776.646431:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 257 00000100:00100000:1.0:1787397776.646466:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+112:73477:x1874218681238400:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:1.0:1787397776.646802:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+113:73477:x1874218681238400:12345-192.168.204.60@tcp:35:touch.0 Request processed in 347us (3799us total) trans 120259084342 rc 0/0 00000100:00100000:1.0:1787397776.646811:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 257 00000100:00100000:0.0:1787397776.650314:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.650402:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681238656 00000100:00100000:1.0:1787397776.650413:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681238656 00000100:00100000:1.0:1787397776.650676:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1481 00000100:00100000:1.0:1787397776.650688:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+113:73477:x1874218681238656:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.650715:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.650736:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191d60 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d837f expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650849:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650863:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650873:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650886:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650893:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.650898:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397776.651364:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x772:0x0], index 0: 0 00010000:00010000:1.0:1787397776.651516:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191d75 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651563:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191d75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651571:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191d75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651606:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651614:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651620:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651627:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651634:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.651637:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651644:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651656:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.651659:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.651674:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651681:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191d67 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.651696:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013567f08 reply state 0000000087ae815f transno 120259084343 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651707:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651713:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a818432000) 00010000:00010000:1.0:1787397776.651716:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.651718:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.651750:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191d60 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d837f expref: 116 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651764:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191d75 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d837f expref: 115 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.651770:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397776.651773:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.651775:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a800, rc 0) 00000100:00100000:1.0:1787397776.651827:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+116:73477:x1874218681238656:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1142us (1523us total) trans 120259084343 rc 0/0 00000100:00100000:1.0:1787397776.651834:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1481 00000100:00100000:2.0:1787397776.651952:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701128064:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787397776.652004:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397776.652039:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806079a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397776.654585:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128064 00000100:00100000:2.0:1787397776.654621:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128064 00000100:00100000:2.0:1787397776.654693:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5014 00000100:00100000:2.0:1787397776.654704:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:94348:x1874218701128064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787397776.654749:0:26158:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00000100:00080000:0.0:1787397776.655243:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397776.656749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.657001:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681238912 00000100:00100000:1.0:1787397776.657011:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681238912 00000100:00100000:1.0:1787397776.657076:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1482 00000100:00100000:1.0:1787397776.657087:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+116:73477:x1874218681238912:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:1.0:1787397776.657180:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397776.657220:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191d75 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d837f expref: 116 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.657238:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397776.657250:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397776.657303:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.657317:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.657328:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.657433:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2b7f82f reply state 000000004a311e25 transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.657662:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.657669:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:1.0:1787397776.657672:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.657674:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397776.657817:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+117:73477:x1874218681238912:12345-192.168.204.60@tcp:36:touch.0 Request processed in 731us (1074us total) trans 120259084344 rc 0/0 00000100:00100000:1.0:1787397776.657825:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1482 00000100:00100000:0.0:1787397776.660415:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701128064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5707us (8403us total) trans 4294968749 rc 0/0 00000100:00100000:0.0:1787397776.660431:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5014 00000100:00100000:2.0:1787397776.662583:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701128064:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787397776.662603:0:94348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x772:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:0.0:1787397776.665415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.665686:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681239040 00000100:00100000:2.0:1787397776.665697:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681239040 00000100:00100000:0.0:1787397776.665852:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1483 00000100:00100000:0.0:1787397776.665862:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+117:73477:x1874218681239040:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:0.0:1787397776.665888:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397776.665923:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191d8a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8386 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.665989:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191d8a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8386 expref: 118 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.666004:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191d8a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8386 expref: 118 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397776.666024:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:0.0:1787397776.666028:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787397776.666031:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00000100:00100000:0.0:1787397776.666149:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+118:73477:x1874218681239040:12345-192.168.204.60@tcp:101:touch.0 Request processed in 282us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.666156:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1483 00000100:00100000:2.0:1787397776.669042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.669135:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681239168 00000100:00100000:3.0:1787397776.669149:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681239168 00000100:00100000:3.0:1787397776.669226:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5015 00000100:00100000:3.0:1787397776.669235:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:2405:x1874218681239168:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:3.0:1787397776.669500:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2405:x1874218681239168:12345-192.168.204.60@tcp:2:touch.0 Request processed in 265us (464us total) trans 4294968750 rc 0/0 00000100:00100000:3.0:1787397776.669508:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5015 00000100:00100000:2.0:1787397776.672428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.672780:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681239424 00000100:00100000:0.0:1787397776.672791:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681239424 00000100:00100000:0.0:1787397776.672888:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 258 00000100:00100000:0.0:1787397776.672900:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+118:73477:x1874218681239424:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:0.0:1787397776.676967:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+119:73477:x1874218681239424:12345-192.168.204.60@tcp:35:touch.0 Request processed in 4058us (4538us total) trans 120259084345 rc 0/0 00000100:00100000:0.0:1787397776.676982:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 258 00000100:00100000:2.0:1787397776.681735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.681813:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681239680 00000100:00100000:3.0:1787397776.681825:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681239680 00000100:00100000:3.0:1787397776.681888:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1484 00000100:00100000:3.0:1787397776.681896:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+119:73477:x1874218681239680:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.681920:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.681941:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191d91 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d838d expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682043:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682059:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682070:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682083:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682106:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682113:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.682685:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x773:0x0], index 0: 0 00010000:00010000:3.0:1787397776.682832:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d191da6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682843:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d191da6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682852:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d191da6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682884:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682890:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682897:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682902:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397776.682906:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682912:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682936:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.682939:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397776.682943:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682949:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191d98 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.682962:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000301a8350 reply state 000000000870cd96 transno 120259084346 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682973:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.682979:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a82e43ed00) 00010000:00010000:3.0:1787397776.682982:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.682985:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397776.683018:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191d91 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d838d expref: 122 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.683032:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d191da6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d838d expref: 121 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.683039:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a82e43ef00) 00010000:00010000:3.0:1787397776.683041:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397776.683043:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135200, rc 0) 00000100:00100000:3.0:1787397776.683243:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+122:73477:x1874218681239680:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1346us (1516us total) trans 120259084346 rc 0/0 00000100:00100000:3.0:1787397776.683252:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1484 00000100:00100000:0.0:1787397776.686770:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.686877:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681239936 00000100:00100000:1.0:1787397776.686888:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681239936 00000100:00100000:1.0:1787397776.687000:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1485 00000100:00100000:1.0:1787397776.687022:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+122:73477:x1874218681239936:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:1.0:1787397776.687101:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397776.687131:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d191da6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d838d expref: 122 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.687163:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a82e43ef00) 00010000:00010000:1.0:1787397776.687176:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397776.687250:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.687265:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.687276:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.687402:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4125743 reply state 00000000f4b74605 transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.687416:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.687422:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397776.687425:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.687428:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397776.688019:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+123:73477:x1874218681239936:12345-192.168.204.60@tcp:36:touch.0 Request processed in 995us (1257us total) trans 120259084347 rc 0/0 00000100:00100000:1.0:1787397776.688028:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1485 00000100:00100000:2.0:1787397776.691094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.691347:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681240064 00000100:00100000:1.0:1787397776.691357:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681240064 00000100:00100000:1.0:1787397776.691432:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1486 00000100:00100000:1.0:1787397776.691452:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+123:73477:x1874218681240064:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.691476:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.691497:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191dbb lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8394 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.691593:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191dbb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8394 expref: 124 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.691609:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191dbb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8394 expref: 124 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.691628:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397776.691631:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787397776.691635:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b800, rc 0) 00000100:00100000:1.0:1787397776.691690:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+124:73477:x1874218681240064:12345-192.168.204.60@tcp:101:touch.0 Request processed in 249us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397776.691698:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1486 00000100:00100000:0.0:1787397776.694914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.695127:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681240192 00000100:00100000:2.0:1787397776.695139:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681240192 00000100:00100000:2.0:1787397776.695219:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5016 00000100:00100000:2.0:1787397776.695229:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2405:x1874218681240192:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:2.0:1787397776.695460:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:2405:x1874218681240192:12345-192.168.204.60@tcp:2:touch.0 Request processed in 231us (554us total) trans 4294968751 rc 0/0 00000100:00100000:2.0:1787397776.695469:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5016 00000100:00100000:2.0:1787397776.698388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.698470:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681240448 00000100:00100000:1.0:1787397776.698480:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681240448 00000100:00100000:1.0:1787397776.698578:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 259 00000100:00100000:1.0:1787397776.698588:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+124:73477:x1874218681240448:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:1.0:1787397776.698862:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+125:73477:x1874218681240448:12345-192.168.204.60@tcp:35:touch.0 Request processed in 275us (483us total) trans 120259084348 rc 0/0 00000100:00100000:1.0:1787397776.698870:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 259 00000100:00100000:3.0:1787397776.701583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.701700:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681240704 00000100:00100000:1.0:1787397776.701723:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681240704 00000100:00100000:1.0:1787397776.701818:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1487 00000100:00100000:1.0:1787397776.701827:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+125:73477:x1874218681240704:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:1.0:1787397776.701849:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397776.701875:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191dc2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d839b expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.701978:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.701992:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702003:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702019:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702026:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702032:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397776.702395:0:77740:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x774:0x0], index 0: 0 00010000:00010000:1.0:1787397776.702733:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191dd7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702744:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191dd7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702763:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191dd7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702803:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702810:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702815:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702821:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702827:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397776.702832:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702839:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702851:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397776.702854:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397776.702859:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702865:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191dc9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.702879:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aee10835 reply state 00000000f0bfe766 transno 120259084349 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702896:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702902:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a818432900) 00010000:00010000:1.0:1787397776.702904:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.702907:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397776.702935:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191dc2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d839b expref: 128 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702949:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191dd7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d839b expref: 127 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.702956:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a818432d00) 00010000:00010000:1.0:1787397776.702959:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397776.702961:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00000100:00100000:1.0:1787397776.703071:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+128:73477:x1874218681240704:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1244us (1497us total) trans 120259084349 rc 0/0 00000100:00100000:1.0:1787397776.703080:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1487 00000100:00100000:0.0:1787397776.707998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.708086:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681240960 00000100:00100000:2.0:1787397776.708097:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681240960 00000100:00100000:2.0:1787397776.708189:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1488 00000100:00100000:2.0:1787397776.708201:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+128:73477:x1874218681240960:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:2.0:1787397776.708279:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397776.708306:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191dd7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d839b expref: 128 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.708340:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a818432d00) 00010000:00010000:2.0:1787397776.708352:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397776.708415:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.708428:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.708450:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397776.708597:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b84689fe reply state 000000001c1abd75 transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.708609:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.708616:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:2.0:1787397776.708618:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397776.708621:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397776.708722:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+129:73477:x1874218681240960:12345-192.168.204.60@tcp:36:touch.0 Request processed in 523us (733us total) trans 120259084350 rc 0/0 00000100:00100000:2.0:1787397776.708729:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1488 00000100:00100000:0.0:1787397776.712232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.712297:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681241088 00000100:00100000:3.0:1787397776.712308:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681241088 00000100:00100000:3.0:1787397776.712374:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1489 00000100:00100000:3.0:1787397776.712385:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+129:73477:x1874218681241088:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.712558:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.712645:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191dec lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83a2 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.712700:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191dec lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a2 expref: 130 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.712715:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191dec lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a2 expref: 130 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.712731:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:3.0:1787397776.712734:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787397776.712737:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135600, rc 0) 00000100:00100000:3.0:1787397776.713031:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+130:73477:x1874218681241088:12345-192.168.204.60@tcp:101:touch.0 Request processed in 647us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.713039:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1489 00000100:00100000:2.0:1787397776.716996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.717065:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681241216 00000100:00100000:0.0:1787397776.717089:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681241216 00000100:00100000:0.0:1787397776.717245:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5017 00000100:00100000:0.0:1787397776.717258:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:2404:x1874218681241216:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:0.0:1787397776.717498:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2404:x1874218681241216:12345-192.168.204.60@tcp:2:touch.0 Request processed in 242us (510us total) trans 4294968752 rc 0/0 00000100:00100000:0.0:1787397776.717506:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5017 00000100:00100000:0.0:1787397776.720878:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.720988:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681241472 00000100:00100000:2.0:1787397776.720999:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681241472 00000100:00100000:2.0:1787397776.721088:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 260 00000100:00100000:2.0:1787397776.721099:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+130:73477:x1874218681241472:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.721637:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+131:73477:x1874218681241472:12345-192.168.204.60@tcp:35:touch.0 Request processed in 538us (767us total) trans 120259084351 rc 0/0 00000100:00100000:2.0:1787397776.721647:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 260 00000100:00100000:1.0:1787397776.724348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.724418:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681241728 00000100:00100000:3.0:1787397776.724428:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681241728 00000100:00100000:3.0:1787397776.724499:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1490 00000100:00100000:3.0:1787397776.724508:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+131:73477:x1874218681241728:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:3.0:1787397776.724579:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397776.724600:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191df3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83a9 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724730:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724746:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724758:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724776:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724783:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.724790:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397776.725106:0:74374:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x775:0x0], index 0: 0 00010000:00010000:3.0:1787397776.725285:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d191e08 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725295:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d191e08 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725303:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d191e08 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725339:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725359:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725366:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725377:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397776.725381:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725388:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725403:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397776.725406:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397776.725411:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725416:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191dfa lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397776.725429:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f9f96b5 reply state 00000000b00757a4 transno 120259084352 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725440:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725447:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a82e43ef00) 00010000:00010000:3.0:1787397776.725449:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397776.725452:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397776.725484:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191df3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a9 expref: 134 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725505:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d191e08 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a9 expref: 133 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397776.725512:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:3.0:1787397776.725515:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397776.725517:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134c00, rc 0) 00000100:00100000:3.0:1787397776.725619:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+134:73477:x1874218681241728:12345-192.168.204.60@tcp:101:touch.0 Request processed in 1112us (1278us total) trans 120259084352 rc 0/0 00000100:00100000:3.0:1787397776.725627:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1490 00000100:00100000:3.0:1787397776.729953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397776.730015:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681241984 00000100:00100000:1.0:1787397776.730027:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681241984 00000100:00100000:1.0:1787397776.730091:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1491 00000100:00100000:1.0:1787397776.730102:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+134:73477:x1874218681241984:12345-192.168.204.60@tcp:36:touch.0 00010000:00010000:1.0:1787397776.730174:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397776.730211:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d191e08 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a9 expref: 134 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.730248:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a82e43e300) 00010000:00010000:1.0:1787397776.730259:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397776.730320:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.730332:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.730341:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397776.730453:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c3443c45 reply state 00000000b50a2424 transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.730466:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397776.730472:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:1.0:1787397776.730474:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397776.730477:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397776.730620:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+135:73477:x1874218681241984:12345-192.168.204.60@tcp:36:touch.0 Request processed in 519us (676us total) trans 120259084353 rc 0/0 00000100:00100000:1.0:1787397776.730629:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1491 00000100:00100000:0.0:1787397776.734080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397776.734193:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242112 00000100:00100000:2.0:1787397776.734321:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242112 00000100:00100000:2.0:1787397776.734418:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1492 00000100:00100000:2.0:1787397776.734429:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+135:73477:x1874218681242112:12345-192.168.204.60@tcp:101:touch.0 00010000:00010000:2.0:1787397776.734455:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397776.734489:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191e1d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83b0 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.734613:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191e1d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b0 expref: 136 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.734629:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191e1d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b0 expref: 136 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397776.734649:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:2.0:1787397776.734653:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787397776.734657:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582800, rc 0) 00000100:00100000:2.0:1787397776.734722:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+136:73477:x1874218681242112:12345-192.168.204.60@tcp:101:touch.0 Request processed in 294us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.734730:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1492 00000100:00100000:2.0:1787397776.737401:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397776.737511:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242240 00000100:00100000:0.0:1787397776.737567:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242240 00000100:00100000:0.0:1787397776.737842:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5018 00000100:00100000:0.0:1787397776.737853:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2405:x1874218681242240:12345-192.168.204.60@tcp:2:touch.0 00000100:00100000:0.0:1787397776.738075:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2405:x1874218681242240:12345-192.168.204.60@tcp:2:touch.0 Request processed in 223us (683us total) trans 4294968753 rc 0/0 00000100:00100000:0.0:1787397776.738083:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5018 00000100:00100000:0.0:1787397776.740913:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397776.741001:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242496 00000100:00100000:3.0:1787397776.741010:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242496 00000100:00100000:3.0:1787397776.741067:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00100000:3.0:1787397776.741078:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+136:73477:x1874218681242496:12345-192.168.204.60@tcp:35:touch.0 00000100:00100000:2.0:1787397776.742930:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+137:73477:x1874218681242496:12345-192.168.204.60@tcp:35:touch.0 Request processed in 1843us (2015us total) trans 120259084354 rc 0/0 00000100:00100000:2.0:1787397776.742962:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00100000:0.0:1787397776.869214:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701128448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869286:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869315:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701128960:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869339:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869377:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701129472:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869424:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787397776.869430:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701128320:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869484:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701128832:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869559:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701129344:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869582:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.869616:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128960 00000100:00100000:0.0:1787397776.869625:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128960 00000100:00100000:0.0:1787397776.869687:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129472 00000100:00100000:0.0:1787397776.869690:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129472 00000100:00100000:0.0:1787397776.869710:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1787397776.869718:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701128960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869769:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701128960:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.869777:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1787397776.869795:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1787397776.869801:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701129472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869827:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701129472:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.869833:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1787397776.869850:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128832 00000100:00100000:0.0:1787397776.869854:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128832 00000100:00100000:0.0:1787397776.869882:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129344 00000100:00100000:0.0:1787397776.869884:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129344 00000100:00100000:0.0:1787397776.869896:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:0.0:1787397776.869901:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701128832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.869933:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701128832:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.869938:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:3.0:1787397776.870004:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701128576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397776.870060:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701129088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397776.870102:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701129600:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.870109:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:0.0:1787397776.870124:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701129344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397776.870151:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787397776.870160:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701128192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.870172:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701129344:12345-0@lo:400:kworker.0 Request processed in 51us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.870179:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1787397776.870196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397776.870205:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397776.870232:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701128704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.870242:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701128832:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.870257:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701129344:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.870274:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701128960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.870292:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701129472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701129216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397776.870330:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128448 00000100:00100000:0.0:1787397776.870335:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128448 00000100:00100000:3.0:1787397776.870348:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701129728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397776.870401:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129088 00000100:00100000:3.0:1787397776.870405:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129088 00000100:00100000:3.0:1787397776.870445:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129600 00000100:00100000:3.0:1787397776.870448:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129600 00000100:00100000:3.0:1787397776.870469:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1787397776.870475:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701129088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870511:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701129088:12345-0@lo:400:kworker.0 Request processed in 36us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.870517:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1787397776.870559:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1787397776.870584:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701129600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870616:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701129600:12345-0@lo:400:kworker.0 Request processed in 52us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.870623:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1787397776.870688:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701129856:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787397776.870714:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397776.870717:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397776.870719:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397776.870760:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129856 00000100:00100000:0.0:1787397776.870761:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128320 00000100:00100000:3.0:1787397776.870765:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129856 00000100:00100000:0.0:1787397776.870768:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128320 00000100:00080000:0.0:1787397776.870791:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397776.870800:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:3.0:1787397776.870810:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701129856:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397776.870813:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128576 00000100:00100000:0.0:1787397776.870818:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128576 00000100:00080000:0.0:1787397776.870834:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787397776.870845:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397776.870849:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128704 00000100:00100000:0.0:1787397776.870853:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128704 00000100:00080000:0.0:1787397776.870867:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397776.870885:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129216 00000100:00100000:0.0:1787397776.870889:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129216 00000100:00100000:0.0:1787397776.870904:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129728 00000100:00100000:0.0:1787397776.870907:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129728 00000100:00100000:3.0:1787397776.870920:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701129856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.870921:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1787397776.870931:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701128448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.870933:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:3.0:1787397776.870973:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701129856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397776.871168:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701128448:12345-0@lo:400:kworker.0 Request processed in 237us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.871175:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1787397776.871204:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701128448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.871224:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1787397776.871231:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701128320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.871266:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701128320:12345-0@lo:400:kworker.0 Request processed in 36us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.871271:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1787397776.871291:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701128320:0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.871311:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1787397776.871317:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701128576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.871460:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701129088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.871470:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701129600:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.871488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701128576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.871510:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1787397776.871519:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701128704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397776.871753:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1787397776.871764:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701129216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397776.871828:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701128576:12345-0@lo:400:kworker.0 Request processed in 510us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.871836:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1787397776.871853:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1787397776.871861:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701129728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397776.871877:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701128192 00000100:00100000:1.0:1787397776.871914:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701128192 00000100:00100000:1.0:1787397776.871954:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787397776.871961:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701128192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397776.873689:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701129216:12345-0@lo:400:kworker.0 Request processed in 1920us (3354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.873703:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1787397776.873800:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701129216:0@lo:400:kworker.0 00000100:00100000:2.0:1787397776.873932:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397776.873946:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701129984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397776.876447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397776.876568:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701129984 00000100:00100000:2.0:1787397776.876578:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701129984 00000100:00100000:2.0:1787397776.876631:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1787397776.876641:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701129984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397776.876686:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397776.876733:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701129984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397776.876740:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1787397776.876788:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701129984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397776.877550:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701129728:12345-0@lo:400:kworker.0 Request processed in 5687us (7174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397776.877562:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1787397776.877665:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701129728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397776.880864:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701128704:12345-0@lo:400:kworker.0 Request processed in 9336us (10581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397776.880884:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1787397776.881159:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701128192:12345-0@lo:400:kworker.0 Request processed in 9121us (10886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397776.881183:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787397776.883180:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701128192:0@lo:400:kworker.0 00000100:00100000:2.0:1787397776.883202:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701128704:0@lo:400:kworker.0 00000100:00100000:2.0:1787397777.157404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397777.157585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397777.157634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397777.157668:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397777.157698:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397777.157727:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242880 00000100:00100000:2.0:1787397777.157737:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242880 00000100:00100000:2.0:1787397777.157802:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242752 00000100:00100000:2.0:1787397777.157807:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242752 00000100:00100000:2.0:1787397777.157837:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1409 00000100:00100000:2.0:1787397777.157848:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681242880:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397777.157933:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681242880:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397777.157941:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1409 00000100:00080000:0.0:1787397777.158075:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397777.158210:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1410 00000100:00100000:0.0:1787397777.158219:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+137:2403:x1874218681242752:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397777.158259:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+137:2403:x1874218681242752:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397777.158276:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1410 00000100:00100000:1.0:1787397777.158611:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243136 00000100:00100000:1.0:1787397777.158617:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243136 00000100:00100000:1.0:1787397777.158662:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243008 00000100:00100000:1.0:1787397777.158665:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243008 00000100:00100000:1.0:1787397777.158689:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2646 00000100:00100000:1.0:1787397777.158697:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681243136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397777.158728:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681243136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397777.158734:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2646 00000100:00100000:1.0:1787397777.158748:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2647 00000100:00100000:1.0:1787397777.158755:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2403:x1874218681243008:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397777.158778:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2403:x1874218681243008:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397777.158783:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2647 00000100:00080000:0.0:1787397777.159048:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397777.159422:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681242624 00000100:00100000:3.0:1787397777.159428:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681242624 00000100:00100000:3.0:1787397777.159647:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 179 00000100:00100000:3.0:1787397777.159657:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681242624:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397777.159705:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681242624:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 50us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397777.159713:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 179 00010000:00010000:1.0:1787397777.253915:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397777.383585:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397777.383662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397777.383717:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397777.383724:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397777.383750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397777.383784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130112 00000100:00100000:2.0:1787397777.383792:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130112 00000100:00100000:2.0:1787397777.383830:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130240 00000100:00100000:2.0:1787397777.383833:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130240 00000100:00100000:2.0:1787397777.383847:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:2.0:1787397777.383855:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701130112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397777.383888:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397777.383928:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701130112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397777.383952:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:2.0:1787397777.383968:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1787397777.383974:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701130240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397777.383985:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787397777.384011:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701130240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397777.384017:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1787397777.384055:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397777.384069:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397777.384698:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701130368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397777.384734:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397777.384764:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397777.384771:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701130496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397777.384793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397777.384868:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130368 00000100:00100000:0.0:1787397777.384873:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130368 00000100:00100000:0.0:1787397777.384907:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1787397777.384915:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701130368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397777.384927:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397777.384968:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701130368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397777.384975:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:0.0:1787397777.384992:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130496 00000100:00100000:0.0:1787397777.384995:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130496 00000100:00100000:0.0:1787397777.385009:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1787397777.385014:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701130496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397777.385024:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397777.385049:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701130496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397777.385054:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1787397777.385249:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701130496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397777.385263:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701130368:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787397778.276791:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397778.625033:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397778.625150:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243264 00000100:00100000:2.0:1787397778.625161:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243264 00000100:00100000:2.0:1787397778.625236:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1493 00000100:00100000:2.0:1787397778.625249:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+137:73504:x1874218681243264:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397778.625287:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397778.625362:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+137:73504:x1874218681243264:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397778.625385:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1493 00000100:00080000:0.0:1787397778.625556:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397778.634320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397778.634426:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243392 00000100:00100000:0.0:1787397778.634436:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243392 00000100:00100000:0.0:1787397778.634547:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1494 00000100:00100000:0.0:1787397778.634558:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73504:x1874218681243392:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397778.634597:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397778.634671:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73504:x1874218681243392:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397778.634691:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1494 00000100:00100000:1.0:1787397778.644069:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397778.644169:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243520 00000100:00100000:0.0:1787397778.644179:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243520 00000100:00100000:0.0:1787397778.644261:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2111 00000100:00100000:0.0:1787397778.644271:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:73504:x1874218681243520:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397778.644306:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397778.644378:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:73504:x1874218681243520:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 108us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397778.644386:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2111 00000100:00080000:2.0:1787397778.644467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397778.652005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397778.652122:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243648 00000100:00100000:2.0:1787397778.652131:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243648 00000100:00100000:2.0:1787397778.652189:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2112 00000100:00100000:2.0:1787397778.652198:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:73504:x1874218681243648:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397778.652224:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397778.652297:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:73504:x1874218681243648:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397778.652305:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2112 00000001:00080000:3.0:1787397778.924465:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084354 is committed 00010000:00010000:0.0:1787397778.924908:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.924936:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.924947:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.924954:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.924960:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925285:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925309:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a817ea6c00) 00010000:00010000:0.0:1787397778.925313:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.925319:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925343:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1919cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925369:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925375:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925382:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925387:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.925391:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925397:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925405:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397778.925408:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.925411:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925417:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1919d2 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925433:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925439:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925451:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925455:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.925458:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925464:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925472:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397778.925475:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397778.925478:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925494:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d191a2d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925508:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925515:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925607:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925614:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.925617:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925634:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925646:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a818432b00) 00010000:00010000:0.0:1787397778.925648:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.925652:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925658:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191a5e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925692:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925699:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925705:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925710:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.925712:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925717:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.925725:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:0.0:1787397778.926260:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.926267:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926283:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d191a73 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926302:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926309:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926316:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926322:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.926325:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926332:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926343:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a82250cc00) 00010000:00010000:0.0:1787397778.926346:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.926349:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926355:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d191a8f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926377:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926384:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926396:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926403:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.926406:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926412:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926420:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:0.0:1787397778.926423:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.926426:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926433:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d191aa4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926446:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926464:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926471:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926476:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.926479:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926507:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.926516:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a82e43e500) 00010000:00010000:0.0:1787397778.926518:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.926916:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927261:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d191ac0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927288:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927296:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927302:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927307:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.927311:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927317:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927329:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:0.0:1787397778.927331:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.927334:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927459:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191ad5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927476:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927491:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927498:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927503:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.927507:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.927514:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928020:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a817ea6b00) 00010000:00010000:0.0:1787397778.928027:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.928033:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928040:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d191af1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928211:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928219:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928237:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928242:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.928245:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928252:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928261:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:0.0:1787397778.928263:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.928266:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928272:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d191b06 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928286:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928291:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928297:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928303:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.928306:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928324:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928334:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a82e43eb00) 00010000:00010000:0.0:1787397778.928337:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.928340:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928347:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d191b22 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928870:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928882:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928889:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928896:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.928900:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928907:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.928919:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:0.0:1787397778.928921:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.929698:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.929718:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191b37 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930152:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930163:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930171:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930177:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.930180:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930188:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930202:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a818432400) 00010000:00010000:0.0:1787397778.930205:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.930208:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930213:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191b53 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930236:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930242:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930255:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930261:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.930264:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930271:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930281:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:0.0:1787397778.930284:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.930287:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930293:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d191b68 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930308:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930314:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930321:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930326:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.930329:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930345:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930367:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a817ea6e00) 00010000:00010000:0.0:1787397778.930370:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.930373:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.930379:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191b84 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.931916:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932376:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932385:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932396:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.932403:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932412:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932435:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:0.0:1787397778.932438:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.932444:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932479:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191b99 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.932515:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933436:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933457:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933464:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.933469:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933478:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933503:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a817ea6a00) 00010000:00010000:0.0:1787397778.933506:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.933510:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933516:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191bb5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933593:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933600:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933620:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933625:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.933629:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933636:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933645:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:0.0:1787397778.933647:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.933651:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933657:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d191bca lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933671:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933677:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933684:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933689:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800031000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.933691:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933708:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.933718:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a817ea6700) 00010000:00010000:0.0:1787397778.933720:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.933723:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935013:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191be6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935230:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935239:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935246:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935251:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.935255:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935263:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935279:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:0.0:1787397778.935281:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.935285:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935301:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d191bfb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935314:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935319:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935326:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935331:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.935333:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935339:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935395:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a817ea6300) 00010000:00010000:0.0:1787397778.935398:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.935402:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935407:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d191c17 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935423:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935430:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935441:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935447:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.935609:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935618:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935628:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397778.935630:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.935633:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935640:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d191c2c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935652:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935658:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935663:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935669:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.935671:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935686:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935694:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a817ea6200) 00010000:00010000:0.0:1787397778.935696:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.935699:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935705:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d191c48 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935719:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935725:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.935995:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936000:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.936004:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936010:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936020:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397778.936022:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.936558:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936577:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d191c5d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936595:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936601:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936608:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936613:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.936616:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936622:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936632:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a82ebb1100) 00010000:00010000:0.0:1787397778.936634:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.936637:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936642:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582200/0x274786fe0d191c79 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936658:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936664:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936674:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936680:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.936682:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936688:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936695:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:0.0:1787397778.936697:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.936699:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936704:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d191c8e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936715:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936720:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.936725:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937229:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.937233:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937254:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937264:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a818432500) 00010000:00010000:0.0:1787397778.937266:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.937270:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937276:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191caa lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937301:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937307:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937312:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937317:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.937319:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937324:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.937332:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:0.0:1787397778.937334:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.937336:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938161:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191cbf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938189:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938195:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938201:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938207:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938210:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938217:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938228:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a82ebb1800) 00010000:00010000:0.0:1787397778.938230:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938233:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938238:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d191cdb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938257:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938264:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938280:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938286:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938288:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938295:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938303:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:0.0:1787397778.938305:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938308:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938314:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191cf0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938324:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938329:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938335:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938340:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938342:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938370:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938379:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a82e43e100) 00010000:00010000:0.0:1787397778.938382:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938385:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938391:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191d0c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938408:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938414:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938419:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938425:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938428:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938433:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938441:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:0.0:1787397778.938443:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938446:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938469:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191d21 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938491:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938497:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938502:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938507:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938509:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938514:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938552:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a82e43ec00) 00010000:00010000:0.0:1787397778.938556:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938559:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938565:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d191d3d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938579:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938584:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938596:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938601:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938604:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938610:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938618:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:0.0:1787397778.938620:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938622:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938627:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191d52 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938642:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938647:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938653:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938658:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938661:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938675:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938684:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a818432000) 00010000:00010000:0.0:1787397778.938686:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938688:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938693:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191d6e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938711:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938717:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938721:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938737:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938741:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938746:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938755:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:0.0:1787397778.938757:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938760:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938772:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191d83 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938788:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938794:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938800:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938806:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938808:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938814:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938822:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a82e43ed00) 00010000:00010000:0.0:1787397778.938825:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938828:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938833:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191d9f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938848:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938854:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938866:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938870:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.938873:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938879:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938887:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:0.0:1787397778.938890:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.938893:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938898:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191db4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938910:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.938917:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941649:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941675:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.941682:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941709:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941732:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a818432900) 00010000:00010000:0.0:1787397778.941735:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.941741:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941749:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191dd0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941792:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941800:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941806:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941812:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.941814:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941820:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941828:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:0.0:1787397778.941830:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.941834:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941847:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191de5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941864:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941871:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941877:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941882:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.941885:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941892:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941901:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a82e43ef00) 00010000:00010000:0.0:1787397778.941904:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.941909:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.941915:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191e01 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.942879:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.942897:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.942919:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.943669:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397778.943676:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.943688:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.943708:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:0.0:1787397778.943710:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397778.943715:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397778.943722:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191e16 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.304452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787397779.738407:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968753 is committed 00000001:00080000:3.0:1787397779.738499:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968749 is committed 00000100:00100000:1.0:1787397779.983998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397779.984149:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681243904 00000100:00100000:0.0:1787397779.984162:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681243904 00000100:00100000:0.0:1787397779.984245:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1495 00000100:00100000:0.0:1787397779.984256:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:73545:x1874218681243904:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:0.0:1787397779.984346:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397779.984386:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d191a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d828a expref: 31 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984412:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397779.984418:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397779.984593:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984613:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984627:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984655:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984663:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.984670:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985231:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985245:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985252:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985259:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985266:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397779.985271:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985293:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985305:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397779.985308:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397779.985312:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985319:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191e24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397779.985337:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1174798 reply state 00000000c92da9cd transno 120259084355 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985349:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397779.985356:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a835734800) 00010000:00010000:0.0:1787397779.985359:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397779.985361:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397779.985488:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:73545:x1874218681243904:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 1231us (1503us total) trans 120259084355 rc 0/0 00000100:00100000:0.0:1787397779.985498:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1495 00000100:00100000:3.0:1787397780.064412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397780.064561:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244032 00000100:00100000:3.0:1787397780.064605:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244032 00000100:00100000:3.0:1787397780.064700:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1496 00000100:00100000:3.0:1787397780.064714:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:73548:x1874218681244032:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397780.064749:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397780.064777:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83b7 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.064864:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.064880:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.064894:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397780.064957:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397780.064962:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397780.064985:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.065014:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b7 expref: 34 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.065032:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b7 expref: 33 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.065041:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397780.065044:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397780.065048:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134400, rc 0) 00000100:00100000:3.0:1787397780.065138:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73548:x1874218681244032:12345-192.168.204.60@tcp:101:rm.0 Request processed in 426us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397780.065146:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1496 00000100:00080000:3.0:1787397780.065177:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397780.073343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397780.074495:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244160 00000100:00100000:2.0:1787397780.074516:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244160 00000100:00100000:2.0:1787397780.074626:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1497 00000100:00100000:2.0:1787397780.074641:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73548:x1874218681244160:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397780.074670:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397780.074698:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83be expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074788:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074805:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074818:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074831:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074847:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074854:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074958:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074965:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.074973:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397780.075030:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1787397780.075034:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397780.075060:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075073:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075084:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075091:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075099:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075116:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075122:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397780.075128:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075136:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075151:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397780.075154:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397780.075159:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075167:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d191e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075183:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075311:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075318:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075323:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a800030a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397780.075327:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075342:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075352:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a835734800) 00010000:00010000:2.0:1787397780.075354:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397780.075358:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075363:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d191e4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075395:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031200/0x274786fe0d191e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83be expref: 35 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075408:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83be expref: 34 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397780.075416:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff89a803ec8600) 00010000:00010000:2.0:1787397780.075418:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397780.075421:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00000100:00100000:2.0:1787397780.075517:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73548:x1874218681244160:12345-192.168.204.60@tcp:101:rm.0 Request processed in 880us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397780.075551:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1497 00000100:00100000:0.0:1787397780.093168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397780.093332:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244416 00000100:00100000:3.0:1787397780.093346:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244416 00000100:00100000:3.0:1787397780.093432:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1498 00000100:00100000:3.0:1787397780.093445:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73548:x1874218681244416:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397780.093811:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787397780.093849:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800031000/0x274786fe0d191e55 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83be expref: 34 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093871:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff89a803ec8600) 00010000:00010000:3.0:1787397780.093891:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b7 expref: 33 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093901:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397780.093905:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397780.093932:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093948:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093959:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093972:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.093994:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.094001:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.094124:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.094133:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.094141:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095010:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095023:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095033:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095041:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095048:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095054:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095362:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397780.095391:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095399:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095406:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095412:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397780.095417:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095425:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095437:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff89a70c7dca00) 00010000:00010000:3.0:1787397780.095441:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397780.095445:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095452:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e6a lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095487:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095494:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095500:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.095514:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096059:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397780.096067:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096076:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096088:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397780.096091:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397780.096094:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096101:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397780.096114:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb99f475 reply state 00000000a1f7f3d3 transno 120259084356 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096128:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397780.096135:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a835734800) 00010000:00010000:3.0:1787397780.096138:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397780.096142:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397780.096402:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73548:x1874218681244416:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2953us (3254us total) trans 120259084356 rc 0/0 00000100:00100000:3.0:1787397780.096413:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1498 00010000:00010000:0.0:1787397780.101003:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397780.101023:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397780.101037:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397780.101043:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397780.101075:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397780.101100:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff89a70c7dca00) 00010000:00010000:0.0:1787397780.101104:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397780.101110:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397780.101116:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191e71 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397780.101159:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397780.101162:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397780.101164:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397780.328422:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397781.349178:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397781.415901:0:95572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff4898e800 00000020:00000080:3.0:1787397781.415924:0:95572:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-OST0000 00000020:00000080:3.0:1787397781.415938:0:95572:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-OST0000, dev 18 00000100:00100000:1.0:1787397781.988806:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397781.988844:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701130624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397781.988949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397781.989291:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397781.989306:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397781.989342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397781.989435:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130624 00000100:00100000:1.0:1787397781.989446:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130624 00000100:00100000:1.0:1787397781.989510:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130752 00000100:00100000:1.0:1787397781.989514:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130752 00000100:00100000:1.0:1787397781.989564:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1787397781.989574:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701130624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397781.989618:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397781.989689:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701130624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397781.989697:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1787397781.989721:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1787397781.989728:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701130752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397781.989745:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397781.989775:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701130752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397781.989780:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:3.0:1787397781.989994:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701130752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397781.990047:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701130624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397781.991378:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701130880:0@lo:400:kworker.0 00000100:00100000:2.0:1787397781.991467:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397781.991697:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701130880 00000100:00100000:3.0:1787397781.991706:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701130880 00000100:00100000:3.0:1787397781.991839:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787397781.991850:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701130880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.997906:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701131136:0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.998013:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397781.998080:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701131648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.998109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397781.998133:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701132160:0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.998155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397781.998183:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397781.998190:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701131264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.998210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397781.998227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701131776:0@lo:400:kworker.0 00000100:00100000:1.0:1787397781.998262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397781.998458:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701130880:12345-0@lo:400:kworker.0 Request processed in 6607us (6987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.998471:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787397781.998547:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131136 00000100:00100000:3.0:1787397781.998556:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131136 00000100:00100000:3.0:1787397781.998624:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132160 00000100:00100000:3.0:1787397781.998628:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132160 00000100:00100000:3.0:1787397781.998648:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131264 00000100:00100000:3.0:1787397781.998651:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131264 00000100:00100000:3.0:1787397781.998665:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131776 00000100:00100000:3.0:1787397781.998746:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131776 00000100:00100000:3.0:1787397781.998768:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1787397781.998777:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701131136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.998843:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701131136:12345-0@lo:400:kworker.0 Request processed in 66us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.998850:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1787397781.998873:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1787397781.998879:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701132160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.998910:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701132160:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.998916:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1787397781.998928:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1787397781.998934:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701131264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.998957:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701131264:12345-0@lo:400:kworker.0 Request processed in 23us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.998963:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1787397781.998973:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1787397781.998979:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999005:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701131776:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.999011:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1787397781.999122:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131648 00000100:00100000:3.0:1787397781.999127:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131648 00000100:00100000:3.0:1787397781.999161:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:3.0:1787397781.999168:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999206:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701131648:12345-0@lo:400:kworker.0 Request processed in 39us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397781.999213:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:3.0:1787397781.999276:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701131264:0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701131776:0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999301:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701131136:0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999324:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701131648:0@lo:400:kworker.0 00000100:00100000:3.0:1787397781.999334:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701132160:0@lo:400:kworker.0 00000100:00080000:1.0:1787397781.999482:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397781.999489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397781.999492:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397782.000189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701131008:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.000246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397782.000287:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701131520:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.000314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397782.000336:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701132032:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.000359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397782.000383:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787397782.000390:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701131392:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.000411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397782.000439:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701131904:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.000461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397782.000496:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131520 00000100:00100000:3.0:1787397782.000503:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131520 00000100:00100000:3.0:1787397782.000564:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132032 00000100:00100000:3.0:1787397782.000567:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132032 00000100:00100000:3.0:1787397782.000591:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131904 00000100:00100000:3.0:1787397782.000594:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131904 00000100:00100000:3.0:1787397782.000616:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:3.0:1787397782.000624:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701131520:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787397782.000648:0:25908:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678e680 x1874218701131520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:223/0 lens 224/224 e 0 to 0 dl 1787397793 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397782.000830:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701130880:0@lo:400:kworker.0 00000100:00100000:2.0:1787397782.000866:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1787397782.000883:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701132032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397782.000930:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701132032:12345-0@lo:400:kworker.0 Request processed in 48us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397782.000938:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1787397782.000957:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1787397782.000964:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701131904:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397782.000975:0:26165:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678fb80 x1874218701131904/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:223/0 lens 224/224 e 0 to 0 dl 1787397793 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397782.001001:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701131904:12345-0@lo:400:kworker.0 Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397782.001007:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1787397782.001054:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701131904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397782.001066:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701132032:0@lo:400:kworker.0 00000100:00100000:1.0:1787397782.001214:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131008 00000100:00100000:1.0:1787397782.001220:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131008 00000100:00100000:1.0:1787397782.001263:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701131392 00000100:00100000:1.0:1787397782.001266:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701131392 00000100:00100000:1.0:1787397782.001294:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1787397782.001303:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701131008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397782.001343:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701131008:12345-0@lo:400:kworker.0 Request processed in 43us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397782.001350:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1787397782.001366:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1787397782.001372:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701131392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397782.001400:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701131392:12345-0@lo:400:kworker.0 Request processed in 27us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397782.001406:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:1.0:1787397782.001620:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397782.001625:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397782.001627:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397782.001630:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397782.002037:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701131392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397782.002051:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701131008:0@lo:400:kworker.0 00000100:00100000:3.0:1787397782.002180:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701131520:12345-0@lo:400:kworker.0 Request processed in 1555us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397782.002201:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:2.0:1787397782.002360:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701131520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397782.284394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397782.284457:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397782.284493:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397782.284541:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397782.284600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397782.284651:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244544 00000100:00100000:0.0:1787397782.284666:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244544 00000100:00100000:0.0:1787397782.284742:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:0.0:1787397782.284754:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681244544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397782.284871:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681244544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 119us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397782.284880:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 181 00000100:00100000:0.0:1787397782.284931:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244800 00000100:00100000:0.0:1787397782.284936:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244800 00000100:00100000:0.0:1787397782.284997:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244672 00000100:00100000:0.0:1787397782.285001:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244672 00000100:00100000:0.0:1787397782.285032:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1417 00000100:00100000:0.0:1787397782.285039:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681244800:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397782.285075:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681244800:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397782.285082:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1417 00000100:00100000:0.0:1787397782.285096:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1418 00000100:00100000:0.0:1787397782.285102:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:2404:x1874218681244672:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397782.285135:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:2404:x1874218681244672:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397782.285142:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1418 00000100:00100000:0.0:1787397782.285163:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245056 00000100:00100000:0.0:1787397782.285167:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245056 00000100:00100000:0.0:1787397782.285199:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681244928 00000100:00100000:0.0:1787397782.285201:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681244928 00000100:00100000:0.0:1787397782.285225:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2652 00000100:00100000:0.0:1787397782.285231:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681245056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397782.285261:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681245056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397782.285267:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2652 00000100:00100000:0.0:1787397782.285278:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2653 00000100:00100000:0.0:1787397782.285284:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681244928:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787397782.285297:0:26162:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828410000 x1874218681244928/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:223/0 lens 224/224 e 0 to 0 dl 1787397793 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397782.285338:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681244928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397782.285343:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2653 00000100:00080000:0.0:1787397782.285567:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397782.285573:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397782.285576:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397782.285578:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397782.375132:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397782.503444:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701132288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397782.503569:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397782.503659:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132288 00000100:00100000:1.0:1787397782.503672:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132288 00000100:00100000:1.0:1787397782.503748:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:1.0:1787397782.503761:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701132288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397782.503827:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397782.503887:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701132288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397782.503897:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:1.0:1787397782.503969:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701132288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397782.507913:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701132416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397782.508032:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397782.509300:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132416 00000100:00100000:1.0:1787397782.509318:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132416 00000100:00100000:1.0:1787397782.509409:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1787397782.509435:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701132416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397782.509481:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:1.0:1787397782.509503:0:8438:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828411180 x1874218701132416/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:223/0 lens 224/368 e 0 to 0 dl 1787397793 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397782.509615:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701132416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 183us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397782.509623:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:0.0:1787397782.509990:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701132416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397782.511906:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701132544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397782.512221:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397782.512457:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132544 00000100:00100000:1.0:1787397782.512467:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132544 00000100:00100000:1.0:1787397782.512547:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:1.0:1787397782.512559:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701132544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397782.512591:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397782.512823:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701132672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397782.512861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397782.512897:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132672 00000100:00100000:2.0:1787397782.512902:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132672 00000100:00100000:2.0:1787397782.512926:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1787397782.512933:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701132672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397782.512944:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:2.0:1787397782.512970:0:8438:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af27b80 x1874218701132672/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:223/0 lens 224/368 e 0 to 0 dl 1787397793 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397782.513006:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701132672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397782.513013:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1787397782.513079:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701132672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397782.516714:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701132544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4144us (4675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397782.516737:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1787397782.517080:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701132544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787397783.405470:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397784.422480:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397785.445334:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787397785.578869:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084356 is committed 00010000:00010000:0.0:1787397785.578973:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.578986:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.578994:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579000:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397785.579006:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579031:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579049:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a835734800) 00010000:00010000:0.0:1787397785.579052:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397785.579058:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579064:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191e2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579086:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579091:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579096:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579100:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397785.579103:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579108:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579114:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a835734800) 00010000:00010000:0.0:1787397785.579117:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397785.579120:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397785.579131:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191e63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.471242:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397786.574184:0:95869:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:2.0:1787397786.817768:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.817865:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245184 00000100:00100000:3.0:1787397786.817876:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245184 00000100:00080000:0.0:1787397786.817951:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397786.817966:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1499 00000100:00100000:3.0:1787397786.817979:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+30:73626:x1874218681245184:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.817999:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.818021:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83c5 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818097:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818111:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818124:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.818167:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397786.818171:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397786.818208:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818231:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83c5 expref: 32 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818250:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83c5 expref: 31 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.818291:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397786.818294:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397786.818298:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134000, rc 0) 00000100:00100000:3.0:1787397786.818373:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:73626:x1874218681245184:12345-192.168.204.60@tcp:101:dd.0 Request processed in 397us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.818380:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1499 00000100:00100000:0.0:1787397786.826289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.826378:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245440 00000100:00100000:3.0:1787397786.826389:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245440 00000100:00100000:3.0:1787397786.826456:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1500 00000100:00100000:3.0:1787397786.826479:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:73626:x1874218681245440:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.826500:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.826519:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e86 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83cc expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826690:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826705:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826716:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826745:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826753:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826781:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826841:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d191e9b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826849:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d191e9b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826857:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d191e9b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.826867:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:3.0:1787397786.826984:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826992:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.826998:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827004:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827009:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.827014:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827020:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827044:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.827047:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.827052:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827058:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191e8d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827073:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827089:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827094:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827100:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.827103:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827109:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827117:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a70526e500) 00010000:00010000:3.0:1787397786.827119:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.827122:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827127:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191e94 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827182:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191e86 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83cc expref: 34 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827196:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d191e9b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83cc expref: 33 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.827204:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:3.0:1787397786.827206:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.827209:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135c00, rc 0) 00000100:00100000:3.0:1787397786.827279:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73626:x1874218681245440:12345-192.168.204.60@tcp:101:dd.0 Request processed in 801us (1007us total) trans 120259084357 rc 0/0 00000100:00100000:3.0:1787397786.827287:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1500 00000100:00100000:0.0:1787397786.834712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.834761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.835091:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245568 00000100:00100000:1.0:1787397786.835101:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245568 00000100:00100000:1.0:1787397786.835177:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245824 00000100:00100000:1.0:1787397786.835181:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245824 00000100:00100000:1.0:1787397786.835208:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1501 00000100:00100000:1.0:1787397786.835217:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73626:x1874218681245568:12345-192.168.204.60@tcp:101:dd.0 00000100:00100000:3.0:1787397786.835387:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1502 00000100:00100000:3.0:1787397786.835398:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73628:x1874218681245824:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.835601:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.835624:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191ea9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83da expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835761:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835783:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835794:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835825:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835833:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835847:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835914:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191ebe lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835923:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191ebe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.835930:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191ebe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.835940:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:3.0:1787397786.836020:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836028:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836034:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836040:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.836044:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836061:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836073:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.836076:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.836081:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836088:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191eb0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836102:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836108:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836114:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836119:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.836121:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836127:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836133:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a70526e300) 00010000:00010000:3.0:1787397786.836135:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.836138:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836152:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191eb7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836198:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191ea9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83da expref: 37 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836218:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191ebe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83da expref: 36 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.836225:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397786.836227:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.836230:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134200, rc 0) 00000100:00100000:3.0:1787397786.836288:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+36:73628:x1874218681245824:12345-192.168.204.60@tcp:101:dd.0 Request processed in 892us (1526us total) trans 120259084358 rc 0/0 00000100:00100000:3.0:1787397786.836296:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1502 00010000:00010000:1.0:1787397786.840364:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.840399:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191ecc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83d3 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840440:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191ed3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840466:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191ed3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840478:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191ed3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840640:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191ecc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83d3 expref: 37 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840660:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191ed3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83d3 expref: 36 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.840669:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:1.0:1787397786.840672:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787397786.840676:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720bc00, rc 0) 00000100:00100000:1.0:1787397786.840749:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+36:73626:x1874218681245568:12345-192.168.204.60@tcp:101:dd.0 Request processed in 5531us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397786.840759:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1501 00000100:00100000:0.0:1787397786.843414:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.843505:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.843629:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681245952 00000100:00100000:1.0:1787397786.843641:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681245952 00000100:00100000:1.0:1787397786.843696:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681246208 00000100:00100000:1.0:1787397786.843700:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681246208 00000100:00100000:1.0:1787397786.843721:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1503 00000100:00100000:1.0:1787397786.843731:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:73628:x1874218681245952:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.843752:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.843773:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191eda lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83e1 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843812:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191ee1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843826:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191ee1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843839:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191ee1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843956:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d191eda lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e1 expref: 39 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843974:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191ee1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e1 expref: 38 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.843982:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:1.0:1787397786.843985:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787397786.843988:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720aa00, rc 0) 00000100:00100000:1.0:1787397786.844041:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:73628:x1874218681245952:12345-192.168.204.60@tcp:101:dd.0 Request processed in 310us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397786.844058:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1503 00000100:00100000:1.0:1787397786.844079:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1504 00000100:00100000:1.0:1787397786.844086:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:73627:x1874218681246208:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.844094:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.844104:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191ee8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83e8 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844209:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844219:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844242:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844256:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844263:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844270:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844313:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191efd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844322:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191efd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844352:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191efd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397786.844363:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787397786.844451:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844459:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844465:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844473:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844479:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.844484:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844491:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844502:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397786.844505:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.844509:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844516:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d191eef lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844557:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844570:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844576:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844582:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.844586:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844593:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844602:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a818432000) 00010000:00010000:1.0:1787397786.844604:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.844607:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844614:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d191ef6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844651:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d191ee8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e8 expref: 40 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844664:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191efd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e8 expref: 39 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.844671:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:1.0:1787397786.844674:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397786.844682:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:1.0:1787397786.844715:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:73627:x1874218681246208:12345-192.168.204.60@tcp:101:dd.0 Request processed in 629us (1209us total) trans 120259084359 rc 0/0 00000100:00100000:1.0:1787397786.844723:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1504 00000100:00100000:1.0:1787397786.845438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.845629:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681246464 00000100:00100000:0.0:1787397786.845636:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681246464 00000100:00100000:0.0:1787397786.845678:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1505 00000100:00100000:0.0:1787397786.845686:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:73626:x1874218681246464:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787397786.845721:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397786.845740:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d191e9b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83cc expref: 39 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.845756:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:0.0:1787397786.845760:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397786.845901:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.845911:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.845920:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397786.845976:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084360 00000004:00010000:0.0:1787397786.845995:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9f7ece0 reply state 000000000a2c4b64 transno 120259084361 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.846007:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.846013:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:0.0:1787397786.846015:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397786.846018:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397786.846091:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:73626:x1874218681246464:12345-192.168.204.60@tcp:36:dd.0 Request processed in 405us (655us total) trans 120259084361 rc 0/0 00000100:00100000:0.0:1787397786.846099:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1505 00000020:00080000:0.0:1787397786.846103:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397786.852661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.852965:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681246592 00000100:00100000:1.0:1787397786.852975:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681246592 00000100:00100000:0.0:1787397786.853125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.858073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.859694:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681246848 00000100:00100000:1.0:1787397786.859709:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681246848 00000100:00100000:1.0:1787397786.859795:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1506 00000100:00100000:1.0:1787397786.859805:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+42:73627:x1874218681246592:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.859832:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.859855:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191f12 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83ef expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.859892:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191f19 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.859907:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191f19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.859920:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191f19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860039:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d191f12 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83ef expref: 44 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860060:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191f19 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83ef expref: 43 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860083:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:1.0:1787397786.860086:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787397786.860090:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a200, rc 0) 00000100:00100000:1.0:1787397786.860154:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+43:73627:x1874218681246592:12345-192.168.204.60@tcp:101:dd.0 Request processed in 350us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397786.860162:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1506 00000100:00100000:1.0:1787397786.860183:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1507 00000100:00100000:1.0:1787397786.860190:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+42:73630:x1874218681246848:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.860199:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.860209:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191f20 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83f6 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860336:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860347:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860355:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860371:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860379:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860386:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860444:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191f35 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860555:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191f35 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860565:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191f35 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397786.860576:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:1.0:1787397786.860658:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860667:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860673:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860680:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860687:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.860691:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860700:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860710:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397786.860713:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.860737:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860745:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d191f27 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860758:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860765:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860771:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860777:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.860780:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860787:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860795:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a818432400) 00010000:00010000:1.0:1787397786.860799:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.860802:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860808:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d191f2e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860845:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d191f20 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83f6 expref: 45 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860870:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191f35 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83f6 expref: 44 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.860877:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:1.0:1787397786.860879:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397786.860881:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00000100:00100000:1.0:1787397786.860917:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:73630:x1874218681246848:12345-192.168.204.60@tcp:101:dd.0 Request processed in 727us (7793us total) trans 120259084362 rc 0/0 00000100:00100000:1.0:1787397786.860925:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1507 00000100:00100000:0.0:1787397786.861789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.861959:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681247104 00000100:00100000:0.0:1787397786.861966:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681247104 00000100:00100000:0.0:1787397786.862006:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1508 00000100:00100000:0.0:1787397786.862015:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:73628:x1874218681247104:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787397786.862053:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397786.862074:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134200/0x274786fe0d191ebe lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83da expref: 44 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.862088:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:0.0:1787397786.862101:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397786.862561:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681247232 00000100:00100000:1.0:1787397786.862567:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681247232 00010000:00010000:0.0:1787397786.862677:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.862692:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.862702:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397786.862749:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084363 00000004:00010000:0.0:1787397786.862775:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afaedb0f reply state 00000000032496f2 transno 120259084364 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.862788:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.862794:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:0.0:1787397786.862797:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397786.862799:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397786.862878:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+46:73628:x1874218681247104:12345-192.168.204.60@tcp:36:dd.0 Request processed in 862us (4812us total) trans 120259084364 rc 0/0 00000100:00100000:0.0:1787397786.862886:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1508 00000020:00080000:0.0:1787397786.862891:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397786.862971:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5019 00000100:00100000:1.0:1787397786.862980:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:73626:x1874218681247232:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.862991:0:26157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.863005:0:26157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d191f4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83fd expref: -99 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397786.863026:0:26157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:1.0:1787397786.863042:0:26157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1787397786.863046:0:26157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397786.863053:0:26157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d191f4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 6 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.863068:0:26157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d191f4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 6 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.863093:0:26157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23200, rc 0) 00010000:00000080:1.0:1787397786.863101:0:26157:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bb8380 x1874218681247232/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397786.863126:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:73626:x1874218681247232:12345-192.168.204.60@tcp:101:dd.0 Request processed in 148us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397786.863131:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5019 00000100:00080000:3.0:1787397786.864004:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397786.864627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.864745:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681247488 00000100:00100000:1.0:1787397786.864753:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681247488 00000100:00100000:1.0:1787397786.864804:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1509 00000100:00100000:1.0:1787397786.864813:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+46:73627:x1874218681247488:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:1.0:1787397786.864862:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397786.864886:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d191efd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e8 expref: 46 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.864902:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:1.0:1787397786.864907:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397786.865060:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.865073:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.865083:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397786.865125:0:66178:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084365 00000004:00010000:1.0:1787397786.865160:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000349df975 reply state 000000006b672e55 transno 120259084366 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.865171:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.865178:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:1.0:1787397786.865180:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397786.865182:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397786.865502:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+48:73627:x1874218681247488:12345-192.168.204.60@tcp:36:dd.0 Request processed in 689us (878us total) trans 120259084366 rc 0/0 00000100:00100000:1.0:1787397786.865511:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1509 00000020:00080000:1.0:1787397786.865516:0:66178:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787397786.873245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.873569:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681247616 00000100:00100000:3.0:1787397786.873579:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681247616 00000100:00100000:3.0:1787397786.873642:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1510 00000100:00100000:3.0:1787397786.873652:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+48:73630:x1874218681247616:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.873674:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.873696:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f58 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8404 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873731:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191f5f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873763:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191f5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873775:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191f5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873882:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f58 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8404 expref: 50 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873905:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191f5f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8404 expref: 49 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.873913:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:3.0:1787397786.873917:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787397786.873920:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135800, rc 0) 00000100:00100000:3.0:1787397786.873978:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+49:73630:x1874218681247616:12345-192.168.204.60@tcp:101:dd.0 Request processed in 327us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.873985:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1510 00000100:00100000:1.0:1787397786.874173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.874287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.874313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.874342:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681247872 00000100:00100000:1.0:1787397786.874347:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681247872 00000100:00100000:1.0:1787397786.874375:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1511 00000100:00100000:1.0:1787397786.874381:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+49:73629:x1874218681247872:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.874391:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.874403:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191f66 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d840b expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874547:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874558:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874566:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874589:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874596:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874603:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874658:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191f7b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874666:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191f7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874673:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191f7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397786.874682:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00010000:00010000:1.0:1787397786.874760:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874768:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874774:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874780:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874785:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.874796:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874803:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874813:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397786.874816:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.874819:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874825:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d191f6d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874836:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874841:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874846:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874851:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.874853:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874859:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874866:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a818432000) 00010000:00010000:1.0:1787397786.874868:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.874878:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874884:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d191f74 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874923:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d191f66 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d840b expref: 52 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874935:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191f7b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d840b expref: 51 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.874942:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:1.0:1787397786.874944:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397786.874947:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22800, rc 0) 00000100:00100000:1.0:1787397786.874985:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:73629:x1874218681247872:12345-192.168.204.60@tcp:101:dd.0 Request processed in 603us (813us total) trans 120259084367 rc 0/0 00000100:00100000:1.0:1787397786.874992:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1511 00000100:00100000:2.0:1787397786.875138:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248128 00000100:00100000:2.0:1787397786.875143:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248128 00000100:00100000:2.0:1787397786.875187:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5020 00000100:00100000:2.0:1787397786.875194:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:73628:x1874218681248128:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397786.875203:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397786.875215:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d191f89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8412 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397786.875236:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:2.0:1787397786.875252:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:2.0:1787397786.875257:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397786.875265:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d191f89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.875276:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d191f89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.875299:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031200, rc 0) 00010000:00000080:2.0:1787397786.875306:0:8437:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dd180 x1874218681248128/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.875369:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:73628:x1874218681248128:12345-192.168.204.60@tcp:101:dd.0 Request processed in 174us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397786.875376:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5020 00000100:00100000:3.0:1787397786.875723:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248000 00000100:00100000:3.0:1787397786.875728:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248000 00002000:00010000:3.0:1787397786.875752:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:3.0:1787397786.875757:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178ddf80 with x1874218681248000 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397786.875767:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178ddf80. 00000100:00100000:3.0:1787397786.875886:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 554 00000100:00100000:3.0:1787397786.875894:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681248000:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:3.0:1787397786.876132:0:24833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397786.876136:0:24833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb mtime from disk: 1787397775 -> 1787397785 00002000:00010000:3.0:1787397786.876144:0:24833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397786.876146:0:24833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb ctime from disk: 1787397775 -> 1787397785 00002000:00010000:3.0:1787397786.876149:0:24833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397786.876157:0:24833:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178ddf80 x1874218681248000/t4294968754(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397786.876202:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681248000:12345-192.168.204.60@tcp:10:dd.0 Request processed in 309us (1915us total) trans 4294968754 rc 0/0 00000100:00100000:3.0:1787397786.876209:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 554 00002000:00010000:3.0:1787397786.876213:0:24833:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:3.0:1787397786.876216:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178ddf80 with x1874218681248000 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397786.876221:0:24833:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178ddf80. 00000100:00100000:2.0:1787397786.882187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.882269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.882304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.882461:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248512 00000100:00100000:3.0:1787397786.882473:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248512 00000100:00100000:3.0:1787397786.882555:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1512 00000100:00100000:3.0:1787397786.882567:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:73630:x1874218681248512:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:3.0:1787397786.882628:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397786.882660:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d191f35 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83f6 expref: 51 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.882681:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:3.0:1787397786.882686:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397786.882854:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.882868:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.882877:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397786.883034:0:77740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084368 00000004:00010000:3.0:1787397786.883060:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2674527 reply state 00000000e4bd085f transno 120259084369 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.883073:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.883079:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:3.0:1787397786.883082:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397786.883084:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397786.883172:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+53:73630:x1874218681248512:12345-192.168.204.60@tcp:36:dd.0 Request processed in 607us (900us total) trans 120259084369 rc 0/0 00000100:00100000:3.0:1787397786.883180:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1512 00000020:00080000:3.0:1787397786.883186:0:77740:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397786.883270:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248640 00000100:00100000:0.0:1787397786.883276:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248640 00002000:00010000:0.0:1787397786.883301:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:0.0:1787397786.883306:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522300 with x1874218681248640 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397786.883314:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522300. 00000100:00100000:0.0:1787397786.883352:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 555 00000100:00100000:0.0:1787397786.883368:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2402:x1874218681248640:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:0.0:1787397786.883479:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787397786.883482:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb mtime from disk: 1787397775 -> 1787397785 00002000:00010000:0.0:1787397786.883485:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:0.0:1787397786.883488:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb ctime from disk: 1787397775 -> 1787397785 00002000:00010000:0.0:1787397786.883490:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1787397786.883499:0:24831:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b522300 x1874218681248640/t4294968755(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397786.883561:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681248640:12345-192.168.204.60@tcp:10:dd.0 Request processed in 194us (1255us total) trans 4294968755 rc 0/0 00000100:00100000:0.0:1787397786.883569:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 555 00002000:00010000:0.0:1787397786.883573:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:0.0:1787397786.883575:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522300 with x1874218681248640 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397786.883580:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522300. 00000100:00100000:0.0:1787397786.883679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.883741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.883792:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248768 00000100:00100000:0.0:1787397786.883796:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248768 00000100:00100000:0.0:1787397786.883824:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681249024 00000100:00100000:0.0:1787397786.883827:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681249024 00000100:00100000:0.0:1787397786.883847:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1513 00000100:00100000:0.0:1787397786.883854:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+54:73629:x1874218681248768:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.883868:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.883882:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191f97 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8420 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.883925:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191f9e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.883935:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191f9e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.883944:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191f9e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884027:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d191f97 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8420 expref: 56 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884044:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191f9e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8420 expref: 55 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884052:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:0.0:1787397786.884055:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.884058:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab800, rc 0) 00000100:00100000:0.0:1787397786.884085:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+55:73629:x1874218681248768:12345-192.168.204.60@tcp:101:dd.0 Request processed in 232us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.884092:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1513 00000100:00100000:0.0:1787397786.884105:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1514 00000100:00100000:0.0:1787397786.884112:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+54:73631:x1874218681249024:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.884120:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.884130:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191fa5 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8427 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884241:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884250:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884259:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884273:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884281:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884288:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884341:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191fba lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884350:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191fba lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884357:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191fba lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397786.884366:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787397786.884425:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884432:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884446:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884451:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.884455:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884462:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884471:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397786.884474:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.884477:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884482:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d191fac lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884492:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884497:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884502:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884506:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.884509:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884553:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884564:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a835734800) 00010000:00010000:0.0:1787397786.884566:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.884569:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884573:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d191fb3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884611:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d191fa5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8427 expref: 57 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884624:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191fba lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8427 expref: 56 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.884630:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:0.0:1787397786.884632:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397786.884635:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582a00, rc 0) 00000100:00100000:0.0:1787397786.884668:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+56:73631:x1874218681249024:12345-192.168.204.60@tcp:101:dd.0 Request processed in 555us (926us total) trans 120259084370 rc 0/0 00000100:00100000:0.0:1787397786.884675:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1514 00000100:00100000:0.0:1787397786.889229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.889266:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.889334:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681249536 00000100:00100000:3.0:1787397786.889343:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681249536 00000100:00100000:2.0:1787397786.889388:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681249280 00000100:00100000:2.0:1787397786.889393:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681249280 00000100:00100000:3.0:1787397786.889406:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1515 00000100:00100000:3.0:1787397786.889415:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:73629:x1874218681249536:12345-192.168.204.60@tcp:36:dd.0 00000100:00100000:2.0:1787397786.889436:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 262 00000100:00100000:2.0:1787397786.889443:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:73626:x1874218681249280:12345-192.168.204.60@tcp:35:dd.0 00010000:00010000:3.0:1787397786.889471:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397786.889500:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d191f7b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d840b expref: 57 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.889518:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397786.889539:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397786.889647:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397786.889649:0:66179:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084372 00010000:00010000:3.0:1787397786.889661:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.889685:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397786.889745:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:73626:x1874218681249280:12345-192.168.204.60@tcp:35:dd.0 Request processed in 300us (525us total) trans 120259084373 rc 0/0 00000100:00100000:2.0:1787397786.889753:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 262 00000020:00080000:2.0:1787397786.889758:0:66179:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787397786.889912:0:77740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084371 00000004:00010000:3.0:1787397786.889938:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e220f279 reply state 00000000dbafa136 transno 120259084374 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.889951:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.889958:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397786.889961:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397786.890016:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397786.890071:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:73629:x1874218681249536:12345-192.168.204.60@tcp:36:dd.0 Request processed in 657us (803us total) trans 120259084374 rc 0/0 00000100:00100000:3.0:1787397786.890078:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1515 00000020:00080000:3.0:1787397786.890082:0:77740:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787397786.890120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.890190:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681249792 00000100:00100000:3.0:1787397786.890194:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681249792 00000100:00100000:3.0:1787397786.890219:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 263 00000100:00100000:3.0:1787397786.890226:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:73628:x1874218681249792:12345-192.168.204.60@tcp:35:dd.0 00000001:00080000:3.0:1787397786.890432:0:80567:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084375 00000100:00100000:3.0:1787397786.890509:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+62:73628:x1874218681249792:12345-192.168.204.60@tcp:35:dd.0 Request processed in 282us (387us total) trans 120259084376 rc 0/0 00000100:00100000:3.0:1787397786.890516:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 263 00000020:00080000:3.0:1787397786.890519:0:80567:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787397786.890573:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.894101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.894141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.894166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.894714:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248256 00000100:00100000:1.0:1787397786.894726:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248256 00000100:00100000:3.0:1787397786.894821:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250176 00000100:00100000:3.0:1787397786.894826:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250176 00000100:00100000:3.0:1787397786.894874:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250432 00000100:00100000:3.0:1787397786.894878:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250432 00000100:00100000:3.0:1787397786.894902:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1516 00000100:00100000:3.0:1787397786.894911:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:73631:x1874218681250176:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.894938:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.894958:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191fcf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d843c expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.894999:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191fd6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895013:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191fd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895026:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191fd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895147:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d191fcf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d843c expref: 65 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895167:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191fd6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d843c expref: 64 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895177:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:3.0:1787397786.895180:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787397786.895184:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a134600, rc 0) 00000100:00100000:3.0:1787397786.895242:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+64:73631:x1874218681250176:12345-192.168.204.60@tcp:101:dd.0 Request processed in 331us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.895260:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1516 00000100:00100000:3.0:1787397786.895280:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1517 00000100:00100000:3.0:1787397786.895287:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:73637:x1874218681250432:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.895296:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.895306:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191fdd lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8443 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895425:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895435:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.895443:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397786.896104:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681249920 00000100:00100000:0.0:1787397786.896112:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681249920 00000100:00100000:0.0:1787397786.896156:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5021 00000100:00100000:0.0:1787397786.896173:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:73627:x1874218681248256:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.896185:0:26158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.896200:0:26158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004413a727/0x274786fe0d191feb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8419 expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397786.896222:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:0.0:1787397786.896444:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397786.896449:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397786.896458:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004413a727/0x274786fe0d191feb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 11 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896474:0:26158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004413a727/0x274786fe0d191feb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 11 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896486:0:26158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582200, rc 0) 00010000:00000080:0.0:1787397786.896493:0:26158:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af24700 x1874218681248256/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397786.896558:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73627:x1874218681248256:12345-192.168.204.60@tcp:101:dd.0 Request processed in 386us (14382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.896565:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5021 00000100:00100000:0.0:1787397786.896584:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5022 00000100:00100000:0.0:1787397786.896590:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:73630:x1874218681249920:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.896597:0:26158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.896607:0:26158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d191ff2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d842e expref: -99 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.896627:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397786.896633:0:26158:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397786.896645:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896649:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397786.896657:0:26158:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397786.896662:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896664:0:26158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d191ff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 11 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896685:0:26158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d191ff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 11 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.896694:0:26158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582600, rc 0) 00010000:00000080:0.0:1787397786.896699:0:26158:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678ce00 x1874218681249920/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397786.896722:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73630:x1874218681249920:12345-192.168.204.60@tcp:101:dd.0 Request processed in 133us (6150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.896728:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5022 00010000:00010000:3.0:1787397786.896744:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d192000 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.896755:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d192000 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.896775:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d192000 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.896786:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00010000:00010000:3.0:1787397786.897070:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897078:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897084:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897090:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897095:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.897100:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897108:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897119:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.897121:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.897125:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897130:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d191fe4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897143:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897155:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897161:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897166:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.897169:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897175:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897183:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a70526e300) 00010000:00010000:3.0:1787397786.897185:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.897187:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897192:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d191ff9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897236:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d191fdd lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8443 expref: 66 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897249:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d192000 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8443 expref: 65 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.897256:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397786.897258:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.897267:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135e00, rc 0) 00000100:00100000:3.0:1787397786.897293:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:73637:x1874218681250432:12345-192.168.204.60@tcp:101:dd.0 Request processed in 2005us (3151us total) trans 120259084377 rc 0/0 00000100:00100000:3.0:1787397786.897708:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1517 00000100:00100000:0.0:1787397786.899070:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250048 00000100:00100000:0.0:1787397786.899082:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250048 00000100:00100000:0.0:1787397786.899279:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5023 00000100:00100000:0.0:1787397786.899291:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:73629:x1874218681250048:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.899319:0:26165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.899349:0:26165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d19200e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8435 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397786.899374:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:0.0:1787397786.899406:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397786.899410:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397786.899420:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d19200e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 12 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.899437:0:26165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d19200e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 12 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.899450:0:26165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582400, rc 0) 00010000:00000080:0.0:1787397786.899667:0:26165:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b520700 x1874218681250048/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397786.899752:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:73629:x1874218681250048:12345-192.168.204.60@tcp:101:dd.0 Request processed in 464us (5584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.899760:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5023 00000100:00100000:0.0:1787397786.905972:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.906077:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250688 00000100:00100000:3.0:1787397786.906087:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250688 00000100:00100000:3.0:1787397786.906141:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1518 00000100:00100000:3.0:1787397786.906150:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:73631:x1874218681250688:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:3.0:1787397786.906205:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397786.906230:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d191fba lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8427 expref: 65 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.906250:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:3.0:1787397786.906255:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397786.906428:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.906712:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.906722:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397786.906764:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084378 00000004:00010000:3.0:1787397786.906784:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058a60b10 reply state 0000000066a17014 transno 120259084379 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.906795:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.906819:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:3.0:1787397786.906822:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397786.906824:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397786.920685:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+67:73631:x1874218681250688:12345-192.168.204.60@tcp:36:dd.0 Request processed in 14523us (14711us total) trans 120259084379 rc 0/0 00000100:00100000:3.0:1787397786.920701:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1518 00000020:00080000:3.0:1787397786.920710:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787397786.923824:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.923873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.923907:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250944 00000100:00100000:2.0:1787397786.923916:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250944 00002000:00010000:2.0:1787397786.923971:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.923976:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522680 with x1874218681250944 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.923990:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522680. 00000100:00100000:2.0:1787397786.924012:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250816 00000100:00100000:2.0:1787397786.924016:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250816 00002000:00010000:2.0:1787397786.924029:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.924032:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b520380 with x1874218681250816 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.924037:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b520380. 00000100:00100000:2.0:1787397786.924055:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 556 00000100:00100000:2.0:1787397786.924064:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681250944:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.924214:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.924217:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.924220:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.924222:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.924224:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.924233:0:8441:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b522680 x1874218681250944/t4294968756(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.924288:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2404:x1874218681250944:12345-192.168.204.60@tcp:10:dd.0 Request processed in 224us (473us total) trans 4294968756 rc 0/0 00000100:00100000:2.0:1787397786.924296:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 556 00002000:00010000:2.0:1787397786.924300:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.924302:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522680 with x1874218681250944 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.924306:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522680. 00000100:00100000:2.0:1787397786.924335:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 557 00000100:00100000:2.0:1787397786.924344:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2403:x1874218681250816:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.924410:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.924413:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb mtime from disk: 1787397775 -> 1787397785 00002000:00010000:2.0:1787397786.924415:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.924417:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb ctime from disk: 1787397775 -> 1787397785 00002000:00010000:2.0:1787397786.924419:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.924424:0:8441:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b520380 x1874218681250816/t4294968757(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.924728:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681250816:12345-192.168.204.60@tcp:10:dd.0 Request processed in 108us (578us total) trans 4294968757 rc 0/0 00000100:00100000:2.0:1787397786.924738:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 557 00002000:00010000:2.0:1787397786.924742:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.924745:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b520380 with x1874218681250816 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.924750:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b520380. 00000100:00100000:2.0:1787397786.924803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.924899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.924941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.925196:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251328 00000100:00100000:3.0:1787397786.925202:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251328 00000100:00100000:3.0:1787397786.925236:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251456 00000100:00100000:3.0:1787397786.925240:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251456 00000100:00100000:3.0:1787397786.925260:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1519 00000100:00100000:3.0:1787397786.925268:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+68:73632:x1874218681251328:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.925284:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.925302:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d19201c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d844a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925442:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925469:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925481:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925497:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925503:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925545:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925612:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d192031 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925620:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d192031 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925628:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d192031 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.925638:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00010000:00010000:3.0:1787397786.925704:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925712:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925718:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925728:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925734:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.925739:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925747:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925777:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.925780:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.925786:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925793:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134400/0x274786fe0d192023 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925808:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925815:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925822:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925828:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.925831:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925837:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925856:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a70526e300) 00010000:00010000:3.0:1787397786.925860:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.925863:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925870:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135a00/0x274786fe0d19202a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397786.925906:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1520 00000100:00100000:0.0:1787397786.925918:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+70:73637:x1874218681251456:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.925928:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.925930:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135200/0x274786fe0d19201c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d844a expref: 71 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.925940:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d19203f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8451 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925947:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d192031 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d844a expref: 70 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.925958:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397786.925961:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.925964:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70a135000, rc 0) 00010000:00010000:0.0:1787397786.925968:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192046 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.925979:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192046 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.925998:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192046 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397786.926010:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+71:73632:x1874218681251328:12345-192.168.204.60@tcp:101:dd.0 Request processed in 742us (1110us total) trans 120259084380 rc 0/0 00000100:00100000:3.0:1787397786.926019:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1519 00010000:00010000:0.0:1787397786.926070:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d19203f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8451 expref: 71 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.926086:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192046 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8451 expref: 70 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.926093:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:0.0:1787397786.926096:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.926098:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583200, rc 0) 00000100:00100000:0.0:1787397786.926143:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+70:73637:x1874218681251456:12345-192.168.204.60@tcp:101:dd.0 Request processed in 227us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.926150:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1520 00000100:00100000:1.0:1787397786.927144:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251072 00000100:00100000:1.0:1787397786.927157:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251072 00002000:00010000:1.0:1787397786.927189:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:1.0:1787397786.927193:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522a00 with x1874218681251072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397786.927202:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522a00. 00000100:00100000:1.0:1787397786.927272:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 558 00000100:00100000:1.0:1787397786.927282:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681251072:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:1.0:1787397786.927427:0:24830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787397786.927431:0:24830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397786.927445:0:24830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:1.0:1787397786.927447:0:24830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397786.927450:0:24830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1787397786.930600:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b522a00 x1874218681251072/t4294968758(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397786.930689:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2403:x1874218681251072:12345-192.168.204.60@tcp:10:dd.0 Request processed in 3407us (5883us total) trans 4294968758 rc 0/0 00000100:00100000:1.0:1787397786.930701:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 558 00002000:00010000:1.0:1787397786.930706:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:1.0:1787397786.930710:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a83b522a00 with x1874218681251072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397786.930720:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a83b522a00. 00000100:00100000:3.0:1787397786.930997:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.931112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.931136:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251712 00000100:00100000:3.0:1787397786.931143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.931146:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251712 00000100:00100000:0.0:1787397786.931198:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251968 00000100:00100000:0.0:1787397786.931202:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251968 00000100:00100000:0.0:1787397786.931222:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1521 00000100:00100000:0.0:1787397786.931230:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+71:73632:x1874218681251712:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.931253:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.931272:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d19204d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d845f expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931303:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192054 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931348:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192054 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931360:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192054 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931475:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d19204d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d845f expref: 73 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931494:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192054 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d845f expref: 72 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931503:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:0.0:1787397786.931505:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.931509:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583c00, rc 0) 00000100:00100000:0.0:1787397786.931556:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+72:73632:x1874218681251712:12345-192.168.204.60@tcp:101:dd.0 Request processed in 327us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.931563:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1521 00000100:00100000:0.0:1787397786.931578:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1522 00000100:00100000:0.0:1787397786.931584:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+71:73633:x1874218681251968:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.931592:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.931600:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19205b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8466 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931701:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931720:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931728:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931743:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931751:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931757:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931801:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192070 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931809:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192070 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931816:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192070 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397786.931825:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00010000:00010000:0.0:1787397786.931904:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931912:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931918:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931930:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931937:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.931941:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931949:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931959:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397786.931962:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.931965:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931972:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192062 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931982:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931988:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931994:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.931999:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.932002:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932018:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932027:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a835734800) 00010000:00010000:0.0:1787397786.932029:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.932032:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932037:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192069 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932071:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19205b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8466 expref: 74 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932083:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192070 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8466 expref: 73 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.932089:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:0.0:1787397786.932092:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397786.932094:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582e00, rc 0) 00000100:00100000:0.0:1787397786.932127:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+73:73633:x1874218681251968:12345-192.168.204.60@tcp:101:dd.0 Request processed in 542us (983us total) trans 120259084381 rc 0/0 00000100:00100000:0.0:1787397786.932133:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1522 00000100:00100000:2.0:1787397786.933617:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251584 00000100:00100000:2.0:1787397786.933629:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251584 00000100:00100000:2.0:1787397786.933721:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5024 00000100:00100000:2.0:1787397786.933732:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:73631:x1874218681251584:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397786.933748:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397786.933766:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d19207e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8458 expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397786.933793:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:2.0:1787397786.933823:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:2.0:1787397786.933827:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397786.933835:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d19207e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 16 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.933860:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d19207e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 16 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.933872:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800031000, rc 0) 00010000:00000080:2.0:1787397786.933879:0:26160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83678f800 x1874218681251584/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.933932:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:73631:x1874218681251584:12345-192.168.204.60@tcp:101:dd.0 Request processed in 202us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397786.933940:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5024 00000100:00100000:0.0:1787397786.934354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.936343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.936387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.937820:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681252480 00000100:00100000:3.0:1787397786.937834:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681252480 00000100:00100000:3.0:1787397786.937911:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1523 00000100:00100000:3.0:1787397786.937921:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+73:73637:x1874218681252480:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:3.0:1787397786.938007:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397786.938037:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135e00/0x274786fe0d192000 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8443 expref: 73 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.938058:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397786.938063:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397786.938254:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.938276:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.938287:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397786.938347:0:66178:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084382 00000004:00010000:3.0:1787397786.939834:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000226ab0a9 reply state 00000000010cfc4a transno 120259084383 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.939866:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.939875:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:3.0:1787397786.939878:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397786.939881:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397786.940030:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+75:73637:x1874218681252480:12345-192.168.204.60@tcp:36:dd.0 Request processed in 2107us (3703us total) trans 120259084383 rc 0/0 00000100:00100000:3.0:1787397786.940040:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1523 00000020:00080000:3.0:1787397786.940046:0:66178:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787397786.940183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.940592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.940647:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681252864 00000100:00100000:2.0:1787397786.940656:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681252864 00000100:00100000:2.0:1787397786.940700:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1524 00000100:00100000:2.0:1787397786.940709:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+75:73633:x1874218681252864:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397786.940727:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397786.940748:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d19208c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d846d expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940780:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d192093 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940794:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d192093 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940820:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d192093 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940929:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d19208c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d846d expref: 77 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940953:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d192093 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d846d expref: 76 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.940962:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:2.0:1787397786.940964:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397786.940967:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a800030000, rc 0) 00000100:00100000:2.0:1787397786.941000:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+76:73633:x1874218681252864:12345-192.168.204.60@tcp:101:dd.0 Request processed in 292us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397786.941007:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1524 00000100:00100000:3.0:1787397786.942206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.942236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.942262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.942369:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253376 00000100:00100000:3.0:1787397786.942377:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253376 00000100:00100000:3.0:1787397786.942413:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253760 00000100:00100000:3.0:1787397786.942417:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253760 00000100:00100000:3.0:1787397786.942436:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1525 00000100:00100000:3.0:1787397786.942471:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+77:73635:x1874218681253376:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.942489:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.942506:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d19209a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8474 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942653:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942667:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942677:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942691:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942698:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942705:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942759:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1920af lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942768:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1920af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942776:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1920af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.942795:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00010000:00010000:3.0:1787397786.942888:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942896:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942902:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942909:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942915:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.942920:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942927:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942938:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.942941:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.942945:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942951:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1920a1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942967:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942972:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942986:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.942992:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.942994:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943001:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943008:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a70526e500) 00010000:00010000:3.0:1787397786.943010:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.943013:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943019:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1920a8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943065:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135c00/0x274786fe0d19209a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8474 expref: 80 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943080:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1920af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8474 expref: 79 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943087:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:3.0:1787397786.943089:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.943092:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:3.0:1787397786.943145:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+79:73635:x1874218681253376:12345-192.168.204.60@tcp:101:dd.0 Request processed in 690us (943us total) trans 120259084384 rc 0/0 00000100:00100000:3.0:1787397786.943162:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1525 00000100:00100000:3.0:1787397786.943345:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1526 00000100:00100000:3.0:1787397786.943354:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+78:73632:x1874218681253760:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:3.0:1787397786.943384:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397786.943398:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135000/0x274786fe0d192031 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d844a expref: 78 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943410:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397786.943413:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397786.943550:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943560:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943567:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397786.943618:0:67264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084385 00000004:00010000:3.0:1787397786.943639:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001bdc788e reply state 000000006a47472a transno 120259084386 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943651:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.943657:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397786.943659:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397786.943662:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397786.943709:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+80:73632:x1874218681253760:12345-192.168.204.60@tcp:36:dd.0 Request processed in 356us (1445us total) trans 120259084386 rc 0/0 00000100:00100000:3.0:1787397786.943722:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1526 00000020:00080000:3.0:1787397786.943726:0:67264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787397786.943781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.943877:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253888 00000100:00100000:3.0:1787397786.943882:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253888 00000100:00100000:3.0:1787397786.943914:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5025 00000100:00100000:3.0:1787397786.943921:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:73637:x1874218681253888:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.943930:0:25908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787397786.944495:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253504 00000100:00100000:2.0:1787397786.944502:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253504 00002000:00010000:2.0:1787397786.944540:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.944545:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a703509c00 with x1874218681253504 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.944554:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a703509c00. 00000100:00100000:2.0:1787397786.944576:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 559 00000100:00100000:2.0:1787397786.944584:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2405:x1874218681253504:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.944690:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.944694:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.944696:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.944698:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.944709:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.944719:0:8440:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a703509c00 x1874218681253504/t4294968759(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.944761:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:2405:x1874218681253504:12345-192.168.204.60@tcp:10:dd.0 Request processed in 178us (2524us total) trans 4294968759 rc 0/0 00000100:00100000:2.0:1787397786.944768:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 559 00002000:00010000:2.0:1787397786.944772:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.944774:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a703509c00 with x1874218681253504 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.944779:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a703509c00. 00000100:00100000:1.0:1787397786.944927:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681252224 00000100:00100000:1.0:1787397786.944932:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681252224 00000100:00100000:1.0:1787397786.944956:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681252736 00000100:00100000:1.0:1787397786.944959:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681252736 00000100:00100000:1.0:1787397786.944970:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253120 00000100:00100000:1.0:1787397786.944973:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253120 00000100:00100000:1.0:1787397786.944986:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 264 00000100:00100000:1.0:1787397786.944992:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+82:73630:x1874218681252224:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:1.0:1787397786.945169:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+83:73630:x1874218681252224:12345-192.168.204.60@tcp:35:dd.0 Request processed in 175us (10816us total) trans 120259084387 rc 0/0 00000100:00100000:1.0:1787397786.945175:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 264 00000100:00100000:1.0:1787397786.945192:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 265 00000100:00100000:1.0:1787397786.945198:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+82:73627:x1874218681252736:12345-192.168.204.60@tcp:35:dd.0 00000001:00080000:1.0:1787397786.945283:0:80567:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084388 00000100:00100000:1.0:1787397786.945343:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+84:73627:x1874218681252736:12345-192.168.204.60@tcp:35:dd.0 Request processed in 144us (8954us total) trans 120259084389 rc 0/0 00000100:00100000:1.0:1787397786.945357:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 265 00000020:00080000:1.0:1787397786.945361:0:80567:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397786.945373:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 266 00000100:00100000:1.0:1787397786.945380:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+83:73629:x1874218681253120:12345-192.168.204.60@tcp:35:dd.0 00010000:00010000:3.0:1787397786.945661:0:25908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f40df3f2/0x274786fe0d1920c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d847b expref: -99 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397786.945685:0:25908:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397786.945703:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1787397786.945708:0:25908:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397786.945715:0:25908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f40df3f2/0x274786fe0d1920c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 18 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.945731:0:25908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f40df3f2/0x274786fe0d1920c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 18 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.945741:0:25908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74000, rc 0) 00010000:00000080:3.0:1787397786.945747:0:25908:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350bb80 x1874218681253888/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397786.945782:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:73637:x1874218681253888:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1862us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.945798:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5025 00000100:00100000:1.0:1787397786.945929:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+84:73629:x1874218681253120:12345-192.168.204.60@tcp:35:dd.0 Request processed in 549us (5338us total) trans 120259084390 rc 0/0 00000100:00100000:1.0:1787397786.945936:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 266 00000100:00100000:3.0:1787397786.946769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.946808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.946860:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681254144 00000100:00100000:0.0:1787397786.946867:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681254144 00000100:00100000:0.0:1787397786.946917:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681254272 00000100:00100000:0.0:1787397786.946921:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681254272 00000100:00100000:0.0:1787397786.946950:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1527 00000100:00100000:0.0:1787397786.946959:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+85:73633:x1874218681254144:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787397786.947004:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397786.947033:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192070 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8466 expref: 85 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947052:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:0.0:1787397786.947057:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397786.947183:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947195:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947204:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397786.947238:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084391 00000004:00010000:0.0:1787397786.947260:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009150f234 reply state 0000000021900c4e transno 120259084392 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947271:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947277:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:0.0:1787397786.947280:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397786.947282:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397786.947353:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+87:73633:x1874218681254144:12345-192.168.204.60@tcp:36:dd.0 Request processed in 394us (586us total) trans 120259084392 rc 0/0 00000100:00100000:0.0:1787397786.947370:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1527 00000020:00080000:0.0:1787397786.947375:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397786.947391:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1528 00000100:00100000:0.0:1787397786.947399:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+86:73635:x1874218681254272:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.947408:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.947418:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1920d2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8482 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947439:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1920d9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947448:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1920d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947467:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1920d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947580:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d1920d2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8482 expref: 88 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947594:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1920d9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8482 expref: 87 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.947600:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397786.947603:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.947605:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:0.0:1787397786.947636:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+87:73635:x1874218681254272:12345-192.168.204.60@tcp:101:dd.0 Request processed in 239us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.947651:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1528 00000100:00100000:0.0:1787397786.951704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.951742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.951784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.951881:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681254400 00000100:00100000:1.0:1787397786.951895:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681254400 00000100:00100000:1.0:1787397786.951959:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5026 00000100:00100000:3.0:1787397786.951962:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681254912 00000100:00100000:3.0:1787397786.951968:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681254912 00000100:00100000:1.0:1787397786.951972:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:73632:x1874218681254400:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.951992:0:15073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787397786.952008:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1529 00010000:00010000:1.0:1787397786.952016:0:15073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d1920e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8489 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397786.952018:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+87:73634:x1874218681254912:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.952035:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1787397786.952047:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397786.952052:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1920e7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8490 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.952073:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1787397786.952079:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397786.952088:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d1920e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 19 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.952103:0:15073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d1920e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 19 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.952118:0:15073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22400, rc 0) 00010000:00000080:1.0:1787397786.952140:0:15073:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd6300 x1874218681254400/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787397786.952194:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397786.952203:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:73632:x1874218681254400:12345-192.168.204.60@tcp:101:dd.0 Request processed in 233us (458us total) trans 0 rc 0/0 00010000:00010000:3.0:1787397786.952210:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397786.952214:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5026 00010000:00010000:3.0:1787397786.952225:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952606:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952616:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952624:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952679:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1920fc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952693:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1920fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952701:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1920fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397786.952713:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787397786.952799:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952807:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952813:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952819:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952825:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.952829:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952837:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952848:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397786.952852:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.952856:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952862:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1920ee lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952884:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952890:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952897:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952903:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397786.952906:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952911:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952919:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a70526e300) 00010000:00010000:3.0:1787397786.952922:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397786.952924:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.952929:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d1920f5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397786.953145:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681254784 00000100:00100000:2.0:1787397786.953152:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681254784 00000100:00100000:2.0:1787397786.953204:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 267 00000100:00100000:2.0:1787397786.953213:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+90:73631:x1874218681254784:12345-192.168.204.60@tcp:35:dd.0 00010000:00010000:3.0:1787397786.953355:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d1920e7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8490 expref: 92 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.953372:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1920fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8490 expref: 91 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.953391:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:3.0:1787397786.953394:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397786.953397:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74200, rc 0) 00000100:00100000:2.0:1787397786.953425:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+91:73631:x1874218681254784:12345-192.168.204.60@tcp:35:dd.0 Request processed in 212us (1639us total) trans 120259084394 rc 0/0 00000100:00100000:3.0:1787397786.953428:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+91:73634:x1874218681254912:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1411us (1733us total) trans 120259084393 rc 0/0 00000100:00100000:2.0:1787397786.953438:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 267 00000100:00100000:3.0:1787397786.953442:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1529 00000100:00100000:0.0:1787397786.958062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.958104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.958130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.958154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.958206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.958242:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255424 00000100:00100000:0.0:1787397786.958253:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255424 00000100:00100000:0.0:1787397786.958296:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255552 00000100:00100000:0.0:1787397786.958299:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255552 00000100:00100000:0.0:1787397786.958313:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255808 00000100:00100000:0.0:1787397786.958316:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255808 00000100:00100000:0.0:1787397786.958348:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1530 00000100:00100000:0.0:1787397786.958358:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+92:73635:x1874218681255424:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787397786.958417:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397786.958443:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1920af lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8474 expref: 92 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958463:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397786.958467:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397786.958570:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255168 00000100:00100000:1.0:1787397786.958576:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255168 00002000:00010000:1.0:1787397786.958605:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:1.0:1787397786.958610:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd7800 with x1874218681255168 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397786.958621:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd7800. 00000100:00100000:1.0:1787397786.958639:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 560 00000100:00100000:1.0:1787397786.958648:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2402:x1874218681255168:12345-192.168.204.60@tcp:10:dd.0 00010000:00010000:0.0:1787397786.958686:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958701:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958725:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397786.958763:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787397786.958768:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397786.958771:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:1.0:1787397786.958773:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00000001:00080000:0.0:1787397786.958774:0:66176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084395 00002000:00010000:1.0:1787397786.958776:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1787397786.958787:0:24831:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd7800 x1874218681255168/t4294968760(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000004:00010000:0.0:1787397786.958801:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f02344e6 reply state 00000000368da12c transno 120259084396 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958814:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958821:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:0.0:1787397786.958823:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397786.958826:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397786.958866:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:2402:x1874218681255168:12345-192.168.204.60@tcp:10:dd.0 Request processed in 217us (759us total) trans 4294968760 rc 0/0 00000100:00100000:1.0:1787397786.958875:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 560 00002000:00010000:1.0:1787397786.958882:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00000100:00100000:0.0:1787397786.958882:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+94:73635:x1874218681255424:12345-192.168.204.60@tcp:36:dd.0 Request processed in 522us (747us total) trans 120259084396 rc 0/0 00002000:00100000:1.0:1787397786.958890:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd7800 with x1874218681255168 ext(0->18446744073709551615) 00000100:00100000:0.0:1787397786.958895:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1530 00002000:00010000:1.0:1787397786.958897:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd7800. 00000020:00080000:0.0:1787397786.958901:0:66176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397786.958921:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1531 00000100:00100000:0.0:1787397786.958930:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+93:73634:x1874218681255552:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.958941:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.958952:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d192111 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d849e expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958975:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192118 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.958984:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192118 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959001:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192118 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959073:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d192111 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d849e expref: 95 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959087:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192118 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d849e expref: 94 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959094:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:0.0:1787397786.959097:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.959099:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:0.0:1787397786.959141:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+94:73634:x1874218681255552:12345-192.168.204.60@tcp:101:dd.0 Request processed in 213us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.959148:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1531 00000100:00100000:0.0:1787397786.959163:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1532 00000100:00100000:0.0:1787397786.959170:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+93:73636:x1874218681255808:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.959179:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.959189:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d19211f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84a5 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959277:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959286:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959304:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959319:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959343:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959349:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959390:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192134 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959398:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192134 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959405:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192134 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397786.959413:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00010000:00010000:0.0:1787397786.959461:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959469:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959475:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959482:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959494:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.959498:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959505:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959514:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397786.959516:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.959555:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959563:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d192126 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959574:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959581:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959586:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959591:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397786.959594:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959601:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959622:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a835734800) 00010000:00010000:0.0:1787397786.959625:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397786.959627:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959633:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19212d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959666:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d19211f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84a5 expref: 96 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959677:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192134 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84a5 expref: 95 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.959684:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397786.959686:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397786.959688:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583e00, rc 0) 00000100:00100000:0.0:1787397786.959726:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+95:73636:x1874218681255808:12345-192.168.204.60@tcp:101:dd.0 Request processed in 556us (1519us total) trans 120259084397 rc 0/0 00000100:00100000:0.0:1787397786.959732:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1532 00000100:00100000:3.0:1787397786.960153:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255040 00000100:00100000:3.0:1787397786.960160:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255040 00000100:00100000:3.0:1787397786.965765:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5027 00000100:00100000:3.0:1787397786.965794:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:73633:x1874218681255040:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.965818:0:26159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.965842:0:26159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d192142 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8497 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397786.965880:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397786.965904:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1787397786.965908:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397786.965917:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d192142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 21 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.965934:0:26159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d192142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 21 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.965947:0:26159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74a00, rc 0) 00010000:00000080:3.0:1787397786.965972:0:26159:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd5180 x1874218681255040/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397786.967348:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:73633:x1874218681255040:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1558us (9289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.967358:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5027 00000100:00100000:1.0:1787397786.968102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.968222:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.968303:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255936 00000100:00100000:2.0:1787397786.968313:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255936 00002000:00010000:2.0:1787397786.968358:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.968364:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178df100 with x1874218681255936 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.968378:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178df100. 00000100:00100000:2.0:1787397786.968416:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 561 00000100:00100000:2.0:1787397786.968425:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:2404:x1874218681255936:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.968674:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.968679:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00000100:00100000:1.0:1787397786.968682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00002000:00010000:2.0:1787397786.968691:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.968694:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.968697:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.968708:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178df100 x1874218681255936/t4294968761(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397786.968719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.968787:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2404:x1874218681255936:12345-192.168.204.60@tcp:10:dd.0 Request processed in 362us (688us total) trans 4294968761 rc 0/0 00000100:00100000:2.0:1787397786.968795:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 561 00002000:00010000:2.0:1787397786.968800:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.968803:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178df100 with x1874218681255936 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.968809:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178df100. 00000100:00100000:2.0:1787397786.968836:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681256448 00000100:00100000:2.0:1787397786.968840:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681256448 00000100:00100000:2.0:1787397786.968948:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 268 00000100:00100000:2.0:1787397786.968956:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+95:73637:x1874218681256448:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:0.0:1787397786.969063:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681256064 00000100:00100000:0.0:1787397786.969069:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681256064 00000100:00100000:0.0:1787397786.969102:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681256832 00000100:00100000:0.0:1787397786.969116:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681256832 00000100:00100000:0.0:1787397786.969144:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1533 00000100:00100000:0.0:1787397786.969152:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+98:73636:x1874218681256064:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.969163:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787397786.969169:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+98:73637:x1874218681256448:12345-192.168.204.60@tcp:35:dd.0 Request processed in 211us (486us total) trans 120259084398 rc 0/0 00000100:00100000:2.0:1787397786.969178:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 268 00010000:00010000:0.0:1787397786.969189:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192149 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84ac expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397786.969204:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1534 00000100:00100000:2.0:1787397786.969213:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+98:73638:x1874218681256832:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397786.969223:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397786.969224:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192150 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969236:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d192157 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84b3 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.969239:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192150 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.969333:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192150 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969357:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969375:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969383:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969398:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969406:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.969413:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.969419:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192149 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ac expref: 100 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.969441:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192150 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ac expref: 99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.969450:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:0.0:1787397786.969453:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.969456:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582000, rc 0) 00000100:00100000:0.0:1787397786.969488:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+99:73636:x1874218681256064:12345-192.168.204.60@tcp:101:dd.0 Request processed in 337us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.969494:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1533 00000100:00100000:1.0:1787397786.969913:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.970044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.970077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:2.0:1787397786.970096:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d19216c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970108:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d19216c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970116:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d19216c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397786.970127:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:2.0:1787397786.970194:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970202:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970207:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970220:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970227:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397786.970231:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970239:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970248:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397786.970251:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397786.970255:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970261:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d19215e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970277:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970283:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970289:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970294:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397786.970297:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970317:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970336:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a803ec8b00) 00010000:00010000:2.0:1787397786.970338:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397786.970341:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970347:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d192165 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970387:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030a00/0x274786fe0d192157 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84b3 expref: 100 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970402:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d19216c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84b3 expref: 99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970409:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:2.0:1787397786.970412:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397786.970415:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718600, rc 0) 00000100:00100000:2.0:1787397786.970446:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+99:73638:x1874218681256832:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1234us (1732us total) trans 120259084399 rc 0/0 00000100:00100000:2.0:1787397786.970468:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1534 00000100:00100000:2.0:1787397786.970490:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681256576 00000100:00100000:2.0:1787397786.970496:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681256576 00000100:00100000:2.0:1787397786.970557:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1535 00000100:00100000:2.0:1787397786.970566:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+99:73634:x1874218681256576:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:2.0:1787397786.970606:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397786.970621:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1920fc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8490 expref: 99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970634:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397786.970637:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397786.970731:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970740:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970748:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397786.970786:0:77740:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084400 00000004:00010000:2.0:1787397786.970807:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a92eb4f reply state 00000000c211ac77 transno 120259084401 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970818:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.970824:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397786.970826:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397786.970828:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397786.970888:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+101:73634:x1874218681256576:12345-192.168.204.60@tcp:36:dd.0 Request processed in 323us (976us total) trans 120259084401 rc 0/0 00000100:00100000:2.0:1787397786.970895:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1535 00000020:00080000:2.0:1787397786.970899:0:77740:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787397786.970923:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257088 00000100:00100000:2.0:1787397786.970932:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257088 00002000:00010000:2.0:1787397786.970951:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.970955:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6d180 with x1874218681257088 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.970963:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6d180. 00000100:00100000:2.0:1787397786.970992:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 562 00000100:00100000:2.0:1787397786.971000:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2405:x1874218681257088:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.971086:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.971090:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.971092:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.971095:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.971097:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.971105:0:8442:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6d180 x1874218681257088/t4294968762(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.971136:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:2405:x1874218681257088:12345-192.168.204.60@tcp:10:dd.0 Request processed in 136us (1059us total) trans 4294968762 rc 0/0 00000100:00100000:2.0:1787397786.971144:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 562 00002000:00010000:2.0:1787397786.971147:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.971149:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6d180 with x1874218681257088 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.971154:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6d180. 00000100:00100000:2.0:1787397786.974392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.974744:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257344 00000100:00100000:1.0:1787397786.974756:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257344 00000100:00100000:1.0:1787397786.974899:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1536 00000100:00100000:1.0:1787397786.974911:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+101:73636:x1874218681257344:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:1.0:1787397786.974985:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397786.975014:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192134 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84a5 expref: 101 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.975033:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:1.0:1787397786.975038:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397786.975209:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.975223:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.975233:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397786.975456:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084402 00000004:00010000:1.0:1787397786.975481:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a1a709a reply state 000000005adf8a3e transno 120259084403 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.975511:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.975517:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00000100:00100000:3.0:1787397786.975767:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681256960 00000100:00100000:3.0:1787397786.975774:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681256960 00000100:00100000:3.0:1787397786.975889:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5028 00000100:00100000:3.0:1787397786.975897:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:73635:x1874218681256960:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397786.975908:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397786.975942:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d192188 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84ba expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397786.975965:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397786.975983:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1787397786.975987:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397786.975994:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d192188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 24 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.976007:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d192188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 24 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397786.976018:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75200, rc 0) 00010000:00000080:3.0:1787397786.976024:0:8435:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6e300 x1874218681256960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397786.976080:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:73635:x1874218681256960:12345-192.168.204.60@tcp:101:dd.0 Request processed in 183us (6035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.976093:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5028 00010000:00010000:1.0:1787397786.976378:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397786.976382:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397786.976452:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+103:73636:x1874218681257344:12345-192.168.204.60@tcp:36:dd.0 Request processed in 1544us (2068us total) trans 120259084403 rc 0/0 00000100:00100000:1.0:1787397786.976459:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1536 00000020:00080000:1.0:1787397786.976463:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397786.981095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397786.981967:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257472 00000100:00100000:2.0:1787397786.982022:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257472 00000100:00100000:2.0:1787397786.982544:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5029 00000100:00100000:2.0:1787397786.982557:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:73636:x1874218681257472:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397786.982576:0:26167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397786.982609:0:26167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba5a11a/0x274786fe0d19218f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84c1 expref: -99 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397786.982634:0:26167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:2.0:1787397786.982657:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:2.0:1787397786.982661:0:26167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397786.982670:0:26167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba5a11a/0x274786fe0d19218f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 25 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.982687:0:26167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ba5a11a/0x274786fe0d19218f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 25 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397786.982699:0:26167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718200, rc 0) 00010000:00000080:2.0:1787397786.982707:0:26167:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6f800 x1874218681257472/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.982782:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:73636:x1874218681257472:12345-192.168.204.60@tcp:101:dd.0 Request processed in 228us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.984023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.984140:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.984172:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397786.984599:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257600 00000100:00100000:3.0:1787397786.984678:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257600 00000100:00100000:3.0:1787397786.984764:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257984 00000100:00100000:3.0:1787397786.984768:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257984 00000100:00100000:0.0:1787397786.984799:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1537 00000100:00100000:0.0:1787397786.984810:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+104:73638:x1874218681257600:12345-192.168.204.60@tcp:101:dd.0 00000100:00100000:1.0:1787397786.984833:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1538 00000100:00100000:1.0:1787397786.984847:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+104:73639:x1874218681257984:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397786.984851:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.984869:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.984886:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d19219d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84cf expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.984886:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192196 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84c8 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.984944:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d1921a4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.984958:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d1921a4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.984970:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d1921a4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985040:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985052:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985061:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.985069:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d192196 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c8 expref: 107 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.985091:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d1921a4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c8 expref: 106 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397786.985099:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:0.0:1787397786.985102:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397786.985105:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582e00, rc 0) 00000100:00100000:0.0:1787397786.985162:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+106:73638:x1874218681257600:12345-192.168.204.60@tcp:101:dd.0 Request processed in 355us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397786.985169:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1537 00010000:00010000:1.0:1787397786.985573:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985596:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985603:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985658:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d1921b9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985667:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d1921b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985673:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d1921b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397786.985682:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:1.0:1787397786.985766:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985774:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985779:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985785:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985791:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.985795:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985814:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985824:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397786.985827:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.985831:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985837:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1921ab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985848:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985854:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985939:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985944:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397786.985947:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985953:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.985972:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a818432900) 00010000:00010000:1.0:1787397786.985975:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397786.985979:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986054:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d1921b2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986378:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d19219d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84cf expref: 107 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986394:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d1921b9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84cf expref: 106 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986401:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:1.0:1787397786.986403:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397786.986406:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:1.0:1787397786.986460:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+106:73639:x1874218681257984:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1617us (2287us total) trans 120259084404 rc 0/0 00000100:00100000:1.0:1787397786.986469:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1538 00000100:00100000:1.0:1787397786.986559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.986652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.986674:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681258368 00000100:00100000:1.0:1787397786.986680:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681258368 00000100:00100000:1.0:1787397786.986718:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5030 00000100:00100000:1.0:1787397786.986726:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+26:73634:x1874218681258368:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397786.986739:0:26168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397786.986757:0:26168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa9f413/0x274786fe0d1921c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84d6 expref: -99 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397786.986779:0:26168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:1.0:1787397786.986803:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:1.0:1787397786.986808:0:26168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397786.986816:0:26168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa9f413/0x274786fe0d1921c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 27 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986828:0:26168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aaa9f413/0x274786fe0d1921c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 27 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397786.986837:0:26168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b200, rc 0) 00010000:00000080:1.0:1787397786.986843:0:26168:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6fb80 x1874218681258368/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 328/400 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397786.987478:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681258240 00000100:00100000:3.0:1787397786.987487:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681258240 00000100:00100000:3.0:1787397786.987556:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00100000:3.0:1787397786.987565:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+106:73632:x1874218681258240:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:2.0:1787397786.987618:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5029 00000100:00100000:2.0:1787397786.987665:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257728 00000100:00100000:2.0:1787397786.987669:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257728 00002000:00010000:2.0:1787397786.987693:0:24828:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.987698:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd4a80 with x1874218681257728 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.987711:0:24828:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd4a80. 00000100:00100000:3.0:1787397786.987811:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+107:73632:x1874218681258240:12345-192.168.204.60@tcp:35:dd.0 Request processed in 242us (1246us total) trans 120259084405 rc 0/0 00000100:00100000:1.0:1787397786.987811:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:73634:x1874218681258368:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1080us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397786.987827:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00100000:1.0:1787397786.987828:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5030 00000100:00100000:2.0:1787397786.988056:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 563 00000100:00100000:2.0:1787397786.988065:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+26:2405:x1874218681257728:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:2.0:1787397786.988210:0:24828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397786.988239:0:24828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.988242:0:24828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397786.988244:0:24828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397786.988247:0:24828:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397786.988257:0:24828:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd4a80 x1874218681257728/t4294968763(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397786.988511:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:2405:x1874218681257728:12345-192.168.204.60@tcp:10:dd.0 Request processed in 446us (4369us total) trans 4294968763 rc 0/0 00000100:00100000:2.0:1787397786.988555:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 563 00002000:00010000:2.0:1787397786.988560:0:24828:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:2.0:1787397786.988564:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd4a80 with x1874218681257728 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397786.988570:0:24828:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd4a80. 00000100:00100000:1.0:1787397786.999634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999682:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999717:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999782:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397786.999821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397786.999852:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681258624 00000100:00100000:3.0:1787397786.999871:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259776 00000100:00100000:0.0:1787397786.999874:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681258624 00000100:00100000:3.0:1787397786.999877:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259776 00000100:00100000:0.0:1787397786.999937:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 270 00000100:00100000:0.0:1787397786.999948:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+108:73633:x1874218681258624:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.000043:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 271 00000100:00100000:3.0:1787397787.000053:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+108:73635:x1874218681259776:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.000337:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+109:73635:x1874218681259776:12345-192.168.204.60@tcp:35:dd.0 Request processed in 274us (504us total) trans 120259084406 rc 0/0 00000100:00100000:3.0:1787397787.000346:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 271 00000100:00100000:2.0:1787397787.000573:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681258752 00000100:00100000:2.0:1787397787.000579:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681258752 00002000:00010000:2.0:1787397787.000604:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:2.0:1787397787.000609:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6f480 with x1874218681258752 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397787.000620:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6f480. 00000100:00100000:2.0:1787397787.000738:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259520 00000100:00100000:2.0:1787397787.000742:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259520 00002000:00010000:2.0:1787397787.000756:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1787397787.000760:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6c700 with x1874218681259520 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397787.000766:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6c700. 00000100:00100000:0.0:1787397787.000867:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+109:73633:x1874218681258624:12345-192.168.204.60@tcp:35:dd.0 Request processed in 913us (1175us total) trans 120259084407 rc 0/0 00000100:00100000:0.0:1787397787.000876:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 270 00000100:00100000:0.0:1787397787.000905:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259008 00000100:00100000:0.0:1787397787.000910:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259008 00000100:00100000:0.0:1787397787.000936:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259136 00000100:00100000:0.0:1787397787.000940:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259136 00000100:00100000:0.0:1787397787.000957:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259392 00000100:00100000:0.0:1787397787.000960:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259392 00000100:00100000:0.0:1787397787.000977:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1539 00000100:00100000:0.0:1787397787.000984:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+111:73638:x1874218681259008:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:0.0:1787397787.001019:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397787.001046:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d19216c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84b3 expref: 111 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001069:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:0.0:1787397787.001085:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397787.001191:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001205:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001215:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787397787.001254:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084408 00000004:00010000:0.0:1787397787.001277:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f015c2e reply state 00000000e6c09ace transno 120259084409 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001312:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001319:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:0.0:1787397787.001321:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397787.001332:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397787.001372:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 564 00000100:00100000:3.0:1787397787.001388:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+28:2402:x1874218681258752:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:0.0:1787397787.001388:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+113:73638:x1874218681259008:12345-192.168.204.60@tcp:36:dd.0 Request processed in 399us (1666us total) trans 120259084409 rc 0/0 00000100:00100000:0.0:1787397787.001404:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1539 00000020:00080000:0.0:1787397787.001408:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787397787.001427:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 565 00000100:00100000:0.0:1787397787.001428:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1540 00000100:00100000:2.0:1787397787.001446:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+28:2404:x1874218681259520:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:0.0:1787397787.001446:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+112:73639:x1874218681259136:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.001473:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.001485:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1921d5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84dd expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001508:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1921dc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001517:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1921dc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001560:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1921dc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397787.001583:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397787.001587:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.001590:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397787.001592:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.001601:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397787.001611:0:24831:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6f480 x1874218681258752/t4294968764(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787397787.001637:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1921d5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84dd expref: 114 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397787.001643:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:2402:x1874218681258752:12345-192.168.204.60@tcp:10:dd.0 Request processed in 260us (2019us total) trans 4294968764 rc 0/0 00000100:00100000:3.0:1787397787.001655:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 564 00002000:00010000:3.0:1787397787.001662:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.001666:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6f480 with x1874218681258752 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.001671:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6f480. 00010000:00010000:0.0:1787397787.001676:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1921dc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84dd expref: 113 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.001684:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:0.0:1787397787.001687:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397787.001690:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583e00, rc 0) 00000100:00100000:3.0:1787397787.001704:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1541 00000100:00100000:3.0:1787397787.001714:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+113:73640:x1874218681259392:12345-192.168.204.60@tcp:101:dd.0 00000100:00100000:0.0:1787397787.001722:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+113:73639:x1874218681259136:12345-192.168.204.60@tcp:101:dd.0 Request processed in 283us (1973us total) trans 0 rc 0/0 00010000:00010000:3.0:1787397787.001724:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787397787.001732:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1540 00010000:00010000:3.0:1787397787.001736:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1921e3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84e4 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001838:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001847:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001856:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001873:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001880:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397787.001882:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787397787.001887:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00010000:00010000:3.0:1787397787.001897:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397787.001898:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:2.0:1787397787.001905:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:2.0:1787397787.001909:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1787397787.001919:0:8440:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6c700 x1874218681259520/t4294968765(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:227/0 lens 440/432 e 0 to 0 dl 1787397797 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787397787.001949:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1921f8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.001959:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1921f8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.001967:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:2404:x1874218681259520:12345-192.168.204.60@tcp:10:dd.0 Request processed in 526us (2198us total) trans 4294968765 rc 0/0 00010000:00010000:3.0:1787397787.001969:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1921f8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.001982:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 565 00000004:00200000:3.0:1787397787.001984:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00002000:00010000:2.0:1787397787.001986:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1787397787.001991:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b6c700 with x1874218681259520 ext(0->18446744073709551615) 00002000:00010000:2.0:1787397787.001997:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b6c700. 00010000:00010000:3.0:1787397787.002035:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002043:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002050:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002056:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397787.002060:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002067:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002076:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397787.002079:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.002089:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002096:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1921ea lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002109:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002115:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002120:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002125:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397787.002128:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002134:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002141:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a70526ec00) 00010000:00010000:3.0:1787397787.002144:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.002147:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002153:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1921f1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002190:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d1921e3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84e4 expref: 115 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002215:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1921f8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84e4 expref: 114 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.002222:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:3.0:1787397787.002225:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397787.002227:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:3.0:1787397787.002263:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+114:73640:x1874218681259392:12345-192.168.204.60@tcp:101:dd.0 Request processed in 551us (2479us total) trans 120259084410 rc 0/0 00000100:00100000:3.0:1787397787.002270:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1541 00000100:00100000:0.0:1787397787.012333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.012377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.012413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.012453:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259904 00000100:00100000:3.0:1787397787.012464:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259904 00000100:00100000:3.0:1787397787.012557:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5031 00000100:00100000:3.0:1787397787.012568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:73638:x1874218681259904:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397787.012587:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.012608:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d192206 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84eb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397787.012627:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681260160 00000100:00100000:1.0:1787397787.012633:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681260160 00002000:00010000:3.0:1787397787.012637:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397787.012663:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1787397787.012668:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397787.012676:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d192206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 30 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.012692:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d192206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 30 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397787.012719:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1542 00010000:00010000:3.0:1787397787.012726:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75800, rc 0) 00000100:00100000:1.0:1787397787.012731:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+114:73639:x1874218681260160:12345-192.168.204.60@tcp:36:dd.0 00010000:00000080:3.0:1787397787.012738:0:8436:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd4700 x1874218681259904/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787397787.012782:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787397787.012801:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+30:73638:x1874218681259904:12345-192.168.204.60@tcp:101:dd.0 Request processed in 235us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.012811:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5031 00010000:00010000:1.0:1787397787.012825:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d1921b9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84cf expref: 114 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.012842:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:1.0:1787397787.012847:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397787.013033:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.013044:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.013053:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397787.013116:0:66177:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084411 00000004:00010000:1.0:1787397787.013143:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ee1f2da reply state 0000000038588328 transno 120259084412 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.013154:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.013159:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:1.0:1787397787.013162:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397787.013164:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397787.013219:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+116:73639:x1874218681260160:12345-192.168.204.60@tcp:36:dd.0 Request processed in 492us (841us total) trans 120259084412 rc 0/0 00000100:00100000:1.0:1787397787.013225:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1542 00000020:00080000:1.0:1787397787.013228:0:66177:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787397787.013304:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681260416 00000100:00100000:2.0:1787397787.013309:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681260416 00000100:00100000:2.0:1787397787.013356:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 272 00000100:00100000:2.0:1787397787.013364:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+116:73634:x1874218681260416:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:2.0:1787397787.013497:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+117:73634:x1874218681260416:12345-192.168.204.60@tcp:35:dd.0 Request processed in 133us (1082us total) trans 120259084413 rc 0/0 00000100:00100000:2.0:1787397787.013505:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 272 00000100:00100000:3.0:1787397787.014235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.014299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.014410:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681260672 00000100:00100000:2.0:1787397787.014417:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681260672 00000100:00100000:2.0:1787397787.014453:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 273 00000100:00100000:2.0:1787397787.014461:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+117:73636:x1874218681260672:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:2.0:1787397787.015158:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+118:73636:x1874218681260672:12345-192.168.204.60@tcp:35:dd.0 Request processed in 694us (922us total) trans 120259084414 rc 0/0 00000100:00100000:2.0:1787397787.015168:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 273 00000100:00100000:0.0:1787397787.021492:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681260800 00000100:00100000:0.0:1787397787.021509:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681260800 00000100:00100000:2.0:1787397787.022001:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1543 00000100:00100000:2.0:1787397787.022015:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+118:73640:x1874218681260800:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397787.022038:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397787.022059:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192214 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84f2 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022218:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19221b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022232:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19221b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022243:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19221b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022443:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192214 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f2 expref: 120 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022464:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19221b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f2 expref: 119 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.022472:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397787.022475:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787397787.022479:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718000, rc 0) 00000100:00100000:2.0:1787397787.022577:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+119:73640:x1874218681260800:12345-192.168.204.60@tcp:101:dd.0 Request processed in 565us (8277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.022584:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1543 00000100:00100000:3.0:1787397787.022860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.022968:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261056 00000100:00100000:0.0:1787397787.022974:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261056 00000100:00100000:3.0:1787397787.022990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.023015:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1544 00000100:00100000:0.0:1787397787.023025:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+119:73642:x1874218681261056:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.023036:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787397787.023046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:0.0:1787397787.023049:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d192222 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84f9 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397787.023171:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261184 00000100:00100000:1.0:1787397787.023176:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261184 00002000:00010000:1.0:1787397787.023199:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:1.0:1787397787.023212:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70350a300 with x1874218681261184 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397787.023221:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70350a300. 00000100:00100000:1.0:1787397787.023246:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 566 00000100:00100000:1.0:1787397787.023253:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+30:2405:x1874218681261184:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:1.0:1787397787.023410:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787397787.023414:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397787.023416:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:1.0:1787397787.023419:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397787.023421:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1787397787.023429:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350a300 x1874218681261184/t4294968766(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397787.023469:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:2405:x1874218681261184:12345-192.168.204.60@tcp:10:dd.0 Request processed in 216us (479us total) trans 4294968766 rc 0/0 00000100:00100000:1.0:1787397787.023476:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 566 00002000:00010000:1.0:1787397787.023480:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:1.0:1787397787.023482:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70350a300 with x1874218681261184 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397787.023487:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70350a300. 00000100:00100000:0.0:1787397787.024594:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261312 00000100:00100000:0.0:1787397787.024685:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261312 00000100:00100000:0.0:1787397787.024769:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5032 00000100:00100000:0.0:1787397787.024779:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:73639:x1874218681261312:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.024817:0:26163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.024837:0:26163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192229 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8500 expref: -99 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025258:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025273:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025364:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025381:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025396:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025403:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025462:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d19223e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025470:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d19223e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025477:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d19223e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397787.025486:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00010000:00010000:1.0:1787397787.025683:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025691:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025697:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025702:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025708:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397787.025713:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025730:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025741:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397787.025744:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397787.025748:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025754:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192230 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025766:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025771:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025776:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025780:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397787.025783:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025799:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025807:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a81ab06300) 00010000:00010000:1.0:1787397787.025809:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397787.025812:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.025827:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192237 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.026073:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d192222 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f9 expref: 122 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.026169:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d19223e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f9 expref: 121 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.026178:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:1.0:1787397787.026180:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397787.026183:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:1.0:1787397787.026248:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+121:73642:x1874218681261056:12345-192.168.204.60@tcp:101:dd.0 Request processed in 3225us (3389us total) trans 120259084415 rc 0/0 00000100:00100000:1.0:1787397787.026257:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1544 00002000:00010000:0.0:1787397787.026414:0:26163:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:0.0:1787397787.026440:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397787.026445:0:26163:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397787.026453:0:26163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 32 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.026469:0:26163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 32 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.026479:0:26163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63800, rc 0) 00010000:00000080:0.0:1787397787.026485:0:26163:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a703508700 x1874218681261312/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397787.026548:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:73639:x1874218681261312:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1770us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.026555:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5032 00000100:00100000:2.0:1787397787.029028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.029137:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261568 00000100:00100000:3.0:1787397787.029148:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261568 00000100:00100000:3.0:1787397787.029215:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 274 00000100:00100000:3.0:1787397787.029226:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+121:73638:x1874218681261568:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.032450:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+122:73638:x1874218681261568:12345-192.168.204.60@tcp:35:dd.0 Request processed in 3214us (3419us total) trans 120259084416 rc 0/0 00000100:00100000:3.0:1787397787.032465:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 274 00000100:00100000:2.0:1787397787.032784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.033427:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.033828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.033830:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261824 00000100:00100000:0.0:1787397787.033841:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261824 00000100:00100000:1.0:1787397787.033886:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261952 00000100:00100000:1.0:1787397787.033891:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261952 00000100:00100000:1.0:1787397787.033933:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262208 00000100:00100000:1.0:1787397787.033936:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262208 00000100:00100000:1.0:1787397787.033967:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1545 00000100:00100000:1.0:1787397787.033975:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+124:73642:x1874218681261952:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397787.033999:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397787.034020:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19224c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8507 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.034057:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192253 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.034082:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192253 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.034094:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192253 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.034208:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19224c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8507 expref: 126 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.034226:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192253 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8507 expref: 125 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397787.034232:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1546 00010000:00010000:1.0:1787397787.034248:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:1.0:1787397787.034251:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787397787.034254:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b400, rc 0) 00000100:00100000:0.0:1787397787.034495:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+125:73641:x1874218681262208:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.034505:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.034516:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19225a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d850e expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.034657:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1547 00000100:00100000:2.0:1787397787.034668:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+126:73640:x1874218681261824:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:2.0:1787397787.034695:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397787.034711:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1921f8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84e4 expref: 126 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034723:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397787.034726:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397787.034847:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034872:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034883:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034892:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397787.034943:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084417 00000004:00010000:2.0:1787397787.034963:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a687fc64 reply state 00000000138aee37 transno 120259084418 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034974:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.034980:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397787.034982:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397787.034984:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787397787.035046:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035059:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.035067:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+128:73640:x1874218681261824:12345-192.168.204.60@tcp:36:dd.0 Request processed in 399us (2282us total) trans 120259084418 rc 0/0 00000100:00100000:2.0:1787397787.035082:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1547 00000020:00080000:2.0:1787397787.035087:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787397787.035209:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035218:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035226:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035571:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0c00/0x274786fe0d192276 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035580:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0c00/0x274786fe0d192276 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035586:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0c00/0x274786fe0d192276 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397787.035595:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00010000:00010000:0.0:1787397787.035719:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035728:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035742:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035749:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035755:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397787.035760:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035767:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035776:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397787.035779:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397787.035784:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397787.035805:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+128:73642:x1874218681261952:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1827us (2376us total) trans 0 rc 0/0 00010000:00010000:0.0:1787397787.035805:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0e00/0x274786fe0d192261 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397787.035823:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1545 00010000:00010000:0.0:1787397787.035828:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035835:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035840:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.035846:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397787.035855:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036050:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036061:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a835734400) 00010000:00010000:0.0:1787397787.036063:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397787.036066:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036071:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d19226f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036253:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d19225a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d850e expref: 128 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036267:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0c00/0x274786fe0d192276 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d850e expref: 127 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.036275:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:0.0:1787397787.036277:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397787.036434:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0c00, rc 0) 00000100:00100000:0.0:1787397787.036484:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+127:73641:x1874218681262208:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1992us (2656us total) trans 120259084419 rc 0/0 00000100:00100000:0.0:1787397787.036491:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1546 00000100:00100000:0.0:1787397787.037481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.037571:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262336 00000100:00100000:3.0:1787397787.037581:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262336 00002000:00010000:3.0:1787397787.037617:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.037623:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd4000 with x1874218681262336 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.037635:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd4000. 00000100:00100000:3.0:1787397787.037662:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 567 00000100:00100000:3.0:1787397787.037683:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2404:x1874218681262336:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:3.0:1787397787.037833:0:24832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397787.037837:0:24832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.037840:0:24832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397787.037842:0:24832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.037844:0:24832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397787.037852:0:24832:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd4000 x1874218681262336/t4294968767(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.037900:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:2404:x1874218681262336:12345-192.168.204.60@tcp:10:dd.0 Request processed in 219us (425us total) trans 4294968767 rc 0/0 00000100:00100000:3.0:1787397787.037907:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 567 00002000:00010000:3.0:1787397787.037911:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.037913:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd4000 with x1874218681262336 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.037917:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd4000. 00000100:00100000:1.0:1787397787.044583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.044737:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262720 00000100:00100000:2.0:1787397787.044746:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262720 00000100:00100000:2.0:1787397787.044813:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1548 00000100:00100000:2.0:1787397787.044823:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+127:73642:x1874218681262720:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:2.0:1787397787.044882:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397787.044910:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d19223e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f9 expref: 127 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.044927:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:2.0:1787397787.044931:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397787.045103:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.045116:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.045127:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397787.045169:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084420 00000004:00010000:2.0:1787397787.045190:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000490f9b1d reply state 00000000efbe7f16 transno 120259084421 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.045201:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.045207:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:2.0:1787397787.045225:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397787.045228:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397787.045332:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+129:73642:x1874218681262720:12345-192.168.204.60@tcp:36:dd.0 Request processed in 500us (747us total) trans 120259084421 rc 0/0 00000100:00100000:2.0:1787397787.045339:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1548 00000020:00080000:2.0:1787397787.045344:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397787.045813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.045846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.045965:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262464 00000100:00100000:2.0:1787397787.045971:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262464 00000100:00100000:0.0:1787397787.045986:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262848 00000100:00100000:0.0:1787397787.045994:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262848 00000100:00100000:2.0:1787397787.046015:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5033 00000100:00100000:2.0:1787397787.046025:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:73640:x1874218681262464:12345-192.168.204.60@tcp:101:dd.0 00000100:00100000:0.0:1787397787.046034:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1549 00010000:00010000:2.0:1787397787.046051:0:26165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787397787.046053:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+129:73641:x1874218681262848:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.046068:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397787.046073:0:26165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de5d30d/0x274786fe0d19228b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8515 expref: -99 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397787.046096:0:26165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:2.0:1787397787.046116:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:2.0:1787397787.046120:0:26165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397787.046127:0:26165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006de5d30d/0x274786fe0d19228b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 34 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.046141:0:26165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006de5d30d/0x274786fe0d19228b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 34 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.046152:0:26165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718800, rc 0) 00010000:00000080:2.0:1787397787.046159:0:26165:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82f52f450 x1874218681262464/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397787.046194:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73640:x1874218681262464:12345-192.168.204.60@tcp:101:dd.0 Request processed in 171us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.046206:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5033 00010000:00010000:0.0:1787397787.046209:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d192292 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d851c expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046239:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d192299 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046250:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d192299 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046260:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d192299 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046419:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1a00/0x274786fe0d192292 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d851c expref: 131 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046434:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d192299 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d851c expref: 130 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.046440:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:0.0:1787397787.046442:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397787.046446:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0400, rc 0) 00000100:00100000:0.0:1787397787.046484:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+130:73641:x1874218681262848:12345-192.168.204.60@tcp:101:dd.0 Request processed in 432us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.046491:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1549 00000100:00100000:1.0:1787397787.051463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.051508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.051577:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263360 00000100:00100000:2.0:1787397787.051587:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263360 00000100:00100000:1.0:1787397787.051589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.051653:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 275 00000100:00100000:2.0:1787397787.051663:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+130:73639:x1874218681263360:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.051707:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263104 00000100:00100000:3.0:1787397787.051713:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263104 00000100:00100000:3.0:1787397787.051746:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1550 00000100:00100000:3.0:1787397787.051754:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+131:73643:x1874218681263104:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397787.051767:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.051789:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1922a0 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8523 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.051905:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.051919:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.051944:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.051950:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+133:73639:x1874218681263360:12345-192.168.204.60@tcp:35:dd.0 Request processed in 287us (439us total) trans 120259084422 rc 0/0 00000100:00100000:2.0:1787397787.051959:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 275 00010000:00010000:3.0:1787397787.051964:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.051973:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.051982:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.051984:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263488 00000100:00100000:2.0:1787397787.051988:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263488 00000100:00100000:2.0:1787397787.052014:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5034 00000100:00100000:2.0:1787397787.052021:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+34:73642:x1874218681263488:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397787.052028:0:26160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.052031:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1922b5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052041:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1922b5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.052042:0:26160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2881505/0x274786fe0d1922bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d852a expref: -99 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052052:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1922b5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397787.052065:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00002000:00010000:2.0:1787397787.052066:0:26160:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397787.052118:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052126:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052133:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052140:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052154:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397787.052158:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052167:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052179:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397787.052182:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.052187:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052193:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74200/0x274786fe0d1922a7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052207:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052213:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052219:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052224:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397787.052227:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052233:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052250:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a70526e800) 00010000:00010000:3.0:1787397787.052252:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.052256:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052277:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1922ae lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052314:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d1922a0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8523 expref: 134 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052338:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1922b5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8523 expref: 133 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.052346:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:3.0:1787397787.052348:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397787.052350:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582c00, rc 0) 00000100:00100000:3.0:1787397787.052374:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+133:73643:x1874218681263104:12345-192.168.204.60@tcp:101:dd.0 Request processed in 621us (923us total) trans 120259084423 rc 0/0 00000100:00100000:3.0:1787397787.052380:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1550 00010000:00010000:2.0:1787397787.054582:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3666s v=(0 0) 00000100:00100000:0.0:1787397787.054584:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:2.0:1787397787.054593:0:26160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397787.054607:0:26160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2881505/0x274786fe0d1922bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 35 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.054633:0:26160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2881505/0x274786fe0d1922bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 35 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.054669:0:26160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718c00, rc 0) 00010000:00000080:2.0:1787397787.054679:0:26160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6fb80 x1874218681263488/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.054730:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263744 00000100:00100000:3.0:1787397787.054738:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263744 00000100:00100000:2.0:1787397787.054799:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:73642:x1874218681263488:12345-192.168.204.60@tcp:101:dd.0 Request processed in 2775us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.054800:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1551 00000100:00100000:3.0:1787397787.054812:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+133:73641:x1874218681263744:12345-192.168.204.60@tcp:36:dd.0 00000100:00100000:2.0:1787397787.054813:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5034 00010000:00010000:3.0:1787397787.054859:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397787.054978:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0c00/0x274786fe0d192276 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d850e expref: 133 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.055005:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:3.0:1787397787.055009:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397787.055165:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.055177:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.055186:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397787.055236:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084424 00000004:00010000:3.0:1787397787.055257:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025c404a2 reply state 00000000233d7794 transno 120259084425 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.055268:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.055275:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:3.0:1787397787.055277:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397787.055279:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397787.055344:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+135:73641:x1874218681263744:12345-192.168.204.60@tcp:36:dd.0 Request processed in 533us (769us total) trans 120259084425 rc 0/0 00000100:00100000:3.0:1787397787.055352:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1551 00000020:00080000:3.0:1787397787.055356:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397787.059076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.059290:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263872 00000100:00100000:1.0:1787397787.059300:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263872 00002000:00010000:1.0:1787397787.059352:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:1.0:1787397787.059358:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd6300 with x1874218681263872 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397787.059388:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd6300. 00000100:00100000:1.0:1787397787.059427:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 568 00000100:00100000:1.0:1787397787.059437:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:2405:x1874218681263872:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:3.0:1787397787.059808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.059844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.059863:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264128 00000100:00100000:3.0:1787397787.059867:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264128 00002000:00010000:3.0:1787397787.059889:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.059893:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70350a680 with x1874218681264128 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.059900:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70350a680. 00000100:00100000:3.0:1787397787.059916:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 569 00000100:00100000:3.0:1787397787.059923:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+36:2405:x1874218681264128:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:3.0:1787397787.060046:0:24831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397787.060050:0:24831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.060052:0:24831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397787.060055:0:24831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.060057:0:24831:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397787.060068:0:24831:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350a680 x1874218681264128/t4294968768(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.060136:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:2405:x1874218681264128:12345-192.168.204.60@tcp:10:dd.0 Request processed in 213us (290us total) trans 4294968768 rc 0/0 00000100:00100000:3.0:1787397787.060145:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 569 00002000:00010000:3.0:1787397787.060148:0:24831:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.060151:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70350a680 with x1874218681264128 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.060155:0:24831:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70350a680. 00000100:00100000:3.0:1787397787.060241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397787.060423:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264000 00000100:00100000:0.0:1787397787.060434:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264000 00000100:00100000:0.0:1787397787.060471:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5035 00000100:00100000:0.0:1787397787.060479:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:73641:x1874218681264000:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.060489:0:26164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.060508:0:26164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d1922d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8531 expref: -99 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397787.060557:0:26164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:0.0:1787397787.060574:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397787.060578:0:26164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397787.060585:0:26164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d1922d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 38 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060600:0:26164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d1922d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 38 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060612:0:26164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0e00, rc 0) 00010000:00000080:0.0:1787397787.060617:0:26164:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a703509880 x1874218681264000/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397787.060649:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:73641:x1874218681264000:12345-192.168.204.60@tcp:101:dd.0 Request processed in 171us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.060655:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5035 00000100:00100000:0.0:1787397787.060677:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264256 00000100:00100000:0.0:1787397787.060680:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264256 00000100:00100000:0.0:1787397787.060704:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1552 00000100:00100000:0.0:1787397787.060711:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+135:73643:x1874218681264256:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.060730:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.060742:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1922d8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8538 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060785:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d1922df lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060797:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d1922df lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060807:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d1922df lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060902:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0200/0x274786fe0d1922d8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8538 expref: 137 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060919:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d1922df lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8538 expref: 136 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.060927:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:0.0:1787397787.060929:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787397787.060932:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1800, rc 0) 00000100:00100000:0.0:1787397787.060956:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+136:73643:x1874218681264256:12345-192.168.204.60@tcp:101:dd.0 Request processed in 245us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.060962:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1552 00000100:00100000:0.0:1787397787.061885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.061947:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264512 00000100:00100000:3.0:1787397787.061954:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264512 00000100:00100000:3.0:1787397787.061999:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1553 00000100:00100000:3.0:1787397787.062008:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+136:73644:x1874218681264512:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397787.062023:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.062036:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1922e6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d853f expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062364:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062377:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062388:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062402:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062410:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062417:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062474:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1922fb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062483:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1922fb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062490:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1922fb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397787.062500:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00010000:00010000:3.0:1787397787.062647:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062656:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062669:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062677:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062683:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397787.062688:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062695:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062706:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397787.062709:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.062713:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062718:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1922ed lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062731:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062736:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062741:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.062746:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00002000:00010000:1.0:1787397787.063005:0:24830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787397787.063009:0:24830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397787.063011:0:24830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:1.0:1787397787.063013:0:24830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:1.0:1787397787.063015:0:24830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1787397787.063025:0:24830:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd6300 x1874218681263872/t4294968769(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397787.063091:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:2405:x1874218681263872:12345-192.168.204.60@tcp:10:dd.0 Request processed in 3655us (4023us total) trans 4294968769 rc 0/0 00000100:00100000:1.0:1787397787.063099:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 568 00010000:00010000:3.0:1787397787.063480:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.063489:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.063499:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a70526e600) 00010000:00010000:3.0:1787397787.063502:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397787.063505:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.063511:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1922f4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397787.063603:0:24830:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:1.0:1787397787.063608:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82ebd6300 with x1874218681263872 ext(0->18446744073709551615) 00002000:00010000:1.0:1787397787.063616:0:24830:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82ebd6300. 00010000:00010000:3.0:1787397787.063802:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1922e6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d853f expref: 139 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.063817:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1922fb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d853f expref: 138 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.063824:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:3.0:1787397787.063826:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397787.063829:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:3.0:1787397787.063865:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+138:73644:x1874218681264512:12345-192.168.204.60@tcp:101:dd.0 Request processed in 1858us (1984us total) trans 120259084426 rc 0/0 00000100:00100000:3.0:1787397787.063872:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1553 00000100:00100000:2.0:1787397787.064880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.064927:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264768 00000100:00100000:3.0:1787397787.064935:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264768 00000100:00100000:2.0:1787397787.064955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.065024:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.065116:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681265152 00000100:00100000:1.0:1787397787.065120:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681265152 00000100:00100000:1.0:1787397787.065172:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1554 00000100:00100000:1.0:1787397787.065181:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+138:73643:x1874218681265152:12345-192.168.204.60@tcp:36:dd.0 00000100:00100000:3.0:1787397787.065226:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 276 00010000:00010000:1.0:1787397787.065231:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787397787.065241:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+139:73642:x1874218681264768:12345-192.168.204.60@tcp:35:dd.0 00010000:00010000:1.0:1787397787.065252:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1922b5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8523 expref: 139 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.065269:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397787.065279:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397787.065461:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.065479:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.065488:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397787.065556:0:67264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084427 00000004:00010000:1.0:1787397787.065581:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ba1c772 reply state 00000000530eec5e transno 120259084428 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.065593:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.065599:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397787.065602:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397787.065605:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397787.065859:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+142:73643:x1874218681265152:12345-192.168.204.60@tcp:36:dd.0 Request processed in 501us (656us total) trans 120259084428 rc 0/0 00000100:00100000:1.0:1787397787.065877:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1554 00000020:00080000:1.0:1787397787.065883:0:67264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787397787.066186:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+141:73642:x1874218681264768:12345-192.168.204.60@tcp:35:dd.0 Request processed in 952us (1309us total) trans 120259084429 rc 0/0 00000100:00100000:3.0:1787397787.066194:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 276 00000100:00100000:0.0:1787397787.066336:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264896 00000100:00100000:0.0:1787397787.066343:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264896 00002000:00010000:0.0:1787397787.066368:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:0.0:1787397787.066381:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70261b100 with x1874218681264896 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397787.066389:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70261b100. 00000100:00100000:0.0:1787397787.066462:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 570 00000100:00100000:0.0:1787397787.066471:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+38:2403:x1874218681264896:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:0.0:1787397787.066596:0:24843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787397787.066600:0:24843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:0.0:1787397787.066603:0:24843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:0.0:1787397787.066605:0:24843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:0.0:1787397787.066607:0:24843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1787397787.066614:0:24843:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70261b100 x1874218681264896/t4294968770(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397787.066650:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:2403:x1874218681264896:12345-192.168.204.60@tcp:10:dd.0 Request processed in 181us (1694us total) trans 4294968770 rc 0/0 00000100:00100000:0.0:1787397787.066657:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 570 00002000:00010000:0.0:1787397787.066660:0:24843:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:0.0:1787397787.066662:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70261b100 with x1874218681264896 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397787.066667:0:24843:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70261b100. 00000100:00100000:1.0:1787397787.069716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.069753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.069786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.069824:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.069865:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681265792 00000100:00100000:3.0:1787397787.069877:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681265408 00000100:00100000:2.0:1787397787.069877:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681265792 00000100:00100000:3.0:1787397787.069881:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681265408 00000100:00100000:2.0:1787397787.069925:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 277 00000100:00100000:2.0:1787397787.069935:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+142:73640:x1874218681265792:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.069970:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681265536 00000100:00100000:3.0:1787397787.069973:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681265536 00000100:00100000:1.0:1787397787.070161:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1555 00000100:00100000:1.0:1787397787.070171:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+144:73645:x1874218681265408:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397787.070197:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397787.070215:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192310 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8546 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397787.070228:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+145:73640:x1874218681265792:12345-192.168.204.60@tcp:35:dd.0 Request processed in 296us (442us total) trans 120259084430 rc 0/0 00000100:00100000:2.0:1787397787.070236:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 277 00010000:00010000:1.0:1787397787.070716:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070731:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070741:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070756:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070764:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070770:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070816:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192325 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070825:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192325 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070832:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192325 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397787.070843:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00000100:00100000:0.0:1787397787.070848:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681265920 00000100:00100000:0.0:1787397787.070854:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681265920 00010000:00010000:1.0:1787397787.070903:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070912:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070918:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070925:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.070931:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1a774f0) 00000100:00100000:0.0:1787397787.070933:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5036 00000100:00100000:0.0:1787397787.070941:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:73643:x1874218681265920:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:0.0:1787397787.070950:0:26162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397787.070963:0:26162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192333 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8554 expref: -99 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397787.070995:0:26162:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:0.0:1787397787.071011:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:0.0:1787397787.071016:0:26162:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397787.071024:0:26162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 40 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.071035:0:26162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 40 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397787.071046:0:26162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0200, rc 0) 00010000:00000080:0.0:1787397787.071052:0:26162:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6d880 x1874218681265920/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397787.071090:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:784819ec-79bc-4534-8fa6-902d7a92d2f8+40:73643:x1874218681265920:12345-192.168.204.60@tcp:101:dd.0 Request processed in 150us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.071097:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5036 00000100:00100000:3.0:1787397787.072027:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1556 00000100:00100000:3.0:1787397787.072043:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+145:73644:x1874218681265536:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397787.072057:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.072074:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d19233a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d854d expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072106:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d192341 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072116:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d192341 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072126:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d192341 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072216:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d19233a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d854d expref: 147 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072238:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d192341 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d854d expref: 146 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.072258:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:3.0:1787397787.072261:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787397787.072265:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:3.0:1787397787.072314:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+146:73644:x1874218681265536:12345-192.168.204.60@tcp:101:dd.0 Request processed in 275us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.072333:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1556 00010000:00010000:1.0:1787397787.072716:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072731:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072744:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397787.072746:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397787.072827:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072835:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192317 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072849:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072856:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072862:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072876:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397787.072880:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072886:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072895:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a81ab06300) 00010000:00010000:1.0:1787397787.072898:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397787.072900:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072907:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19231e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072961:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192310 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8546 expref: 146 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072974:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192325 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8546 expref: 145 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.072982:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:1.0:1787397787.072985:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397787.072988:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:1.0:1787397787.073064:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+145:73645:x1874218681265408:12345-192.168.204.60@tcp:101:dd.0 Request processed in 2894us (3357us total) trans 120259084431 rc 0/0 00000100:00100000:1.0:1787397787.073072:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1555 00000100:00100000:2.0:1787397787.073503:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.073912:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266176 00000100:00100000:3.0:1787397787.073921:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266176 00000100:00100000:3.0:1787397787.074017:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 278 00000100:00100000:3.0:1787397787.074026:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+145:73641:x1874218681266176:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.074369:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+146:73641:x1874218681266176:12345-192.168.204.60@tcp:35:dd.0 Request processed in 343us (866us total) trans 120259084432 rc 0/0 00000100:00100000:3.0:1787397787.074377:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 278 00000100:00100000:1.0:1787397787.076682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.076742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.077069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.077140:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266560 00000100:00100000:2.0:1787397787.077150:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266560 00000100:00100000:2.0:1787397787.077221:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266688 00000100:00100000:2.0:1787397787.077224:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266688 00000100:00100000:2.0:1787397787.077259:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1557 00000100:00100000:2.0:1787397787.077268:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+147:73644:x1874218681266560:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:2.0:1787397787.077333:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397787.077368:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1922fb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d853f expref: 147 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.077390:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00000100:00100000:0.0:1787397787.077394:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266304 00010000:00010000:2.0:1787397787.077396:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397787.077401:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266304 00002000:00010000:0.0:1787397787.077428:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1787397787.077434:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a836693b80 with x1874218681266304 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397787.077445:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a836693b80. 00000100:00100000:0.0:1787397787.077468:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 571 00000100:00100000:0.0:1787397787.077476:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+40:2402:x1874218681266304:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:1.0:1787397787.077615:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1558 00000100:00100000:1.0:1787397787.077627:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+146:73645:x1874218681266688:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:1.0:1787397787.077642:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1787397787.077654:0:24842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787397787.077658:0:24842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00010000:00010000:1.0:1787397787.077661:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192348 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d855b expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397787.077672:0:24842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:0.0:1787397787.077676:0:24842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:0.0:1787397787.077679:0:24842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1787397787.077689:0:24842:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a836693b80 x1874218681266304/t4294968771(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787397787.077695:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19234f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.077710:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19234f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.077721:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19234f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.077802:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192348 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d855b expref: 148 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.077816:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19234f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d855b expref: 147 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397787.077824:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:1.0:1787397787.077827:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787397787.077829:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a400, rc 0) 00000100:00100000:0.0:1787397787.077835:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:2402:x1874218681266304:12345-192.168.204.60@tcp:10:dd.0 Request processed in 357us (1089us total) trans 4294968771 rc 0/0 00000100:00100000:0.0:1787397787.077844:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 571 00002000:00010000:0.0:1787397787.077848:0:24842:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:0.0:1787397787.077851:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a836693b80 with x1874218681266304 ext(0->18446744073709551615) 00002000:00010000:0.0:1787397787.077857:0:24842:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a836693b80. 00000100:00100000:1.0:1787397787.077864:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+147:73645:x1874218681266688:12345-192.168.204.60@tcp:101:dd.0 Request processed in 239us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.077871:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1558 00010000:00010000:2.0:1787397787.078689:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.078704:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.078713:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397787.078760:0:74374:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084433 00000004:00010000:2.0:1787397787.078781:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072ee3237 reply state 00000000fadb50b4 transno 120259084434 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.078792:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.078799:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:2.0:1787397787.078802:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397787.078805:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397787.078880:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+149:73644:x1874218681266560:12345-192.168.204.60@tcp:36:dd.0 Request processed in 1611us (2206us total) trans 120259084434 rc 0/0 00000100:00100000:2.0:1787397787.078889:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1557 00000020:00080000:2.0:1787397787.078894:0:74374:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787397787.083004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.083098:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266944 00000100:00100000:2.0:1787397787.083110:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266944 00000100:00100000:2.0:1787397787.083177:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1559 00000100:00100000:2.0:1787397787.083187:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+149:73645:x1874218681266944:12345-192.168.204.60@tcp:36:dd.0 00010000:00010000:2.0:1787397787.083261:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397787.083292:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192325 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8546 expref: 149 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.083311:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:2.0:1787397787.083318:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397787.083510:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.083642:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.083654:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397787.083697:0:66178:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084435 00000004:00010000:2.0:1787397787.083719:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f4a228c reply state 00000000ed8426df transno 120259084436 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.083730:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.083736:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:2.0:1787397787.083738:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397787.083741:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397787.083970:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+151:73645:x1874218681266944:12345-192.168.204.60@tcp:36:dd.0 Request processed in 782us (974us total) trans 120259084436 rc 0/0 00000100:00100000:2.0:1787397787.083978:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1559 00000020:00080000:2.0:1787397787.083983:0:66178:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787397787.086215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397787.086264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.086340:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267200 00000100:00100000:2.0:1787397787.086362:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267200 00000100:00100000:2.0:1787397787.086413:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 279 00000100:00100000:2.0:1787397787.086422:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+151:73643:x1874218681267200:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:2.0:1787397787.086771:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040be450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+152:73643:x1874218681267200:12345-192.168.204.60@tcp:35:dd.0 Request processed in 348us (561us total) trans 120259084437 rc 0/0 00000100:00100000:2.0:1787397787.086779:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 279 00000100:00100000:3.0:1787397787.087090:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267328 00000100:00100000:3.0:1787397787.087095:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267328 00000100:00100000:3.0:1787397787.087144:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5037 00000100:00100000:3.0:1787397787.087151:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:73644:x1874218681267328:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:3.0:1787397787.087163:0:26159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397787.087184:0:26159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d192364 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8562 expref: -99 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397787.087207:0:26159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:3.0:1787397787.087225:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:3.0:1787397787.087230:0:26159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397787.087246:0:26159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d192364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 42 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.087264:0:26159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d192364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 42 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397787.087277:0:26159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74200, rc 0) 00010000:00000080:3.0:1787397787.087284:0:26159:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a80763aa00 x1874218681267328/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.087336:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+42:73644:x1874218681267328:12345-192.168.204.60@tcp:101:dd.0 Request processed in 185us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.087342:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5037 00000100:00100000:1.0:1787397787.088371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.088466:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267456 00000100:00100000:2.0:1787397787.088473:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267456 00000100:00100000:2.0:1787397787.088628:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5038 00000100:00100000:2.0:1787397787.088638:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+42:73645:x1874218681267456:12345-192.168.204.60@tcp:101:dd.0 00010000:00010000:2.0:1787397787.088651:0:26157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397787.088669:0:26157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c710ded/0x274786fe0d19236b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8569 expref: -99 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397787.088688:0:26157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x6a89868f, atime: 0x6a89868f, ctime: 0x6a89868f, blocks: 0x0 00010000:00010000:2.0:1787397787.088704:0:26157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3666s v=(0 0) 00010000:00010000:2.0:1787397787.088708:0:26157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397787.088714:0:26157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c710ded/0x274786fe0d19236b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 43 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.088727:0:26157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c710ded/0x274786fe0d19236b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 43 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397787.088737:0:26157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718600, rc 0) 00010000:00000080:2.0:1787397787.088742:0:26157:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf8000 x1874218681267456/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 328/400 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397787.089203:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+43:73645:x1874218681267456:12345-192.168.204.60@tcp:101:dd.0 Request processed in 565us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.089211:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5038 00000100:00100000:2.0:1787397787.091657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.092095:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267584 00000100:00100000:3.0:1787397787.092106:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267584 00002000:00010000:3.0:1787397787.092151:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.092156:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70261bb80 with x1874218681267584 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.092170:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70261bb80. 00000100:00100000:3.0:1787397787.092297:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 572 00000100:00100000:3.0:1787397787.092307:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+43:2404:x1874218681267584:12345-192.168.204.60@tcp:10:dd.0 00000100:00100000:1.0:1787397787.093565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00002000:00010000:3.0:1787397787.093797:0:24832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397787.093801:0:24832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.093804:0:24832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397787.093806:0:24832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.093809:0:24832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397787.093819:0:24832:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70261bb80 x1874218681267584/t4294968772(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.093906:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:2404:x1874218681267584:12345-192.168.204.60@tcp:10:dd.0 Request processed in 1599us (2257us total) trans 4294968772 rc 0/0 00000100:00100000:3.0:1787397787.093915:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 572 00002000:00010000:3.0:1787397787.093920:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.093923:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70261bb80 with x1874218681267584 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.093930:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70261bb80. 00000100:00100000:3.0:1787397787.095026:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267712 00000100:00100000:3.0:1787397787.095037:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267712 00002000:00010000:3.0:1787397787.095072:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.095076:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a828cfad80 with x1874218681267712 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.095086:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a828cfad80. 00000100:00100000:3.0:1787397787.095110:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 573 00000100:00100000:3.0:1787397787.095118:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+44:2403:x1874218681267712:12345-192.168.204.60@tcp:10:dd.0 00002000:00010000:3.0:1787397787.095543:0:24832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787397787.095548:0:24832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb mtime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.095551:0:24832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb atime from disk: 1787397775 -> 1787397775 00002000:00010000:3.0:1787397787.095553:0:24832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb ctime from disk: 1787397775 -> 1787397786 00002000:00010000:3.0:1787397787.095555:0:24832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1787397787.095565:0:24832:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfad80 x1874218681267712/t4294968773(0) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:228/0 lens 440/432 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397787.095711:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+45:2403:x1874218681267712:12345-192.168.204.60@tcp:10:dd.0 Request processed in 592us (2151us total) trans 4294968773 rc 0/0 00000100:00100000:3.0:1787397787.095721:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 573 00002000:00010000:3.0:1787397787.095725:0:24832:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:3.0:1787397787.095740:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a828cfad80 with x1874218681267712 ext(0->18446744073709551615) 00002000:00010000:3.0:1787397787.095746:0:24832:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a828cfad80. 00000100:00100000:1.0:1787397787.100719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.100853:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267968 00000100:00100000:3.0:1787397787.100866:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267968 00000100:00100000:3.0:1787397787.100930:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 280 00000100:00100000:3.0:1787397787.100951:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+152:73644:x1874218681267968:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.101430:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+153:73644:x1874218681267968:12345-192.168.204.60@tcp:35:dd.0 Request processed in 488us (718us total) trans 120259084438 rc 0/0 00000100:00100000:3.0:1787397787.101439:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 280 00000100:00100000:1.0:1787397787.101571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.101648:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268224 00000100:00100000:3.0:1787397787.101653:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268224 00000100:00100000:3.0:1787397787.101685:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 281 00000100:00100000:3.0:1787397787.101694:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+153:73645:x1874218681268224:12345-192.168.204.60@tcp:35:dd.0 00000100:00100000:3.0:1787397787.102019:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+154:73645:x1874218681268224:12345-192.168.204.60@tcp:35:dd.0 Request processed in 325us (447us total) trans 120259084439 rc 0/0 00000100:00100000:3.0:1787397787.102027:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 281 00000100:00100000:0.0:1787397787.111222:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701133056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111304:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111345:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701133568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111374:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111393:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701134080:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111436:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787397787.111443:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701132928:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111480:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701133440:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111552:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111573:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701133952:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.111595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.111639:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133440 00000100:00100000:0.0:1787397787.111647:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133440 00000100:00100000:0.0:1787397787.111689:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133952 00000100:00100000:0.0:1787397787.111692:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133952 00000100:00100000:0.0:1787397787.111708:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1787397787.111716:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701133440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.112011:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701133440:12345-0@lo:400:kworker.0 Request processed in 293us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.112019:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1787397787.112037:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1787397787.112043:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.112073:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701133952:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.112078:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1787397787.112105:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133568 00000100:00100000:0.0:1787397787.112108:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133568 00000100:00100000:0.0:1787397787.112141:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134080 00000100:00100000:0.0:1787397787.112144:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134080 00000100:00100000:0.0:1787397787.112164:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1787397787.112170:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701133568:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397787.112185:0:26167:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8179a2300 x1874218701133568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:228/0 lens 224/224 e 0 to 0 dl 1787397798 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397787.112215:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701133568:12345-0@lo:400:kworker.0 Request processed in 46us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.112220:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1787397787.112402:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701134464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397787.112436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397787.112467:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133056 00000100:00100000:3.0:1787397787.112471:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133056 00000100:00100000:3.0:1787397787.112500:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132928 00000100:00100000:3.0:1787397787.112503:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132928 00000100:00100000:3.0:1787397787.112542:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787397787.112549:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701133056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397787.112581:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701133056:12345-0@lo:400:kworker.0 Request processed in 33us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.112599:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1787397787.112614:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1787397787.112620:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701132928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397787.112651:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701132928:12345-0@lo:400:kworker.0 Request processed in 31us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.112657:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1787397787.112728:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1787397787.112735:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701134080:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397787.112840:0:26167:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8179a2a00 x1874218701134080/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:228/0 lens 224/224 e 0 to 0 dl 1787397798 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397787.112871:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701134080:12345-0@lo:400:kworker.0 Request processed in 136us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.112876:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00080000:0.0:1787397787.112894:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397787.112897:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397787.112899:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397787.112906:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134464 00000100:00100000:0.0:1787397787.112910:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134464 00000100:00100000:2.0:1787397787.113054:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701132800:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113118:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701133312:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113154:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701133824:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113188:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701134336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113226:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787397787.113245:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701133184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113282:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701133696:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113303:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113317:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701134208:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397787.113376:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133696 00000100:00100000:2.0:1787397787.113380:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133696 00000100:00100000:2.0:1787397787.113410:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134208 00000100:00100000:2.0:1787397787.113413:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134208 00000100:00100000:2.0:1787397787.113434:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1787397787.113441:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701133696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113487:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701133696:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.113493:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1787397787.113506:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1787397787.113512:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701134208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113567:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701134208:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.113573:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1787397787.113611:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701133696:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113623:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701134208:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.113650:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133312 00000100:00100000:2.0:1787397787.113653:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133312 00000100:00100000:2.0:1787397787.113672:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133824 00000100:00100000:2.0:1787397787.113676:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133824 00000100:00100000:2.0:1787397787.113685:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134336 00000100:00100000:2.0:1787397787.113687:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134336 00000100:00100000:2.0:1787397787.113697:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701133184 00000100:00100000:2.0:1787397787.113699:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701133184 00000100:00100000:2.0:1787397787.113711:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1787397787.113717:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701133312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.114005:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701133312:12345-0@lo:400:kworker.0 Request processed in 218us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.114012:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1787397787.114039:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701133312:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.114058:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1787397787.114066:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701133824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.114109:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701133824:12345-0@lo:400:kworker.0 Request processed in 44us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.114115:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1787397787.114139:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701133824:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.114157:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1787397787.114163:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701134336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.114196:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701134336:12345-0@lo:400:kworker.0 Request processed in 34us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397787.114201:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1787397787.114221:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701134336:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114317:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1787397787.114338:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701134464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397787.114366:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397787.114410:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701134464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.114415:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00080000:0.0:1787397787.114432:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397787.114435:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397787.114437:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397787.114464:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701134464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397787.114495:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701132928:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114504:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701133440:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114514:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701133952:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114539:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701133056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114551:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701133568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397787.114572:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701134080:0@lo:400:kworker.0 00000100:00100000:1.0:1787397787.114730:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701132800 00000100:00100000:1.0:1787397787.114735:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701132800 00000100:00100000:1.0:1787397787.114779:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787397787.114786:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701132800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397787.114820:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701132800:12345-0@lo:400:kworker.0 Request processed in 35us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.114825:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787397787.114852:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397787.114860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701134592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397787.114886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397787.114912:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134592 00000100:00100000:1.0:1787397787.114916:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134592 00000100:00100000:1.0:1787397787.114953:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:1.0:1787397787.114960:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701134592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397787.114978:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397787.115009:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701134592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.115014:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:1.0:1787397787.115041:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701134592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397787.115065:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1787397787.115072:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701133184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397787.115111:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701133184:12345-0@lo:400:kworker.0 Request processed in 40us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.115116:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1787397787.115403:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701133184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.115413:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701132800:0@lo:400:kworker.0 00000100:00100000:2.0:1787397787.402015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397787.402065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.402147:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268352 00000100:00100000:3.0:1787397787.402156:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268352 00000100:00100000:3.0:1787397787.402218:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:3.0:1787397787.402230:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681268352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397787.402230:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268480 00000100:00100000:1.0:1787397787.402237:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268480 00000100:00100000:1.0:1787397787.402293:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1425 00000100:00100000:1.0:1787397787.402302:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681268480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397787.402311:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681268352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.402334:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 183 00000100:00100000:1.0:1787397787.402353:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681268480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.402363:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1425 00000100:00080000:1.0:1787397787.402388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397787.402901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397787.402970:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268608 00000100:00100000:3.0:1787397787.402977:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268608 00000100:00100000:3.0:1787397787.403031:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2658 00000100:00100000:3.0:1787397787.403039:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681268608:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397787.403077:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681268608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397787.403085:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2658 00000100:00080000:1.0:1787397787.403936:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397787.494474:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397787.620687:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397787.620710:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701134720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397787.620790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.621183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134720 00000100:00100000:0.0:1787397787.621192:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134720 00000100:00100000:0.0:1787397787.621242:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1787397787.621251:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701134720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397787.621284:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397787.621340:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701134720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.621347:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1787397787.621401:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701134720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397787.621645:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397787.621682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397787.621715:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134976 00000100:00100000:1.0:1787397787.621720:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134976 00000100:00100000:1.0:1787397787.621746:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1787397787.621753:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701134976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397787.621772:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:1.0:1787397787.621783:0:19690:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82e4f6d80 x1874218701134976/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:228/0 lens 224/368 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397787.621817:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701134976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397787.621823:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1787397787.621855:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397787.622177:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701135104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397787.622209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.622238:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135104 00000100:00100000:0.0:1787397787.622242:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135104 00000100:00100000:0.0:1787397787.622267:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1787397787.622276:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701135104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397787.622288:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397787.622332:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701135104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.622338:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1787397787.622366:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701135104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397787.622401:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701134848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397787.622430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397787.622455:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701134848 00000100:00100000:0.0:1787397787.622458:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701134848 00000100:00100000:0.0:1787397787.622477:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1787397787.622482:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701134848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397787.622493:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:0.0:1787397787.622501:0:8439:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70731ed80 x1874218701134848/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:228/0 lens 224/368 e 0 to 0 dl 1787397798 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397787.622549:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701134848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397787.622555:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1787397787.622582:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701134848:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787397788.518269:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787397788.855074:0:95967:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787397788.855134:0:95967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.855427:0:95967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.855446:0:95967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.855453:0:95967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.855472:0:95967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787397788.855479:0:95967:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787397788.855509:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787397788.855514:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787397788.855520:0:95967:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787397788.855569:0:95967:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787397788.856166:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397788.856175:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856194:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397788.856200:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856210:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397788.856219:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397788.856238:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397788.856241:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397788.856244:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397788.856278:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856285:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397788.856321:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856329:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d19199a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856348:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397788.856350:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397788.856353:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397788.856363:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397788.856383:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701135360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397788.856473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397788.856565:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135360 00000100:00100000:0.0:1787397788.856573:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135360 00000100:00100000:0.0:1787397788.856631:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787397788.856642:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834539450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701135360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397788.856656:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397788.856672:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1919a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19199a expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.856688:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397788.856738:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834539450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701135360:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397788.856748:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787397788.856818:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701135360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397788.856859:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701135232:0@lo:39:umount.0 00000100:00100000:0.0:1787397788.856892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397788.856921:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135232 00000100:00100000:2.0:1787397788.856927:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135232 00000100:00100000:2.0:1787397788.856967:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1787397788.856975:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701135232:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397788.862239:0:66178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1915c6 00000100:00080000:2.0:1787397788.862458:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a837bc3000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787397788.862591:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3647:x1874218701135232:12345-0@lo:39:umount.0 Request processed in 5611us (5694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397788.862621:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000020:00000080:2.0:1787397788.862636:0:66178:0:(genops.c:906:class_export_put()) final put ffff89a7054c4000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1787397788.864944:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397788.870544:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702321000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397788.870576:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701135232:0@lo:39:umount.0 00000100:00080000:3.0:1787397788.870609:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787397788.870616:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000020:00000080:0.0:1787397788.870620:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787397788.870622:0:95967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397788.870698:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bc3000 for lustre-MDT0000 00000100:00080000:3.0:1787397788.871545:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397788.871550:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787397788.871555:0:95967:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787397788.871576:0:95967:0:(import.c:65:import_set_state_nolock()) ffff89a702324000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397788.872060:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701135488:0@lo:39:umount.0 00000100:00100000:0.0:1787397788.872138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397788.873237:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135488 00000100:00100000:3.0:1787397788.873249:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135488 00000100:00100000:3.0:1787397788.873319:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1787397788.873329:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701135488:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787397788.873357:0:66177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b35d 00000100:00080000:3.0:1787397788.873365:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a83fa42800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787397788.873437:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3647:x1874218701135488:12345-0@lo:39:umount.0 Request processed in 110us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397788.873456:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000020:00000080:3.0:1787397788.873467:0:66177:0:(genops.c:906:class_export_put()) final put ffff89a83fa40800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:0.0:1787397788.873635:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397788.873671:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702324000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397788.873686:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701135488:0@lo:39:umount.0 00000100:00080000:3.0:1787397788.873711:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397788.873717:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787397788.873722:0:95967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397788.873800:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa40800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787397788.873935:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83fa42800 for lustre-MDT0001 00010000:00010000:3.0:1787397788.875762:0:95967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875779:0:95967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875786:0:95967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875792:0:95967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875815:0:95967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397788.875822:0:95967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875828:0:95967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875834:0:95967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875839:0:95967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.875866:0:95967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787397788.875871:0:95967:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787397788.875921:0:95967:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787397788.875926:0:95967:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:3.0:1787397788.875931:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1787397788.875937:0:95967:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:2.0:1787397788.878614:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397788.878629:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878641:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397788.878646:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878657:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397788.878663:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397788.878668:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397788.878671:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787397788.878674:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787397788.878715:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878721:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397788.878759:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878767:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62400/0x274786fe0d1919a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1919af expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878798:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397788.878801:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878807:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397788.878809:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878815:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397788.878821:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397788.878825:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787397788.878827:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787397788.878829:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787397788.878844:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878849:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397788.878866:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878872:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d22e00/0x274786fe0d19159c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1915a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.878880:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397788.878882:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397788.878889:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397788.878897:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397788.878905:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397788.878926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701135616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397788.878999:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397788.879059:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701135744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397788.879087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397788.879117:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135616 00000100:00100000:0.0:1787397788.879136:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135744 00000100:00100000:0.0:1787397788.879144:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135744 00000100:00100000:1.0:1787397788.879241:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1787397788.879253:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701135744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397788.879268:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397788.879283:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74400/0x274786fe0d1915a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19159c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397788.879309:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397788.879356:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701135744:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397788.879364:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787397788.879410:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135616 00000100:00100000:0.0:1787397788.879506:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701135744:0@lo:103:ldlm_bl.0 00002000:00000080:3.0:1787397788.880678:0:95967:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1787397788.880723:0:95967:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000100:00100000:2.0:1787397788.881014:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1787397788.881027:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701135616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397788.881044:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397788.881062:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d1919af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1919a8 expref: 22 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397788.881075:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397788.881133:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701135616:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397788.881140:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1787397788.881326:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701135616:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1787397788.881465:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968773 is committed 00000020:00000080:3.0:1787397788.881767:0:95967:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1787397788.881778:0:95967:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a83ae93000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968773 stale:0 00000020:00080000:3.0:1787397788.881786:0:95967:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a817efd800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968749 stale:0 00000020:00080000:3.0:1787397788.881791:0:95967:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a703c34000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968731 stale:0 00000020:00080000:3.0:1787397788.881797:0:95967:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff89a70207cd40) has exports, disconnecting them 00000020:00080000:3.0:1787397788.881803:0:95967:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.60@tcp (ffff89a83ae93000), last request at 1787397787 00000020:00000080:3.0:1787397788.881810:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1917da 00000020:00010000:3.0:1787397788.881819:0:95967:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83ae93000: total 0 00000100:00080000:3.0:1787397788.881823:0:95967:0:(import.c:65:import_set_state_nolock()) ffff89a83ae90000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397788.881847:0:95967:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a83ae93000): rc 0 00000020:00080000:3.0:1787397788.881852:0:95967:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a817efd800), last request at 1787397787 00000020:00000080:3.0:1787397788.881857:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1914a7 00000100:00080000:3.0:1787397788.881865:0:95967:0:(import.c:65:import_set_state_nolock()) ffff89a817eff000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787397788.881873:0:95967:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817efd800): rc 0 00000020:00000080:3.0:1787397788.881876:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a817efd800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1787397788.881882:0:95967:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a703c34000), last request at 1787397787 00000020:00000080:3.0:1787397788.881885:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2d8 00000100:00080000:3.0:1787397788.881890:0:95967:0:(import.c:65:import_set_state_nolock()) ffff89a703c33800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787397788.881908:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83ae93000: total 1 00000020:00080000:3.0:1787397788.881919:0:95967:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a703c34000): rc 0 00000020:00000080:3.0:1787397788.881921:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a703c34000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1787397788.881952:0:95967:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff89a70207cd40) has no exports 00000020:00000080:1.0:1787397788.882110:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787397788.882142:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c34000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787397788.882159:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817eff000 for lustre-OST0000 00000020:00000080:1.0:1787397788.882163:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a703c33800 for lustre-OST0000 00010000:00010000:3.0:1787397788.883146:0:95967:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d191f4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 21 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.883180:0:95967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d191f4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 21 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.883234:0:95967:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000004413a727/0x274786fe0d191feb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 20 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.883245:0:95967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004413a727/0x274786fe0d191feb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 20 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.883277:0:95967:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d191f89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397788.883299:0:95967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8b29aa/0x274786fe0d191f89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397788.883615:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397788.883815:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83ae93000, canceled 0 locks, left on hash table 17. 00010000:00010000:0.0:1787397788.883855:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d1922d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 18 pid: 26164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883877:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192333 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 17 pid: 26162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883908:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d192364 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 16 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883926:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d19200e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 15 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883943:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d191ff2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 14 pid: 26158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883959:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba5a11a/0x274786fe0d19218f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 13 pid: 26167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883977:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192229 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 12 pid: 26163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.883995:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014e9eca7/0x274786fe0d192206 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 11 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884014:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2881505/0x274786fe0d1922bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 10 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884033:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c710ded/0x274786fe0d19236b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 9 pid: 26157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884066:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f40df3f2/0x274786fe0d1920c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 8 pid: 25908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884083:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d192188 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884100:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d1920e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 6 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884180:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a50268/0x274786fe0d19207e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 5 pid: 26160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884204:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d192142 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 4 pid: 26159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884221:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa9f413/0x274786fe0d1921c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 3 pid: 26168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884238:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de5d30d/0x274786fe0d19228b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 2 pid: 26165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397788.884249:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83ae93000, canceled 17 locks, left on hash table 0. 00010000:00010000:2.0:1787397788.886010:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397788.887095:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a83ae93000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397788.887468:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae93000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:1.0:1787397788.887551:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae90000 for lustre-OST0000 00010000:00010000:2.0:1787397788.887552:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397788.887555:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397788.887558:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787397788.888264:0:95967:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7024d5840 - data ffff89a827c370d8/ffff89a83b96f000 00000020:01000000:3.0:1787397788.888710:0:95967:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a83ba70d20 - data ffff89a701c0a948/ffff89a702472000 00100000:10000000:3.0:1787397788.899579:0:95967:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787397788.911449:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b740 00000020:00000080:2.0:1787397788.911464:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a702025800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787397788.911539:0:95967:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a836577000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787397788.911544:0:95967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a836577000 2 00000020:01000004:2.0:1787397788.911560:0:95967:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a836577000 from lustre-OST0000 00000020:00000080:2.0:1787397788.911585:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397788.911601:0:95967:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787397788.911616:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a702026000/lustre-OST0000_UUID 00000020:00000080:2.0:1787397788.911620:0:95967:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702026000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787397788.911627:0:95967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787397788.911674:0:95967:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787397788.911677:0:95967:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787397788.911680:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397788.911686:0:95967:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787397788.911693:0:95967:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89a702323800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397788.911698:0:95967:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff89a83549cd40) has exports, disconnecting them 00000020:00080000:2.0:1787397788.911703:0:95967:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89a702323800), last request at 1787394350 00000020:00000080:2.0:1787397788.911707:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b76a 00000020:00080000:2.0:1787397788.911716:0:95967:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a702323800): rc 0 00000020:00000080:2.0:1787397788.911721:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a702323800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787397788.911863:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702025800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787397788.913326:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702323800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787397788.916123:0:95967:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787397788.916133:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397788.916138:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397788.916145:0:95967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397788.916207:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702321000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787397788.916556:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397788.916569:0:95967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787397788.916575:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a836493800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787397788.916579:0:95967:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836493800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787397788.916595:0:95967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787397788.918455:0:95967:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787397788.918464:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397788.918478:0:95967:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787397788.918486:0:95967:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff89a702325000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397788.918494:0:95967:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff89a70247b380) has exports, disconnecting them 00000020:00080000:0.0:1787397788.918500:0:95967:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff89a702325000), last request at 1787394350 00000020:00000080:0.0:1787397788.918506:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b77f 00000020:00080000:0.0:1787397788.918550:0:95967:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a702325000): rc 0 00000020:00000080:0.0:1787397788.918556:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a702325000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397788.919077:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702325000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787397788.929662:0:95967:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787397788.929673:0:95967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397788.929678:0:95967:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787397788.929687:0:95967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397788.930074:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702324000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397788.930638:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397788.930664:0:95967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787397788.930671:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a702321800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787397788.930676:0:95967:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702321800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787397788.930682:0:95967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787397788.930877:0:95967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a836577000 1 00000020:00000080:1.0:1787397788.930883:0:95967:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b708 00000020:00000080:1.0:1787397788.930890:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a836576000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787397788.931060:0:95967:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787397788.931073:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836576000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787397788.931085:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397788.931092:0:95967:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787397788.931095:0:95967:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff89a82e4f8000) has no exports 00000020:00000080:2.0:1787397789.015678:0:95967:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397789.015699:0:95967:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787397789.015704:0:95967:0:(genops.c:906:class_export_put()) final put ffff89a836570000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787397789.015709:0:95967:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836570000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787397789.015722:0:95967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787397789.015842:0:95967:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a836575800 00000020:02000400:2.0:1787397789.016212:0:95967:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787397789.540755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397790.565030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397791.493755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397791.493757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397791.495720:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268736 00000100:00100000:1.0:1787397791.495735:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268736 00000100:00100000:1.0:1787397791.495803:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 574 00000100:00100000:1.0:1787397791.495812:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2404:x1874218681268736:12345-192.168.204.60@tcp:4:dd.0 00000020:00080000:1.0:1787397791.495822:0:24828:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397791.496306:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0+-99:2404:x1874218681268736:12345-192.168.204.60@tcp:4:dd.0 Request processed in 490us (2548us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397791.496317:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 574 00000100:00100000:0.0:1787397791.496901:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268864 00000100:00100000:0.0:1787397791.496910:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268864 00000100:00100000:0.0:1787397791.497113:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5039 00000100:00100000:0.0:1787397791.497121:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2404:x1874218681268864:12345-192.168.204.60@tcp:16:kworker.0 00000020:00080000:0.0:1787397791.497129:0:25908:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:0.0:1787397791.497185:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2404:x1874218681268864:12345-192.168.204.60@tcp:16:kworker.0 Request processed in 62us (3448us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787397791.497193:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5039 00000100:00100000:2.0:1787397791.516028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397791.516382:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268992 00000100:00100000:1.0:1787397791.516394:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268992 00000100:00100000:1.0:1787397791.516458:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5040 00000100:00100000:1.0:1787397791.516468:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681268992:12345-192.168.204.60@tcp:8:ptlrpcd_01_00.0 00010000:00020000:1.0:1787397791.516495:0:15073:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397791.516583:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681268992:12345-192.168.204.60@tcp:8:ptlrpcd_01_00.0 Request processed in 114us (563us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397791.516602:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5040 00010000:00010000:0.0:1787397791.589689:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397792.229051:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701136000:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.229155:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701136512:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.229272:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701137024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229295:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.229321:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397792.229327:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701136128:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.229366:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701136640:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.229419:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701137152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397792.229441:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.229915:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701136256:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.229953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.229986:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701136768:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230025:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.230040:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701137280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397792.230058:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.230079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787397792.230085:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701135872:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.230141:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701136384:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230162:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397792.230261:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136000 00000100:00100000:1.0:1787397792.230269:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136000 00000100:00100000:1.0:1787397792.230343:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136128 00000100:00100000:1.0:1787397792.230347:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136128 00000100:00100000:3.0:1787397792.230399:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136256 00000100:00100000:3.0:1787397792.230410:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136256 00000100:00100000:3.0:1787397792.230432:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136768 00000100:00100000:3.0:1787397792.230434:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136768 00000100:00100000:3.0:1787397792.230444:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137280 00000100:00100000:3.0:1787397792.230446:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137280 00000100:00100000:3.0:1787397792.230471:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1787397792.230481:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701136256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397792.230568:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701136256:12345-0@lo:400:kworker.0 Request processed in 78us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.230576:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1787397792.230593:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:3.0:1787397792.230599:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701136768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397792.230628:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701136768:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.230634:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:3.0:1787397792.230646:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:3.0:1787397792.230652:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701137280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397792.230674:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397792.230704:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701137280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.230709:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:2.0:1787397792.230871:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701136896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.230943:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701136256:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230953:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701136768:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.230965:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701137280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397792.231027:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136512 00000100:00100000:3.0:1787397792.231032:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136512 00000100:00100000:3.0:1787397792.231063:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137024 00000100:00100000:3.0:1787397792.231067:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137024 00000100:00100000:3.0:1787397792.231086:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136384 00000100:00100000:3.0:1787397792.231089:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136384 00000100:00100000:3.0:1787397792.231101:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136896 00000100:00100000:3.0:1787397792.231112:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136896 00000100:00100000:3.0:1787397792.231131:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1787397792.231138:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701136512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397792.231178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701136512:12345-0@lo:400:kworker.0 Request processed in 41us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.231185:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1787397792.231196:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1787397792.231201:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701137024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397792.231240:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701137024:12345-0@lo:400:kworker.0 Request processed in 38us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.231246:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1787397792.231257:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5041 00000100:00100000:3.0:1787397792.231262:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874218701136384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397792.231267:0:8437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397792.231301:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874218701136384:12345-0@lo:400:kworker.0 Request processed in 37us (1137us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397792.231307:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5041 00000100:00100000:3.0:1787397792.231317:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042 00000100:00100000:3.0:1787397792.231321:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874218701136896:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397792.231325:0:8437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397792.231348:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874218701136896:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397792.231354:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042 00000100:00100000:1.0:1787397792.231504:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701136640 00000100:00100000:1.0:1787397792.231509:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701136640 00000100:00100000:2.0:1787397792.231628:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137152 00000100:00100000:2.0:1787397792.231633:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137152 00000100:00100000:2.0:1787397792.231685:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1787397792.231692:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701136000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.231725:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701136000:12345-0@lo:400:kworker.0 Request processed in 35us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.231732:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1787397792.231747:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1787397792.231753:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701136128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.231780:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701136128:12345-0@lo:400:kworker.0 Request processed in 27us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.231796:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1787397792.231809:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1787397792.231815:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701136640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.231846:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701136640:12345-0@lo:400:kworker.0 Request processed in 31us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.231852:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1787397792.231863:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1787397792.231869:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701137152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.231894:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701137152:12345-0@lo:400:kworker.0 Request processed in 26us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.231900:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1787397792.231927:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701135872 00000100:00100000:2.0:1787397792.231930:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701135872 00000100:00100000:2.0:1787397792.231961:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787397792.231967:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701135872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.231997:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701135872:12345-0@lo:400:kworker.0 Request processed in 30us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.232002:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787397792.232051:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701135872:0@lo:400:kworker.0 00000100:00080000:2.0:1787397792.232065:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397792.232069:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397792.232073:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787397792.232087:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787397792.232090:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397792.232101:0:3650:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2791 00000100:00080000:2.0:1787397792.232106:0:3650:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397792.232132:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70731d500 x1874218701137408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397792.232153:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701136384:0@lo:400:kworker.0 00000100:00080000:2.0:1787397792.232165:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397792.232168:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397792.232172:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787397792.232181:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787397792.232183:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397792.232186:0:3650:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3620 00000100:00080000:2.0:1787397792.232208:0:3650:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397792.232232:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70731df80 x1874218701137536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397792.232243:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701136896:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232424:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701136128:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232436:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701136640:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232446:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701137152:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232457:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701136000:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701136512:0@lo:400:kworker.0 00000100:00100000:2.0:1787397792.232500:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701137024:0@lo:400:kworker.0 00000100:00080000:2.0:1787397792.232590:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397792.232595:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397792.232597:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397792.232631:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397792.232639:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701137664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397792.232669:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.232737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701137408:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397792.232762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.232779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701137536:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397792.232797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397792.232833:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137408 00000100:00100000:2.0:1787397792.232839:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137408 00000100:00100000:2.0:1787397792.232860:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137536 00000100:00100000:2.0:1787397792.232863:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137536 00000100:00100000:2.0:1787397792.232877:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043 00000100:00100000:2.0:1787397792.232883:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3647:x1874218701137408:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397792.232902:0:26168:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397792.232934:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3647:x1874218701137408:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 50us (171us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397792.232941:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043 00000100:00100000:2.0:1787397792.232952:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5044 00000100:00100000:2.0:1787397792.232956:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3647:x1874218701137536:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:2.0:1787397792.232965:0:26168:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397792.232986:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3647:x1874218701137536:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 28us (188us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397792.232992:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5044 00000100:00080000:2.0:1787397792.233024:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397792.233029:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397792.233031:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701137408:0@lo:8:ptlrpcd_00_02.0 00000100:00080000:2.0:1787397792.233038:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397792.233041:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397792.233043:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701137536:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1787397792.233239:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137664 00000100:00100000:3.0:1787397792.233244:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137664 00000100:00100000:3.0:1787397792.233282:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:3.0:1787397792.233293:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701137664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397792.233325:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397792.233365:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701137664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.233372:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:3.0:1787397792.233404:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701137664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397792.525134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397792.525181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397792.525227:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269248 00000100:00100000:0.0:1787397792.525239:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269248 00000100:00100000:0.0:1787397792.525320:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1430 00000100:00080000:2.0:1787397792.525328:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397792.525334:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+154:2403:x1874218681269248:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397792.525424:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+154:2403:x1874218681269248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397792.525433:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1430 00000100:00100000:3.0:1787397792.526393:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269120 00000100:00100000:3.0:1787397792.526404:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269120 00000100:00100000:3.0:1787397792.526509:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 185 00000100:00100000:3.0:1787397792.526519:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681269120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397792.526730:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681269120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 212us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397792.526738:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 185 00000100:00100000:2.0:1787397792.532335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397792.532401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397792.532443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397792.532485:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269376 00000100:00100000:2.0:1787397792.532496:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269376 00000100:00100000:2.0:1787397792.532625:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1431 00000100:00100000:2.0:1787397792.532638:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681269376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397792.532714:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681269376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.532723:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1431 00000100:00100000:2.0:1787397792.532755:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269632 00000100:00100000:2.0:1787397792.532760:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269632 00000100:00100000:2.0:1787397792.533079:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269504 00000100:00100000:2.0:1787397792.533085:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269504 00000100:00100000:2.0:1787397792.533408:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2661 00000100:00100000:2.0:1787397792.533419:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681269632:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397792.533460:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681269632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397792.533482:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2661 00000100:00100000:2.0:1787397792.533495:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5045 00000100:00100000:2.0:1787397792.533500:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681269504:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:2.0:1787397792.533544:0:26166:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397792.533569:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681269504:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 67us (1128us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397792.533576:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5045 00000100:00080000:2.0:1787397792.533605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397792.533609:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787397792.613722:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397792.740728:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701137792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397792.740809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.740883:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137792 00000100:00100000:0.0:1787397792.740891:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137792 00000100:00100000:0.0:1787397792.740950:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1787397792.740958:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701137792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397792.740989:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397792.741029:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701137792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397792.741037:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1787397792.742152:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a807638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701137792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397792.742177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397792.742185:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701137920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397792.742243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397792.742281:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701137920 00000100:00100000:0.0:1787397792.742286:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701137920 00000100:00100000:0.0:1787397792.742913:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1787397792.742925:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701137920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397792.742946:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397792.742996:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701137920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397792.743003:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1787397792.743056:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701137920:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1787397792.753467:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084439 is committed 00010000:00010000:1.0:1787397792.753588:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753603:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753611:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753618:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753623:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753631:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753652:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:1.0:1787397792.753655:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753660:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753667:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d191f0b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753686:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753698:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753704:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753708:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753711:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753717:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753726:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:1.0:1787397792.753728:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753731:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753737:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d191f43 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753748:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753754:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753760:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753765:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753773:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753780:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753789:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:1.0:1787397792.753791:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753794:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753800:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d191f51 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753813:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753819:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753841:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753846:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753849:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753855:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753863:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:1.0:1787397792.753865:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753873:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753879:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134e00/0x274786fe0d191f90 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753893:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753899:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753904:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753909:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a135400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753912:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753919:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753926:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:1.0:1787397792.753928:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753931:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753937:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135400/0x274786fe0d191fc8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753947:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753953:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753965:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753969:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.753972:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753978:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753986:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:1.0:1787397792.753988:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.753991:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.753996:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134c00/0x274786fe0d192015 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754007:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754013:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754019:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754024:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70a134800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754027:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754042:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754051:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:1.0:1787397792.754053:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754056:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754061:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134800/0x274786fe0d192085 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754084:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754091:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754097:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754102:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754105:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754111:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754118:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:1.0:1787397792.754120:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754123:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754137:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d1920bd lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754151:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754157:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754162:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754167:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754170:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754176:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754184:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:1.0:1787397792.754185:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754188:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754192:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d1920cb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754202:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754208:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754233:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754238:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754241:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754248:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754256:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:1.0:1787397792.754258:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754260:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754266:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62c00/0x274786fe0d19210a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754277:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754283:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754288:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754293:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754296:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754308:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754316:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:1.0:1787397792.754319:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754321:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754327:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19217a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754340:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754346:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754352:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754356:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754358:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754363:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754369:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:1.0:1787397792.754372:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754374:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754387:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192181 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754397:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754402:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754408:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754413:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754417:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754422:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754429:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:1.0:1787397792.754431:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754434:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754439:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d1921ce lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754450:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754455:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754468:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754473:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754475:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754481:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754488:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:1.0:1787397792.754490:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754492:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754498:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d19220d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754507:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754512:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754517:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754547:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754550:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754565:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754573:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:1.0:1787397792.754575:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754577:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754582:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d192268 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754593:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754598:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754603:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754607:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754609:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754613:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754618:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:1.0:1787397792.754620:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754622:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754634:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192284 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754644:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754648:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754653:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754657:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754659:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754664:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754670:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:1.0:1787397792.754671:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754673:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754678:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1922ca lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754688:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754693:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754702:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754707:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754710:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754716:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754723:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:1.0:1787397792.754725:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754727:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754731:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192309 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754742:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754747:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754752:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754757:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754759:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754771:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754779:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:1.0:1787397792.754781:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754783:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754789:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192356 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754799:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754804:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754809:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754814:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397792.754816:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754821:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754827:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:1.0:1787397792.754829:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397792.754832:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397792.754846:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d19235d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397793.636669:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397794.672244:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397795.685656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787397795.813065:0:96312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:0.0:1787397796.721232:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397797.348860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397797.348869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397797.348873:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397797.348884:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3671 00000100:00080000:3.0:1787397797.348890:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397797.348897:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397797.348918:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc5f80 x1874218701138560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397797.348966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397797.348969:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397797.348978:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397797.348982:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3671 00000100:00080000:3.0:1787397797.348985:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397797.348989:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397797.349001:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc4e00 x1874218701139072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397797.349059:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701138176:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349189:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701138816:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349236:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787397797.349242:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701138048:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349299:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701138688:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349342:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701139328:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349390:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701138304:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349443:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701138944:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349557:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397797.349563:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701138432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701139200:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701138560:0@lo:8:kworker.0 00000100:00100000:3.0:1787397797.349710:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701139072:0@lo:8:kworker.0 00000100:00100000:3.0:1787397797.349747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.349778:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138176 00000100:00100000:3.0:1787397797.349785:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138176 00000100:00100000:3.0:1787397797.349840:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138816 00000100:00100000:3.0:1787397797.349844:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138816 00000100:00100000:3.0:1787397797.349864:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139328 00000100:00100000:3.0:1787397797.349867:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139328 00000100:00100000:3.0:1787397797.349879:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138304 00000100:00100000:3.0:1787397797.349881:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138304 00000100:00100000:3.0:1787397797.349895:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1787397797.349903:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701138176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.349955:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701138176:12345-0@lo:400:kworker.0 Request processed in 51us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.349962:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1787397797.349980:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1787397797.349986:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701138816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350012:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701138816:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350018:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1787397797.350030:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1787397797.350036:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701139328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350063:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701139328:12345-0@lo:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350075:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1787397797.350089:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1787397797.350095:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701138304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350144:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701138304:12345-0@lo:400:kworker.0 Request processed in 50us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350151:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1787397797.350173:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138048 00000100:00100000:3.0:1787397797.350177:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138048 00000100:00100000:3.0:1787397797.350200:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787397797.350206:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701138048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350236:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701138048:12345-0@lo:400:kworker.0 Request processed in 30us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350242:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787397797.350270:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138688 00000100:00100000:3.0:1787397797.350274:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138688 00000100:00100000:3.0:1787397797.350300:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139200 00000100:00100000:3.0:1787397797.350303:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139200 00000100:00100000:3.0:1787397797.350323:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138560 00000100:00100000:3.0:1787397797.350326:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138560 00000100:00100000:3.0:1787397797.350339:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139072 00000100:00100000:3.0:1787397797.350341:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139072 00000100:00100000:3.0:1787397797.350358:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1787397797.350364:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701138688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350398:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701138688:12345-0@lo:400:kworker.0 Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350404:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1787397797.350414:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1787397797.350427:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701139200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350456:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701139200:12345-0@lo:400:kworker.0 Request processed in 29us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350461:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1787397797.350474:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5046 00000100:00100000:3.0:1787397797.350478:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1874218701138560:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787397797.350498:0:25908:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397797.350550:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1874218701138560:12345-0@lo:8:kworker.0 Request processed in 69us (838us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397797.350556:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5046 00000100:00100000:3.0:1787397797.350566:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047 00000100:00100000:3.0:1787397797.350571:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1874218701139072:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787397797.350581:0:25908:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397797.350603:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3647:x1874218701139072:12345-0@lo:8:kworker.0 Request processed in 31us (855us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397797.350608:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047 00000100:00100000:3.0:1787397797.350630:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138944 00000100:00100000:3.0:1787397797.350634:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138944 00000100:00100000:3.0:1787397797.350659:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701138432 00000100:00100000:3.0:1787397797.350662:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701138432 00000100:00100000:3.0:1787397797.350674:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1787397797.350680:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701138944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350714:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701138944:12345-0@lo:400:kworker.0 Request processed in 33us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350720:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1787397797.350732:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1787397797.350744:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701138432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350774:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701138432:12345-0@lo:400:kworker.0 Request processed in 31us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.350779:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00080000:3.0:1787397797.350809:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397797.350814:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397797.350815:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397797.350876:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397797.350882:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397797.350886:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701138560:0@lo:8:kworker.0 00000100:00080000:3.0:1787397797.350896:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397797.350899:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397797.350901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701139072:0@lo:8:kworker.0 00000100:00100000:3.0:1787397797.350933:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701138432:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350944:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701139200:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350954:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701138304:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350961:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701138944:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.350989:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701138048:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.351000:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701138688:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.351010:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701139328:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.351020:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701138176:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.351031:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701138816:0@lo:400:kworker.0 00000100:00100000:3.0:1787397797.357731:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701139456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397797.357815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.357878:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139456 00000100:00100000:3.0:1787397797.357889:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139456 00000100:00100000:3.0:1787397797.357943:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1787397797.358021:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701139456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397797.358067:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397797.358117:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701139456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.358134:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1787397797.358188:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701139456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397797.358371:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397797.358380:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701139584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397797.358408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397797.358436:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139584 00000100:00100000:3.0:1787397797.358440:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139584 00000100:00100000:3.0:1787397797.358467:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1787397797.358474:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701139584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397797.358495:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397797.358552:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701139584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.358559:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1787397797.358585:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701139584:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1787397797.637602:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a8356a5850 x1874218681269760 msgsize 224 00000100:00100000:3.0:1787397797.637616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:3.0:1787397797.637627:0:3642:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1787397797.637662:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269760 00000100:00100000:3.0:1787397797.637671:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269760 00000020:00000040:3.0:1787397797.637675:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:3.0:1787397797.637680:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:3.0:1787397797.637702:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397797.637739:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 187 00000100:00000040:3.0:1787397797.637744:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:3.0:1787397797.637752:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8356a5850 x1874218681269760/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397797.637765:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681269760:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:3.0:1787397797.637785:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681269760 00000100:00000040:3.0:1787397797.637796:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.637802:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397797.637841:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.637847:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8356a5850 x1874218681269760/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:238/0 lens 224/224 e 0 to 0 dl 1787397808 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397797.637857:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681269760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.637864:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 187 00000100:00000040:3.0:1787397797.637867:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:3.0:1787397797.637880:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00000100:00000040:1.0:1787397797.680020:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a828410000 x1874218681269888 msgsize 224 00000100:00100000:1.0:1787397797.680038:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397797.680074:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a835b5ad80 x1874218681270016 msgsize 224 00000100:00100000:1.0:1787397797.680080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397797.680105:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681269888 00000100:00000040:1.0:1787397797.680107:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a829b42300 x1874218681270272 msgsize 224 00000100:00100000:1.0:1787397797.680111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397797.680126:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681269888 00000020:00000040:3.0:1787397797.680131:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19144c 00000020:00000040:3.0:1787397797.680136:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b19800 refcount=51 00000100:00100000:1.0:1787397797.680146:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270272 00000100:00100000:1.0:1787397797.680149:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270272 00000020:00000040:1.0:1787397797.680150:0:8435:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917e1 00000020:00000040:3.0:1787397797.680151:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000020:00000040:1.0:1787397797.680153:0:8435:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803902000 refcount=7 00000020:00000040:1.0:1787397797.680160:0:8435:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:3.0:1787397797.680173:0:66178:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1787397797.680173:0:8435:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1787397797.680196:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270016 00000100:00100000:3.0:1787397797.680199:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270016 00000100:00100000:1.0:1787397797.680199:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2664 00000020:00000040:3.0:1787397797.680201:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d190a43 00000020:00000040:3.0:1787397797.680203:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1c800 refcount=11 00000100:00000040:1.0:1787397797.680203:0:8435:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803902000 : new rpc_count 1 00000020:00000040:3.0:1787397797.680209:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00000040:1.0:1787397797.680211:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829b42300 x1874218681270272/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397797.680224:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681270272:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397797.680226:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1436 00000100:00000040:3.0:1787397797.680229:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b19800 : new rpc_count 1 00000100:00000040:3.0:1787397797.680232:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a828410000 x1874218681269888/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397797.680242:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681269888:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:1.0:1787397797.680246:0:8435:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681270272 00010000:00000040:3.0:1787397797.680254:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084439, transno 0, xid 1874218681269888 00000100:00000040:1.0:1787397797.680255:0:8435:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.680257:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.680262:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397797.680262:0:8435:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397797.680302:0:8435:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397797.680308:0:8435:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829b42300 x1874218681270272/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/224 e 0 to 0 dl 1787397808 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397797.680316:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681270272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397797.680331:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2664 00000100:00000040:1.0:1787397797.680334:0:8435:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803902000 : new rpc_count 0 00000020:00000040:1.0:1787397797.680346:0:8435:0:(genops.c:900:class_export_put()) PUTting export ffff89a803902000 : new refcount 6 00000100:00000040:3.0:1787397797.686809:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.686830:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a828410000 x1874218681269888/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/224 e 0 to 0 dl 1787397808 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397797.686843:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681269888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 6600us (6824us total) trans 0 rc 0/0 00000100:00000040:0.0:1787397797.687087:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a82ebd5f80 x1874218681270144 msgsize 520 00000100:00100000:0.0:1787397797.687094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397797.687611:0:26162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270144 00000100:00100000:1.0:1787397797.687621:0:26162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270144 00000020:00000040:1.0:1787397797.687624:0:26162:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917da 00000100:00100000:3.0:1787397797.687664:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1436 00000100:00000040:3.0:1787397797.687668:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b19800 : new rpc_count 0 00000100:00100000:1.0:1787397797.687669:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5048 00000100:00000040:1.0:1787397797.687676:0:26162:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82ebd5f80 x1874218681270144/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397797.687681:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b19800 : new refcount 50 00000100:00100000:1.0:1787397797.687686:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2401:x1874218681270144:12345-192.168.204.60@tcp:8:kworker.0 00000100:00100000:3.0:1787397797.687692:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1437 00000100:00000040:3.0:1787397797.687694:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1c800 : new rpc_count 1 00000100:00000040:3.0:1787397797.687698:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a835b5ad80 x1874218681270016/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:1.0:1787397797.687708:0:26162:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397797.687711:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681270016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00000040:1.0:1787397797.687728:0:26162:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397797.687732:0:26162:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397797.687736:0:26162:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397797.687768:0:26162:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397797.687773:0:26162:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82ebd5f80 x1874218681270144/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397817 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397797.687783:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2401:x1874218681270144:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 96us (694us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397797.687789:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5048 00010000:00000040:3.0:1787397797.687802:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 81604378767, transno 0, xid 1874218681270016 00000100:00000040:3.0:1787397797.687810:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.687813:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397797.687828:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397797.687833:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a835b5ad80 x1874218681270016/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:238/0 lens 224/224 e 0 to 0 dl 1787397808 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397797.687842:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681270016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 135us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397797.687848:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1437 00000100:00000040:3.0:1787397797.687850:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1c800 : new rpc_count 0 00000020:00000040:3.0:1787397797.687856:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1c800 : new refcount 10 00000100:00080000:3.0:1787397797.687874:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1787397797.687880:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00080000:3.0:1787397797.687883:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1787397797.687885:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00080000:3.0:1787397797.687887:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1787397797.687889:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00010000:00010000:2.0:1787397797.741263:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1787397797.861607:0:75627:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397797.861651:0:75627:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000088189e98] to pc [ptlrpcd_00_01+1] req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397797.861694:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.861708:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701139712:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397797.861755:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397797.861765:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397797.861803:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a82ebd4380 x1874218701139712 msgsize 224 00000100:00100000:0.0:1787397797.861809:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397797.861829:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397797.861841:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5390 usecs (6 jiffies) 00000100:00100000:0.0:1787397797.861896:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139712 00000100:00100000:0.0:1787397797.861904:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139712 00000020:00000040:0.0:1787397797.861907:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:0.0:1787397797.861911:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:0.0:1787397797.861934:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1787397797.861961:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00000040:0.0:1787397797.861965:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:0.0:1787397797.861972:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82ebd4380 x1874218701139712/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.861986:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701139712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397797.862016:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1787397797.862026:0:8439:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701139712 00000100:00000040:0.0:1787397797.862036:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397797.862041:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397797.862058:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397797.862089:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397797.862094:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82ebd4380 x1874218701139712/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:238/0 lens 224/368 e 0 to 0 dl 1787397808 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.862102:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701139712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397797.862121:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00000040:0.0:1787397797.862124:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:0.0:1787397797.862135:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00000040:0.0:1787397797.862169:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:0.0:1787397797.862177:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1787397797.862185:0:3649:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1787397797.862188:0:3649:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1787397797.862195:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.862202:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701139712:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397797.862208:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82ebd6a00 x1874218701139712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397797.862217:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:00000040:2.0:1787397797.862298:0:94350:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1787397797.862314:0:94350:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cb756a99] to pc [ptlrpcd_00_02+2] req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397797.862353:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1787397797.862363:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397797.862371:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701139840:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1787397797.862388:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397797.862395:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397797.862411:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a70731c000 x1874218701139840 msgsize 224 00000100:00100000:2.0:1787397797.862416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397797.862433:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397797.862456:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7242 usecs (8 jiffies) 00000100:00100000:0.0:1787397797.862706:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139840 00000100:00100000:0.0:1787397797.862712:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139840 00000020:00000040:0.0:1787397797.862714:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:0.0:1787397797.862717:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00000040:0.0:1787397797.862740:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1787397797.862760:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00000040:0.0:1787397797.862763:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397797.862774:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70731c000 x1874218701139840/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:238/0 lens 224/0 e 0 to 0 dl 1787397808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.862786:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701139840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397797.862799:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1787397797.862805:0:8438:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701139840 00000100:00000040:0.0:1787397797.862811:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397797.862815:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397797.862833:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397797.862848:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397797.862853:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731c000 x1874218701139840/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:238/0 lens 224/368 e 0 to 0 dl 1787397808 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397797.862862:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701139840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397797.862868:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00000040:0.0:1787397797.862870:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:0.0:1787397797.862877:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00000040:2.0:1787397797.862950:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:2.0:1787397797.862957:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1787397797.862966:0:3651:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1787397797.862969:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1787397797.862976:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397797.862983:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701139840:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1787397797.862988:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ea00 x1874218701139840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397797.862997:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:3.0:1787397798.756722:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397799.803197:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397800.806071:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397801.829722:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1787397802.470082:0:94346:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1787397802.470128:0:94346:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000af9fbe44] to pc [ptlrpcd_00_03+3] req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397802.470170:0:75623:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1787397802.470183:0:75623:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000340d2200] to pc [ptlrpcd_00_00+0] req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.470211:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.470234:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701139968:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1787397802.470266:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.470276:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.470316:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe51880 x1874218701139968 msgsize 224 00000100:00100000:3.0:1787397802.470321:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397802.470342:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.470356:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3243 usecs (4 jiffies) 00000100:00100000:3.0:1787397802.470389:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701139968 00000100:00100000:3.0:1787397802.470396:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701139968 00000020:00000040:3.0:1787397802.470399:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:3.0:1787397802.470404:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00000040:3.0:1787397802.470423:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1787397802.470451:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00000040:3.0:1787397802.470456:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:3.0:1787397802.470462:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe51880 x1874218701139968/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.470473:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701139968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397802.470506:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00010000:00000040:3.0:1787397802.470516:0:8445:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701139968 00000100:00000040:3.0:1787397802.470543:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.470548:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.473088:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473127:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397802.473136:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe51880 x1874218701139968/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.473153:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701139968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2681us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397802.473163:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00000040:3.0:1787397802.473167:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:3.0:1787397802.473183:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00000040:3.0:1787397802.473229:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473239:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:3.0:1787397802.473261:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 99b57a74-e5dc-42df-b087-b10fad741506->MGS req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473275:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003760967d] to pc [ptlrpcd_00_01+1] req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473286:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473292:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7033bb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1787397802.473299:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473307:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a0712c1] to pc [ptlrpcd_00_02+2] req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473315:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473320:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7033bd800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1787397802.473327:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473336:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000022faa9fe] to pc [ptlrpcd_00_03+3] req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473344:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473354:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1787397802.473363:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473371:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000445b8441] to pc [ptlrpcd_00_00+0] req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397802.473379:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397802.473382:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397802.473385:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397802.473390:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3676 00000100:00080000:3.0:1787397802.473395:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1787397802.473398:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:3.0:1787397802.473401:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:3.0:1787397802.473403:0:83690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2ca 00000020:00000040:3.0:1787397802.473408:0:83690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a706ff2800 refcount=4 00000100:00000040:3.0:1787397802.473411:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:3.0:1787397802.473413:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:3.0:1787397802.473414:0:83690:0:(genops.c:900:class_export_put()) PUTting export ffff89a706ff2800 : new refcount 3 00000100:00080000:3.0:1787397802.473417:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:3.0:1787397802.473427:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1787397802.473438:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473447:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d62f7b5] to pc [ptlrpcd_rcv+-1] req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473460:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473465:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1787397802.473471:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473487:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bfa5e24f] to pc [ptlrpcd_00_01+1] req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473495:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473500:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7054c2800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1787397802.473508:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473517:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087ba6bf5] to pc [ptlrpcd_00_02+2] req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397802.473541:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397802.473544:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397802.473546:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397802.473550:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3676 00000100:00080000:3.0:1787397802.473553:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1787397802.473555:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:3.0:1787397802.473558:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:3.0:1787397802.473560:0:83690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191492 00000020:00000040:3.0:1787397802.473563:0:83690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828785000 refcount=4 00000100:00000040:3.0:1787397802.473565:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:3.0:1787397802.473568:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:3.0:1787397802.473570:0:83690:0:(genops.c:900:class_export_put()) PUTting export ffff89a828785000 : new refcount 3 00000100:00080000:3.0:1787397802.473573:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:3.0:1787397802.473579:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1787397802.473588:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473595:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004641a8b6] to pc [ptlrpcd_rcv+-1] req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473609:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473615:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1787397802.473622:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473631:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000073ad5e06] to pc [ptlrpcd_00_03+3] req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473638:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1787397802.473643:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a828a58000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1787397802.473650:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397802.473658:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c6dfe84e] to pc [ptlrpcd_00_00+0] req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473668:0:83690:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3686) 00000100:00000040:3.0:1787397802.473685:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.473697:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701140736:0@lo:8:kworker.0 00000100:00000040:3.0:1787397802.473722:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473731:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.473764:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc6d80 x1874218701140736 msgsize 520 00000100:00100000:3.0:1787397802.473768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397802.473790:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473800:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5426 usecs (6 jiffies) 00000100:00000040:3.0:1787397802.473809:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.473823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701141120:0@lo:8:kworker.0 00000100:00000040:3.0:1787397802.473836:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473843:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.473854:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc4000 x1874218701141120 msgsize 520 00000100:00100000:3.0:1787397802.473857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397802.473870:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.473878:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7242 usecs (8 jiffies) 00000100:00100000:3.0:1787397802.473900:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140736 00000100:00100000:3.0:1787397802.473908:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140736 00000020:00000040:3.0:1787397802.473910:0:26163:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2d8 00000100:00000040:1.0:1787397802.474570:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.474583:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140096:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1787397802.474600:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474618:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397802.474652:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15f80 x1874218701140096 msgsize 224 00000100:00100000:1.0:1787397802.474657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397802.474674:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474685:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1726103 usecs (1727 jiffies) 00000100:00000040:1.0:1787397802.474691:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.474699:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140608:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.474710:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474717:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397802.474727:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af14000 x1874218701140608 msgsize 224 00000100:00100000:1.0:1787397802.474730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397802.474740:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474746:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1726103 usecs (1727 jiffies) 00000100:00000040:1.0:1787397802.474751:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.474758:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701141376:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.474769:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474776:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397802.474788:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af17100 x1874218701141376 msgsize 224 00000100:00100000:1.0:1787397802.474791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397802.474803:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474824:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 8163 usecs (9 jiffies) 00000100:00100000:1.0:1787397802.474833:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1787397802.474839:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.474848:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701140224:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.474860:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474867:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397802.474880:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a8356a7c50 x1874218701140224 msgsize 224 00000100:00100000:1.0:1787397802.474883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397802.474885:0:3648:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397802.474897:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.474919:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476069:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141120 00000100:00100000:3.0:1787397802.476080:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141120 00000020:00000040:3.0:1787397802.476083:0:26163:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914a7 00000100:00100000:3.0:1787397802.476125:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5049 00000100:00000040:3.0:1787397802.476134:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc6d80 x1874218701140736/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476145:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701140736:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787397802.476172:0:26163:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1787397802.476188:0:26163:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.476191:0:26163:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.476195:0:26163:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.476232:0:26163:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.476256:0:26163:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397802.476261:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc6d80 x1874218701140736/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476275:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701140736:12345-0@lo:8:kworker.0 Request processed in 130us (2509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397802.476282:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5049 00000100:00100000:3.0:1787397802.476301:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5050 00000100:00000040:3.0:1787397802.476306:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc4000 x1874218701141120/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476314:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701141120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787397802.476328:0:26163:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1787397802.476338:0:26163:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.476341:0:26163:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.476344:0:26163:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.476363:0:26163:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397822 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.476376:0:26163:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397802.476380:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4000 x1874218701141120/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476388:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701141120:12345-0@lo:8:kworker.0 Request processed in 74us (2533us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397802.476394:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5050 00000100:00000040:0.0:1787397802.476594:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.476608:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701140352:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.476629:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476638:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.476658:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a82ebd6a00 x1874218701140352 msgsize 224 00000100:00100000:0.0:1787397802.476663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.476685:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476697:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7996 usecs (8 jiffies) 00000100:00000040:0.0:1787397802.476706:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.476714:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701140992:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.476729:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476735:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.476749:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a703508700 x1874218701140992 msgsize 224 00000100:00100000:0.0:1787397802.476753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.476766:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476775:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 81916 usecs (82 jiffies) 00000100:00100000:0.0:1787397802.476785:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1787397802.476791:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.476799:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701140480:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.476811:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476818:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.476839:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984b800 x1874218701140480 msgsize 224 00000100:00100000:0.0:1787397802.476844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.476869:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476879:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7493 usecs (8 jiffies) 00000100:00000040:0.0:1787397802.476885:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.476900:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701141248:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.476915:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.476920:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140096 00000100:00000040:0.0:1787397802.476924:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397802.476927:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140096 00000100:00000040:0.0:1787397802.476939:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984ad80 x1874218701141248 msgsize 224 00000100:00100000:0.0:1787397802.476943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.476957:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.476966:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6993 usecs (7 jiffies) 00000100:00100000:0.0:1787397802.476984:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141376 00000100:00100000:0.0:1787397802.476989:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141376 00000020:00000040:0.0:1787397802.476991:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915db 00000020:00000040:0.0:1787397802.476995:0:74374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835592000 refcount=5 00000100:00000040:0.0:1787397802.477012:0:74374:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397802.477043:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140352 00000100:00100000:0.0:1787397802.477046:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140352 00000020:00000040:0.0:1787397802.477048:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915cd 00000020:00000040:0.0:1787397802.477050:0:74374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5c000 refcount=5 00000020:00000040:0.0:1787397802.477059:0:74374:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00100000:0.0:1787397802.477078:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140992 00000100:00100000:0.0:1787397802.477081:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140992 00000020:00000040:0.0:1787397802.477083:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915d4 00000020:00000040:0.0:1787397802.477085:0:74374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5a000 refcount=5 00000100:00100000:0.0:1787397802.477096:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140480 00000100:00100000:0.0:1787397802.477098:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140480 00000020:00000040:0.0:1787397802.477100:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b364 00000020:00000040:0.0:1787397802.477103:0:74374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803e98000 refcount=5 00000020:00000040:3.0:1787397802.477110:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:0.0:1787397802.477111:0:74374:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000020:00000040:3.0:1787397802.477116:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00100000:0.0:1787397802.477128:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00000040:0.0:1787397802.477132:0:74374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835592000 : new rpc_count 1 00000100:00000040:3.0:1787397802.477134:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:0.0:1787397802.477145:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af17100 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477156:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140608 00000100:00100000:0.0:1787397802.477161:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701141376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397802.477162:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140608 00000020:00000040:3.0:1787397802.477167:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:3.0:1787397802.477177:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=8 00010000:00000040:0.0:1787397802.477180:0:74374:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701141376 00000100:00000040:0.0:1787397802.477189:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397802.477195:0:74374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397802.477200:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00000040:3.0:1787397802.477203:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:3.0:1787397802.477208:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15f80 x1874218701140096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.477215:0:74374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477224:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701140096:12345-0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1787397802.477246:0:74374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.477252:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17100 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00000024:3.0:1787397802.477253:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397802.477266:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701141376:12345-0@lo:400:kworker.0 Request processed in 110us (2476us total) trans 0 rc 0/0 00010000:00000040:3.0:1787397802.477267:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701140096 00000100:00000040:3.0:1787397802.477277:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00100000:0.0:1787397802.477279:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00000040:0.0:1787397802.477284:0:74374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835592000 : new rpc_count 0 00000100:00000040:3.0:1787397802.477285:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1787397802.477299:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a835592000 : new refcount 4 00000100:00000040:3.0:1787397802.477309:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477311:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00000040:0.0:1787397802.477316:0:74374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5c000 : new rpc_count 1 00000100:00000040:0.0:1787397802.477324:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82ebd6a00 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.477333:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00100000:0.0:1787397802.477338:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701140352:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1787397802.477341:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15f80 x1874218701140096/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397802.477350:0:74374:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701140352 00000100:00100000:3.0:1787397802.477351:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701140096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (2697us total) trans 0 rc 0/0 00000100:00000040:0.0:1787397802.477358:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00100000:3.0:1787397802.477362:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00000040:0.0:1787397802.477366:0:74374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.477368:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:3.0:1787397802.477378:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 7 00000100:00000040:0.0:1787397802.477384:0:74374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477390:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00000040:3.0:1787397802.477396:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:3.0:1787397802.477401:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af14000 x1874218701140608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477430:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701140608:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.477440:0:74374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00010000:00000040:3.0:1787397802.477441:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701140608 00000100:00000040:0.0:1787397802.477447:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82ebd6a00 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.477456:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00100000:0.0:1787397802.477462:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701140352:12345-0@lo:400:kworker.0 Request processed in 125us (799us total) trans 0 rc 0/0 00000100:00000040:3.0:1787397802.477465:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1787397802.477474:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00000040:0.0:1787397802.477478:0:74374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5c000 : new rpc_count 0 00000020:00000040:0.0:1787397802.477487:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5c000 : new refcount 4 00000100:00000040:3.0:1787397802.477488:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477500:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00000040:0.0:1787397802.477503:0:74374:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5a000 : new rpc_count 1 00000100:00000040:3.0:1787397802.477505:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.477511:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a703508700 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.477513:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14000 x1874218701140608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477556:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701140608:12345-0@lo:400:kworker.0 Request processed in 129us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397802.477560:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701140992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397802.477568:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00000040:3.0:1787397802.477571:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00010000:00000040:0.0:1787397802.477574:0:74374:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701140992 00000020:00000040:3.0:1787397802.477581:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00000040:0.0:1787397802.477582:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397802.477588:0:74374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397802.477603:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00000040:0.0:1787397802.477606:0:74374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.477608:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803e98000 : new rpc_count 1 00000100:00000040:3.0:1787397802.477616:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984b800 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.477625:0:74374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.477633:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a703508700 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477634:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701140480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397802.477648:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701140992:12345-0@lo:400:kworker.0 Request processed in 93us (896us total) trans 0 rc 0/0 00010000:00000040:3.0:1787397802.477650:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701140480 00000100:00000040:3.0:1787397802.477659:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00100000:0.0:1787397802.477660:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00000040:0.0:1787397802.477665:0:74374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5a000 : new rpc_count 0 00000100:00000040:3.0:1787397802.477666:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1787397802.477680:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5a000 : new refcount 4 00000100:00000040:3.0:1787397802.477687:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.477703:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00100000:0.0:1787397802.477706:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141248 00000100:00000040:3.0:1787397802.477711:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b800 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477712:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141248 00000020:00000040:0.0:1787397802.477718:0:26160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:0.0:1787397802.477722:0:26160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00100000:3.0:1787397802.477724:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701140480:12345-0@lo:400:kworker.0 Request processed in 94us (881us total) trans 0 rc 0/0 00000020:00000040:0.0:1787397802.477732:0:26160:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00100000:3.0:1787397802.477745:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00000040:0.0:1787397802.477745:0:26160:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:3.0:1787397802.477749:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803e98000 : new rpc_count 0 00000020:00000040:3.0:1787397802.477758:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a803e98000 : new refcount 4 00000100:00100000:0.0:1787397802.477769:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00000040:0.0:1787397802.477773:0:26160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397802.477777:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984ad80 x1874218701141248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477789:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701141248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397802.477795:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140224 00010000:00000040:0.0:1787397802.477799:0:26160:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701141248 00000100:00100000:3.0:1787397802.477801:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140224 00000020:00000040:3.0:1787397802.477804:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000100:00000040:0.0:1787397802.477807:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000020:00000040:3.0:1787397802.477808:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=21 00000100:00000040:0.0:1787397802.477814:0:26160:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.477823:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:0.0:1787397802.477835:0:26160:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.477848:0:26160:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.477853:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984ad80 x1874218701141248/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.477857:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1787397802.477863:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00100000:0.0:1787397802.477870:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701141248:12345-0@lo:400:kworker.0 Request processed in 81us (927us total) trans 0 rc 0/0 00000100:00000040:3.0:1787397802.477871:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8356a7c50 x1874218701140224/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477885:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00000040:0.0:1787397802.477888:0:26160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000100:00100000:3.0:1787397802.477893:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701140224:12345-0@lo:400:kworker.0 00000020:00000040:0.0:1787397802.477896:0:26160:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00010000:00000040:3.0:1787397802.477904:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701140224 00000100:00000040:3.0:1787397802.477910:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.477914:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:0.0:1787397802.477915:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1787397802.477920:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00080000:0.0:1787397802.477925:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1787397802.477927:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00080000:0.0:1787397802.477937:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1787397802.477939:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00000040:0.0:1787397802.477970:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397802.477978:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.477988:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.477995:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701140480:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.478007:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:0.0:1787397802.478011:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478017:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.478039:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701141248:0@lo:400:kworker.0 00000100:00100000:1.0:1787397802.478044:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140864:0@lo:400:kworker.0 00000100:00000040:0.0:1787397802.478051:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397802.478057:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478065:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478069:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.478080:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701140352:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.478086:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.478097:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1787397802.478104:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af14380 x1874218701140864 msgsize 224 00000100:00000040:0.0:1787397802.478104:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.478116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.478124:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478134:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.478141:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701140992:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.478150:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5376 usecs (6 jiffies) 00000100:00000040:0.0:1787397802.478154:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe50e00 x1874218701140480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478166:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000020:00000040:0.0:1787397802.478166:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7033bd800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1787397802.478174:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478180:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc4380 x1874218701141248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397802.478200:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000004:00000040:1.0:1787397802.478201:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352803 avail=317100 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023572 state=0: rc = 0 00000100:00000040:0.0:1787397802.478206:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe52680 x1874218701140352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478213:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397802.478216:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7033bb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1787397802.478226:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140096:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1787397802.478228:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe52a00 x1874218701140992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478239:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000020:00000040:0.0:1787397802.478239:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7054c2800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1787397802.478246:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.478255:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.478262:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397802.478263:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701140864 00000100:00100000:0.0:1787397802.478269:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701140864 00000020:00000040:0.0:1787397802.478272:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:0.0:1787397802.478275:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:1.0:1787397802.478276:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1787397802.478281:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397802.478281:0:26164:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:1.0:1787397802.478293:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478298:0:26164:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1787397802.478304:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701141376:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.478311:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe51c00 x1874218701140096/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397802.478319:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1787397802.478320:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00000040:0.0:1787397802.478325:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:1.0:1787397802.478328:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe50a80 x1874218701140608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478332:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af14380 x1874218701140864/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397802.478338:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1787397802.478348:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7800 x1874218701141376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.478352:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701140864:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1787397802.478367:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a828a58000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00010000:00000040:0.0:1787397802.478368:0:26164:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701140864 00000100:00000040:0.0:1787397802.478375:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397802.478384:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.478402:0:26164:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.478415:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397802.478420:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14380 x1874218701140864/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.478427:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701140864:12345-0@lo:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397802.478433:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00000040:0.0:1787397802.478435:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:0.0:1787397802.478442:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00080000:0.0:1787397802.478456:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1787397802.478459:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:3.0:1787397802.484839:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.484891:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397802.484902:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8356a7c50 x1874218701140224/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.484912:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701140224:12345-0@lo:400:kworker.0 Request processed in 7023us (10029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397802.484923:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1787397802.484939:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397802.484956:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 20 00000100:00000040:3.0:1787397802.485098:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1787397802.485113:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1787397802.485126:0:3651:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352910 avail=317207 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:3.0:1787397802.485136:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.485144:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701139968:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1787397802.485152:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe53b80 x1874218701139968/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397802.485164:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1787397802.485201:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397802.485210:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397802.485215:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1787397802.485219:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.485225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701140736:0@lo:8:kworker.0 00000100:00000040:3.0:1787397802.485237:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397802.485244:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397802.485246:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1787397802.485249:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.485254:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701141120:0@lo:8:kworker.0 00000100:00000040:3.0:1787397802.485258:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe51500 x1874218701140736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397802.485274:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a83670c800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1787397802.485279:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe52d80 x1874218701141120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397802.485285:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1787397802.489560:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.489585:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.489594:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701140224:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.489620:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:1.0:1787397802.489625:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397802.489633:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397802.489640:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701140864:0@lo:400:kworker.0 00000100:00000040:1.0:1787397802.489647:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe53800 x1874218701140224/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397802.489659:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397802.489669:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a80fe50380 x1874218701140864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397802.489676:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397802.763135:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a702789c50 x1874218681270400 msgsize 224 00000100:00100000:0.0:1787397802.763153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397802.763156:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1787397802.763193:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984bb80 x1874218681270656 msgsize 224 00000100:00100000:0.0:1787397802.763198:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397802.763225:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984b480 x1874218681270528 msgsize 224 00000100:00100000:0.0:1787397802.763230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397802.763250:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a829849880 x1874218681270912 msgsize 224 00000100:00100000:0.0:1787397802.763254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397802.763275:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a829848a80 x1874218681270784 msgsize 520 00000100:00100000:0.0:1787397802.763280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397802.763306:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270656 00000100:00100000:0.0:1787397802.763316:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270656 00000020:00000040:0.0:1787397802.763319:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d190a43 00000020:00000040:0.0:1787397802.763324:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1c800 refcount=11 00000020:00000040:0.0:1787397802.763340:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00000040:0.0:1787397802.763376:0:66178:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397802.763400:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270528 00000100:00100000:0.0:1787397802.763403:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270528 00000020:00000040:0.0:1787397802.763405:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19144c 00000020:00000040:0.0:1787397802.763407:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b19800 refcount=51 00000020:00000040:0.0:1787397802.763415:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00100000:0.0:1787397802.763436:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1442 00000100:00000040:0.0:1787397802.763440:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1c800 : new rpc_count 1 00000100:00000040:0.0:1787397802.763448:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984bb80 x1874218681270656/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.763462:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681270656:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:0.0:1787397802.763490:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 81604378767, transno 0, xid 1874218681270656 00000100:00000040:0.0:1787397802.763502:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763508:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763592:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763598:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984bb80 x1874218681270656/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.763613:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681270656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 153us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397802.763621:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1442 00000100:00000040:0.0:1787397802.763624:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1c800 : new rpc_count 0 00000020:00000040:0.0:1787397802.763638:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1c800 : new refcount 10 00000100:00100000:0.0:1787397802.763648:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1443 00000100:00000040:0.0:1787397802.763650:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b19800 : new rpc_count 1 00000100:00000040:0.0:1787397802.763654:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984b480 x1874218681270528/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.763665:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681270528:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:0.0:1787397802.763684:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084439, transno 0, xid 1874218681270528 00000100:00000040:0.0:1787397802.763690:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763693:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763709:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397802.763714:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b480 x1874218681270528/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.763722:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681270528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 60us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397802.763728:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1443 00000100:00000040:0.0:1787397802.763731:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b19800 : new rpc_count 0 00000020:00000040:0.0:1787397802.763736:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b19800 : new refcount 50 00000100:00080000:0.0:1787397802.763750:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1787397802.763754:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00080000:0.0:1787397802.763757:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1787397802.763759:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00100000:3.0:1787397802.765339:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270400 00000100:00100000:3.0:1787397802.765352:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270400 00000020:00000040:3.0:1787397802.765355:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:3.0:1787397802.765360:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:3.0:1787397802.765385:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397802.765477:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00000040:3.0:1787397802.765481:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:3.0:1787397802.765488:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702789c50 x1874218681270400/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.765502:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681270400:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:3.0:1787397802.765555:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681270400 00000100:00000040:3.0:1787397802.765564:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397802.765570:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397802.765616:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397802.765621:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702789c50 x1874218681270400/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.765900:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681270400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 399us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397802.765908:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 189 00000100:00000040:3.0:1787397802.765910:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:3.0:1787397802.765920:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00000100:00100000:2.0:1787397802.767076:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270912 00000100:00100000:2.0:1787397802.767087:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270912 00000020:00000040:2.0:1787397802.767090:0:8501:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917e1 00000020:00000040:2.0:1787397802.767095:0:8501:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803902000 refcount=7 00000020:00000040:2.0:1787397802.767109:0:8501:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:2.0:1787397802.767130:0:8501:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1787397802.767150:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681270784 00000100:00100000:2.0:1787397802.767154:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681270784 00000020:00000040:2.0:1787397802.767155:0:8501:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917da 00000100:00100000:2.0:1787397802.767176:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2667 00000100:00000040:2.0:1787397802.767180:0:8501:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803902000 : new rpc_count 1 00000100:00000040:2.0:1787397802.767187:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829849880 x1874218681270912/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397802.767200:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681270912:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:2.0:1787397802.767224:0:8501:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681270912 00000100:00000040:2.0:1787397802.767231:0:8501:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767235:0:8501:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767273:0:8501:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767279:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849880 x1874218681270912/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:243/0 lens 224/224 e 0 to 0 dl 1787397813 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397802.767287:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681270912:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397802.767293:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2667 00000100:00000040:2.0:1787397802.767295:0:8501:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803902000 : new rpc_count 0 00000020:00000040:2.0:1787397802.767304:0:8501:0:(genops.c:900:class_export_put()) PUTting export ffff89a803902000 : new refcount 6 00000100:00100000:2.0:1787397802.767312:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5051 00000100:00000040:2.0:1787397802.767315:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829848a80 x1874218681270784/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397802.767323:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681270784:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:2.0:1787397802.767345:0:8501:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1787397802.767357:0:8501:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767360:0:8501:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767364:0:8501:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767375:0:8501:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397802.767379:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848a80 x1874218681270784/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397822 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397802.767388:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681270784:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 64us (4111us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397802.767394:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5051 00000100:00080000:1.0:1787397802.768942:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1787397802.768952:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00010000:00010000:1.0:1787397802.855222:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1787397802.980612:0:75627:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397802.980655:0:75627:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3f2ab16] to pc [ptlrpcd_00_01+1] req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.980709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1787397802.980722:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.980804:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701141504:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397802.980833:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.980842:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.981001:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a829848700 x1874218701141504 msgsize 224 00000100:00100000:0.0:1787397802.981006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397802.981042:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.981054:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5418 usecs (6 jiffies) 00000100:00100000:0.0:1787397802.981078:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141504 00000100:00100000:0.0:1787397802.981085:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141504 00000020:00000040:0.0:1787397802.981088:0:19690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:0.0:1787397802.981092:0:19690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:0.0:1787397802.981112:0:19690:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1787397802.981135:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00000040:0.0:1787397802.981139:0:19690:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:0.0:1787397802.981144:0:19690:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829848700 x1874218701141504/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.981155:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701141504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397802.981184:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1787397802.981195:0:19690:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701141504 00000100:00000040:0.0:1787397802.981203:0:19690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397802.981208:0:19690:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397802.981224:0:19690:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397802.981241:0:19690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.981245:0:19690:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848700 x1874218701141504/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:243/0 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.981254:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701141504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397802.981260:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00000040:0.0:1787397802.981263:0:19690:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:0.0:1787397802.981274:0:19690:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00000040:0.0:1787397802.981306:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:0.0:1787397802.981318:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1787397802.981327:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1787397802.981330:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1787397802.981337:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.981345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701141504:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397802.981351:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848e00 x1874218701141504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397802.981360:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:00000040:0.0:1787397802.982006:0:94350:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397802.982035:0:94350:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3f2ab16] to pc [ptlrpcd_00_02+2] req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.982079:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.982098:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701141632:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1787397802.982118:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.982126:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.982145:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc5180 x1874218701141632 msgsize 224 00000100:00100000:3.0:1787397802.982150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397802.982168:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.982178:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6937 usecs (7 jiffies) 00000100:00100000:3.0:1787397802.985080:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141632 00000100:00100000:3.0:1787397802.985095:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141632 00000020:00000040:3.0:1787397802.985099:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:3.0:1787397802.985212:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00000040:3.0:1787397802.985237:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1787397802.985273:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00000040:3.0:1787397802.985277:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:3.0:1787397802.985285:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc5180 x1874218701141632/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/0 e 0 to 0 dl 1787397813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.985297:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701141632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397802.985321:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1787397802.985330:0:8439:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701141632 00000100:00000040:3.0:1787397802.985340:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397802.985346:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397802.985503:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397802.985561:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397802.985621:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:0.0:1787397802.985630:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1787397802.985640:0:3650:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1787397802.985644:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1787397802.985653:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397802.985661:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701141632:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1787397802.985668:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848e00 x1874218701141632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397802.985681:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1787397802.985741:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc5180 x1874218701141632/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:243/0 lens 224/368 e 0 to 0 dl 1787397813 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397802.985757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701141632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 461us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397802.985765:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00000040:3.0:1787397802.985768:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:3.0:1787397802.985924:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00010000:00010000:3.0:1787397803.879719:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397804.911856:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397805.925631:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397806.949970:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1787397807.590147:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590164:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:0.0:1787397807.590189:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 99b57a74-e5dc-42df-b087-b10fad741506->MGS req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590207:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3f2ab16] to pc [ptlrpcd_00_03+3] req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590237:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590243:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7033bb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1787397807.590251:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590260:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000629bd137] to pc [ptlrpcd_00_00+0] req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590276:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590281:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7033bd800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1787397807.590287:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590295:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fadc7209] to pc [ptlrpcd_00_01+1] req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590302:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590307:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1787397807.590312:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590320:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000030b5b82f] to pc [ptlrpcd_00_02+2] req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397807.590337:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397807.590341:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397807.590344:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397807.590349:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3681 00000100:00080000:0.0:1787397807.590354:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1787397807.590357:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:0.0:1787397807.590360:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:0.0:1787397807.590363:0:83690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2ca 00000020:00000040:0.0:1787397807.590368:0:83690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a706ff2800 refcount=4 00000100:00000040:0.0:1787397807.590371:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:0.0:1787397807.590373:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:0.0:1787397807.590376:0:83690:0:(genops.c:900:class_export_put()) PUTting export ffff89a706ff2800 : new refcount 3 00000100:00080000:0.0:1787397807.590379:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:0.0:1787397807.590389:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1787397807.590401:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590409:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089cb62d0] to pc [ptlrpcd_rcv+-1] req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590422:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590427:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397807.590434:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590442:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a22c9b21] to pc [ptlrpcd_00_03+3] req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590448:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590457:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a7054c2800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1787397807.590465:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590473:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001108a604] to pc [ptlrpcd_00_00+0] req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590480:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590484:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397807.590489:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590497:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d3fdc99] to pc [ptlrpcd_00_01+1] req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397807.590504:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397807.590507:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397807.590509:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397807.590513:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3681 00000100:00080000:0.0:1787397807.590515:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1787397807.590518:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:0.0:1787397807.590538:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:0.0:1787397807.590541:0:83690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191492 00000020:00000040:0.0:1787397807.590544:0:83690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828785000 refcount=4 00000100:00000040:0.0:1787397807.590547:0:83690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 50 to 0@lo 00000100:00000040:0.0:1787397807.590549:0:83690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:0.0:1787397807.590551:0:83690:0:(genops.c:900:class_export_put()) PUTting export ffff89a828785000 : new refcount 3 00000100:00080000:0.0:1787397807.590553:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:0.0:1787397807.590558:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1787397807.590566:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590580:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d44c6fae] to pc [ptlrpcd_rcv+-1] req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590588:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590592:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397807.590600:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590608:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000000b1a4fb] to pc [ptlrpcd_00_02+2] req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590615:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397807.590619:0:83690:0:(genops.c:1231:class_import_get()) import ffff89a828a58000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1787397807.590625:0:83690:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397807.590633:0:83690:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0d63325] to pc [ptlrpcd_00_03+3] req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590643:0:83690:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3691) 00000100:00000040:0.0:1787397807.590662:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.590674:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701142144:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.590701:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590710:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.590748:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe50380 x1874218701142144 msgsize 224 00000100:00100000:0.0:1787397807.590753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.590773:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590793:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1715531 usecs (1716 jiffies) 00000100:00000040:0.0:1787397807.590804:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.590812:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701142912:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.590824:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590831:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.590845:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe53800 x1874218701142912 msgsize 224 00000100:00100000:0.0:1787397807.590849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.590865:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590873:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6847 usecs (7 jiffies) 00000100:00100000:3.0:1787397807.590875:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142912 00000100:00100000:3.0:1787397807.590883:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142912 00000100:00100000:0.0:1787397807.590884:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000020:00000040:3.0:1787397807.590885:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:3.0:1787397807.590888:0:26169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00000040:0.0:1787397807.590889:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.590896:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701141760:0@lo:400:kworker.0 00000020:00000040:3.0:1787397807.590898:0:26169:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:0.0:1787397807.590908:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.590915:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397807.590917:0:26169:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:0.0:1787397807.590941:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a70278bc50 x1874218701141760 msgsize 224 00000100:00100000:0.0:1787397807.590945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.590947:0:3650:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1787397807.590953:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00000040:3.0:1787397807.590957:0:26169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397807.590958:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.590962:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe53800 x1874218701142912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.590973:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701142912:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.590977:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1787397807.590991:0:26169:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701142912 00000100:00100000:0.0:1787397807.590993:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701142400:0@lo:400:kworker.0 00000100:00000040:3.0:1787397807.590998:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397807.591002:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591005:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591011:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397807.591017:0:26169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591021:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe52d80 x1874218701142400 msgsize 224 00000100:00100000:0.0:1787397807.591024:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397807.591033:0:26169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.591035:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.591037:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe53800 x1874218701142912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591045:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5405 usecs (6 jiffies) 00000100:00100000:3.0:1787397807.591046:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701142912:12345-0@lo:400:kworker.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00000040:0.0:1787397807.591050:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591057:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701143040:0@lo:400:kworker.0 00000100:00100000:3.0:1787397807.591059:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00000040:3.0:1787397807.591062:0:26169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000100:00000040:0.0:1787397807.591069:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397807.591074:0:26169:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00000040:0.0:1787397807.591074:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397807.591080:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142400 00000100:00100000:3.0:1787397807.591083:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142400 00000020:00000040:3.0:1787397807.591085:0:26169:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:3.0:1787397807.591087:0:26169:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:0.0:1787397807.591087:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe51500 x1874218701143040 msgsize 224 00000100:00100000:0.0:1787397807.591090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397807.591095:0:26169:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:0.0:1787397807.591101:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.591106:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00000040:3.0:1787397807.591109:0:26169:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:0.0:1787397807.591111:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7978 usecs (8 jiffies) 00000100:00000040:3.0:1787397807.591112:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe52d80 x1874218701142400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.591121:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701142400:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591129:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00010000:00000040:3.0:1787397807.591130:0:26169:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701142400 00000100:00000040:3.0:1787397807.591134:0:26169:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.591134:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.591137:0:26169:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591143:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.591150:0:26169:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591150:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701142912:0@lo:400:kworker.0 00000100:00000040:3.0:1787397807.591161:0:26169:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.591161:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984a300 x1874218701142912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.591165:0:26169:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52d80 x1874218701142400/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.591171:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:3.0:1787397807.591173:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701142400:12345-0@lo:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397807.591178:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00000040:3.0:1787397807.591180:0:26169:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000100:00000040:0.0:1787397807.591184:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000020:00000040:3.0:1787397807.591186:0:26169:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00000040:0.0:1787397807.591188:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591195:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591202:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701142400:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591206:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848380 x1874218701142400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.591213:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397807.591229:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591238:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701141888:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591252:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591259:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591272:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe53b80 x1874218701141888 msgsize 224 00000100:00100000:0.0:1787397807.591275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591295:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591305:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7992 usecs (8 jiffies) 00000100:00000040:0.0:1787397807.591310:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701142528:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591340:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591347:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591358:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe50a80 x1874218701142528 msgsize 224 00000100:00100000:0.0:1787397807.591361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591375:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591383:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 81528 usecs (82 jiffies) 00000100:00100000:0.0:1787397807.591391:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1787397807.591396:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591403:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701142016:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591415:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591421:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591432:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe51c00 x1874218701142016 msgsize 224 00000100:00100000:0.0:1787397807.591435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591446:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591453:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7491 usecs (8 jiffies) 00000100:00000040:0.0:1787397807.591458:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701142656:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.591477:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591495:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591509:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe52a00 x1874218701142656 msgsize 224 00000100:00100000:0.0:1787397807.591513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591546:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591554:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3837 usecs (4 jiffies) 00000100:00000040:0.0:1787397807.591572:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591580:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701142272:0@lo:8:kworker.0 00000100:00000040:0.0:1787397807.591592:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591600:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591611:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe52680 x1874218701142272 msgsize 520 00000100:00100000:0.0:1787397807.591615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591626:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591635:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5453 usecs (6 jiffies) 00000100:00000040:0.0:1787397807.591640:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701142784:0@lo:8:kworker.0 00000100:00000040:0.0:1787397807.591658:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591663:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591673:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a80fe50e00 x1874218701142784 msgsize 520 00000100:00100000:0.0:1787397807.591676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397807.591686:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591706:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7512 usecs (8 jiffies) 00000100:00100000:0.0:1787397807.591724:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142144 00000100:00100000:0.0:1787397807.591728:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142144 00000020:00000040:0.0:1787397807.591730:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:0.0:1787397807.591733:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00000040:0.0:1787397807.591746:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1787397807.591763:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142656 00000100:00100000:0.0:1787397807.591766:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142656 00000020:00000040:0.0:1787397807.591767:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:0.0:1787397807.591769:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00100000:0.0:1787397807.591782:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00000040:0.0:1787397807.591785:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:0.0:1787397807.591789:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe50380 x1874218701142144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591799:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701142144:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397807.591811:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701142144 00000100:00000040:0.0:1787397807.591816:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.591821:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591840:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591856:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.591861:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50380 x1874218701142144/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591867:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701142144:12345-0@lo:400:kworker.0 Request processed in 70us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.591873:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00000040:0.0:1787397807.591875:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:0.0:1787397807.591888:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00100000:0.0:1787397807.591898:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00000040:0.0:1787397807.591900:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:0.0:1787397807.591904:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe52a00 x1874218701142656/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591914:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701142656:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397807.591937:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701142656 00000100:00000040:0.0:1787397807.591942:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.591946:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.591961:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.591978:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.591982:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52a00 x1874218701142656/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.591990:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701142656:12345-0@lo:400:kworker.0 Request processed in 77us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.591995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00000040:0.0:1787397807.591997:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:0.0:1787397807.592002:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00100000:0.0:1787397807.592019:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141760 00000100:00100000:0.0:1787397807.592023:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141760 00000020:00000040:0.0:1787397807.592024:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397807.592026:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=21 00000100:00000040:0.0:1787397807.592037:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397807.592055:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1787397807.592057:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397807.592061:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70278bc50 x1874218701141760/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592081:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701141760:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397807.592092:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701141760 00000100:00000040:0.0:1787397807.592096:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592098:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.592112:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592123:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.592127:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70278bc50 x1874218701141760/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592134:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701141760:12345-0@lo:400:kworker.0 Request processed in 55us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.592140:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1787397807.592142:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397807.592147:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 20 00000100:00100000:0.0:1787397807.592172:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142272 00000100:00100000:0.0:1787397807.592175:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142272 00000020:00000040:0.0:1787397807.592177:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2d8 00000100:00100000:0.0:1787397807.592195:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142784 00000100:00100000:0.0:1787397807.592197:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142784 00000020:00000040:0.0:1787397807.592199:0:26167:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914a7 00000100:00100000:0.0:1787397807.592213:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052 00000100:00000040:0.0:1787397807.592217:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe52680 x1874218701142272/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592225:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701142272:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787397807.592233:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143040 00000100:00100000:3.0:1787397807.592242:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143040 00000020:00000040:3.0:1787397807.592244:0:77740:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915db 00010000:00020000:0.0:1787397807.592244:0:26167:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000040:3.0:1787397807.592246:0:77740:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835592000 refcount=5 00000100:00000040:0.0:1787397807.592252:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397807.592257:0:77740:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:0.0:1787397807.592259:0:26167:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592262:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397807.592272:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701141888 00000100:00100000:3.0:1787397807.592275:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701141888 00000020:00000040:3.0:1787397807.592276:0:77740:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915cd 00000100:00000040:0.0:1787397807.592278:0:26167:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397807.592279:0:77740:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5c000 refcount=5 00000020:00000040:3.0:1787397807.592285:0:77740:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00000040:0.0:1787397807.592292:0:26167:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.592297:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe52680 x1874218701142272/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397827 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.592301:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142528 00000100:00100000:3.0:1787397807.592303:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142528 00000020:00000040:3.0:1787397807.592305:0:77740:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915d4 00000100:00100000:0.0:1787397807.592305:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701142272:12345-0@lo:8:kworker.0 Request processed in 79us (692us total) trans 0 rc -19/-19 00000020:00000040:3.0:1787397807.592307:0:77740:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5a000 refcount=5 00000100:00100000:0.0:1787397807.592311:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052 00000100:00100000:3.0:1787397807.592319:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701142016 00000100:00100000:3.0:1787397807.592321:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701142016 00000100:00100000:0.0:1787397807.592321:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5053 00000020:00000040:3.0:1787397807.592322:0:77740:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b364 00000020:00000040:3.0:1787397807.592324:0:77740:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803e98000 refcount=5 00000100:00000040:0.0:1787397807.592324:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe50e00 x1874218701142784/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397807.592329:0:77740:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00100000:0.0:1787397807.592331:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701142784:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787397807.592339:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00000040:3.0:1787397807.592341:0:77740:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835592000 : new rpc_count 1 00010000:00020000:0.0:1787397807.592341:0:26167:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1787397807.592345:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe51500 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592348:0:26167:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592350:0:26167:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592353:0:26167:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397807.592356:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701143040:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1787397807.592365:0:77740:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701143040 00000100:00000040:0.0:1787397807.592365:0:26167:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397832 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.592369:0:77740:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:3.0:1787397807.592373:0:77740:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.592376:0:26167:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592380:0:26167:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50e00 x1874218701142784/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397827 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592388:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701142784:12345-0@lo:8:kworker.0 Request processed in 56us (713us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397807.592393:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5053 00000100:00000040:3.0:1787397807.592400:0:77740:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592411:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00000040:3.0:1787397807.592412:0:77740:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397807.592416:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe51500 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592419:0:67264:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5c000 : new rpc_count 1 00000100:00000040:0.0:1787397807.592423:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe53b80 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.592434:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701143040:12345-0@lo:400:kworker.0 Request processed in 78us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.592434:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701141888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397807.592440:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00000040:3.0:1787397807.592443:0:77740:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835592000 : new rpc_count 0 00010000:00000040:0.0:1787397807.592444:0:67264:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701141888 00000100:00000040:0.0:1787397807.592448:0:67264:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000020:00000040:3.0:1787397807.592450:0:77740:0:(genops.c:900:class_export_put()) PUTting export ffff89a835592000 : new refcount 4 00000100:00000040:0.0:1787397807.592451:0:67264:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397807.592458:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00000040:3.0:1787397807.592461:0:77740:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5a000 : new rpc_count 1 00000100:00000040:3.0:1787397807.592464:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe50a80 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592466:0:67264:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.592474:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701142528:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592477:0:67264:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397807.592481:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe53b80 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1787397807.592483:0:77740:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701142528 00000100:00000040:3.0:1787397807.592486:0:77740:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397807.592489:0:77740:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1787397807.592489:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701141888:12345-0@lo:400:kworker.0 Request processed in 56us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.592495:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00000040:0.0:1787397807.592497:0:67264:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5c000 : new rpc_count 0 00000020:00000040:0.0:1787397807.592502:0:67264:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5c000 : new refcount 4 00000100:00100000:0.0:1787397807.592511:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00000040:0.0:1787397807.592513:0:67264:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803e98000 : new rpc_count 1 00000100:00000040:3.0:1787397807.592515:0:77740:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592517:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80fe51c00 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592542:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701142016:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397807.592551:0:67264:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701142016 00000100:00000040:0.0:1787397807.592556:0:67264:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397807.592559:0:67264:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397807.592572:0:67264:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592596:0:67264:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397807.592601:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe51c00 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592608:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701142016:12345-0@lo:400:kworker.0 Request processed in 69us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.592614:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00000040:0.0:1787397807.592616:0:67264:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803e98000 : new rpc_count 0 00000020:00000040:0.0:1787397807.592622:0:67264:0:(genops.c:900:class_export_put()) PUTting export ffff89a803e98000 : new refcount 4 00000100:00000040:0.0:1787397807.592668:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592677:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592684:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701141760:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592695:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397807.592700:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592708:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592715:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701143040:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592724:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1787397807.592729:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592736:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592757:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701142144:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592763:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848e00 x1874218701141760/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.592772:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000100:00000040:0.0:1787397807.592779:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849180 x1874218701143040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.592783:0:77740:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000020:00000040:0.0:1787397807.592785:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a828a58000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1787397807.592787:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80fe50a80 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592789:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848000 x1874218701142144/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.592796:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701142528:12345-0@lo:400:kworker.0 Request processed in 323us (1437us total) trans 0 rc 0/0 00000020:00000040:0.0:1787397807.592797:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1787397807.592803:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00000040:3.0:1787397807.592805:0:77740:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5a000 : new rpc_count 0 00000020:00000040:3.0:1787397807.592810:0:77740:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5a000 : new refcount 4 00000100:00000040:0.0:1787397807.592818:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397807.592822:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592829:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592835:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701142016:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592845:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397807.592849:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592856:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592863:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701142656:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.592871:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397807.592881:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.592890:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.592896:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701141888:0@lo:400:kworker.0 00000020:00000040:1.0:1787397807.595909:0:94346:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1787397807.595961:0:94346:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000542ecf44] to pc [ptlrpcd_00_00+0] req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397807.595994:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1787397807.596008:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00080000:1.0:1787397807.596011:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1787397807.596013:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00080000:1.0:1787397807.596016:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1787397807.596018:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00100000:1.0:1787397807.596039:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1787397807.596055:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596068:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701143168:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1787397807.596097:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397807.596120:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397807.596159:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af16a00 x1874218701143168 msgsize 224 00000100:00100000:1.0:1787397807.596164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397807.596194:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397807.596205:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3803 usecs (4 jiffies) 00000100:00100000:1.0:1787397807.596230:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143168 00000100:00100000:1.0:1787397807.596238:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143168 00000020:00000040:1.0:1787397807.596241:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:1.0:1787397807.596244:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00000040:1.0:1787397807.596264:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1787397807.596289:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00000040:1.0:1787397807.596293:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:1.0:1787397807.596298:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af16a00 x1874218701143168/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596309:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701143168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397807.596343:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00010000:00000040:1.0:1787397807.596354:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701143168 00000100:00000040:1.0:1787397807.596372:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:1.0:1787397807.596377:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397807.596393:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397807.596410:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:1.0:1787397807.596415:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16a00 x1874218701143168/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596424:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701143168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397807.596431:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00000040:1.0:1787397807.596434:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:1.0:1787397807.596446:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00000040:1.0:1787397807.596473:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1787397807.596478:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1787397807.596489:0:3649:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352910 avail=317207 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:1.0:1787397807.596496:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701143168:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1787397807.596509:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af15500 x1874218701143168/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397807.596519:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1787397807.596609:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397807.596618:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397807.596623:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1787397807.596635:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596642:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701142272:0@lo:8:kworker.0 00000020:00000040:3.0:1787397807.596650:0:75623:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1787397807.596657:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397807.596664:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00000040:3.0:1787397807.596665:0:75623:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a8ead059] to pc [ptlrpcd_00_01+1] req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397807.596667:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1787397807.596671:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596678:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701142784:0@lo:8:kworker.0 00000100:00000040:1.0:1787397807.596683:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701142272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397807.596691:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a83670c800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1787397807.596697:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984a680 x1874218701142784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397832 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397807.596704:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1787397807.596715:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.596724:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701143296:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1787397807.596737:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397807.596744:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397807.596758:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15500 x1874218701143296 msgsize 224 00000100:00100000:1.0:1787397807.596762:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397807.596786:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397807.596803:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1710278 usecs (1711 jiffies) 00000100:00100000:3.0:1787397807.596829:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143296 00000100:00100000:3.0:1787397807.596834:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143296 00000020:00000040:3.0:1787397807.596836:0:8445:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:3.0:1787397807.596838:0:8445:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00000040:3.0:1787397807.596850:0:8445:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1787397807.596873:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00000040:3.0:1787397807.596876:0:8445:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:3.0:1787397807.596889:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15500 x1874218701143296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.596900:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701143296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397807.596929:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00010000:00000040:3.0:1787397807.596937:0:8445:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701143296 00000100:00000040:3.0:1787397807.596943:0:8445:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397807.596946:0:8445:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397807.596971:0:8445:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397807.596986:0:8445:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397807.596989:0:8445:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15500 x1874218701143296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/368 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397807.596996:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701143296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397807.597001:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00000040:3.0:1787397807.597003:0:8445:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:3.0:1787397807.597011:0:8445:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00000040:1.0:1787397807.597332:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1787397807.597339:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1787397807.597347:0:3649:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352803 avail=317100 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023572 state=0: rc = 0 00000100:00000040:1.0:1787397807.597353:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.597359:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701143296:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1787397807.597365:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc5500 x1874218701143296/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397807.597373:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1787397807.601586:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397807.601604:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397807.601619:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.601627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701142528:0@lo:400:kworker.0 00000100:00000040:0.0:1787397807.601637:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849f80 x1874218701142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.601648:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7033bd800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1787397807.601659:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984aa00 x1874218701142656/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.601666:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397807.601673:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849c00 x1874218701141888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.601680:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7033bb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1787397807.601685:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849500 x1874218701142528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397807.601690:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7054c2800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:01000004:3.0:1787397807.669675:0:96908:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397807.669697:0:96908:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787397807.669698:0:96908:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787397807.669822:0:96908:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a8364e0800 00000020:01000004:3.0:1787397807.669837:0:96908:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787397807.669853:0:96908:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397807.669868:0:96908:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89a838780000) 00000020:00000040:3.0:1787397807.669875:0:96908:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a8364e2000 with handle 0x274786fe0d192372 to hash 00000020:00000040:3.0:1787397807.669881:0:96908:0:(genops.c:900:class_export_put()) PUTting export ffff89a8364e2000 : new refcount 1 00000020:00000040:3.0:1787397807.669889:0:96908:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff89a838780000) now 2 - obd_device_list 00000020:00000080:3.0:1787397807.669894:0:96908:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00000040:1.0:1787397807.888702:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451a850 x1874218681271040 msgsize 224 00000100:00100000:1.0:1787397807.888719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397807.888721:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397807.888768:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af16680 x1874218681271296 msgsize 224 00000100:00100000:1.0:1787397807.888773:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397807.888800:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af16300 x1874218681271168 msgsize 224 00000100:00100000:1.0:1787397807.888804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397807.888830:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15180 x1874218681271552 msgsize 224 00000100:00100000:1.0:1787397807.888834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397807.888908:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af17800 x1874218681271424 msgsize 520 00000100:00100000:1.0:1787397807.888925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397807.888961:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271296 00000100:00100000:1.0:1787397807.888971:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271296 00000020:00000040:1.0:1787397807.888974:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d190a43 00000020:00000040:1.0:1787397807.888979:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1c800 refcount=11 00000020:00000040:1.0:1787397807.889006:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00000040:1.0:1787397807.889030:0:66178:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1787397807.889057:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271168 00000100:00100000:1.0:1787397807.889060:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271168 00000020:00000040:1.0:1787397807.889062:0:66178:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19144c 00000020:00000040:1.0:1787397807.889064:0:66178:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b19800 refcount=51 00000020:00000040:1.0:1787397807.889071:0:66178:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00100000:1.0:1787397807.889108:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1448 00000100:00000040:1.0:1787397807.889113:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1c800 : new rpc_count 1 00000100:00000040:1.0:1787397807.889121:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af16680 x1874218681271296/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889135:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681271296:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:1.0:1787397807.889162:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 81604378767, transno 0, xid 1874218681271296 00000100:00000040:1.0:1787397807.889173:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889179:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889221:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889227:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16680 x1874218681271296/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889237:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681271296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 104us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397807.889244:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1448 00000100:00000040:1.0:1787397807.889247:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1c800 : new rpc_count 0 00000020:00000040:1.0:1787397807.889259:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1c800 : new refcount 10 00000100:00100000:1.0:1787397807.889269:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1449 00000100:00000040:1.0:1787397807.889271:0:66178:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b19800 : new rpc_count 1 00000100:00000040:1.0:1787397807.889275:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af16300 x1874218681271168/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889298:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681271168:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:1.0:1787397807.889310:0:66178:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084439, transno 0, xid 1874218681271168 00000100:00000040:1.0:1787397807.889316:0:66178:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889320:0:66178:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889335:0:66178:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889340:0:66178:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16300 x1874218681271168/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889348:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681271168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397807.889354:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1449 00000100:00000040:1.0:1787397807.889356:0:66178:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b19800 : new rpc_count 0 00000020:00000040:1.0:1787397807.889362:0:66178:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b19800 : new refcount 50 00000100:00100000:1.0:1787397807.889378:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271552 00000100:00100000:1.0:1787397807.889382:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271552 00000020:00000040:1.0:1787397807.889385:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917e1 00000020:00000040:1.0:1787397807.889387:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803902000 refcount=7 00000020:00000040:1.0:1787397807.889398:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:1.0:1787397807.889411:0:26161:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1787397807.889432:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271424 00000100:00100000:1.0:1787397807.889436:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271424 00000020:00000040:1.0:1787397807.889437:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917da 00000100:00100000:1.0:1787397807.889454:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2670 00000100:00000040:1.0:1787397807.889458:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803902000 : new rpc_count 1 00000100:00000040:1.0:1787397807.889462:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15180 x1874218681271552/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889475:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681271552:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:1.0:1787397807.889495:0:26161:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681271552 00000100:00000040:1.0:1787397807.889502:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889506:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889557:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889563:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15180 x1874218681271552/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889571:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681271552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 99us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397807.889579:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2670 00000100:00000040:1.0:1787397807.889581:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803902000 : new rpc_count 0 00000020:00000040:1.0:1787397807.889589:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff89a803902000 : new refcount 6 00000100:00100000:1.0:1787397807.889601:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5054 00000100:00000040:1.0:1787397807.889605:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af17800 x1874218681271424/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889613:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2401:x1874218681271424:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:1.0:1787397807.889635:0:26161:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1787397807.889652:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889656:0:26161:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889660:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889674:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397807.889678:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17800 x1874218681271424/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397827 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397807.889687:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2401:x1874218681271424:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 74us (777us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397807.889693:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5054 00000100:00080000:1.0:1787397807.889724:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1787397807.889728:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00080000:1.0:1787397807.889731:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1787397807.889733:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 14 - evictor 00000100:00080000:1.0:1787397807.889735:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1787397807.889737:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 10 - evictor 00000100:00100000:0.0:1787397807.890116:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271040 00000100:00100000:0.0:1787397807.890122:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271040 00000020:00000040:0.0:1787397807.890133:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:0.0:1787397807.890137:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:0.0:1787397807.890151:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397807.890182:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 191 00000100:00000040:0.0:1787397807.890185:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:0.0:1787397807.890190:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451a850 x1874218681271040/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:248/0 lens 224/0 e 0 to 0 dl 1787397818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.890200:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681271040:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:0.0:1787397807.890210:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681271040 00000100:00000040:0.0:1787397807.890214:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397807.890217:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397807.890240:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397807.890245:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451a850 x1874218681271040/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:248/0 lens 224/224 e 0 to 0 dl 1787397818 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397807.890252:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681271040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 55us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397807.890258:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 191 00000100:00000040:0.0:1787397807.890260:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:0.0:1787397807.890267:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00010000:00010000:2.0:1787397807.973114:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1787397808.101073:0:94350:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397808.101133:0:94350:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001108a604] to pc [ptlrpcd_00_02+2] req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.101229:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.101244:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701143424:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1787397808.101295:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.101314:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.101366:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a829849c00 x1874218701143424 msgsize 224 00000100:00100000:0.0:1787397808.101371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.101395:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.101410:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6633 usecs (7 jiffies) 00000100:00100000:0.0:1787397808.101825:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143424 00000100:00100000:0.0:1787397808.101837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143424 00000020:00000040:0.0:1787397808.101841:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:0.0:1787397808.101847:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00000040:0.0:1787397808.101875:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1787397808.101916:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00000040:0.0:1787397808.101922:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397808.101929:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829849c00 x1874218701143424/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.101941:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701143424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397808.101983:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1787397808.101996:0:8438:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701143424 00000100:00000040:0.0:1787397808.102009:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.102015:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.102040:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.102062:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.102067:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849c00 x1874218701143424/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/368 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.102075:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701143424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.102092:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00000040:0.0:1787397808.102095:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:0.0:1787397808.102109:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00000040:0.0:1787397808.102261:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:0.0:1787397808.102268:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1787397808.102280:0:3650:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1787397808.102284:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1787397808.102292:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.102299:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701143424:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1787397808.102306:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849500 x1874218701143424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.102317:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:3.0:1787397808.108122:0:75627:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1787397808.108183:0:75627:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000626d455] to pc [ptlrpcd_00_03+3] req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.108233:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:3.0:1787397808.108255:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.108271:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701143552:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1787397808.108325:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.108335:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.108388:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc5880 x1874218701143552 msgsize 224 00000100:00100000:3.0:1787397808.108394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397808.108421:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.108436:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5392 usecs (6 jiffies) 00000100:00100000:3.0:1787397808.108472:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143552 00000100:00100000:3.0:1787397808.108481:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143552 00000020:00000040:3.0:1787397808.108485:0:8439:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:3.0:1787397808.108490:0:8439:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:3.0:1787397808.108548:0:8439:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1787397808.108595:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00000040:3.0:1787397808.108619:0:8439:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:3.0:1787397808.108625:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc5880 x1874218701143552/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.108637:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701143552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397808.108668:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1787397808.108683:0:8439:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701143552 00000100:00000040:3.0:1787397808.108695:0:8439:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.108702:0:8439:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.108723:0:8439:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.108742:0:8439:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.108747:0:8439:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc5880 x1874218701143552/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/368 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.108755:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701143552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.108763:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00000040:3.0:1787397808.108766:0:8439:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:3.0:1787397808.108782:0:8439:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00000040:3.0:1787397808.108827:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:3.0:1787397808.108834:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1787397808.108846:0:3650:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1787397808.108850:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1787397808.108859:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.108866:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701143552:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1787397808.108880:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7480 x1874218701143552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.108890:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000001:00000040:3.0:1787397808.563866:0:96908:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1787397808.593434:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787397808.594093:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787397808.594137:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787397808.608943:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787397808.609032:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787397808.609067:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787397808.609122:0:96908:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1787397808.626250:0:96908:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:0.0:1787397808.630008:0:96908:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff89a838780000) now 3 - setup 00000020:00000080:0.0:1787397808.630021:0:96908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787397808.630040:0:96908:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:0.0:1787397808.630054:0:96908:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a703c33000 with handle 0x274786fe0d192379 to hash 00000020:00000040:0.0:1787397808.630065:0:96908:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff89a838780000) now 4 - export 00000020:00000040:0.0:1787397808.630069:0:96908:0:(genops.c:900:class_export_put()) PUTting export ffff89a703c33000 : new refcount 1 00000020:00000080:0.0:1787397808.630072:0:96908:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192379 00000020:00000040:0.0:1787397808.630075:0:96908:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d192379 00000020:00000040:0.0:1787397808.630078:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a703c33000 refcount=2 00000020:01000004:0.0:1787397808.630087:0:96908:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787397808.630122:0:96908:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787397808.630158:0:96908:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787397808.632059:0:96908:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787397808.632142:0:96908:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787397808.633762:0:96908:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:0.0:1787397808.636884:0:96908:0:(genops.c:889:class_export_get()) GET export ffff89a8364e2000 refcount=2 00000040:00000040:0.0:1787397808.636913:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 00000040:00000040:0.0:1787397808.641507:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a8092ecd80 : new refcount 1 00000040:01000000:0.0:1787397808.641552:0:96908:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 10000000:00000040:0.0:1787397808.641558:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 10000000:00000040:0.0:1787397808.641562:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a8092ecd80 : new refcount 1 00000020:00000040:0.0:1787397808.641566:0:96908:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.160@tcp (ffff89a828c1b380) now 6 - mgc_fs 00000020:01000004:0.0:1787397808.641626:0:96908:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787397808.641632:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787397808.641634:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397808.641635:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397808.641636:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397808.641638:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397808.641639:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397808.641641:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397808.641643:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397808.641645:0:96908:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787397808.641650:0:96908:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787397808.641653:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397808.641654:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397808.641655:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397808.641657:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397808.641658:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397808.641659:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397808.641660:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397808.641661:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397808.641662:0:96908:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:0.0:1787397808.641671:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 10000000:01000000:0.0:1787397808.641703:0:96908:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1787397808.641730:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.641747:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143680:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1787397808.641797:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.641805:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.641869:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70278ac50 x1874218701143680 msgsize 4848 00000100:00100000:0.0:1787397808.641874:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.641876:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1787397808.641928:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.641962:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397808.643026:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143680 00000100:00100000:3.0:1787397808.643044:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143680 00000020:00000040:3.0:1787397808.643049:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.643056:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=21 00000100:00000040:3.0:1787397808.643098:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.643145:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:3.0:1787397808.643150:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.643160:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70278ac50 x1874218701143680/t0(0) o253->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 4848/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.643175:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:96908:x1874218701143680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787397808.643241:0:94334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787397808.643245:0:94334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787397808.643251:0:94334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:3.0:1787397808.648853:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701143680 00000100:00000040:3.0:1787397808.648887:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.648908:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.648994:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.649044:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.649053:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70278ac50 x1874218701143680/t0(0) o253->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 4848/4768 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.649089:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:96908:x1874218701143680:12345-0@lo:253:mount.lustre.0 Request processed in 5916us (7217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.649102:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:3.0:1787397808.649107:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.649124:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 20 00000100:00000040:1.0:1787397808.649376:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.649390:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.649399:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143680:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1787397808.649410:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787397808.649426:0:96908:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787397808.649430:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787397808.649432:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397808.649433:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397808.649434:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397808.649436:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397808.649451:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397808.649453:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397808.649455:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397808.649457:0:96908:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:1.0:1787397808.649461:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849500 x1874218701143680/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.649473:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:01000004:1.0:1787397808.649504:0:96908:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a8364e0800 from lustre-OST0000 10000000:01000000:1.0:1787397808.649598:0:96908:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787397808.649602:0:96908:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:1.0:1787397808.649614:0:96908:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff89a8310b7800) refs 5 10000000:01000000:1.0:1787397808.649618:0:96908:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00000020:00000040:1.0:1787397808.649633:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a75200 refcount=2 00010000:00010000:1.0:1787397808.649643:0:96908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1787397808.649677:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a81aa5d540 : new refcount 2 10000000:00000040:1.0:1787397808.649681:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 10000000:00000040:1.0:1787397808.649684:0:96908:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.160@tcp: copy local log lustre-sptlrpc 00000020:00000040:1.0:1787397808.649749:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.649756:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.649794:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.649809:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143808:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.649831:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.649850:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.649878:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704519850 x1874218701143808 msgsize 512 00000100:00100000:1.0:1787397808.649883:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.649885:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.649914:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.649945:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397808.650374:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143808 00000100:00100000:3.0:1787397808.650383:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143808 00000020:00000040:3.0:1787397808.650387:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.650391:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=21 00000100:00000040:3.0:1787397808.650414:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.651821:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1787397808.651831:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.651985:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704519850 x1874218701143808/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.652012:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:96908:x1874218701143808:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1787397808.652050:0:94334:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:3.0:1787397808.652054:0:94334:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:3.0:1787397808.652117:0:94334:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:3.0:1787397808.652124:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701143808 00000100:00000040:3.0:1787397808.652139:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.652147:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.652829:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.652885:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.652892:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704519850 x1874218701143808/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/272 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.652911:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:96908:x1874218701143808:12345-0@lo:501:mount.lustre.0 Request processed in 912us (3030us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397808.652940:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1787397808.652944:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.652959:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 20 00000100:00000040:1.0:1787397808.666501:0:96908:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.666549:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.666560:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.666568:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143808:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.666603:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.666617:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.666622:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af16d80 x1874218701143808/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.666633:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:01000000:1.0:1787397808.666942:0:96908:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787397808.667005:0:96908:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:1.0:1787397808.667014:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a75200 refcount=3 00010000:00010000:1.0:1787397808.667023:0:96908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.667035:0:96908:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397808.667089:0:96908:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a8364e0800 10000000:01000000:1.0:1787397808.667097:0:96908:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:1.0:1787397808.667102:0:96908:0:(genops.c:889:class_export_get()) GET export ffff89a8310ab800 refcount=18 10000000:00000040:1.0:1787397808.667108:0:96908:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff89a835640600) refs 4 10000000:01000000:1.0:1787397808.667110:0:96908:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787397808.667113:0:96908:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:1.0:1787397808.667115:0:96908:0:(genops.c:889:class_export_get()) GET export ffff89a8310ab800 refcount=19 10000000:01000000:1.0:1787397808.667120:0:96908:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787397808.667124:0:96908:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:1.0:1787397808.667132:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00010000:00000040:1.0:1787397808.668366:0:96908:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a817ea6600 count: 8 00000020:00000040:1.0:1787397808.668871:0:96908:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a70720ac00 with handle 0x274786fe0d192380 to hash 00010000:00010000:1.0:1787397808.668884:0:96908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.668930:0:96908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.668944:0:96908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1787397808.668976:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.668993:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143936:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1787397808.669033:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.669042:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.669119:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704518450 x1874218701143936 msgsize 328 00000100:00100000:1.0:1787397808.669125:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.669127:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.669895:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.669948:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397808.670620:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701143936 00000100:00100000:3.0:1787397808.670634:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701143936 00000020:00000040:3.0:1787397808.670638:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.670707:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=21 00000100:00000040:3.0:1787397808.670749:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.670785:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:3.0:1787397808.670790:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.670798:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704518450 x1874218701143936/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.670811:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:96908:x1874218701143936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397808.670833:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1787397808.670848:0:94340:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a82e43e000 count: 10 00000020:00000040:3.0:1787397808.670857:0:94340:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a80fe74a00 with handle 0x274786fe0d192387 to hash 00010000:00010000:3.0:1787397808.670861:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74a00/0x274786fe0d192387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192380 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670870:0:94340:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670d800 : new locks_count 16 00000020:00000040:3.0:1787397808.670872:0:94340:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=22 00010000:00000040:3.0:1787397808.670906:0:94340:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff89a82e43e000) refcount = 10 00010000:00000040:3.0:1787397808.670911:0:94340:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1787397808.670915:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1919b6 expref: 22 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670924:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19198c expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670953:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19197e expref: 22 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670961:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191970 expref: 22 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670969:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191962 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670975:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191954 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670981:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191946 expref: 22 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670991:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8275 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.670997:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d826e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.671004:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74a00/0x274786fe0d192387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192380 expref: 22 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.671022:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74a00/0x274786fe0d192387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192380 expref: 22 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.671033:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74a00, rc 0) 00010000:00000040:3.0:1787397808.671038:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701143936 00000100:00000040:3.0:1787397808.671052:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.671059:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.671300:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.671338:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.671345:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704518450 x1874218701143936/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/344 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.671355:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701143936:12345-0@lo:101:mount.lustre.0 Request processed in 545us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.671363:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:3.0:1787397808.671366:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000100:00000040:1.0:1787397808.671389:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.671402:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.671411:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701143936:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1787397808.671421:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.671435:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720ac00 refcount=4 00010000:00000040:1.0:1787397808.671449:0:96908:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff89a70720ac00, remote cookie: 0x274786fe0d192387, flags: 0x0 00010000:00000040:1.0:1787397808.671455:0:96908:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff89a817ea6600) refcount = 8 00010000:00000040:1.0:1787397808.671457:0:96908:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1787397808.671461:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671470:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671477:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671484:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671491:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671498:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.671505:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.671511:0:96908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.671541:0:96908:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1787397808.671554:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af16d80 x1874218701143936/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.671576:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:00000040:1.0:1787397808.671589:0:96908:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff89a817811c00) refs 2 00000020:00000040:1.0:1787397808.671604:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720ac00 refcount=3 10000000:00000040:1.0:1787397808.671650:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a81aa5d540 : new refcount 2 10000000:00000040:1.0:1787397808.671654:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 10000000:00000040:1.0:1787397808.671658:0:96908:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.160@tcp: copy local log lustre-OST0000 00000040:00080000:1.0:1787397808.671895:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:00000040:3.0:1787397808.671956:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00000040:00080000:1.0:1787397808.672809:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397808.681005:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787397808.681095:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787397808.681120:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787397808.681146:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787397808.681167:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787397808.681181:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787397808.681930:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787397808.681951:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:1.0:1787397808.682052:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.682062:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.682118:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.682323:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144064:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.682367:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.682377:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.682829:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451b850 x1874218701144064 msgsize 512 00000100:00100000:1.0:1787397808.682837:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.682840:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.682928:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.682991:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397808.688161:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144064 00000100:00100000:0.0:1787397808.688183:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144064 00000020:00000040:0.0:1787397808.688187:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.688195:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:1.0:1787397808.689581:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1787397808.690141:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1787397808.690149:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:1.0:1787397808.690162:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451b850 x1874218701144064/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.690182:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144064:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1787397808.690221:0:94335:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:1.0:1787397808.690225:0:94335:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:1.0:1787397808.690338:0:94335:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00000020:00000040:1.0:1787397808.690350:0:94335:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=23 00000020:00000040:1.0:1787397808.690355:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00010000:00000040:1.0:1787397808.690361:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144064 00000100:00000040:1.0:1787397808.690375:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:1.0:1787397808.690381:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.690713:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.690819:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:1.0:1787397808.690835:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451b850 x1874218701144064/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/272 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.690845:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144064:12345-0@lo:501:mount.lustre.0 Request processed in 670us (8324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397808.690854:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1787397808.690858:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:1.0:1787397808.690873:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00000100:00000040:2.0:1787397808.691204:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.691216:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.691224:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144064:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1787397808.691235:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.691251:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.691256:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af16d80 x1874218701144064/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.691266:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.691285:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.691292:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.691327:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.691340:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144192:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1787397808.691389:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.691398:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.696613:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451ac50 x1874218701144192 msgsize 272 00000100:00100000:2.0:1787397808.696660:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.696663:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.696717:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.696787:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144192 00000100:00100000:3.0:1787397808.696802:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144192 00000020:00000040:3.0:1787397808.696806:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.696813:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:3.0:1787397808.696847:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.696880:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:3.0:1787397808.696885:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.696892:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451ac50 x1874218701144192/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.696915:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144192:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1787397808.696966:0:94340:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:3.0:1787397808.697047:0:94340:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:3.0:1787397808.697054:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144192 00000100:00000040:3.0:1787397808.697069:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.697077:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.697134:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.697153:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.697188:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451ac50 x1874218701144192/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8416 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.697201:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144192:12345-0@lo:503:mount.lustre.0 Request processed in 287us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.697209:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:3.0:1787397808.697213:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.697228:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00000100:00100000:2.0:1787397808.697355:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686d80 going to sleep for 11 seconds 00000100:00000040:2.0:1787397808.697389:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.697401:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.697409:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144192:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1787397808.697504:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.697547:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ea00 x1874218701144192/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.697563:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.697574:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.698309:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1787397808.698388:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.698395:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.698591:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.698607:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144320:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.698661:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.698669:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.698720:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704518850 x1874218701144320 msgsize 272 00000100:00100000:2.0:1787397808.698725:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.698734:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.701537:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.701586:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397808.703987:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144320 00000100:00100000:3.0:1787397808.704010:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144320 00000020:00000040:3.0:1787397808.704015:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.704024:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:3.0:1787397808.704323:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.704444:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1787397808.704451:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.704462:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704518850 x1874218701144320/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.704478:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144320:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1787397808.704793:0:94334:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:3.0:1787397808.706319:0:94334:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:3.0:1787397808.706337:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144320 00000100:00000040:3.0:1787397808.706357:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.706366:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.706849:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.706893:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.706916:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704518850 x1874218701144320/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.706927:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144320:12345-0@lo:502:mount.lustre.0 Request processed in 2452us (8205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.706957:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1787397808.706962:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.706980:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00000100:00000040:2.0:1787397808.708022:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.708040:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.708048:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144320:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.708060:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.708079:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ea00 x1874218701144320/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.708102:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.708114:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.708439:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787397808.708478:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787397808.708493:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787397808.708507:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787397808.708551:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787397808.708569:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787397808.708580:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787397808.708593:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787397808.708606:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787397808.708621:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787397808.708634:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787397808.708646:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:2.0:1787397808.708655:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.708660:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.708713:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.708727:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144448:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.708768:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.708778:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.708827:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451b050 x1874218701144448 msgsize 272 00000100:00100000:2.0:1787397808.708832:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.708834:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.708855:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.708888:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397808.709163:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144448 00000100:00100000:0.0:1787397808.709172:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144448 00000020:00000040:0.0:1787397808.709176:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.709183:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:0.0:1787397808.709212:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.709253:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1787397808.709258:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.709265:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451b050 x1874218701144448/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.709278:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144448:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1787397808.709318:0:94333:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:0.0:1787397808.709400:0:94333:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:0.0:1787397808.709407:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144448 00000100:00000040:0.0:1787397808.709418:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.709425:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.709452:0:94333:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.709494:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.709500:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451b050 x1874218701144448/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.709508:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144448:12345-0@lo:502:mount.lustre.0 Request processed in 232us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.709516:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1787397808.709546:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397808.709561:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00000100:00000040:2.0:1787397808.710246:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.710258:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.710265:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144448:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.710273:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.710288:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ea00 x1874218701144448/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.710307:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.710317:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.710385:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787397808.710400:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:2.0:1787397808.710941:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a81aa5d540 : new refcount 1 00000020:00000040:2.0:1787397808.710948:0:96908:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:2.0:1787397808.711557:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787397808.711568:0:96913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787397808.711577:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397808.711580:0:96913:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787397808.711587:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787397808.711607:0:96913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89a83b9d19c0) 00000020:00000040:2.0:1787397808.711616:0:96913:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a702021800 with handle 0x274786fe0d19238e to hash 00000020:00000040:2.0:1787397808.711625:0:96913:0:(genops.c:900:class_export_put()) PUTting export ffff89a702021800 : new refcount 1 00000020:00000040:2.0:1787397808.711643:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 2 - obd_device_list 00000020:00000080:2.0:1787397808.711651:0:96913:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:2.0:1787397808.711657:0:96913:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:2.0:1787397808.711660:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787397808.711748:0:96913:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e0800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787397808.711758:0:96913:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:2.0:1787397808.711763:0:96913:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7050a1800 with handle 0x274786fe0d192395 to hash 00000020:00000040:2.0:1787397808.711768:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff89a838780000) now 5 - export 00000020:00000040:2.0:1787397808.711771:0:96913:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a1800 : new refcount 1 00000020:00000080:2.0:1787397808.711774:0:96913:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192395 00000020:00000040:2.0:1787397808.711777:0:96913:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d192395 00000020:00000040:2.0:1787397808.711779:0:96913:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a1800 refcount=2 00010000:00010000:2.0:1787397808.721506:0:96913:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1787397808.721556:0:96913:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 739, crc32c 3923, adler 747, t10ip512 3943, t10ip4k 5631, t10crc512 927, t10crc4k 721 00002000:00000040:2.0:1787397808.721614:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1787397808.721723:0:96913:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968731: rc = 0 00000001:00000040:2.0:1787397808.721729:0:96913:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1787397808.721740:0:96913:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968731, last_xid = 1874218701047552, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1787397808.721745:0:96913:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968731 srv lr: 4294968731 lx: 1874218701047552 gen 0 00000020:00000040:2.0:1787397808.721754:0:96913:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7050a6000 with handle 0x274786fe0d19239c to hash 00000020:00000040:2.0:1787397808.721787:0:96913:0:(genops.c:889:class_export_get()) GET export ffff89a7050a6000 refcount=3 00000020:00000040:2.0:1787397808.721793:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 3 - export 00000001:00000040:2.0:1787397808.721798:0:96913:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1787397808.721801:0:96913:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a6000 : new refcount 2 00000001:00000040:2.0:1787397808.721808:0:96913:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968749, last_xid = 1874218701128064, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1787397808.721813:0:96913:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968749 srv lr: 4294968731 lx: 1874218701128064 gen 0 00000020:00000040:2.0:1787397808.721818:0:96913:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7050a3000 with handle 0x274786fe0d1923a3 to hash 00000020:00000040:2.0:1787397808.721829:0:96913:0:(genops.c:889:class_export_get()) GET export ffff89a7050a3000 refcount=3 00000020:00000040:2.0:1787397808.721832:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 4 - export 00000001:00000040:2.0:1787397808.721835:0:96913:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1787397808.721837:0:96913:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a3000 : new refcount 2 00000001:00000040:2.0:1787397808.721841:0:96913:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = 784819ec-79bc-4534-8fa6-902d7a92d2f8, last_transno = 4294968753, last_xid = 1874218681242240, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1787397808.721845:0:96913:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 4294968753 srv lr: 4294968731 lx: 1874218681242240 gen 0 00000020:00000040:2.0:1787397808.721849:0:96913:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7050a7000 with handle 0x274786fe0d1923aa to hash 00000020:00000040:2.0:1787397808.721862:0:96913:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=3 00000020:00000040:2.0:1787397808.721864:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 5 - export 00000001:00000040:2.0:1787397808.721866:0:96913:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' added, generation 0 00000020:00000040:2.0:1787397808.721868:0:96913:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 2 00000001:00000040:2.0:1787397808.721872:0:96913:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1787397808.721875:0:96913:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1787397808.721881:0:96913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968753 00000001:00000040:0.0:1787397808.728820:0:96913:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968753: rc = 0 00000001:00000040:0.0:1787397808.728861:0:96913:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968753: rc = 0 00002000:00000040:0.0:1787397808.728908:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:0.0:1787397808.729030:0:96913:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:0.0:1787397808.729137:0:96913:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:0.0:1787397808.729153:0:96913:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:0.0:1787397808.729161:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:0.0:1787397808.729227:0:96913:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:0.0:1787397808.729236:0:96913:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:0.0:1787397808.729292:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:0.0:1787397808.729312:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:0.0:1787397808.729370:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:0.0:1787397808.729432:0:96913:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:0.0:1787397808.729477:0:96913:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:0.0:1787397808.729757:0:96913:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:0.0:1787397808.730078:0:96913:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:0.0:1787397808.736117:0:96913:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 6 - setup 00000020:00000080:0.0:1787397808.736127:0:96913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787397808.736141:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397808.736166:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736169:0:96913:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787397808.736173:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397808.736176:0:96913:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787397808.736178:0:96913:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397808.736180:0:96913:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397808.736181:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397808.736184:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736186:0:96913:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397808.736188:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397808.736192:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736193:0:96913:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787397808.736196:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787397808.736198:0:96913:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787397808.736200:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397808.736202:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736204:0:96913:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787397808.736206:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397808.736208:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736209:0:96913:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787397808.736213:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787397808.736261:0:96913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397808.736265:0:96913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.736266:0:96913:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787397808.736269:0:96913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787397808.736603:0:96908:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787397808.736656:0:96908:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:2.0:1787397808.736676:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720ac00 refcount=3 00010000:00010000:2.0:1787397808.736693:0:96908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.736706:0:96908:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397808.736717:0:96908:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a8364e0800 from 1 10000000:01000000:2.0:1787397808.736720:0:96908:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:2.0:1787397808.736730:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00010000:00000040:2.0:1787397808.736763:0:96908:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a8098c4a00 count: 4 00000020:00000040:2.0:1787397808.736773:0:96908:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a808719000 with handle 0x274786fe0d1923b1 to hash 00010000:00010000:2.0:1787397808.736782:0:96908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.736790:0:96908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.736816:0:96908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397808.736847:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.736862:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144576:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1787397808.736905:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.736914:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.736972:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704518c50 x1874218701144576 msgsize 328 00000100:00100000:2.0:1787397808.736977:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.736979:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.737005:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.737043:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397808.737322:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144576 00000100:00100000:0.0:1787397808.737334:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144576 00000020:00000040:0.0:1787397808.737337:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.737341:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:0.0:1787397808.737363:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.737403:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1787397808.737409:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.737416:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704518c50 x1874218701144576/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.737442:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:96908:x1874218701144576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397808.737463:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1787397808.737475:0:94335:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a8191cd100 count: 5 00000020:00000040:0.0:1787397808.737483:0:94335:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a8016a0c00 with handle 0x274786fe0d1923b8 to hash 00010000:00010000:0.0:1787397808.737488:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8016a0c00/0x274786fe0d1923b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1923b1 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.737495:0:94335:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670d800 : new locks_count 17 00000020:00000040:0.0:1787397808.737498:0:94335:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=23 00010000:00000040:0.0:1787397808.737542:0:94335:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff89a8191cd100) refcount = 5 00010000:00000040:0.0:1787397808.737546:0:94335:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1787397808.737550:0:94335:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a800031600/0x274786fe0d191579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191572 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.737557:0:94335:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a704d22600/0x274786fe0d19154f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191548 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.737564:0:94335:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a74200/0x274786fe0d1914d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1914ca expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.737575:0:94335:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a800030200/0x274786fe0d1913d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8205 expref: 9 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.737582:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8016a0c00/0x274786fe0d1923b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1923b1 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.737594:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8016a0c00/0x274786fe0d1923b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923b1 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.737605:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0c00, rc 0) 00010000:00000040:0.0:1787397808.737616:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144576 00000100:00000040:0.0:1787397808.737629:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.737635:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.737661:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.737692:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.737697:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704518c50 x1874218701144576/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/344 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.737706:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144576:12345-0@lo:101:mount.lustre.0 Request processed in 267us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.737713:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1787397808.737716:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397808.737728:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:3.0:1787397808.737759:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.737772:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.737780:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144576:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1787397808.737788:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.737799:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808719000 refcount=4 00010000:00000040:3.0:1787397808.737804:0:96908:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff89a808719000, remote cookie: 0x274786fe0d1923b8, flags: 0x0 00010000:00000040:3.0:1787397808.737809:0:96908:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff89a8098c4a00) refcount = 4 00010000:00000040:3.0:1787397808.737811:0:96908:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1787397808.737814:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.737822:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.737828:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.737833:0:96908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.737842:0:96908:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1787397808.737859:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ea00 x1874218701144576/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.737870:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:00000040:3.0:1787397808.737880:0:96908:0:(mgc_request.c:108:config_log_get()) log params (ffff89a817810a00) refs 2 00000020:00000040:3.0:1787397808.737884:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808719000 refcount=3 10000000:00000040:3.0:1787397808.737928:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a81aa5d540 : new refcount 2 10000000:00000040:3.0:1787397808.737933:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 10000000:00000040:3.0:1787397808.737937:0:96908:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.160@tcp: copy local log params 00000040:00080000:3.0:1787397808.738188:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787397808.743147:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397808.743587:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787397808.744216:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787397808.744245:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787397808.744251:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:3.0:1787397808.744340:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:3.0:1787397808.744350:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:3.0:1787397808.744404:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.744436:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144704:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1787397808.744473:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.744481:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.744561:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704518050 x1874218701144704 msgsize 504 00000100:00100000:3.0:1787397808.744567:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397808.744569:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1787397808.744596:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.745262:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111000 going to sleep for 11 seconds 00000100:00100000:2.0:1787397808.745377:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144704 00000100:00100000:2.0:1787397808.745389:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144704 00000020:00000040:2.0:1787397808.745392:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.745399:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:2.0:1787397808.745428:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397808.745477:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1787397808.745483:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.745490:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704518050 x1874218701144704/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 504/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.745504:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144704:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1787397808.745563:0:94340:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:2.0:1787397808.745567:0:94340:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:2.0:1787397808.745687:0:94340:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:2.0:1787397808.745697:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144704 00000100:00000040:2.0:1787397808.745711:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:2.0:1787397808.745718:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.745758:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.745787:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:2.0:1787397808.745792:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704518050 x1874218701144704/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 504/272 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.745802:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144704:12345-0@lo:501:mount.lustre.0 Request processed in 300us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.745810:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:2.0:1787397808.745814:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.745826:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:1.0:1787397808.746096:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.746122:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.746129:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144704:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.746139:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.746151:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.746162:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7480 x1874218701144704/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.746171:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.746186:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.746192:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.746217:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.746350:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144832:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1787397808.746393:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.746402:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.746471:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704519450 x1874218701144832 msgsize 272 00000100:00100000:1.0:1787397808.746476:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.746478:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.746504:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.746545:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397808.746612:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144832 00000100:00100000:2.0:1787397808.746619:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144832 00000020:00000040:2.0:1787397808.746622:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.746626:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:2.0:1787397808.746643:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397808.746673:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1787397808.746677:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.746682:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704519450 x1874218701144832/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.746694:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144832:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1787397808.746723:0:94335:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:2.0:1787397808.746777:0:94335:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:2.0:1787397808.746782:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144832 00000100:00000040:2.0:1787397808.746790:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:2.0:1787397808.746794:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.746817:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.746842:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:2.0:1787397808.746847:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704519450 x1874218701144832/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8416 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.746854:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144832:12345-0@lo:503:mount.lustre.0 Request processed in 162us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.746861:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:2.0:1787397808.746864:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.746872:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:1.0:1787397808.747012:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.747033:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.747039:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144832:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1787397808.747045:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.747056:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17b80 x1874218701144832/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.747069:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.747077:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:1.0:1787397808.747870:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1787397808.747958:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.747966:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.748000:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.748015:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144960:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1787397808.748056:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.748064:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.748095:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451a450 x1874218701144960 msgsize 272 00000100:00100000:1.0:1787397808.748099:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.748101:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.748132:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.748160:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397808.748257:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701144960 00000100:00100000:3.0:1787397808.748265:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701144960 00000020:00000040:3.0:1787397808.748269:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.748274:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:3.0:1787397808.748294:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397808.748330:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1787397808.748334:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397808.748339:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451a450 x1874218701144960/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.748352:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144960:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1787397808.748387:0:94334:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:3.0:1787397808.748455:0:94334:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:3.0:1787397808.748460:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701144960 00000100:00000040:3.0:1787397808.748469:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:3.0:1787397808.748474:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.748498:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.748559:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:3.0:1787397808.748565:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451a450 x1874218701144960/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.748575:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701144960:12345-0@lo:502:mount.lustre.0 Request processed in 226us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.748583:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1787397808.748587:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.748598:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:2.0:1787397808.758208:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.758239:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.758279:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701144960:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.758291:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.758314:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17b80 x1874218701144960/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.758337:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.758351:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.759098:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787397808.759148:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787397808.759164:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787397808.759178:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787397808.759193:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:2.0:1787397808.759203:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.759210:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.759255:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.759269:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145088:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.759320:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.759328:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.759384:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451a050 x1874218701145088 msgsize 272 00000100:00100000:2.0:1787397808.759390:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.759392:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.759430:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.759465:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397808.759910:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145088 00000100:00100000:0.0:1787397808.759922:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145088 00000020:00000040:0.0:1787397808.759926:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.759932:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:0.0:1787397808.759962:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.760001:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1787397808.760006:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.760013:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451a050 x1874218701145088/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.760025:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701145088:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1787397808.760064:0:94335:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:0.0:1787397808.760135:0:94335:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:0.0:1787397808.760142:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145088 00000100:00000040:0.0:1787397808.760155:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.760160:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.760200:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.760221:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.760225:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451a050 x1874218701145088/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.760233:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701145088:12345-0@lo:502:mount.lustre.0 Request processed in 210us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.760241:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1787397808.760244:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397808.760256:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:2.0:1787397808.760784:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.760810:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.760818:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145088:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.760828:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.760844:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ce00 x1874218701145088/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.760866:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.760877:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.760969:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787397808.760985:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:2.0:1787397808.761369:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a81aa5d540 : new refcount 1 00000020:00000040:2.0:1787397808.761376:0:96908:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:0.0:1787397808.763989:0:96917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397808.764008:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.764011:0:96917:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787397808.764019:0:96917:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a8364e0800 00000020:00000080:0.0:1787397808.764023:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397808.764035:0:96917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397808.764038:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.764040:0:96917:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787397808.764042:0:96917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397808.764044:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.764045:0:96917:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787397808.764048:0:96917:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a8364e0800 00000020:00000080:0.0:1787397808.764051:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397808.764146:0:96917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397808.764150:0:96917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397808.764151:0:96917:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787397808.764155:0:96917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:1.0:1787397808.764263:0:96908:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787397808.764306:0:96908:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:1.0:1787397808.764341:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808719000 refcount=3 00010000:00010000:1.0:1787397808.764351:0:96908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.764364:0:96908:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397808.764454:0:96908:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787397808.764458:0:96908:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a8364e0800 10000000:01000000:1.0:1787397808.764461:0:96908:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a8364e0800 10000000:01000000:1.0:1787397808.764467:0:96908:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:1.0:1787397808.764471:0:96908:0:(genops.c:889:class_export_get()) GET export ffff89a8310ab800 refcount=20 10000000:01000000:1.0:1787397808.764476:0:96908:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a8364e0800 from 1 10000000:01000000:1.0:1787397808.764479:0:96908:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:1.0:1787397808.764488:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00010000:00000040:1.0:1787397808.764540:0:96908:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a817ea6600 count: 9 00000020:00000040:1.0:1787397808.764551:0:96908:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a70720be00 with handle 0x274786fe0d1923bf to hash 00010000:00010000:1.0:1787397808.764559:0:96908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.764568:0:96908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.764580:0:96908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1787397808.764742:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.764760:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145216:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1787397808.764800:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.764816:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.764869:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a704519c50 x1874218701145216 msgsize 328 00000100:00100000:1.0:1787397808.764874:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.764876:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.764916:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.764951:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787397808.765780:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145216 00000100:00100000:0.0:1787397808.765796:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145216 00000020:00000040:0.0:1787397808.765801:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.765806:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:0.0:1787397808.765838:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.765884:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:0.0:1787397808.765889:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.765907:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a704519c50 x1874218701145216/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.765930:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:96908:x1874218701145216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397808.765952:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1787397808.765966:0:94340:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a82e43e000 count: 11 00000020:00000040:0.0:1787397808.765975:0:94340:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a8016a1a00 with handle 0x274786fe0d1923c6 to hash 00010000:00010000:0.0:1787397808.765982:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1923c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1923bf expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.765991:0:94340:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670d800 : new locks_count 18 00000020:00000040:0.0:1787397808.765994:0:94340:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=24 00010000:00000040:0.0:1787397808.766021:0:94340:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff89a82e43e000) refcount = 11 00010000:00000040:0.0:1787397808.766026:0:94340:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1787397808.766030:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a80fe74a00/0x274786fe0d192387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192380 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766042:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1919b6 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766049:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19198c expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766056:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19197e expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766063:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191970 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766080:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191962 expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766088:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191954 expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766096:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191946 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766108:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8275 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1787397808.766116:0:94340:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d826e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.766126:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1923c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1923bf expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.766141:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1923c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923bf expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.766153:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a1a00, rc 0) 00010000:00000040:0.0:1787397808.766159:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145216 00000100:00000040:0.0:1787397808.766173:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.766180:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.766228:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.766265:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.766270:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a704519c50 x1874218701145216/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/344 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.766290:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145216:12345-0@lo:101:mount.lustre.0 Request processed in 371us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.766298:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:0.0:1787397808.766302:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397808.766316:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397808.767042:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.767059:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.767066:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145216:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1787397808.767077:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.767092:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720be00 refcount=4 00010000:00000040:1.0:1787397808.767100:0:96908:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff89a70720be00, remote cookie: 0x274786fe0d1923c6, flags: 0x0 00010000:00000040:1.0:1787397808.767107:0:96908:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff89a817ea6600) refcount = 9 00010000:00000040:1.0:1787397808.767111:0:96908:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1787397808.767114:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767124:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767132:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767139:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767156:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767162:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767168:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1787397808.767174:0:96908:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.767181:0:96908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397808.767191:0:96908:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1787397808.767203:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17480 x1874218701145216/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.767216:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:00000040:1.0:1787397808.767227:0:96908:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff89a817ddf000) refs 2 00000020:00000040:1.0:1787397808.767231:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720be00 refcount=3 10000000:00000040:1.0:1787397808.767271:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a81aa5d540 : new refcount 2 10000000:00000040:1.0:1787397808.767276:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 10000000:00000040:1.0:1787397808.767280:0:96908:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.160@tcp: copy local log lustre-client 00000040:00080000:1.0:1787397808.767752:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787397808.768106:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397808.768327:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787397808.768355:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787397808.768380:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787397808.768395:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787397808.768410:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787397808.768816:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787397808.768838:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787397808.768851:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787397808.768866:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787397808.768879:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787397808.768891:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787397808.768916:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787397808.768929:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787397808.768943:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787397808.768956:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787397808.768971:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787397808.768983:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787397808.768998:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787397808.769012:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787397808.769025:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787397808.769037:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787397808.769048:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787397808.769060:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787397808.769073:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787397808.769085:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787397808.769098:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787397808.769111:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787397808.769123:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787397808.769137:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787397808.769148:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787397808.769159:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787397808.769173:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787397808.769187:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787397808.769199:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787397808.769210:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787397808.769234:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787397808.769246:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787397808.769269:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787397808.769274:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:1.0:1787397808.769346:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.769356:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.769408:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.769440:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145344:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.769477:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.769488:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.769586:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fec50 x1874218701145344 msgsize 512 00000100:00100000:1.0:1787397808.769592:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.769594:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.769697:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.769758:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397808.771203:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145344 00000100:00100000:2.0:1787397808.771221:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145344 00000020:00000040:2.0:1787397808.771224:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.771230:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397808.771263:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397808.771302:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1787397808.771307:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.771316:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fec50 x1874218701145344/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.771329:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145344:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1787397808.771363:0:94334:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1787397808.771366:0:94334:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:2.0:1787397808.771477:0:94334:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00000020:00000040:2.0:1787397808.771490:0:94334:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=25 00000020:00000040:2.0:1787397808.771495:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 24 00010000:00000040:2.0:1787397808.771501:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145344 00000100:00000040:2.0:1787397808.771514:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:2.0:1787397808.771539:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.771593:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.771626:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:2.0:1787397808.771632:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fec50 x1874218701145344/t0(0) o501->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 512/272 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.771641:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145344:12345-0@lo:501:mount.lustre.0 Request processed in 312us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.771648:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1787397808.771651:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.771661:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397808.771672:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.771684:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.771692:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145344:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1787397808.771702:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.771713:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.771718:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17480 x1874218701145344/t0(0) o501->MGC192.168.204.160@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.771735:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.771749:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.771753:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.771782:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.771794:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145472:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1787397808.771831:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.771837:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.771856:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a70451bc50 x1874218701145472 msgsize 272 00000100:00100000:1.0:1787397808.771861:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.771863:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.771889:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.771924:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397808.772112:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145472 00000100:00100000:2.0:1787397808.772118:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145472 00000020:00000040:2.0:1787397808.772120:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.772124:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397808.772140:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397808.772254:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1787397808.772259:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.772265:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70451bc50 x1874218701145472/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.772277:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145472:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1787397808.772303:0:94340:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:2.0:1787397808.772350:0:94340:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:2.0:1787397808.772499:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145472 00000100:00000040:2.0:1787397808.772510:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:2.0:1787397808.772514:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.772571:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.772595:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:2.0:1787397808.772600:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70451bc50 x1874218701145472/t0(0) o503->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8416 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.772610:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145472:12345-0@lo:503:mount.lustre.0 Request processed in 335us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.772618:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1787397808.772621:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.772630:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397808.773110:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.773121:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.773128:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145472:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1787397808.773136:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.773152:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17480 x1874218701145472/t0(0) o503->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.773173:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.773198:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:1.0:1787397808.774175:0:96908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1787397808.774267:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.774277:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:1.0:1787397808.774316:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.774332:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145600:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1787397808.774378:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.774386:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.776802:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fd850 x1874218701145600 msgsize 272 00000100:00100000:1.0:1787397808.776819:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.776821:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397808.776867:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.777025:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145600 00000100:00100000:2.0:1787397808.777036:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145600 00000020:00000040:2.0:1787397808.777040:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.777047:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397808.777077:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.777101:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397808.777110:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:2.0:1787397808.777114:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.777120:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fd850 x1874218701145600/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.777134:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145600:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1787397808.777179:0:94333:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:2.0:1787397808.777267:0:94333:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:2.0:1787397808.777273:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145600 00000100:00000040:2.0:1787397808.777287:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:2.0:1787397808.777294:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.777344:0:94333:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.777388:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:2.0:1787397808.777395:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fd850 x1874218701145600/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.777404:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145600:12345-0@lo:502:mount.lustre.0 Request processed in 273us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.777412:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:2.0:1787397808.777415:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000100:00000040:0.0:1787397808.777560:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.777573:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.777581:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145600:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1787397808.777591:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.777608:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af17480 x1874218701145600/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.777628:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:0.0:1787397808.777639:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.777711:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000040:00080000:0.0:1787397808.778494:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787397808.778631:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787397808.778649:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787397808.778664:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787397808.778680:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787397808.778694:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787397808.778707:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787397808.778722:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787397808.778736:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787397808.778761:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787397808.778774:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787397808.778789:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787397808.778803:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787397808.778815:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787397808.778827:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787397808.778842:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787397808.778855:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787397808.778871:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787397808.778885:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787397808.778911:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787397808.780093:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787397808.780137:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787397808.780153:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787397808.780169:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787397808.780183:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787397808.780197:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787397808.780211:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787397808.780227:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787397808.780241:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787397808.780254:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787397808.781326:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787397808.781345:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787397808.781357:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787397808.781368:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787397808.781380:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787397808.781395:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787397808.781408:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787397808.781420:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787397808.781434:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787397808.781449:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787397808.781463:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787397808.781476:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787397808.781505:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787397808.781519:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787397808.781551:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787397808.781565:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787397808.781579:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787397808.781591:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:0.0:1787397808.781614:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:0.0:1787397808.781624:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:0.0:1787397808.781676:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.781692:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145728:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1787397808.781745:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.781754:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.781813:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fc050 x1874218701145728 msgsize 272 00000100:00100000:0.0:1787397808.781818:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.781820:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1787397808.784374:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.784428:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145728 00000100:00100000:0.0:1787397808.784441:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145728 00000020:00000040:0.0:1787397808.784445:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.784452:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:0.0:1787397808.784487:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.784553:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:0.0:1787397808.784559:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.784566:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fc050 x1874218701145728/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.784579:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145728:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1787397808.784645:0:94335:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:0.0:1787397808.784729:0:94335:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:0.0:1787397808.784736:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145728 00000100:00000040:0.0:1787397808.784750:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.784757:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1787397808.788597:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464300 going to sleep for 11 seconds 00000100:00000040:0.0:1787397808.794144:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.794193:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.794204:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fc050 x1874218701145728/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.794216:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145728:12345-0@lo:502:mount.lustre.0 Request processed in 9639us (12401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.794228:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:0.0:1787397808.794233:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397808.794251:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397808.794298:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.794318:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.794328:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145728:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1787397808.794339:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.794359:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984aa00 x1874218701145728/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.794381:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:1.0:1787397808.794392:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.795046:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787397808.795090:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:2.0:1787397808.795106:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787397808.795123:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:2.0:1787397808.795138:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:2.0:1787397808.795150:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:2.0:1787397808.795162:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:2.0:1787397808.795175:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:2.0:1787397808.795189:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:2.0:1787397808.795204:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:2.0:1787397808.795217:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:2.0:1787397808.795229:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:2.0:1787397808.795242:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:2.0:1787397808.795256:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:2.0:1787397808.795266:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.795275:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.795315:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.795331:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145856:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.795374:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.795390:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.795455:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fcc50 x1874218701145856 msgsize 272 00000100:00100000:2.0:1787397808.795460:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.795463:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.795495:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.795554:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145856 00000100:00100000:0.0:1787397808.795572:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145856 00000100:00100000:2.0:1787397808.795574:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d000 going to sleep for 11 seconds 00000020:00000040:0.0:1787397808.795576:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397808.795589:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:0.0:1787397808.795619:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397808.795658:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1787397808.795662:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397808.795670:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fcc50 x1874218701145856/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.795683:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145856:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1787397808.795724:0:94333:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a702661f00 : new refcount 2 00000040:00000040:0.0:1787397808.795786:0:94333:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a702661f00 : new refcount 1 00010000:00000040:0.0:1787397808.795803:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145856 00000100:00000040:0.0:1787397808.795814:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.795819:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.799757:0:94333:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.799805:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 51 to 0@lo 00000100:00000040:0.0:1787397808.799815:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fcc50 x1874218701145856/t0(0) o502->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 272/8472 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.799825:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701145856:12345-0@lo:502:mount.lustre.0 Request processed in 4143us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.799908:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1787397808.799914:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000100:00000040:2.0:1787397808.799922:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.799934:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:2.0:1787397808.799945:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.799956:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701145856:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1787397808.799969:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.799993:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70731ce00 x1874218701145856/t0(0) o502->MGC192.168.204.160@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.800019:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397808.800033:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000040:00080000:2.0:1787397808.800136:0:96908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1787397808.800156:0:96908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:2.0:1787397808.801762:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a81aa5d540 : new refcount 1 00000020:00000040:2.0:1787397808.801780:0:96908:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:0.0:1787397808.802586:0:96920:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.160@tcp 192.168.204.160@tcp cnt=1 00000020:01000004:0.0:1787397808.802619:0:96920:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787397808.802635:0:96920:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) 00000020:00000040:0.0:1787397808.802644:0:96920:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a702027800 with handle 0x274786fe0d1923cd to hash 00000020:00000040:0.0:1787397808.802653:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a702027800 : new refcount 1 00000020:00000040:0.0:1787397808.802671:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 2 - obd_device_list 00000020:00000080:0.0:1787397808.802678:0:96920:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787397808.803652:0:96920:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397808.803661:0:96920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a8364e0800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397808.803664:0:96920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e0800 3 00000020:00000040:0.0:1787397808.803683:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 3 - import 00000020:00000040:0.0:1787397808.803691:0:96920:0:(genops.c:1244:class_import_put()) import ffff89a8310a8800 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1787397808.803707:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.803710:0:96920:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 52 to 0@lo 00000100:00000040:0.0:1787397808.803712:0:96920:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.160@tcp -> ffff89a809245ac0 00010000:00080000:0.0:1787397808.803716:0:96920:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a8310a8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397808.806762:0:96920:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:0.0:1787397808.806901:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 4 - setup 00000020:00000080:0.0:1787397808.806906:0:96920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787397808.806955:0:96920:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:0.0:1787397808.806974:0:96920:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a702186800 with handle 0x274786fe0d1923d4 to hash 00000020:00000040:0.0:1787397808.806983:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a702186800 refcount=3 00000020:00000040:0.0:1787397808.806988:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 5 - export 00000020:00000040:0.0:1787397808.806992:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a702186800 : new refcount 2 00000020:00000080:0.0:1787397808.806995:0:96920:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x274786fe0d1923d4 00000020:00000040:0.0:1787397808.806999:0:96920:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923d4 00000020:00000040:0.0:1787397808.807001:0:96920:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a702186800 refcount=3 00000100:00080000:0.0:1787397808.807012:0:96920:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1787397808.807017:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 53 to 0@lo 00000020:00000040:0.0:1787397808.807019:0:96920:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923d4 00000020:00000040:0.0:1787397808.807021:0:96920:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a702186800 refcount=4 00000100:00000040:0.0:1787397808.807023:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 54 to 0@lo 00000020:00000040:0.0:1787397808.807025:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a702186800 : new refcount 3 00000100:00080000:0.0:1787397808.807029:0:96920:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a8310a8800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:0.0:1787397808.807045:0:96920:0:(genops.c:1231:class_import_get()) import ffff89a8310a8800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1787397808.807074:0:96920:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807089:0:96920:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fadc7209] to pc [ptlrpcd_rcv+-1] req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.807201:0:96920:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:0.0:1787397808.807205:0:96920:0:(genops.c:1231:class_import_get()) import ffff89a8310a8800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1787397808.807242:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807249:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1787397808.807260:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807278:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d44c6fae] to pc [ptlrpcd_00_00+0] req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807294:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807299:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bd800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1787397808.807308:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807316:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089cb62d0] to pc [ptlrpcd_00_01+1] req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807324:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807328:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1787397808.807334:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807342:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000030b5b82f] to pc [ptlrpcd_00_02+2] req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.807358:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397808.807361:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397808.807364:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397808.807368:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3686 00000100:00080000:0.0:1787397808.807371:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1787397808.807374:0:65702:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397808.807377:0:65702:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 54 to 0@lo 00000020:00000040:0.0:1787397808.807380:0:65702:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2ca 00000020:00000040:0.0:1787397808.807382:0:65702:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a706ff2800 refcount=4 00000100:00000040:0.0:1787397808.807385:0:65702:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397808.807392:0:65702:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 54 to 0@lo 00000020:00000040:0.0:1787397808.807395:0:65702:0:(genops.c:900:class_export_put()) PUTting export ffff89a706ff2800 : new refcount 3 00000100:00080000:0.0:1787397808.807397:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:0.0:1787397808.807404:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1787397808.807417:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807429:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0d63325] to pc [ptlrpcd_rcv+-1] req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807448:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807456:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397808.807469:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807481:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3f2ab16] to pc [ptlrpcd_00_03+3] req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807491:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807496:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7054c2800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1787397808.807503:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807511:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a22c9b21] to pc [ptlrpcd_00_00+0] req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807518:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807553:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397808.807563:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807574:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000000b1a4fb] to pc [ptlrpcd_00_01+1] req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.807589:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397808.807592:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397808.807593:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397808.807597:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3686 00000100:00080000:0.0:1787397808.807600:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1787397808.807602:0:65702:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397808.807604:0:65702:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 54 to 0@lo 00000020:00000040:0.0:1787397808.807606:0:65702:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191492 00000020:00000040:0.0:1787397808.807609:0:65702:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828785000 refcount=4 00000100:00000040:0.0:1787397808.807612:0:65702:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 53 to 0@lo 00000100:00000040:0.0:1787397808.807614:0:65702:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 54 to 0@lo 00000020:00000040:0.0:1787397808.807617:0:65702:0:(genops.c:900:class_export_put()) PUTting export ffff89a828785000 : new refcount 3 00000100:00080000:0.0:1787397808.807619:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:0.0:1787397808.807625:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1787397808.807636:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807646:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d3fdc99] to pc [ptlrpcd_rcv+-1] req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807654:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807659:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397808.807667:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807676:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001108a604] to pc [ptlrpcd_00_02+2] req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807683:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397808.807705:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a828a58000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1787397808.807715:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.807726:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000206e88de] to pc [ptlrpcd_00_03+3] req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807739:0:65702:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3693) 00000100:00000040:0.0:1787397808.807773:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.807790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701146112:0@lo:400:kworker.0 00000100:00000040:2.0:1787397808.807828:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.807828:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.807850:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701146624:0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.807871:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.807913:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.807932:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.807946:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a702189880 x1874218701146112 msgsize 224 00000100:00100000:0.0:1787397808.807955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.807982:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a70731ce00 x1874218701146624 msgsize 224 00000100:00100000:2.0:1787397808.807990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.808000:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808023:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.808026:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7985 usecs (8 jiffies) 00000100:00000040:2.0:1787397808.808052:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5380 usecs (6 jiffies) 00000100:00000040:0.0:1787397808.808053:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808067:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.808077:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701146752:0@lo:400:kworker.0 00000100:00100000:2.0:1787397808.808088:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701147264:0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.808107:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808111:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808149:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.808155:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.808178:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a70731ea00 x1874218701147264 msgsize 224 00000100:00100000:2.0:1787397808.808187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.808210:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808218:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808250:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7591 usecs (8 jiffies) 00000100:00100000:0.0:1787397808.808250:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701146368:0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.808284:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.808291:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146624 00000100:00000040:0.0:1787397808.808298:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1787397808.808304:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146624 00000020:00000040:2.0:1787397808.808310:0:25908:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:2.0:1787397808.808315:0:25908:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00000040:0.0:1787397808.808324:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188a80 x1874218701146368 msgsize 224 00000100:00100000:0.0:1787397808.808331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.808346:0:25908:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:0.0:1787397808.808370:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.808383:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1705050 usecs (1706 jiffies) 00000100:00100000:2.0:1787397808.808390:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00000040:2.0:1787397808.808398:0:25908:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:0.0:1787397808.808399:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808415:0:25908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70731ce00 x1874218701146624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.808422:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701147136:0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.808446:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.808453:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701146624:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.808470:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.808491:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188e00 x1874218701147136 msgsize 224 00000100:00100000:0.0:1787397808.808497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:2.0:1787397808.808507:0:25908:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701146624 00000100:00000040:0.0:1787397808.808518:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.808549:0:25908:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:2.0:1787397808.808560:0:25908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.808570:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6457 usecs (7 jiffies) 00000100:00000040:2.0:1787397808.808593:0:25908:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.808612:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146112 00000100:00100000:0.0:1787397808.808621:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146112 00000020:00000040:0.0:1787397808.808623:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915cd 00000020:00000040:0.0:1787397808.808627:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5c000 refcount=5 00000100:00000040:0.0:1787397808.808648:0:66177:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397808.808673:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147264 00000100:00100000:0.0:1787397808.808676:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147264 00000020:00000040:0.0:1787397808.808677:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915db 00000020:00000040:0.0:1787397808.808680:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835592000 refcount=5 00000100:00100000:0.0:1787397808.808699:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00000040:0.0:1787397808.808713:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5c000 : new rpc_count 1 00000100:00000040:0.0:1787397808.808719:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702189880 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.808730:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701146112:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397808.808755:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701146112 00000100:00000040:2.0:1787397808.808766:0:25908:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00000040:0.0:1787397808.808770:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:2.0:1787397808.808778:0:25908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ce00 x1874218701146624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.808787:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1787397808.808805:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701146624:12345-0@lo:400:kworker.0 Request processed in 358us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.808815:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00000040:2.0:1787397808.808820:0:25908:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000100:00000040:0.0:1787397808.808825:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.808837:0:25908:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00000040:0.0:1787397808.808850:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00100000:2.0:1787397808.808852:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147136 00000100:00100000:2.0:1787397808.808859:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147136 00000100:00000040:0.0:1787397808.808859:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189880 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.808864:0:25908:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:2.0:1787397808.808871:0:25908:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00100000:0.0:1787397808.808885:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701146112:12345-0@lo:400:kworker.0 Request processed in 154us (936us total) trans 0 rc 0/0 00000100:00000040:2.0:1787397808.808890:0:25908:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1787397808.808906:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00000040:0.0:1787397808.808910:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5c000 : new rpc_count 0 00000020:00000040:0.0:1787397808.808926:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5c000 : new refcount 4 00000100:00100000:2.0:1787397808.808928:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00000040:2.0:1787397808.808937:0:25908:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:2.0:1787397808.808943:0:25908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188e00 x1874218701147136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.808951:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00000040:0.0:1787397808.808961:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835592000 : new rpc_count 1 00000100:00000040:0.0:1787397808.808973:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70731ea00 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.808978:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701147136:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397808.809003:0:25908:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701147136 00000100:00100000:0.0:1787397808.809007:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701147264:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1787397808.809016:0:25908:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:2.0:1787397808.809023:0:25908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:0.0:1787397808.809028:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701147264 00000100:00000040:0.0:1787397808.809038:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 56 to 0@lo 00000100:00000040:0.0:1787397808.809044:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.809052:0:25908:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.809073:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.809111:0:25908:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:2.0:1787397808.809119:0:25908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188e00 x1874218701147136/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.809127:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00100000:2.0:1787397808.809136:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701147136:12345-0@lo:400:kworker.0 Request processed in 163us (638us total) trans 0 rc 0/0 00000100:00000040:0.0:1787397808.809143:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731ea00 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.809151:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00000040:2.0:1787397808.809161:0:25908:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:2.0:1787397808.809176:0:25908:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00100000:0.0:1787397808.809176:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701147264:12345-0@lo:400:kworker.0 Request processed in 172us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.809190:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00000040:0.0:1787397808.809193:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835592000 : new rpc_count 0 00000020:00000040:0.0:1787397808.809203:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a835592000 : new refcount 4 00000100:00000040:2.0:1787397808.809241:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:2.0:1787397808.809254:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.809265:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.809272:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701147136:0@lo:400:kworker.0 00000100:00000040:2.0:1787397808.809278:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849500 x1874218701147136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.809288:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1787397808.809314:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a70731e680 x1874218701146752 msgsize 224 00000100:00100000:2.0:1787397808.809318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.809348:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.809360:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 81187 usecs (82 jiffies) 00000100:00000040:2.0:1787397808.809385:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397808.809389:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.809408:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.809415:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701146112:0@lo:400:kworker.0 00000100:00100000:0.0:1787397808.809572:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146752 00000100:00100000:0.0:1787397808.809579:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146752 00000020:00000040:0.0:1787397808.809581:0:77740:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915d4 00000020:00000040:0.0:1787397808.809585:0:77740:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5a000 refcount=5 00000100:00000040:0.0:1787397808.809599:0:77740:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397808.809621:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00000040:0.0:1787397808.809624:0:77740:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5a000 : new rpc_count 1 00000100:00000040:0.0:1787397808.809629:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70731e680 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.809639:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701146752:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397808.809650:0:77740:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701146752 00000100:00000040:0.0:1787397808.809657:0:77740:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:0.0:1787397808.809661:0:77740:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.809686:0:77740:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.809701:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146368 00000100:00100000:3.0:1787397808.809710:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146368 00000020:00000040:3.0:1787397808.809714:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000100:00000040:0.0:1787397808.809721:0:77740:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00000040:0.0:1787397808.809727:0:77740:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70731e680 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.809729:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00100000:0.0:1787397808.809736:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701146752:12345-0@lo:400:kworker.0 Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.809753:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00000040:0.0:1787397808.809756:0:77740:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5a000 : new rpc_count 0 00000020:00000040:0.0:1787397808.809764:0:77740:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5a000 : new refcount 4 00000100:00000040:3.0:1787397808.810075:0:23942:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1787397808.810112:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00000040:3.0:1787397808.810117:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:3.0:1787397808.810122:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188a80 x1874218701146368/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.810135:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701146368:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1787397808.810155:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701146368 00000100:00000040:3.0:1787397808.810163:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:3.0:1787397808.810168:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.810201:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.810230:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00000040:3.0:1787397808.810234:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188a80 x1874218701146368/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.810242:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701146368:12345-0@lo:400:kworker.0 Request processed in 110us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.810249:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00000040:3.0:1787397808.810253:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:3.0:1787397808.810263:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00000040:0.0:1787397808.810294:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1787397808.810304:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.810315:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.810323:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701146368:0@lo:400:kworker.0 00000100:00000040:0.0:1787397808.810330:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848000 x1874218701146368/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.810340:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1787397808.810548:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397808.810557:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.810567:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.810574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701146752:0@lo:400:kworker.0 00000100:00000040:2.0:1787397808.810583:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984a680 x1874218701146112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.810592:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7033bb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1787397808.810602:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:3.0:1787397808.810608:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.810617:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.810623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701146624:0@lo:400:kworker.0 00000100:00000040:3.0:1787397808.810637:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1787397808.810652:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.810660:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.810667:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701147264:0@lo:400:kworker.0 00000100:00000040:3.0:1787397808.810673:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848e00 x1874218701146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.810683:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1787397808.810694:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70218b480 x1874218701147264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.810701:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a828a58000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1787397808.810816:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.810834:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701145984:0@lo:38:llog_process_th.0 00000100:00000040:1.0:1787397808.810869:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.810875:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.810915:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15880 x1874218701145984 msgsize 520 00000100:00100000:1.0:1787397808.810919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.810940:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.810951:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:1.0:1787397808.810974:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.810984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701146496:0@lo:8:kworker.0 00000100:00000040:1.0:1787397808.810998:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811004:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.811019:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af14a80 x1874218701146496 msgsize 520 00000100:00100000:1.0:1787397808.811023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.811039:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811048:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5460 usecs (6 jiffies) 00000100:00000040:1.0:1787397808.811055:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.811064:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701147008:0@lo:8:kworker.0 00000100:00000040:1.0:1787397808.811079:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811094:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.811108:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af14e00 x1874218701147008 msgsize 520 00000100:00100000:1.0:1787397808.811112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.811126:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811135:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7515 usecs (8 jiffies) 00000100:00000040:1.0:1787397808.811160:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.811170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701146240:0@lo:400:kworker.0 00000100:00000040:1.0:1787397808.811185:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811192:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.811203:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af14700 x1874218701146240 msgsize 224 00000100:00100000:1.0:1787397808.811208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.811222:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811231:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7485 usecs (8 jiffies) 00000100:00000040:1.0:1787397808.811238:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.811247:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701146880:0@lo:400:kworker.0 00000100:00000040:1.0:1787397808.811260:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811266:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.811279:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15c00 x1874218701146880 msgsize 224 00000100:00100000:1.0:1787397808.811282:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397808.811295:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.811317:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3690 usecs (4 jiffies) 00000100:00100000:1.0:1787397808.811349:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701145984 00000100:00100000:1.0:1787397808.811357:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701145984 00000020:00000040:1.0:1787397808.811361:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:0.0:1787397808.811381:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146240 00000100:00100000:0.0:1787397808.811395:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146240 00000100:00100000:1.0:1787397808.811397:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000020:00000040:0.0:1787397808.811401:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b364 00000100:00000040:1.0:1787397808.811406:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15880 x1874218701145984/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1787397828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.811408:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803e98000 refcount=5 00000100:00000040:0.0:1787397808.811600:0:66177:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397808.811632:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00000040:0.0:1787397808.811637:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803e98000 : new rpc_count 1 00000100:00000040:0.0:1787397808.811644:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af14700 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.811657:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701146240:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397808.811683:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701146240 00000100:00000040:2.0:1787397808.811688:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848380 x1874218701146752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.811698:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000020:00000040:2.0:1787397808.811706:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7054c2800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1787397808.811707:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.811764:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.811828:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 54 to 0@lo 00000100:00000040:0.0:1787397808.812007:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14700 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.812016:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701146240:12345-0@lo:400:kworker.0 Request processed in 361us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397808.812023:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00000040:0.0:1787397808.812027:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803e98000 : new rpc_count 0 00000020:00000040:0.0:1787397808.812037:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a803e98000 : new refcount 4 00000100:00000040:2.0:1787397808.812704:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397808.812714:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.812726:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.812733:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701146240:0@lo:400:kworker.0 00000100:00100000:1.0:1787397808.812799:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701145984:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1787397808.812823:0:74374:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 14 - find 00010000:00000040:1.0:1787397808.812842:0:74374:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1787397808.812851:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3688 last 0 00000020:00000040:1.0:1787397808.812863:0:74374:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a83fa42800 with handle 0x274786fe0d1923db to hash 00000020:00000040:1.0:1787397808.812918:0:74374:0:(genops.c:889:class_export_get()) GET export ffff89a83fa42800 refcount=3 00000020:00000040:1.0:1787397808.813126:0:74374:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 15 - export 00000020:00000040:1.0:1787397808.813132:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a83fa42800 : new refcount 2 00000020:00000080:1.0:1787397808.813135:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d1923db 00000020:00000040:1.0:1787397808.813139:0:74374:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923db 00000020:00000040:1.0:1787397808.813142:0:74374:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83fa42800 refcount=3 00000001:00000040:1.0:1787397808.813158:0:74374:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.160@tcp 00000001:00000040:1.0:1787397808.813164:0:74374:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 17 00000020:00000040:1.0:1787397808.813169:0:74374:0:(genops.c:889:class_export_get()) GET export ffff89a83fa42800 refcount=4 00000001:00000040:1.0:1787397808.813171:0:74374:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 18 00000001:00000040:1.0:1787397808.813175:0:74374:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff89a702789400) : new refcount 17 00000004:00100000:1.0:1787397808.813182:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1787397808.813195:0:74374:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff89a811418480 for nid 0@lo - ref 6 00000020:00000040:1.0:1787397808.813209:0:74374:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 16 - import 00000020:00000040:1.0:1787397808.813215:0:74374:0:(genops.c:1244:class_import_put()) import ffff89a837bb2800 refcount=1 obd=lustre-MDT0000 00000020:00000040:1.0:1787397808.813224:0:74374:0:(genops.c:889:class_export_get()) GET export ffff89a83fa42800 refcount=5 00000100:00000040:1.0:1787397808.813238:0:74374:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff89a83fa42800 : new rpc_count 1 00000100:00000040:1.0:1787397808.813243:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000100:00000040:1.0:1787397808.813246:0:74374:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 55 to 0@lo 00000020:00000040:1.0:1787397808.813250:0:74374:0:(genops.c:889:class_export_get()) GET export ffff89a83fa42800 refcount=6 00000100:00000040:1.0:1787397808.813258:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 56 to 0@lo 00000100:00080000:1.0:1787397808.813270:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a837bb2800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1787397808.813275:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a83fa42800 : new refcount 5 00000020:00000040:1.0:1787397808.813279:0:74374:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 16 - find 00010000:00000040:1.0:1787397808.813296:0:74374:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701145984 00000100:00000040:1.0:1787397808.813304:0:74374:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:1.0:1787397808.813308:0:74374:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397808.813356:0:74374:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.813386:0:74374:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 56 to 0@lo 00000100:00000040:1.0:1787397808.813391:0:74374:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15880 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787397828 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.813399:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701145984:12345-0@lo:38:llog_process_th.0 Request processed in 612us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397808.813409:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00000040:1.0:1787397808.813412:0:74374:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83fa42800 : new rpc_count 0 00000100:00100000:0.0:1787397808.813698:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1787397808.813706:0:3647:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1787397808.813716:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.813730:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:0.0:1787397808.813733:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923d4 00000020:00000040:0.0:1787397808.813737:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a702186800 refcount=4 00000100:00080000:0.0:1787397808.813744:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1787397808.813747:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff89a702186800 : new refcount 3 00000100:00080000:0.0:1787397808.813751:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397808.813754:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1787397808.813761:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.813768:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701145984:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1787397808.813789:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849f80 x1874218701145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.814183:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a8310a8800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1787397808.814380:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701146240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.814398:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a7033bd800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:0.0:1787397808.814689:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146496 00000100:00100000:2.0:1787397808.814700:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701146880 00000100:00100000:0.0:1787397808.814701:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146496 00000020:00000040:0.0:1787397808.814708:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2d8 00000100:00100000:2.0:1787397808.814712:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701146880 00000020:00000040:2.0:1787397808.814730:0:8446:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:2.0:1787397808.814735:0:8446:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00100000:0.0:1787397808.814755:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147008 00000100:00100000:0.0:1787397808.814761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147008 00000100:00000040:2.0:1787397808.814763:0:8446:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000020:00000040:0.0:1787397808.814764:0:8436:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914a7 00000100:00100000:2.0:1787397808.814807:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00000040:2.0:1787397808.814813:0:8446:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00100000:0.0:1787397808.814816:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055 00000100:00000040:2.0:1787397808.814823:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15c00 x1874218701146880/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.814827:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af14a80 x1874218701146496/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.814856:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397808.814864:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701146496:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1787397808.814891:0:8436:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 7 - find 00010000:00000040:2.0:1787397808.814904:0:8446:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701146880 00010000:00000040:0.0:1787397808.814910:0:8436:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1787397808.814915:0:8436:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 7 - find 00000100:00000040:2.0:1787397808.814918:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:2.0:1787397808.814926:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.814935:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 58 to 0@lo 00000100:00000040:0.0:1787397808.814940:0:8436:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 58 to 0@lo 00000100:00000040:0.0:1787397808.814945:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.814982:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.815018:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.815045:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:0.0:1787397808.815050:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14a80 x1874218701146496/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397828 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.815058:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701146496:12345-0@lo:8:kworker.0 Request processed in 203us (4037us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787397808.815065:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055 00000100:00100000:0.0:1787397808.815083:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5056 00000100:00000040:0.0:1787397808.815087:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af14e00 x1874218701147008/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.815095:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701147008:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1787397808.815453:0:8436:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 7 - find 00010000:00000040:0.0:1787397808.815467:0:8436:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1787397808.815469:0:8436:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 7 - find 00000100:00000040:0.0:1787397808.815478:0:8436:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 58 to 0@lo 00000100:00000040:0.0:1787397808.815480:0:8436:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 58 to 0@lo 00000100:00000040:0.0:1787397808.815484:0:8436:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.815503:0:8436:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397833 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.816671:0:74374:0:(genops.c:900:class_export_put()) PUTting export ffff89a83fa42800 : new refcount 4 00000100:00000040:2.0:1787397808.817048:0:8446:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:2.0:1787397808.817066:0:8446:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15c00 x1874218701146880/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.817078:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701146880:12345-0@lo:400:kworker.0 Request processed in 2226us (5795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.817090:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00000040:2.0:1787397808.817094:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:2.0:1787397808.817106:0:8446:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00000040:0.0:1787397808.817423:0:8436:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 56 to 0@lo 00000100:00000040:0.0:1787397808.817434:0:8436:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14e00 x1874218701147008/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1787397828 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.817446:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701147008:12345-0@lo:8:kworker.0 Request processed in 2350us (6335us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787397808.817456:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5056 00000100:00000040:3.0:1787397808.818120:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1787397808.818135:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.818149:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.818157:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701146880:0@lo:400:kworker.0 00000100:00000040:3.0:1787397808.818167:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984a300 x1874218701146880/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.818181:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397808.818266:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968731 00000100:00000040:0.0:1787397808.818277:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.818289:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397808.818293:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1787397808.818298:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.818305:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701146496:0@lo:8:kworker.0 00000100:00000040:0.0:1787397808.818320:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968732 00000100:00000040:0.0:1787397808.818328:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397808.818335:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397808.818340:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1787397808.818343:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.818371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701147008:0@lo:8:kworker.0 00000100:00000040:0.0:1787397808.818378:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849180 x1874218701146496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.818391:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a83670c800 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1787397808.818403:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984aa00 x1874218701147008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1787397833 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397808.818413:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:2.0:1787397808.821696:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a702186800 refcount=4 00000020:00000040:2.0:1787397808.821756:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a702186800 refcount=5 00000020:00000040:1.0:1787397808.821862:0:96921:0:(genops.c:889:class_export_get()) GET export ffff89a702186800 refcount=6 00000020:00000040:1.0:1787397808.821868:0:96921:0:(genops.c:889:class_export_get()) GET export ffff89a702186800 refcount=7 00000020:00000040:1.0:1787397808.821874:0:96921:0:(genops.c:900:class_export_put()) PUTting export ffff89a702186800 : new refcount 6 00000100:00000040:2.0:1787397808.822065:0:96920:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.160@tcp 192.168.204.160@tcp cnt=1 00000020:01000004:2.0:1787397808.822096:0:96920:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787397808.822120:0:96920:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) 00000020:00000040:2.0:1787397808.822129:0:96920:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a817efb800 with handle 0x274786fe0d1923e2 to hash 00000020:00000040:2.0:1787397808.822136:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a817efb800 : new refcount 1 00000020:00000040:2.0:1787397808.822163:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 2 - obd_device_list 00000020:00000080:2.0:1787397808.822171:0:96920:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787397808.824283:0:96920:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787397808.824294:0:96920:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a8364e0800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787397808.824298:0:96920:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e0800 3 00000020:00000040:2.0:1787397808.824322:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 3 - import 00000020:00000040:2.0:1787397808.824332:0:96920:0:(genops.c:1244:class_import_put()) import ffff89a7054c4000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1787397808.824355:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:2.0:1787397808.824359:0:96920:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 57 to 0@lo 00000100:00000040:2.0:1787397808.824361:0:96920:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.160@tcp -> ffff89a809245ac0 00010000:00080000:2.0:1787397808.824367:0:96920:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7054c4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787397808.826515:0:96920:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:3.0:1787397808.826706:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 4 - setup 00000020:00000080:3.0:1787397808.826719:0:96920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787397808.826789:0:96920:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1787397808.826798:0:96920:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7024ba000 with handle 0x274786fe0d1923e9 to hash 00000020:00000040:3.0:1787397808.826808:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a7024ba000 refcount=3 00000020:00000040:3.0:1787397808.826813:0:96920:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 5 - export 00000020:00000040:3.0:1787397808.826817:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024ba000 : new refcount 2 00000020:00000080:3.0:1787397808.826820:0:96920:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x274786fe0d1923e9 00000020:00000040:3.0:1787397808.826823:0:96920:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923e9 00000020:00000040:3.0:1787397808.826827:0:96920:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024ba000 refcount=3 00000100:00080000:3.0:1787397808.826842:0:96920:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1787397808.826849:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 58 to 0@lo 00000020:00000040:3.0:1787397808.826852:0:96920:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923e9 00000020:00000040:3.0:1787397808.826854:0:96920:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024ba000 refcount=4 00000100:00000040:3.0:1787397808.826857:0:96920:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 59 to 0@lo 00000020:00000040:3.0:1787397808.826859:0:96920:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024ba000 : new refcount 3 00000100:00080000:3.0:1787397808.826862:0:96920:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a7054c4000 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:3.0:1787397808.826885:0:96920:0:(genops.c:1231:class_import_get()) import ffff89a7054c4000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:3.0:1787397808.826930:0:96920:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397808.826948:0:96920:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000029953783] to pc [ptlrpcd_rcv+-1] req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397808.826979:0:96920:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:3.0:1787397808.826983:0:96920:0:(genops.c:1231:class_import_get()) import ffff89a7054c4000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1787397808.832712:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397808.832737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701147392:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1787397808.832785:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.832805:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.832847:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188700 x1874218701147392 msgsize 520 00000100:00100000:0.0:1787397808.832853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397808.832892:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397808.832916:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:0.0:1787397808.832982:0:65702:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3693) 00000100:00100000:3.0:1787397808.833884:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147392 00000100:00100000:3.0:1787397808.833912:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147392 00000020:00000040:3.0:1787397808.833917:0:67264:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:3.0:1787397808.833981:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00000040:3.0:1787397808.833994:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188700 x1874218701147392/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1787397828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.834026:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701147392:12345-0@lo:38:llog_process_th.0 00000020:00000040:3.0:1787397808.834048:0:67264:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 10 - find 00010000:00000040:3.0:1787397808.834064:0:67264:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1787397808.834072:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3688 last 0 00000020:00000040:3.0:1787397808.834084:0:67264:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a7024bd800 with handle 0x274786fe0d1923f0 to hash 00000020:00000040:1.0:1787397808.835316:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a7024ba000 refcount=4 00000020:00000040:1.0:1787397808.835329:0:96920:0:(genops.c:889:class_export_get()) GET export ffff89a7024ba000 refcount=5 00000040:00080000:1.0:1787397808.839074:0:96920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:1.0:1787397808.839265:0:96923:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024ba000 : new refcount 4 00000020:01000000:2.0:1787397808.839575:0:96908:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1787397808.839628:0:96908:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:2.0:1787397808.839649:0:96908:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a70720be00 refcount=3 00010000:00010000:2.0:1787397808.839658:0:96908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.839671:0:96908:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397808.839755:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787397808.839758:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397808.839759:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397808.839760:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397808.839762:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397808.839764:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397808.839766:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397808.839768:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397808.839769:0:96908:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397808.839775:0:96908:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787397808.839777:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397808.839779:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397808.839781:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397808.839791:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397808.839792:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397808.839793:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397808.839793:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397808.839794:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397808.839795:0:96908:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1787397808.839806:0:96908:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 10000000:01000000:2.0:1787397808.839835:0:96908:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1787397808.839860:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.839877:0:96908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701147520:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1787397808.839931:0:96908:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.839941:0:96908:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.840009:0:96908:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278ffc50 x1874218701147520 msgsize 4848 00000100:00100000:2.0:1787397808.840015:0:96908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.840017:0:96908:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397808.840047:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.840087:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147520 00000100:00100000:2.0:1787397808.840096:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147520 00000020:00000040:2.0:1787397808.840100:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397808.840104:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397808.840149:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397808.840194:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:2.0:1787397808.840200:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.840209:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278ffc50 x1874218701147520/t0(0) o253->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 4848/0 e 0 to 0 dl 1787397819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.840223:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701147520:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787397808.840265:0:94340:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787397808.840290:0:94340:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397808.840479:0:96908:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d240 going to sleep for 11 seconds 00000020:00000040:3.0:1787397808.845262:0:67264:0:(genops.c:889:class_export_get()) GET export ffff89a7024bd800 refcount=3 00000020:00000040:3.0:1787397808.845280:0:67264:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 11 - export 00000020:00000040:3.0:1787397808.845286:0:67264:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024bd800 : new refcount 2 00000020:00000080:3.0:1787397808.845290:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d1923f0 00000020:00000040:3.0:1787397808.845295:0:67264:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923f0 00000020:00000040:3.0:1787397808.845299:0:67264:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024bd800 refcount=3 00000001:00000040:3.0:1787397808.845321:0:67264:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.160@tcp 00000001:00000040:3.0:1787397808.845327:0:67264:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 18 00000020:00000040:3.0:1787397808.845332:0:67264:0:(genops.c:889:class_export_get()) GET export ffff89a7024bd800 refcount=4 00000001:00000040:3.0:1787397808.845334:0:67264:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 19 00000001:00000040:3.0:1787397808.845339:0:67264:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff89a702789400) : new refcount 18 00000004:00100000:3.0:1787397808.845347:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:3.0:1787397808.845361:0:67264:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff89a830cc7780 for nid 0@lo - ref 4 00000020:00000040:3.0:1787397808.845373:0:67264:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 12 - import 00000020:00000040:3.0:1787397808.845383:0:67264:0:(genops.c:1244:class_import_put()) import ffff89a7024b8800 refcount=1 obd=lustre-MDT0001 00000020:00000040:3.0:1787397808.845398:0:67264:0:(genops.c:889:class_export_get()) GET export ffff89a7024bd800 refcount=5 00000100:00000040:3.0:1787397808.845402:0:67264:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff89a7024bd800 : new rpc_count 1 00000100:00000040:3.0:1787397808.845410:0:67264:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 60 to 0@lo 00000100:00000040:3.0:1787397808.845415:0:67264:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 60 to 0@lo 00000020:00000040:3.0:1787397808.848769:0:67264:0:(genops.c:889:class_export_get()) GET export ffff89a7024bd800 refcount=6 00000100:00000040:3.0:1787397808.848789:0:67264:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00080000:3.0:1787397808.848803:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1787397808.848810:0:67264:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024bd800 : new refcount 5 00000020:00000040:3.0:1787397808.848834:0:67264:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 12 - find 00010000:00000040:3.0:1787397808.848858:0:67264:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701147392 00000100:00000040:3.0:1787397808.848871:0:67264:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:3.0:1787397808.848879:0:67264:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.848962:0:67264:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.849008:0:67264:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:3.0:1787397808.849015:0:67264:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188700 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787397828 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.849026:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701147392:12345-0@lo:38:llog_process_th.0 Request processed in 15000us (16176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.849039:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00000040:3.0:1787397808.849043:0:67264:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7024bd800 : new rpc_count 0 00000020:00000040:3.0:1787397808.849059:0:67264:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024bd800 : new refcount 4 00000100:00100000:2.0:1787397808.849828:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1787397808.849839:0:3647:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1787397808.849849:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397808.849866:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:2.0:1787397808.849870:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923e9 00000020:00000040:2.0:1787397808.849875:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024ba000 refcount=5 00000100:00080000:2.0:1787397808.849886:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1787397808.849890:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024ba000 : new refcount 4 00000100:00080000:2.0:1787397808.849903:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787397808.849908:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1787397808.849917:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.849924:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701147392:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1787397808.849932:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7b80 x1874218701147392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397818 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.849943:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a7054c4000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 20000000:01000000:0.0:1787397808.855199:0:94340:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397808.855222:0:94340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787397808.855256:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397808.855268:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:3.0:1787397808.855287:0:94337:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a818432f00 count: 4 00000020:00000040:3.0:1787397808.855306:0:94337:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a80fe75400 with handle 0x274786fe0d1923f7 to hash 00010000:00010000:3.0:1787397808.855316:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.855355:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 9 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.855368:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d191502 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.855377:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.855411:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.855590:0:94337:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a818432f00) refcount = 4 00010000:00000040:3.0:1787397808.855594:0:94337:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1787397808.855597:0:94337:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.855676:0:94337:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.855683:0:94337:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 9 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.855688:0:94337:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:3.0:1787397808.855690:0:94337:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1787397808.855721:0:94337:0:(genops.c:1231:class_import_get()) import ffff89a709123800 refcount=2 obd=MGS 00010000:00010000:3.0:1787397808.855751:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.855769:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1787397808.855791:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397808.855805:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147648:0@lo:104: 00000100:00000040:3.0:1787397808.855841:0:94337:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397808.855860:0:94337:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.855929:0:94337:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc5f80 x1874218701147648 msgsize 328 00000100:00100000:3.0:1787397808.855935:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397808.856074:0:94337:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1787397808.856115:0:94337:0:(genops.c:1231:class_import_get()) import ffff89a709123800 refcount=3 obd=MGS 00010000:00010000:3.0:1787397808.856127:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.856138:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 24 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1787397808.856149:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397808.856159:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147776:0@lo:104: 00000100:00000040:3.0:1787397808.856173:0:94337:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397808.856184:0:94337:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397808.856414:0:94337:0:(events.c:337:request_in_callback()) incoming req@ffff89a702189c00 x1874218701147776 msgsize 328 00000100:00100000:0.0:1787397808.856427:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000040:3.0:1787397808.858094:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701147520 00000100:00000040:3.0:1787397808.858123:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:3.0:1787397808.858134:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397808.858213:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.858260:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:3.0:1787397808.858268:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278ffc50 x1874218701147520/t0(0) o253->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 4848/4768 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.858280:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:96908:x1874218701147520:12345-0@lo:253:mount.lustre.0 Request processed in 18060us (18270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.858317:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:3.0:1787397808.858323:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397808.858343:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397808.859414:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397808.859469:0:96908:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397808.859477:0:96908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:96908:1874218701147520:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1787397808.859488:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787397808.859504:0:96908:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787397808.859517:0:96908:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787397808.859519:0:96908:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397808.859538:0:96908:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397808.859539:0:96908:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397808.859541:0:96908:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397808.859542:0:96908:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397808.859544:0:96908:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397808.859547:0:96908:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397808.859548:0:96908:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:1.0:1787397808.859552:0:96908:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984aa00 x1874218701147520/t0(0) o253->MGC192.168.204.160@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397808.859565:0:96908:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000020:02000000:1.0:1787397808.859585:0:96908:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:1.0:1787397808.860056:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:1.0:1787397808.860077:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:1.0:1787397808.860131:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:1.0:1787397808.860178:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:1.0:1787397808.860226:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:1.0:1787397808.860264:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:1.0:1787397808.860290:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:1.0:1787397808.860317:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:1.0:1787397808.860360:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:1.0:1787397808.860428:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000100:00000040:0.0:1787397808.862499:0:94337:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1787397808.862687:0:94337:0:(genops.c:1231:class_import_get()) import ffff89a83670e800 refcount=2 obd=MGS 00010000:00010000:0.0:1787397808.862732:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 9 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397808.862748:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 9 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1787397808.862762:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397808.862773:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147904:192.168.204.60@tcp:104: 00000100:00000040:0.0:1787397808.862799:0:94337:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397808.862807:0:94337:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00100000:0.0:1787397808.862867:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a828d83840 going to sleep for 11 seconds 00000100:00000040:1.0:1787397808.864867:0:3643:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:3.0:1787397808.867398:0:96908:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:3.0:1787397808.867681:0:96908:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968753 00000100:00000040:1.0:1787397808.868840:0:3641:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1787397808.868914:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af17480 x1874218681271680 msgsize 328 00000100:00100000:1.0:1787397808.868921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:3.0:1787397808.869370:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397808.869387:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397808.869395:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147904:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397808.869724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271680 00000100:00100000:3.0:1787397808.869733:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271680 00000020:00000040:3.0:1787397808.869737:0:6508:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:3.0:1787397808.869743:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:3.0:1787397808.869771:0:6508:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1787397808.869785:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a75000 refcount=4 00010000:00010000:3.0:1787397808.869795:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397808.869845:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2647 00000100:00000040:3.0:1787397808.869850:0:6508:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:3.0:1787397808.869856:0:6508:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af17480 x1874218681271680/t0(0) o103->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.869870:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681271680:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397808.869902:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1787397808.869905:0:6508:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a75000 refcount=4 00010000:00000040:3.0:1787397808.869918:0:6508:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a818432f00 count: 5 00010000:00010000:3.0:1787397808.869924:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397808.869937:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1787397808.869960:0:6508:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a828a75000 with handle 0x274786fe0d1914fb from hash 00010000:00010000:3.0:1787397808.869966:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75000/0x274786fe0d1914fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8213 expref: 10 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397808.869973:0:6508:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff89a83670f000 : new locks_count 3 00000020:00000040:3.0:1787397808.869976:0:6508:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00010000:00000040:3.0:1787397808.869989:0:6508:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff89a80fe75400 00010000:00010000:3.0:1787397808.869995:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1787397808.870007:0:6508:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397808.870015:0:6508:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00010000:00080000:1.0:1787397808.870023:0:96925:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96925 00010000:02000000:1.0:1787397808.870057:0:96925:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000100:00000040:3.0:1787397808.870087:0:6508:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397808.870096:0:6508:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17480 x1874218681271680/t0(0) o103->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:249/0 lens 328/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.870107:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2404:x1874218681271680:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 239us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.870117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2647 00000100:00000040:3.0:1787397808.870122:0:6508:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:3.0:1787397808.870139:0:6508:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 8 00000100:00100000:2.0:1787397808.870664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147648 00000100:00100000:2.0:1787397808.870674:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147648 00000020:00000040:2.0:1787397808.870677:0:6506:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d14b4bc 00000020:00000040:2.0:1787397808.870681:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803905800 refcount=3 00000100:00000040:2.0:1787397808.870707:0:6506:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:2.0:1787397808.870737:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701147776 00000100:00100000:2.0:1787397808.870740:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701147776 00000020:00000040:2.0:1787397808.870742:0:6506:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d14b4bc 00000020:00000040:2.0:1787397808.870744:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803905800 refcount=4 00000100:00100000:2.0:1787397808.870759:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00000040:2.0:1787397808.870771:0:6506:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803905800 : new rpc_count 1 00000100:00000040:2.0:1787397808.870777:0:6506:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc5f80 x1874218701147648/t0(0) o104->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397808.870789:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701147648:12345-0@lo:104: 00000020:00000040:2.0:1787397808.870810:0:6506:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a74000 refcount=2 00010000:00010000:2.0:1787397808.870817:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397808.870832:0:6506:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397808.870836:0:6506:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.870878:0:6506:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397808.870919:0:6506:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000020:01000004:1.0:1787397808.870945:0:96908:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1787397808.870955:0:96908:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff89a8092ecd80 : new refcount 2 00000100:00000040:2.0:1787397808.870958:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00000040:1.0:1787397808.870963:0:96908:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff89a8092ecd80 : new refcount 1 00000100:00000040:2.0:1787397808.870982:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397808.870991:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147648:0@lo:104: 00010000:00010000:2.0:1787397808.871020:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:00000040:1.0:1787397808.871022:0:96908:0:(genops.c:900:class_export_put()) PUTting export ffff89a8364e2000 : new refcount 1 00000100:00000040:2.0:1787397808.871028:0:6506:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc5f80 x1874218701147648/t0(0) o104->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397808.871039:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701147648:12345-0@lo:104: Request processed in 250us (15108us total) trans 0 rc 0/0 00000020:00000040:1.0:1787397808.871045:0:96908:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.160@tcp (ffff89a828c1b380) now 6 - mgc_fs 00000100:00100000:2.0:1787397808.871051:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 10000000:01000000:1.0:1787397808.871055:0:96908:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000100:00000040:2.0:1787397808.871056:0:6506:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803905800 : new rpc_count 0 00000020:00000040:2.0:1787397808.871071:0:6506:0:(genops.c:900:class_export_put()) PUTting export ffff89a803905800 : new refcount 3 00010000:00010000:2.0:1787397808.871085:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:1.0:1787397808.871091:0:96908:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787397808.871124:0:96908:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00010000:00010000:2.0:1787397808.871359:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.871370:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397808.871375:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.871382:0:56853:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a74000 refcount=3 00010000:00010000:2.0:1787397808.871387:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397808.871395:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397808.871401:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1787397808.871404:0:56853:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:2.0:1787397808.871406:0:56853:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1787397808.871419:0:56853:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff89a817df4400) refs 2 00000020:00000040:2.0:1787397808.871426:0:56853:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a828a74000 with handle 0x274786fe0d19151e from hash 00000020:00000040:2.0:1787397808.871450:0:56853:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00010000:00010000:2.0:1787397808.871469:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.871475:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1787397808.871488:0:56853:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0d63325] to pc [ptlrpcd_00_00+0] req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787397808.871512:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.871519:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19151e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191525 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.871573:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397808.871576:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397808.871578:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1787397808.871606:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.871621:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701148032:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1787397808.871652:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.871661:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.871687:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984a300 x1874218701148032 msgsize 328 00000100:00100000:2.0:1787397808.871693:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397808.871703:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00000040:3.0:1787397808.871708:0:93049:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803905800 : new rpc_count 1 00000100:00000040:2.0:1787397808.871713:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.871714:0:93049:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702189c00 x1874218701147776/t0(0) o104->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397808.871738:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701147776:12345-0@lo:104: 00000020:00000040:3.0:1787397808.871746:0:93049:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a74600 refcount=2 00010000:00010000:3.0:1787397808.871751:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397808.871758:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148032 00000100:00100000:2.0:1787397808.871763:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148032 00000020:00000040:2.0:1787397808.871765:0:19654:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000100:00000040:3.0:1787397808.871766:0:93049:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000020:00000040:2.0:1787397808.871768:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:3.0:1787397808.871770:0:93049:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.871781:0:19654:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1787397808.871787:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a704d23e00 refcount=4 00000100:00000040:3.0:1787397808.871790:0:93049:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1787397808.871811:0:93049:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00010000:00010000:3.0:1787397808.871822:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:3.0:1787397808.871826:0:93049:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189c00 x1874218701147776/t0(0) o104->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397808.871834:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701147776:12345-0@lo:104: Request processed in 99us (15421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397808.871840:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00000040:3.0:1787397808.871843:0:93049:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803905800 : new rpc_count 0 00000020:00000040:3.0:1787397808.871851:0:93049:0:(genops.c:900:class_export_put()) PUTting export ffff89a803905800 : new refcount 2 00010000:00010000:2.0:1787397808.871992:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397808.872030:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00000040:2.0:1787397808.872033:0:19654:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.872039:0:19654:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984a300 x1874218701148032/t0(0) o103->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.872051:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701148032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397808.872070:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1787397808.872074:0:19654:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a704d23e00 refcount=4 00010000:00000040:2.0:1787397808.872077:0:19654:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a818432f00 count: 4 00010000:00010000:2.0:1787397808.872082:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.872173:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.872195:0:19654:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a704d23e00 with handle 0x274786fe0d191525 from hash 00010000:00010000:2.0:1787397808.872202:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23e00/0x274786fe0d191525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19151e expref: 24 pid: 94334 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397808.872282:0:19654:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff89a83670d800 : new locks_count 17 00000020:00000040:2.0:1787397808.872288:0:19654:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00010000:00000040:2.0:1787397808.872302:0:19654:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff89a80fe75400 00010000:00010000:2.0:1787397808.872309:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1787397808.872315:0:19654:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397808.872322:0:19654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.872353:0:19654:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.872384:0:19654:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:2.0:1787397808.872389:0:19654:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a300 x1874218701148032/t0(0) o103->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.872398:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701148032:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.872404:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00000040:2.0:1787397808.872407:0:19654:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.872414:0:19654:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00010000:00010000:2.0:1787397808.872442:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397808.872448:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.872455:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397808.872459:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.872465:0:6511:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a828a74600 refcount=3 00010000:00010000:2.0:1787397808.872468:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397808.872475:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397808.872481:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1787397808.872484:0:6511:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:2.0:1787397808.872486:0:6511:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1787397808.872494:0:6511:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff89a829952000) refs 2 00000020:00000040:2.0:1787397808.872498:0:6511:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a828a74600 with handle 0x274786fe0d191502 from hash 00000020:00000040:2.0:1787397808.872507:0:6511:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00010000:00010000:2.0:1787397808.872544:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.872551:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1787397808.872573:0:6511:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089cb62d0] to pc [ptlrpcd_00_01+1] req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787397808.872586:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.872593:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74600/0x274786fe0d191502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d191509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397808.872607:0:6511:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff89a818432a00 count: 0 00010000:00010000:2.0:1787397808.872619:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397808.872621:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397808.872622:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1787397808.872664:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397808.872677:0:94337:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397808.872685:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701147776:0@lo:104: 00000100:00000040:2.0:1787397808.872700:0:94337:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702189f80 x1874218701147904/t0(0) o104->MGS@192.168.204.60@tcp:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1787397808.872712:0:94337:0:(genops.c:1244:class_import_put()) import ffff89a83670e800 refcount=1 obd=MGS 00000100:00000040:2.0:1787397808.872722:0:94337:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc4e00 x1874218701147648/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1787397808.872730:0:94337:0:(genops.c:1244:class_import_put()) import ffff89a709123800 refcount=2 obd=MGS 00000100:00000040:2.0:1787397808.872734:0:94337:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7b80 x1874218701147776/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1787397808.872742:0:94337:0:(genops.c:1244:class_import_put()) import ffff89a709123800 refcount=1 obd=MGS 00010000:00010000:2.0:1787397808.872754:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397808.872774:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.872785:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701148160:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1787397808.872929:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397808.872938:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.872945:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701148032:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1787397808.872951:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849180 x1874218701148032/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397808.872970:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397808.873022:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.873039:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.873060:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a829849f80 x1874218701148160 msgsize 328 00000100:00100000:2.0:1787397808.873064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397808.873195:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397808.874741:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148160 00000100:00100000:3.0:1787397808.874756:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148160 00000020:00000040:3.0:1787397808.874760:0:6507:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397808.874768:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000020:00000004:1.0:1787397808.875052:0:96908:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000100:00000040:2.0:1787397808.875090:0:6507:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1787397808.875182:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a8016a1c00 refcount=4 00010000:00010000:2.0:1787397808.875196:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 23 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397808.875298:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00000040:2.0:1787397808.875305:0:6507:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397808.875317:0:6507:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829849f80 x1874218701148160/t0(0) o103->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/0 e 0 to 0 dl 1787397819 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.875347:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701148160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397808.875378:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1787397808.875384:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a8016a1c00 refcount=4 00010000:00000040:2.0:1787397808.875392:0:6507:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a818432f00 count: 3 00000020:00000004:1.0:1787397808.875394:0:96908:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397808.875402:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 23 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875425:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 23 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.875445:0:6507:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a8016a1c00 with handle 0x274786fe0d191509 from hash 00010000:00010000:2.0:1787397808.875451:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8016a1c00/0x274786fe0d191509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d191502 expref: 23 pid: 94340 timeout: 3788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397808.875459:0:6507:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff89a83670d800 : new locks_count 16 00000020:00000040:2.0:1787397808.875475:0:6507:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00010000:00000040:2.0:1787397808.875489:0:6507:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff89a80fe75400 00010000:00010000:2.0:1787397808.875498:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397808.875508:0:6507:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a818432f00) refcount = 2 00010000:00010000:2.0:1787397808.875513:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397808.875555:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020288251s 00000020:00000040:2.0:1787397808.875559:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a80fe75400 refcount=5 00010000:00010000:2.0:1787397808.875562:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875570:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875578:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875587:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875594:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397808.875601:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.875607:0:6507:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a80fe75400 refcount=6 00010000:00010000:2.0:1787397808.875612:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1787397808.875629:0:6507:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff89a80fe75400 with handle 0x274786fe0d1923f7 from hash 00010000:00010000:2.0:1787397808.875645:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.875660:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1787397808.875672:0:6507:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397808.875680:0:6507:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397808.875744:0:6507:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.875808:0:6507:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:2.0:1787397808.875814:0:6507:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849f80 x1874218701148160/t0(0) o103->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:249/0 lens 328/224 e 0 to 0 dl 1787397819 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.875841:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701148160:12345-0@lo:103:ldlm_bl.0 Request processed in 499us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397808.875854:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00000040:2.0:1787397808.875858:0:6507:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397808.875872:0:6507:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 21 00010000:00010000:2.0:1787397808.876211:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.876232:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397808.876245:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75400/0x274786fe0d1923f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397808.876253:0:94337:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff89a818432f00 count: 0 00000100:00000040:2.0:1787397808.876321:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397808.876348:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397808.876379:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701148160:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1787397808.876393:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701148160/t0(0) o103->MGC192.168.204.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787397824 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397808.876422:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00010000:00080000:3.0:1787397808.885770:0:96925:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787397808.885781:0:96925:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:3.0:1787397809.004661:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787397809.788125:0:96974:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397809.788656:0:96974:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787397810.024757:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000040:2.0:1787397810.025439:0:6519:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff89a829952000) refs 2 10000000:01000000:2.0:1787397810.025447:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397810.025450:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 125 10000000:01000000:2.0:1787397810.025454:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1787397810.025462:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397810.025506:0:6519:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a808718200 with handle 0x274786fe0d1923fe to hash 00010000:00010000:2.0:1787397810.025516:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.025540:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.025552:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397810.025579:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.025592:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148288:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.025623:0:6519:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.025632:0:6519:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.025672:0:6519:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fe850 x1874218701148288 msgsize 328 00000100:00100000:2.0:1787397810.025677:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397810.025686:0:6519:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397810.025707:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.025732:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397810.025754:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148288 00000100:00100000:2.0:1787397810.025762:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148288 00000020:00000040:2.0:1787397810.025765:0:94334:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397810.025768:0:94334:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=22 00000100:00000040:2.0:1787397810.026585:0:94334:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397810.026634:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:2.0:1787397810.026638:0:94334:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397810.026645:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fe850 x1874218701148288/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.026661:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701148288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397810.026681:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1787397810.026698:0:94334:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a808718600 with handle 0x274786fe0d192405 to hash 00010000:00010000:2.0:1787397810.026703:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1923fe expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397810.026710:0:94334:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670d800 : new locks_count 17 00000020:00000040:2.0:1787397810.026713:0:94334:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=23 00010000:00000040:2.0:1787397810.026734:0:94334:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a835b90800) refcount = 1 00010000:00010000:2.0:1787397810.026739:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.026749:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.026758:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718600, rc 0) 00010000:00000040:2.0:1787397810.026771:0:94334:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701148288 00000100:00000040:2.0:1787397810.027371:0:94334:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397810.027379:0:94334:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.027416:0:94334:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.027442:0:94334:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:2.0:1787397810.027447:0:94334:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fe850 x1874218701148288/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 328/344 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.027456:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701148288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 799us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397810.027462:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:2.0:1787397810.027465:0:94334:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397810.027477:0:94334:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:2.0:1787397810.027610:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.027621:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.027629:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148288:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.027638:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.027649:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718200 refcount=4 00010000:00000040:2.0:1787397810.027655:0:6519:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff89a808718200, remote cookie: 0x274786fe0d192405, flags: 0x0 00010000:00000040:2.0:1787397810.027660:0:6519:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a835b90600) refcount = 1 00010000:00010000:2.0:1787397810.027664:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.027673:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397810.027692:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701148288/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.027703:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:00000040:2.0:1787397810.027711:0:6519:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff89a829952000) refs 3 00000020:00000040:2.0:1787397810.027714:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718200 refcount=3 00000020:00000040:2.0:1787397810.027735:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397810.027752:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397810.027765:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.027776:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148416:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.027989:0:6519:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.028074:0:6519:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.028098:0:6519:0:(events.c:337:request_in_callback()) incoming req@ffff89a83823c850 x1874218701148416 msgsize 304 00000100:00100000:2.0:1787397810.028103:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397810.028105:0:6519:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397810.028130:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.028145:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397810.029617:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148416 00000100:00100000:0.0:1787397810.029632:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148416 00000020:00000040:0.0:1787397810.029636:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:0.0:1787397810.029641:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:0.0:1787397810.029670:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397810.029710:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1787397810.029715:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:0.0:1787397810.029722:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83823c850 x1874218701148416/t0(0) o256->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 304/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.029736:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701148416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397810.029760:0:94335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:0.0:1787397810.029848:0:94335:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1787397810.029855:0:94335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397810.029858:0:94335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:0.0:1787397810.029866:0:94335:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=24 00000020:00000040:0.0:1787397810.029950:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00010000:00000040:0.0:1787397810.029972:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701148416 00000100:00000040:0.0:1787397810.029983:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:0.0:1787397810.029988:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397810.030073:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.030090:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00000040:0.0:1787397810.030095:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83823c850 x1874218701148416/t0(0) o256->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 304/240 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.030103:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701148416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 370us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397810.030111:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1787397810.030114:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:0.0:1787397810.030125:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 22 00000100:00000040:2.0:1787397810.030616:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.030627:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.030636:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.030643:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148416:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.030662:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1787397810.030673:0:6519:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:2.0:1787397810.030685:0:6519:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1787397810.030700:0:6519:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.160@tcp has 192.168.204.160@tcp. 10000000:00000040:2.0:1787397810.030715:0:6519:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:2.0:1787397810.030719:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a817efe800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:2.0:1787397810.030729:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397810.030731:0:6519:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397810.030733:0:6519:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.160@tcp -> ffff89a809245ac0 00010000:00080000:2.0:1787397810.030737:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a817efe800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.160@tcp, moved to head 00010000:00000040:2.0:1787397810.030740:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 61 to 0@lo 00000100:00080000:2.0:1787397810.030744:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:2.0:1787397810.030748:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 60 to 0@lo 00000100:00000040:2.0:1787397810.030750:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 61 to 0@lo 00000020:00000040:2.0:1787397810.030752:0:6519:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191492 00000020:00000040:2.0:1787397810.030756:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828785000 refcount=4 00000100:00000040:2.0:1787397810.030758:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 60 to 0@lo 00000100:00000040:2.0:1787397810.030760:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 61 to 0@lo 00000020:00000040:2.0:1787397810.030762:0:6519:0:(genops.c:900:class_export_put()) PUTting export ffff89a828785000 : new refcount 3 00000100:00080000:2.0:1787397810.030765:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:2.0:1787397810.030778:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1787397810.031187:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397810.031201:0:6519:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a22c9b21] to pc [ptlrpcd_rcv+-1] req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1787397810.031228:0:6519:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1787397810.031251:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701148416/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.031261:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397810.031264:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:01000000:2.0:1787397810.031288:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:2.0:1787397810.031293:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718200 refcount=3 00010000:00010000:2.0:1787397810.031299:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.031309:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1787397810.031319:0:6519:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff89a817df4400) refs 2 10000000:00000040:2.0:1787397810.031322:0:6519:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff89a829952000) refs 3 10000000:01000000:2.0:1787397810.031324:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397810.031328:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 125 10000000:01000000:2.0:1787397810.031330:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1787397810.031345:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00010000:00000040:2.0:1787397810.031358:0:6519:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a835b90600 count: 2 00000020:00000040:2.0:1787397810.031365:0:6519:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a808718c00 with handle 0x274786fe0d19240c to hash 00010000:00010000:2.0:1787397810.031372:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.031380:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.031389:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1787397810.031403:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.031424:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148672:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.031444:0:6519:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.031450:0:6519:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.031477:0:6519:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fc850 x1874218701148672 msgsize 328 00000100:00100000:2.0:1787397810.031481:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397810.031587:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.031597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701148544:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1787397810.031614:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.031620:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397810.031639:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af17b80 x1874218701148544 msgsize 520 00000100:00100000:1.0:1787397810.031643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397810.031662:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.031674:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7715 usecs (8 jiffies) 00000100:00100000:1.0:1787397810.031705:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148544 00000100:00100000:1.0:1787397810.031717:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148544 00000020:00000040:1.0:1787397810.031720:0:26165:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914a7 00000100:00100000:1.0:1787397810.031752:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5057 00000100:00000040:1.0:1787397810.031758:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af17b80 x1874218701148544/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.031766:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3647:x1874218701148544:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1787397810.031795:0:26165:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 7 - find 00010000:00000040:1.0:1787397810.031805:0:26165:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1787397810.031812:0:26165:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a7050a3000, cookie 0x274786fe0d1923a3 00010000:00080000:1.0:1787397810.031816:0:26165:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968749 exp ffff89a7050a3000 cur 3689 last 1787397808 00010000:02000400:1.0:1787397810.031824:0:26165:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1787397810.031830:0:26165:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1787397810.031839:0:26165:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.160@tcp 00000001:00000040:1.0:1787397810.031843:0:26165:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 19 00000020:00000040:1.0:1787397810.031847:0:26165:0:(genops.c:889:class_export_get()) GET export ffff89a7050a3000 refcount=4 00000001:00000040:1.0:1787397810.031849:0:26165:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 20 00000001:00000040:1.0:1787397810.031852:0:26165:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff89a702789400) : new refcount 19 00002000:00100000:1.0:1787397810.031855:0:26165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a7050a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787397810.031859:0:26165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787397810.031862:0:26165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1787397810.031882:0:26165:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff89a8187a4a20 for nid 0@lo - ref 2 00000020:00000040:1.0:1787397810.031988:0:26165:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 8 - import 00000020:00000040:1.0:1787397810.031994:0:26165:0:(genops.c:1244:class_import_put()) import ffff89a830f73800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1787397810.032010:0:26165:0:(genops.c:889:class_export_get()) GET export ffff89a7050a3000 refcount=5 00000100:00000040:1.0:1787397810.032013:0:26165:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff89a7050a3000 : new rpc_count 1 00000100:00000040:1.0:1787397810.032017:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:1.0:1787397810.032019:0:26165:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 62 to 0@lo 00000020:00000040:1.0:1787397810.032028:0:26165:0:(genops.c:889:class_export_get()) GET export ffff89a7050a3000 refcount=6 00000100:00000040:1.0:1787397810.032034:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 63 to 0@lo 00000100:00080000:1.0:1787397810.032042:0:26165:0:(import.c:65:import_set_state_nolock()) ffff89a830f73800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1787397810.032047:0:26165:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a3000 : new refcount 5 00000020:00000040:1.0:1787397810.032050:0:26165:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 8 - find 00010000:00000040:1.0:1787397810.032061:0:26165:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968749, transno 0, xid 1874218701148544 00000100:00000040:1.0:1787397810.032068:0:26165:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:1.0:1787397810.032072:0:26165:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397810.032088:0:26165:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.032106:0:26165:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 63 to 0@lo 00000100:00000040:1.0:1787397810.032111:0:26165:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17b80 x1874218701148544/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787397830 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.032120:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701148544:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 353us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397810.032126:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5057 00000100:00000040:1.0:1787397810.032129:0:26165:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a3000 : new rpc_count 0 00000020:00000040:1.0:1787397810.032141:0:26165:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a3000 : new refcount 4 00010000:00080000:1.0:1787397810.032173:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.032182:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00000040:1.0:1787397810.032187:0:3647:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294968749) req@ffff89a828cfbb80 x1874218701128064/t4294968749(4294968749) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787397792 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.032195:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a828cfbb80 x1874218701128064/t4294968749(4294968749) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787397792 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397810.032204:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1787397810.032212:0:3647:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:1.0:1787397810.032217:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397810.032232:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1787397810.032234:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191492 00000020:00000040:1.0:1787397810.032237:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828785000 refcount=4 00000020:00000040:1.0:1787397810.032244:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff89a828785000 : new refcount 3 00000100:00080000:1.0:1787397810.032249:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1787397810.032252:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1787397810.032255:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00000040:1.0:1787397810.032257:0:3647:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1787397810.032260:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a817efe800 from lustre-OST0000_UUID committed 4294968749 last 0 00000100:00080000:1.0:1787397810.032263:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1787397810.032266:0:3647:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1787397810.033894:0:6519:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397810.033938:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.033971:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397810.034595:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148672 00000100:00100000:2.0:1787397810.034609:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148672 00000020:00000040:2.0:1787397810.034613:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397810.034617:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=23 00000100:00000040:2.0:1787397810.034641:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397810.034670:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:2.0:1787397810.034674:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397810.034681:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fc850 x1874218701148672/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.034693:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701148672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397810.034709:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1787397810.034720:0:94333:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a835b90800 count: 2 00000020:00000040:2.0:1787397810.034727:0:94333:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a808718800 with handle 0x274786fe0d192413 to hash 00010000:00010000:2.0:1787397810.034734:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19240c expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1787397810.034743:0:94333:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670d800 : new locks_count 18 00000020:00000040:2.0:1787397810.034756:0:94333:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=24 00010000:00000040:2.0:1787397810.034775:0:94333:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a835b90800) refcount = 2 00010000:00000040:2.0:1787397810.034778:0:94333:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1787397810.035902:0:94333:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923fe expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.035914:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19240c expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.035929:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19240c expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.035940:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718800, rc 0) 00010000:00000040:2.0:1787397810.035944:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701148672 00000100:00000040:2.0:1787397810.035957:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:2.0:1787397810.035963:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.040882:0:94333:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.040929:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 63 to 0@lo 00000100:00000040:2.0:1787397810.040938:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fc850 x1874218701148672/t0(0) o101->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 328/344 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.040949:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701148672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6256us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397810.040959:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:2.0:1787397810.040963:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397810.040977:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:1.0:1787397810.041585:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.041598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701148544:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1787397810.041608:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848380 x1874218701148544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397810.041620:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1787397810.044961:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397810.049577:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.049588:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148672:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1787397810.049599:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397810.049614:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718c00 refcount=4 00010000:00000040:3.0:1787397810.049623:0:6519:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff89a808718c00, remote cookie: 0x274786fe0d192413, flags: 0x0 00010000:00000040:3.0:1787397810.049630:0:6519:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a835b90600) refcount = 2 00010000:00000040:3.0:1787397810.049633:0:6519:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1787397810.049637:0:6519:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397810.049648:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397810.049675:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1787397810.049687:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984b100 x1874218701148672/t0(0) o101->MGC192.168.204.160@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1787397826 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1787397810.049698:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:00000040:3.0:1787397810.049707:0:6519:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff89a817df4400) refs 3 00000020:00000040:3.0:1787397810.049710:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718c00 refcount=3 00000020:00000040:3.0:1787397810.049733:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:3.0:1787397810.049751:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=5 obd=MGC192.168.204.160@tcp 00000100:00000040:3.0:1787397810.049767:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.049792:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148800:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1787397810.049826:0:6519:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397810.049835:0:6519:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397810.049891:0:6519:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fc450 x1874218701148800 msgsize 304 00000100:00100000:3.0:1787397810.049896:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1787397810.049898:0:6519:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1787397810.049926:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.049950:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397810.052159:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148800 00000100:00100000:2.0:1787397810.052173:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148800 00000020:00000040:2.0:1787397810.052177:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397810.052182:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397810.052212:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397810.052273:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1787397810.052278:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397810.052287:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fc450 x1874218701148800/t0(0) o256->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 304/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.052300:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701148800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397810.052330:0:94335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1787397810.054433:0:94335:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1787397810.054447:0:94335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397810.054451:0:94335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:2.0:1787397810.054463:0:94335:0:(genops.c:889:class_export_get()) GET export ffff89a83670d800 refcount=25 00000020:00000040:2.0:1787397810.054637:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 24 00010000:00000040:2.0:1787397810.054655:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701148800 00000100:00000040:2.0:1787397810.054670:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:2.0:1787397810.054677:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.054697:0:94335:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.054711:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 63 to 0@lo 00000100:00000040:2.0:1787397810.054717:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fc450 x1874218701148800/t0(0) o256->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:251/0 lens 304/240 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.054727:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701148800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2428us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397810.054736:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1787397810.054740:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397810.054752:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:2.0:1787397810.060138:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.060154:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.060172:0:6519:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.060178:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70adc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701148800:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.060189:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1787397810.060202:0:6519:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:2.0:1787397810.060216:0:6519:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1787397810.060229:0:6519:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.160@tcp has 192.168.204.160@tcp. 10000000:00000040:2.0:1787397810.060246:0:6519:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:2.0:1787397810.060250:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a83670c800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:2.0:1787397810.060262:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:2.0:1787397810.060265:0:6519:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:2.0:1787397810.060268:0:6519:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.160@tcp -> ffff89a809245ac0 00010000:00080000:2.0:1787397810.060271:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a83670c800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.160@tcp, moved to head 00010000:00000040:2.0:1787397810.060275:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 63 to 0@lo 00000100:00080000:2.0:1787397810.060279:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:2.0:1787397810.060284:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397810.060286:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 63 to 0@lo 00000020:00000040:2.0:1787397810.060289:0:6519:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2ca 00000020:00000040:2.0:1787397810.060294:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a706ff2800 refcount=4 00000100:00000040:2.0:1787397810.060297:0:6519:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 62 to 0@lo 00000100:00000040:2.0:1787397810.060299:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 63 to 0@lo 00000020:00000040:2.0:1787397810.060303:0:6519:0:(genops.c:900:class_export_put()) PUTting export ffff89a706ff2800 : new refcount 3 00000100:00080000:2.0:1787397810.060306:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000020:00000040:2.0:1787397810.060321:0:6519:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1787397810.061109:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397810.061134:0:6519:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d44c6fae] to pc [ptlrpcd_rcv+-1] req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1787397810.061161:0:6519:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1787397810.061170:0:6519:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70adc7480 x1874218701148800/t0(0) o256->MGC192.168.204.160@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1787397826 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.061182:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000020:00000040:2.0:1787397810.061187:0:6519:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 10000000:01000000:2.0:1787397810.061214:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:2.0:1787397810.061220:0:6519:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff89a808718c00 refcount=3 00010000:00010000:2.0:1787397810.061227:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397810.061238:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1787397810.061249:0:6519:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff89a817df4400) refs 3 00000100:00000040:1.0:1787397810.062460:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.062478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701148928:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1787397810.062902:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.062911:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397810.062951:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a82f52e050 x1874218701148928 msgsize 520 00000100:00100000:1.0:1787397810.062955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397810.062964:0:3647:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1787397810.062986:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397810.063568:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5482 usecs (6 jiffies) 00010000:00080000:2.0:1787397810.064220:0:96987:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787397810.064226:0:96987:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1787397810.064233:0:96987:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1787397810.064274:0:96987:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1787397810.064285:0:96987:0:(genops.c:1231:class_import_get()) import ffff89a817efe800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1787397810.064315:0:96987:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3f2ab16] to pc [ptlrpcd_rcv+-1] req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.065280:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701148928 00000100:00100000:3.0:1787397810.065296:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701148928 00000020:00000040:3.0:1787397810.065299:0:26168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2d8 00000100:00100000:3.0:1787397810.065355:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058 00000100:00000040:3.0:1787397810.065363:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82f52e050 x1874218701148928/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.065383:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3647:x1874218701148928:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1787397810.065406:0:26168:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 8 - find 00010000:00000040:3.0:1787397810.065419:0:26168:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1787397810.065428:0:26168:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a7050a6000, cookie 0x274786fe0d19239c 00010000:00080000:3.0:1787397810.065433:0:26168:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff89a7050a6000 cur 3689 last 1787397808 00000001:00000040:3.0:1787397810.065450:0:26168:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.160@tcp 00000001:00000040:3.0:1787397810.065454:0:26168:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 20 00000020:00000040:3.0:1787397810.065459:0:26168:0:(genops.c:889:class_export_get()) GET export ffff89a7050a6000 refcount=4 00000001:00000040:3.0:1787397810.065461:0:26168:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 21 00000001:00000040:3.0:1787397810.065465:0:26168:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff89a702789400) : new refcount 20 00002000:00100000:3.0:1787397810.065468:0:26168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a7050a6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787397810.065472:0:26168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787397810.065475:0:26168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1787397810.065495:0:26168:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff89a8187a4a20 for nid 0@lo - ref 3 00000020:00000040:3.0:1787397810.065505:0:26168:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 9 - import 00000020:00000040:3.0:1787397810.065511:0:26168:0:(genops.c:1244:class_import_put()) import ffff89a7024be000 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1787397810.065519:0:26168:0:(genops.c:889:class_export_get()) GET export ffff89a7050a6000 refcount=5 00000100:00000040:3.0:1787397810.065536:0:26168:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff89a7050a6000 : new rpc_count 1 00000100:00000040:3.0:1787397810.065541:0:26168:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000100:00000040:3.0:1787397810.065544:0:26168:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a809245ac0 refcount 64 to 0@lo 00000020:00000040:3.0:1787397810.065547:0:26168:0:(genops.c:889:class_export_get()) GET export ffff89a7050a6000 refcount=6 00000100:00000040:3.0:1787397810.065553:0:26168:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00080000:3.0:1787397810.065563:0:26168:0:(import.c:65:import_set_state_nolock()) ffff89a7024be000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1787397810.065569:0:26168:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a6000 : new refcount 5 00000020:00000040:3.0:1787397810.065573:0:26168:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 9 - find 00010000:00000040:3.0:1787397810.065584:0:26168:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701148928 00000100:00000040:3.0:1787397810.065599:0:26168:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:3.0:1787397810.065604:0:26168:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397810.065646:0:26168:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397810.065667:0:26168:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:3.0:1787397810.065672:0:26168:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82f52e050 x1874218701148928/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1787397830 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.065680:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701148928:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 299us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397810.065687:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058 00000100:00000040:3.0:1787397810.065690:0:26168:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a6000 : new rpc_count 0 00000020:00000040:3.0:1787397810.065699:0:26168:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a6000 : new refcount 4 00000020:00000040:2.0:1787397810.065892:0:96987:0:(genops.c:1244:class_import_put()) import ffff89a817efe800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1787397810.065911:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.065935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701149056:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1787397810.065957:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397826 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.065963:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.065980:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a829848000 x1874218701149056 msgsize 224 00000100:00100000:2.0:1787397810.065984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397810.066247:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397826 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.066259:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7497 usecs (8 jiffies) 00010000:00080000:2.0:1787397810.066284:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.066292:0:3647:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968731 00000100:00000040:2.0:1787397810.066297:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397810.066307:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:2.0:1787397810.066310:0:3647:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2ca 00000020:00000040:2.0:1787397810.066313:0:3647:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a706ff2800 refcount=4 00000020:00000040:2.0:1787397810.066320:0:3647:0:(genops.c:900:class_export_put()) PUTting export ffff89a706ff2800 : new refcount 3 00000100:00080000:2.0:1787397810.066324:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787397810.066328:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1787397810.066390:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 2 00000100:00000040:2.0:1787397810.066394:0:3647:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1787397810.066397:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83670c800 from lustre-OST0000_UUID committed 4294968731 last 0 00000100:00080000:2.0:1787397810.066400:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1787397810.066403:0:3647:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1787397810.068277:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149056 00000100:00100000:2.0:1787397810.068296:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149056 00000020:00000040:2.0:1787397810.068299:0:26159:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923a3 00000020:00000040:2.0:1787397810.068303:0:26159:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a3000 refcount=5 00000100:00000040:2.0:1787397810.068326:0:26159:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1787397810.070119:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00000040:2.0:1787397810.070125:0:26159:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a3000 : new rpc_count 1 00000100:00000040:2.0:1787397810.070133:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829848000 x1874218701149056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070151:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701149056:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1787397810.070165:0:26159:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829848000 x1874218701149056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1787397810.070173:0:26159:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a3000 : new rpc_count 2 00010000:00080000:2.0:1787397810.070177:0:26159:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a829848000 x1874218701149056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.070190:0:26159:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848000 x1874218701149056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070198:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701149056:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 52us (4216us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397810.070204:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00000040:2.0:1787397810.070208:0:26159:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a3000 : new rpc_count 1 00000100:00000040:2.0:1787397810.070509:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070535:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701148928:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1787397810.070545:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984a680 x1874218701148928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397835 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.070557:0:3647:0:(genops.c:1244:class_import_put()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:2.0:1787397810.070591:0:96990:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1787397810.070596:0:96990:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1787397810.070602:0:96990:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1787397810.070642:0:96990:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1787397810.070648:0:96990:0:(genops.c:1231:class_import_get()) import ffff89a83670c800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1787397810.070671:0:96990:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d44c6fae] to pc [ptlrpcd_rcv+-1] req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397810.070685:0:96990:0:(genops.c:1244:class_import_put()) import ffff89a83670c800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1787397810.070696:0:3647:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701149184:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1787397810.070737:0:3647:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397826 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.070746:0:3647:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397810.070781:0:3647:0:(events.c:337:request_in_callback()) incoming req@ffff89a829849500 x1874218701149184 msgsize 224 00000100:00100000:2.0:1787397810.070786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397810.070803:0:3647:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397826 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.070814:0:3647:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5485 usecs (6 jiffies) 00000100:00100000:2.0:1787397810.070834:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149184 00000100:00100000:2.0:1787397810.070840:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149184 00000020:00000040:2.0:1787397810.070842:0:26163:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19239c 00000020:00000040:2.0:1787397810.070846:0:26163:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a6000 refcount=5 00000100:00100000:2.0:1787397810.070889:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00000040:2.0:1787397810.070892:0:26163:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a6000 : new rpc_count 1 00000100:00000040:2.0:1787397810.070896:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829849500 x1874218701149184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070918:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701149184:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1787397810.070926:0:26163:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829849500 x1874218701149184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1787397810.070934:0:26163:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a6000 : new rpc_count 2 00010000:00080000:2.0:1787397810.070937:0:26163:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a829849500 x1874218701149184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397810.070945:0:26163:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849500 x1874218701149184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:251/0 lens 224/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397810.070953:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701149184:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 37us (170us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397810.070958:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00000040:2.0:1787397810.070960:0:26163:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a6000 : new rpc_count 1 00010000:00080000:3.0:1787397810.075133:0:96925:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:1.0:1787397810.564971:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fe450 x1874218681271808 msgsize 328 00000100:00100000:1.0:1787397810.564987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:1.0:1787397810.564990:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1787397810.565115:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271808 00000100:00100000:3.0:1787397810.565126:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271808 00000020:00000040:3.0:1787397810.565130:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:3.0:1787397810.565136:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=9 00000100:00000040:3.0:1787397810.565161:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397810.565196:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00000040:3.0:1787397810.565200:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:3.0:1787397810.565209:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fe450 x1874218681271808/t0(0) o101->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.565222:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681271808:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397810.565237:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1787397810.565247:0:94333:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff89a835b90800 count: 3 00000020:00000040:3.0:1787397810.565253:0:94333:0:(lustre_handles.c:93:class_handle_hash()) added object ffff89a80fe75200 with handle 0x274786fe0d19241a to hash 00010000:00010000:3.0:1787397810.565258:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8570 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397810.565279:0:94333:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff89a83670f000 : new locks_count 4 00000020:00000040:3.0:1787397810.565281:0:94333:0:(genops.c:889:class_export_get()) GET export ffff89a83670f000 refcount=10 00010000:00000040:3.0:1787397810.565300:0:94333:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff89a835b90800) refcount = 3 00010000:00000040:3.0:1787397810.565304:0:94333:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1787397810.565309:0:94333:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1787397810.565316:0:94333:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397810.565324:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397810.565336:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397810.565345:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75200, rc 0) 00010000:00000040:3.0:1787397810.565349:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681271808 00000100:00000040:3.0:1787397810.565359:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.565366:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.565407:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.565413:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fe450 x1874218681271808/t0(0) o101->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:251/0 lens 328/344 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.565423:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681271808:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 202us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397810.565430:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 215 00000100:00000040:3.0:1787397810.565434:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:3.0:1787397810.565445:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00000100:00000040:0.0:1787397810.568739:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278ff050 x1874218681271936 msgsize 304 00000100:00100000:0.0:1787397810.568758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.568760:0:3642:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1787397810.568825:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681271936 00000100:00100000:1.0:1787397810.568835:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681271936 00000020:00000040:1.0:1787397810.568838:0:94335:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:1.0:1787397810.568844:0:94335:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:1.0:1787397810.568877:0:94335:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1787397810.568914:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00000040:1.0:1787397810.568919:0:94335:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:1.0:1787397810.568926:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278ff050 x1874218681271936/t0(0) o256->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:251/0 lens 304/0 e 0 to 0 dl 1787397821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397810.568941:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681271936:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397810.568967:0:94335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1787397810.568983:0:94335:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1787397810.568990:0:94335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397810.568992:0:94335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1787397810.569000:0:94335:0:(genops.c:889:class_export_get()) GET export ffff89a83670f000 refcount=11 00000020:00000040:0.0:1787397810.571979:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 10 00010000:00000040:0.0:1787397810.572019:0:94335:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681271936 00000100:00000040:0.0:1787397810.572034:0:94335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397810.572042:0:94335:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397810.572111:0:94335:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 8 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397810.572121:0:94335:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278ff050 x1874218681271936/t0(0) o256->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:251/0 lens 304/240 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.572132:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681271936:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 3193us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397810.572141:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 216 00000100:00000040:0.0:1787397810.572145:0:94335:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:0.0:1787397810.572161:0:94335:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00000100:00000040:0.0:1787397810.576757:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188000 x1874218681272064 msgsize 520 00000100:00100000:0.0:1787397810.576773:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.576853:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272064 00000100:00100000:3.0:1787397810.576881:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272064 00000020:00000040:3.0:1787397810.576886:0:26160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917da 00000100:00100000:3.0:1787397810.576955:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5059 00000100:00000040:3.0:1787397810.576967:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188000 x1874218681272064/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1787397830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.576981:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2401:x1874218681272064:12345-192.168.204.60@tcp:8:ll_cfg_requeue.0 00000020:00000040:3.0:1787397810.577010:0:26160:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 9 - find 00010000:00000040:3.0:1787397810.577027:0:26160:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1787397810.577050:0:26160:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a7050a7000, cookie 0x274786fe0d1923aa 00010000:00080000:3.0:1787397810.577057:0:26160:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t4294968733 exp ffff89a7050a7000 cur 3689 last 1787397808 00000001:00000040:3.0:1787397810.577078:0:26160:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 21 00000020:00000040:3.0:1787397810.577086:0:26160:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=4 00000001:00000040:3.0:1787397810.577089:0:26160:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff89a702789400) : new refcount 22 00000001:00000040:3.0:1787397810.577095:0:26160:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff89a702789400) : new refcount 21 00002000:00100000:3.0:1787397810.577099:0:26160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a7050a7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397810.577119:0:26160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:3.0:1787397810.577136:0:26160:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff89a70259c1e0 for nid 192.168.204.60@tcp - ref 2 00000020:00000040:3.0:1787397810.577346:0:26160:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 10 - import 00000020:00000040:3.0:1787397810.577356:0:26160:0:(genops.c:1244:class_import_put()) import ffff89a7024b8000 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1787397810.577365:0:26160:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=5 00000100:00000040:3.0:1787397810.577368:0:26160:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.577383:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.577386:0:26160:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff89a7035b44c0 refcount 9 to 192.168.204.60@tcp 00000020:00000040:3.0:1787397810.577389:0:26160:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=6 00000100:00000040:3.0:1787397810.577396:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00080000:3.0:1787397810.577409:0:26160:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8000 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1787397810.577451:0:26160:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 5 00000020:00000040:3.0:1787397810.577455:0:26160:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 10 - find 00010000:00000040:3.0:1787397810.577484:0:26160:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 0, xid 1874218681272064 00000100:00000040:3.0:1787397810.577497:0:26160:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.577508:0:26160:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00010000:00080000:0.0:1787397810.577514:0:96925:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:0.0:1787397810.577546:0:96925:0:(ldlm_lib.c:2861:target_recovery_thread()) 1: request replay stage - 1 clients from t4294968754 00010000:00080000:0.0:1787397810.577549:0:96925:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294968754 00010000:00080000:0.0:1787397810.577555:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968754 00010000:00080000:0.0:1787397810.577560:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968754 00000100:00000040:3.0:1787397810.577609:0:26160:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.577618:0:26160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188000 x1874218681272064/t0(0) o8->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:0/0 lens 520/416 e 0 to 0 dl 1787397830 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397810.577628:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681272064:12345-192.168.204.60@tcp:8:ll_cfg_requeue.0 Request processed in 647us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397810.577637:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5059 00000100:00000040:3.0:1787397810.577641:0:26160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.577655:0:26160:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 4 00000100:00000040:3.0:1787397810.582691:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc6300 x1874218681248000 msgsize 440 00000100:00100000:3.0:1787397810.582707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397810.582805:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248000 00000100:00100000:2.0:1787397810.582814:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248000 00000020:00000040:2.0:1787397810.582818:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:2.0:1787397810.582822:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=5 00000100:00000040:2.0:1787397810.582850:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1787397810.582908:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 575 00000100:00000040:2.0:1787397810.582912:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:2.0:1787397810.582920:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc6300 x1874218681248000/t0(4294968754) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.582933:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681248000:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:2.0:1787397810.582945:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6300 x1874218681248000/t0(4294968754) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1787397810.582969:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968754, current: 4294968754, replaying 00010000:00000040:2.0:1787397810.582972:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:2.0:1787397810.582987:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc6300 x1874218681248000/t0(4294968754) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.582996:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681248000:12345-192.168.204.60@tcp:10:dd.0 Request processed in 66us (307us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397810.583006:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 575 00000100:00000040:2.0:1787397810.583009:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:2.0:1787397810.583027:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968754, next_transno: 4294968754 00010000:00080000:2.0:1787397810.583031:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968754) 00010000:00080000:2.0:1787397810.583037:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681248000 t4294968754 from 192.168.204.60@tcp req@ffff89a70adc6300 x1874218681248000/t0(4294968754) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1787397810.583052:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6300 x1874218681248000/t0(4294968754) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1787397810.583078:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x762:0x0] 00000001:00000040:2.0:1787397810.583743:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 1 00000020:00000040:2.0:1787397810.583749:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=6 00010000:00000040:2.0:1787397810.583801:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968754, xid 1874218681248000 00000100:00000040:2.0:1787397810.583813:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397810.583819:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:2.0:1787397810.583881:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:2.0:1787397810.583894:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:2.0:1787397810.583901:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:2.0:1787397810.583910:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 5 00010000:00080000:2.0:1787397810.583915:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968755 00010000:00080000:2.0:1787397810.583918:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968755 00000100:00000040:3.0:1787397810.602000:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc6a00 x1874218681248640 msgsize 440 00000100:00100000:3.0:1787397810.602016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.602048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681248640 00000100:00100000:3.0:1787397810.602057:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681248640 00000020:00000040:3.0:1787397810.602061:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.602066:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=6 00000100:00000040:3.0:1787397810.602090:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.602135:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 576 00000100:00000040:3.0:1787397810.602139:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.602148:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc6a00 x1874218681248640/t0(4294968755) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.602161:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681248640:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.602173:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6a00 x1874218681248640/t0(4294968755) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.602193:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968755, current: 4294968755, replaying 00010000:00000040:3.0:1787397810.602197:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.602211:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc6a00 x1874218681248640/t0(4294968755) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.602219:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681248640:12345-192.168.204.60@tcp:10:dd.0 Request processed in 60us (220us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.602228:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 576 00000100:00000040:3.0:1787397810.602230:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.602251:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968755, next_transno: 4294968755 00010000:00080000:3.0:1787397810.602255:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968755) 00010000:00080000:3.0:1787397810.602263:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681248640 t4294968755 from 192.168.204.60@tcp req@ffff89a70adc6a00 x1874218681248640/t0(4294968755) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.602277:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6a00 x1874218681248640/t0(4294968755) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.602304:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x764:0x0] 00000001:00000040:3.0:1787397810.602482:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 2 00000020:00000040:3.0:1787397810.602486:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=7 00010000:00000040:3.0:1787397810.607225:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968755, xid 1874218681248640 00000100:00000040:3.0:1787397810.607250:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.607259:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.607349:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.607789:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.607801:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.607818:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 6 00010000:00080000:3.0:1787397810.607824:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968756 00010000:00080000:3.0:1787397810.607828:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968756 40000000:00000040:0.0:1787397810.610067:0:97024:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000100:00000040:0.0:1787397810.613682:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218b100 x1874218681250944 msgsize 440 00000100:00100000:0.0:1787397810.613699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397810.613831:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250944 00000100:00100000:2.0:1787397810.613841:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250944 00000020:00000040:2.0:1787397810.613844:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:2.0:1787397810.613850:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=7 00000100:00000040:2.0:1787397810.613884:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1787397810.613974:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 577 00000100:00000040:2.0:1787397810.613979:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:2.0:1787397810.613987:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218b100 x1874218681250944/t0(4294968756) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.614001:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681250944:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:2.0:1787397810.614014:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218b100 x1874218681250944/t0(4294968756) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1787397810.614023:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968756, current: 4294968756, replaying 00010000:00000040:2.0:1787397810.614027:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:2.0:1787397810.614048:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b100 x1874218681250944/t0(4294968756) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.614058:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2401:x1874218681250944:12345-192.168.204.60@tcp:10:dd.0 Request processed in 58us (377us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397810.614065:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 577 00000100:00000040:2.0:1787397810.614068:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:1.0:1787397810.614111:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968756, next_transno: 4294968756 00010000:00080000:1.0:1787397810.614116:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968756) 00010000:00080000:1.0:1787397810.614125:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681250944 t4294968756 from 192.168.204.60@tcp req@ffff89a70218b100 x1874218681250944/t0(4294968756) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1787397810.614143:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218b100 x1874218681250944/t0(4294968756) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1787397810.614192:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x766:0x0] 00000001:00000040:1.0:1787397810.614385:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 3 00000020:00000040:1.0:1787397810.614389:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=8 00010000:00000040:1.0:1787397810.614426:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968756, xid 1874218681250944 00000100:00000040:1.0:1787397810.614436:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397810.614442:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397810.614507:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:1.0:1787397810.614515:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1787397810.614544:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:1.0:1787397810.614554:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 7 00010000:00080000:1.0:1787397810.614557:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968757 00010000:00080000:1.0:1787397810.614561:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968757 00000100:00000040:3.0:1787397810.634640:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc6d80 x1874218681250816 msgsize 440 00000100:00100000:3.0:1787397810.634657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397810.634778:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681250816 00000100:00100000:1.0:1787397810.634789:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681250816 00000020:00000040:1.0:1787397810.634792:0:24832:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:1.0:1787397810.634797:0:24832:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=8 00000100:00000040:1.0:1787397810.634825:0:24832:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1787397810.634883:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 578 00000100:00000040:1.0:1787397810.634888:0:24832:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:1.0:1787397810.634896:0:24832:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc6d80 x1874218681250816/t0(4294968757) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.634909:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681250816:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:1.0:1787397810.634921:0:24832:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6d80 x1874218681250816/t0(4294968757) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1787397810.634930:0:24832:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968757, current: 4294968757, replaying 00010000:00000040:1.0:1787397810.634934:0:24832:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:1.0:1787397810.634957:0:24832:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc6d80 x1874218681250816/t0(4294968757) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.634967:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681250816:12345-192.168.204.60@tcp:10:dd.0 Request processed in 60us (327us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397810.634974:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 578 00000100:00000040:1.0:1787397810.634978:0:24832:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:1.0:1787397810.634998:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968757, next_transno: 4294968757 00010000:00080000:1.0:1787397810.635001:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968757) 00010000:00080000:1.0:1787397810.635008:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681250816 t4294968757 from 192.168.204.60@tcp req@ffff89a70adc6d80 x1874218681250816/t0(4294968757) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1787397810.635023:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc6d80 x1874218681250816/t0(4294968757) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1787397810.635053:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x763:0x0] 00000001:00000040:1.0:1787397810.635265:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 4 00000020:00000040:1.0:1787397810.635270:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=9 00010000:00000040:1.0:1787397810.635309:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968757, xid 1874218681250816 00000100:00000040:1.0:1787397810.635320:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397810.635326:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397810.635372:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:1.0:1787397810.635382:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1787397810.635387:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:1.0:1787397810.635398:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 8 00010000:00080000:1.0:1787397810.635402:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968758 00010000:00080000:1.0:1787397810.635406:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968758 00000100:00000040:2.0:1787397810.641351:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984ad80 x1874218681251072 msgsize 440 00000100:00100000:2.0:1787397810.641369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397810.641439:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681251072 00000100:00100000:1.0:1787397810.641449:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681251072 00000020:00000040:1.0:1787397810.641452:0:24830:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:1.0:1787397810.641470:0:24830:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=9 00000100:00000040:1.0:1787397810.641506:0:24830:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1787397810.641575:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 579 00000100:00000040:1.0:1787397810.641579:0:24830:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:1.0:1787397810.641588:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984ad80 x1874218681251072/t0(4294968758) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.641601:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681251072:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:1.0:1787397810.641614:0:24830:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a82984ad80 x1874218681251072/t0(4294968758) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1787397810.641622:0:24830:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968758, current: 4294968758, replaying 00010000:00000040:1.0:1787397810.641625:0:24830:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:1.0:1787397810.641645:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984ad80 x1874218681251072/t0(4294968758) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.641655:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681251072:12345-192.168.204.60@tcp:10:dd.0 Request processed in 55us (305us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397810.641661:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 579 00000100:00000040:1.0:1787397810.641664:0:24830:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.641732:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968758, next_transno: 4294968758 00010000:00080000:3.0:1787397810.641736:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968758) 00010000:00080000:3.0:1787397810.641743:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681251072 t4294968758 from 192.168.204.60@tcp req@ffff89a82984ad80 x1874218681251072/t0(4294968758) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.641758:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a82984ad80 x1874218681251072/t0(4294968758) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.641796:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x765:0x0] 00000001:00000040:3.0:1787397810.641978:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 5 00000020:00000040:3.0:1787397810.641982:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=10 00010000:00000040:3.0:1787397810.642014:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968758, xid 1874218681251072 00000100:00000040:3.0:1787397810.642024:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.642031:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.642078:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.642086:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.642091:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.642102:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 9 00010000:00080000:3.0:1787397810.642106:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968759 00010000:00080000:3.0:1787397810.642109:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968759 00000100:00000040:2.0:1787397810.648978:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a829849880 x1874218681253504 msgsize 440 00000100:00100000:2.0:1787397810.648994:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.649062:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681253504 00000100:00100000:3.0:1787397810.649073:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681253504 00000020:00000040:3.0:1787397810.649077:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.649083:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=10 00000100:00000040:3.0:1787397810.649111:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.649163:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 580 00000100:00000040:3.0:1787397810.649167:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.649175:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829849880 x1874218681253504/t0(4294968759) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.649217:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681253504:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.649231:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829849880 x1874218681253504/t0(4294968759) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.649240:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968759, current: 4294968759, replaying 00010000:00000040:3.0:1787397810.649243:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.649256:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849880 x1874218681253504/t0(4294968759) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.649265:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681253504:12345-192.168.204.60@tcp:10:dd.0 Request processed in 51us (288us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.649272:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 580 00000100:00000040:3.0:1787397810.649275:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.649291:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968759, next_transno: 4294968759 00010000:00080000:3.0:1787397810.649295:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968759) 00010000:00080000:3.0:1787397810.649301:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681253504 t4294968759 from 192.168.204.60@tcp req@ffff89a829849880 x1874218681253504/t0(4294968759) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.649316:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829849880 x1874218681253504/t0(4294968759) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.649344:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x767:0x0] 00000001:00000040:3.0:1787397810.650021:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 6 00000020:00000040:3.0:1787397810.650027:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=11 00010000:00000040:3.0:1787397810.650067:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968759, xid 1874218681253504 00000100:00000040:3.0:1787397810.650078:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.650084:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.650132:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.650150:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.650157:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.650166:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 10 00010000:00080000:3.0:1787397810.650170:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968760 00010000:00080000:3.0:1787397810.650175:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968760 00000100:00000040:3.0:1787397810.661695:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc4000 x1874218681255168 msgsize 440 00000100:00100000:3.0:1787397810.661713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.661747:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255168 00000100:00100000:3.0:1787397810.661757:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255168 00000020:00000040:3.0:1787397810.661760:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.661778:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=11 00000100:00000040:3.0:1787397810.661805:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.661845:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 581 00000100:00000040:3.0:1787397810.661849:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.661867:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc4000 x1874218681255168/t0(4294968760) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.661881:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2401:x1874218681255168:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.661894:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4000 x1874218681255168/t0(4294968760) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.661903:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968760, current: 4294968760, replaying 00010000:00000040:3.0:1787397810.661907:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.661918:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4000 x1874218681255168/t0(4294968760) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.661927:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2401:x1874218681255168:12345-192.168.204.60@tcp:10:dd.0 Request processed in 49us (234us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.661934:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 581 00000100:00000040:3.0:1787397810.661948:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.661966:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968760, next_transno: 4294968760 00010000:00080000:3.0:1787397810.661970:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968760) 00010000:00080000:3.0:1787397810.661977:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681255168 t4294968760 from 192.168.204.60@tcp req@ffff89a70adc4000 x1874218681255168/t0(4294968760) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.661991:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4000 x1874218681255168/t0(4294968760) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.662021:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76d:0x0] 00000001:00000040:3.0:1787397810.662205:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 7 00000020:00000040:3.0:1787397810.662209:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=12 00010000:00000040:3.0:1787397810.662246:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968760, xid 1874218681255168 00000100:00000040:3.0:1787397810.662258:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.662264:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.662318:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.662328:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.662430:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.662441:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 11 00010000:00080000:3.0:1787397810.662445:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968761 00010000:00080000:3.0:1787397810.662448:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968761 00000100:00000040:3.0:1787397810.682846:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc5500 x1874218681255936 msgsize 440 00000100:00100000:3.0:1787397810.682871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.682903:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681255936 00000100:00100000:3.0:1787397810.682913:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681255936 00000020:00000040:3.0:1787397810.682916:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.682920:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=12 00000100:00000040:3.0:1787397810.682941:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.682979:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 582 00000100:00000040:3.0:1787397810.682984:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.682999:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc5500 x1874218681255936/t0(4294968761) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.683012:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681255936:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.683023:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc5500 x1874218681255936/t0(4294968761) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.683032:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968761, current: 4294968761, replaying 00010000:00000040:3.0:1787397810.683036:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.683045:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc5500 x1874218681255936/t0(4294968761) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.683055:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681255936:12345-192.168.204.60@tcp:10:dd.0 Request processed in 44us (209us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.683062:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 582 00000100:00000040:3.0:1787397810.683065:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.683082:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968761, next_transno: 4294968761 00010000:00080000:3.0:1787397810.683085:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968761) 00010000:00080000:3.0:1787397810.683091:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681255936 t4294968761 from 192.168.204.60@tcp req@ffff89a70adc5500 x1874218681255936/t0(4294968761) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.683106:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc5500 x1874218681255936/t0(4294968761) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.683134:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x768:0x0] 00000001:00000040:3.0:1787397810.685739:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 8 00000020:00000040:3.0:1787397810.685752:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=13 00010000:00000040:3.0:1787397810.685792:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968761, xid 1874218681255936 00000100:00000040:3.0:1787397810.685806:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.685814:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.685884:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.685898:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.686028:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.686040:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 12 00010000:00080000:3.0:1787397810.686046:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968762 00010000:00080000:3.0:1787397810.686049:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968762 00000100:00000040:3.0:1787397810.696879:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc7800 x1874218681257088 msgsize 440 00000100:00100000:3.0:1787397810.696894:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397810.698676:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257088 00000100:00100000:1.0:1787397810.698690:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257088 00000020:00000040:1.0:1787397810.698694:0:24832:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:1.0:1787397810.698700:0:24832:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=13 00000100:00000040:1.0:1787397810.698726:0:24832:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1787397810.698924:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 583 00000100:00000040:0.0:1787397810.698929:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.698937:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc7800 x1874218681257088/t0(4294968762) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.698952:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2401:x1874218681257088:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:0.0:1787397810.698964:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7800 x1874218681257088/t0(4294968762) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397810.698974:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968762, current: 4294968762, replaying 00010000:00000040:0.0:1787397810.698977:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.698993:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7800 x1874218681257088/t0(4294968762) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.699001:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2401:x1874218681257088:12345-192.168.204.60@tcp:10:dd.0 Request processed in 52us (2123us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.699008:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 583 00000100:00000040:0.0:1787397810.699011:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.699051:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968762, next_transno: 4294968762 00010000:00080000:3.0:1787397810.699055:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968762) 00010000:00080000:3.0:1787397810.699063:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681257088 t4294968762 from 192.168.204.60@tcp req@ffff89a70adc7800 x1874218681257088/t0(4294968762) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.699077:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7800 x1874218681257088/t0(4294968762) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.699105:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x769:0x0] 00000001:00000040:3.0:1787397810.699286:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 9 00000020:00000040:3.0:1787397810.699289:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=14 00010000:00000040:3.0:1787397810.699322:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968762, xid 1874218681257088 00000100:00000040:3.0:1787397810.699332:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.699338:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.699400:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.699407:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.699413:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.699424:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 13 00010000:00080000:3.0:1787397810.699428:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968763 00010000:00080000:3.0:1787397810.699431:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968763 00000100:00000040:0.0:1787397810.706934:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188380 x1874218681257728 msgsize 440 00000100:00100000:0.0:1787397810.706961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.707040:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681257728 00000100:00100000:3.0:1787397810.707054:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681257728 00000020:00000040:3.0:1787397810.707058:0:24830:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.707063:0:24830:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=14 00000100:00000040:3.0:1787397810.707087:0:24830:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.707142:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 584 00000100:00000040:3.0:1787397810.707147:0:24830:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.707156:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188380 x1874218681257728/t0(4294968763) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.707169:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2401:x1874218681257728:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.707181:0:24830:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702188380 x1874218681257728/t0(4294968763) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.707204:0:24830:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968763, current: 4294968763, replaying 00010000:00000040:3.0:1787397810.707208:0:24830:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.707221:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188380 x1874218681257728/t0(4294968763) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.707230:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2401:x1874218681257728:12345-192.168.204.60@tcp:10:dd.0 Request processed in 64us (297us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.707237:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 584 00000100:00000040:3.0:1787397810.707240:0:24830:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.707256:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968763, next_transno: 4294968763 00010000:00080000:3.0:1787397810.707260:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968763) 00010000:00080000:3.0:1787397810.707267:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681257728 t4294968763 from 192.168.204.60@tcp req@ffff89a702188380 x1874218681257728/t0(4294968763) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.707282:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702188380 x1874218681257728/t0(4294968763) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.707312:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76b:0x0] 00000001:00000040:3.0:1787397810.707509:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 10 00000020:00000040:3.0:1787397810.707514:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=15 00010000:00000040:3.0:1787397810.707572:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968763, xid 1874218681257728 00000100:00000040:3.0:1787397810.707582:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.707589:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.707631:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.707639:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.707743:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.707752:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 14 00010000:00080000:3.0:1787397810.707756:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968764 00010000:00080000:3.0:1787397810.707759:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968764 00000100:00000040:0.0:1787397810.719362:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a702189500 x1874218681258752 msgsize 440 00000100:00100000:0.0:1787397810.719380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.719454:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681258752 00000100:00100000:3.0:1787397810.719465:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681258752 00000020:00000040:3.0:1787397810.719478:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.719484:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=15 00000100:00000040:3.0:1787397810.719508:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.719586:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 585 00000100:00000040:3.0:1787397810.719590:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.719598:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702189500 x1874218681258752/t0(4294968764) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.719612:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2401:x1874218681258752:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.719625:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702189500 x1874218681258752/t0(4294968764) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.719634:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968764, current: 4294968764, replaying 00010000:00000040:3.0:1787397810.719637:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.719652:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189500 x1874218681258752/t0(4294968764) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.719678:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2401:x1874218681258752:12345-192.168.204.60@tcp:10:dd.0 Request processed in 69us (317us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.719686:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 585 00000100:00000040:3.0:1787397810.719688:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:1.0:1787397810.719799:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968764, next_transno: 4294968764 00010000:00080000:1.0:1787397810.719803:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968764) 00010000:00080000:1.0:1787397810.719812:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681258752 t4294968764 from 192.168.204.60@tcp req@ffff89a702189500 x1874218681258752/t0(4294968764) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1787397810.719828:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702189500 x1874218681258752/t0(4294968764) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1787397810.719873:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76c:0x0] 00000001:00000040:1.0:1787397810.720056:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 11 00000020:00000040:1.0:1787397810.720061:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=16 00010000:00000040:1.0:1787397810.720097:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968764, xid 1874218681258752 00000100:00000040:1.0:1787397810.720106:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397810.720112:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397810.720155:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:1.0:1787397810.720166:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1787397810.720172:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:1.0:1787397810.720183:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 15 00010000:00080000:1.0:1787397810.720187:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968765 00010000:00080000:1.0:1787397810.720190:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968765 00000100:00000040:3.0:1787397810.726321:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc4380 x1874218681259520 msgsize 440 00000100:00100000:3.0:1787397810.726338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397810.726429:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681259520 00000100:00100000:2.0:1787397810.726439:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681259520 00000020:00000040:2.0:1787397810.726442:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:2.0:1787397810.726460:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=16 00000100:00000040:2.0:1787397810.726495:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1787397810.726560:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 586 00000100:00000040:2.0:1787397810.726565:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:2.0:1787397810.726573:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc4380 x1874218681259520/t0(4294968765) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.726587:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2401:x1874218681259520:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:2.0:1787397810.726599:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4380 x1874218681259520/t0(4294968765) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1787397810.726608:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968765, current: 4294968765, replaying 00010000:00000040:2.0:1787397810.726611:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:2.0:1787397810.726625:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4380 x1874218681259520/t0(4294968765) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787397810.726635:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2401:x1874218681259520:12345-192.168.204.60@tcp:10:dd.0 Request processed in 51us (315us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397810.726642:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 586 00000100:00000040:2.0:1787397810.726645:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:2.0:1787397810.729677:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968765, next_transno: 4294968765 00010000:00080000:2.0:1787397810.729691:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968765) 00010000:00080000:2.0:1787397810.729711:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681259520 t4294968765 from 192.168.204.60@tcp req@ffff89a70adc4380 x1874218681259520/t0(4294968765) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1787397810.729740:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4380 x1874218681259520/t0(4294968765) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1787397810.729795:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76a:0x0] 00000001:00000040:2.0:1787397810.730031:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 12 00000020:00000040:2.0:1787397810.730046:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=17 00010000:00000040:2.0:1787397810.730085:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968765, xid 1874218681259520 00000100:00000040:2.0:1787397810.730096:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397810.730103:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:2.0:1787397810.730227:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:2.0:1787397810.730238:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1787397810.730246:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:2.0:1787397810.730258:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 16 00010000:00080000:2.0:1787397810.730262:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968766 00010000:00080000:2.0:1787397810.730266:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968766 00000100:00000040:3.0:1787397810.746636:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc7480 x1874218681261184 msgsize 440 00000100:00100000:3.0:1787397810.746653:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397810.746927:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681261184 00000100:00100000:0.0:1787397810.746936:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681261184 00000020:00000040:0.0:1787397810.746940:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.746945:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=17 00000100:00000040:0.0:1787397810.746971:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1787397810.747009:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 587 00000100:00000040:0.0:1787397810.747012:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.747021:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc7480 x1874218681261184/t0(4294968766) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.747035:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2401:x1874218681261184:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:0.0:1787397810.747045:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7480 x1874218681261184/t0(4294968766) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397810.747054:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968766, current: 4294968766, replaying 00010000:00000040:0.0:1787397810.747057:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.747073:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7480 x1874218681261184/t0(4294968766) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.747081:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2401:x1874218681261184:12345-192.168.204.60@tcp:10:dd.0 Request processed in 49us (447us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.747088:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 587 00000100:00000040:0.0:1787397810.747091:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:1.0:1787397810.747168:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968766, next_transno: 4294968766 00010000:00080000:1.0:1787397810.747172:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968766) 00010000:00080000:1.0:1787397810.747181:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681261184 t4294968766 from 192.168.204.60@tcp req@ffff89a70adc7480 x1874218681261184/t0(4294968766) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1787397810.747197:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7480 x1874218681261184/t0(4294968766) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1787397810.747228:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76e:0x0] 00000001:00000040:1.0:1787397810.747437:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 13 00000020:00000040:1.0:1787397810.747441:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=18 00010000:00000040:1.0:1787397810.747478:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968766, xid 1874218681261184 00000100:00000040:1.0:1787397810.747488:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397810.747493:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397810.747569:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:1.0:1787397810.747578:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1787397810.747584:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:1.0:1787397810.747606:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 17 00010000:00080000:1.0:1787397810.747610:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968767 00010000:00080000:1.0:1787397810.747613:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968767 00000100:00000040:3.0:1787397810.752110:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc7b80 x1874218681262336 msgsize 440 00000100:00100000:3.0:1787397810.752137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397810.752228:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681262336 00000100:00100000:1.0:1787397810.752239:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681262336 00000020:00000040:1.0:1787397810.752243:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:1.0:1787397810.752248:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=18 00000100:00000040:1.0:1787397810.752273:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1787397810.752322:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 588 00000100:00000040:1.0:1787397810.752327:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:1.0:1787397810.752335:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc7b80 x1874218681262336/t0(4294968767) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.752348:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:2401:x1874218681262336:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:1.0:1787397810.752360:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7b80 x1874218681262336/t0(4294968767) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1787397810.752371:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968767, current: 4294968767, replaying 00010000:00000040:1.0:1787397810.752374:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:1.0:1787397810.752393:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc7b80 x1874218681262336/t0(4294968767) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.752403:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:2401:x1874218681262336:12345-192.168.204.60@tcp:10:dd.0 Request processed in 57us (293us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397810.752410:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 588 00000100:00000040:1.0:1787397810.752414:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.753679:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968767, next_transno: 4294968767 00010000:00080000:3.0:1787397810.753688:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968767) 00010000:00080000:3.0:1787397810.753700:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681262336 t4294968767 from 192.168.204.60@tcp req@ffff89a70adc7b80 x1874218681262336/t0(4294968767) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.753721:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc7b80 x1874218681262336/t0(4294968767) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.753756:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76f:0x0] 00000001:00000040:3.0:1787397810.753940:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 14 00000020:00000040:3.0:1787397810.753945:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=19 00010000:00000040:3.0:1787397810.753977:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968767, xid 1874218681262336 00000100:00000040:3.0:1787397810.753988:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.753994:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.754055:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.754065:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.754073:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.754086:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 18 00010000:00080000:3.0:1787397810.754103:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968768 00010000:00080000:3.0:1787397810.754107:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968768 00000100:00000040:3.0:1787397810.762847:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70adc4e00 x1874218681264128 msgsize 440 00000100:00100000:3.0:1787397810.762874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397810.766493:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264128 00000100:00100000:1.0:1787397810.766510:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264128 00000020:00000040:1.0:1787397810.766514:0:24830:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:1.0:1787397810.766535:0:24830:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=19 00000100:00000040:1.0:1787397810.766571:0:24830:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1787397810.766626:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 589 00000100:00000040:1.0:1787397810.766631:0:24830:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:1.0:1787397810.766639:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70adc4e00 x1874218681264128/t0(4294968768) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.766652:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681264128:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:1.0:1787397810.766664:0:24830:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4e00 x1874218681264128/t0(4294968768) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1787397810.766673:0:24830:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968768, current: 4294968768, replaying 00010000:00000040:1.0:1787397810.766677:0:24830:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:1.0:1787397810.766688:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70adc4e00 x1874218681264128/t0(4294968768) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397810.766696:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681264128:12345-192.168.204.60@tcp:10:dd.0 Request processed in 46us (3850us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397810.766703:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 589 00000100:00000040:1.0:1787397810.766706:0:24830:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:3.0:1787397810.766978:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968768, next_transno: 4294968768 00010000:00080000:3.0:1787397810.766984:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968768) 00010000:00080000:3.0:1787397810.766992:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681264128 t4294968768 from 192.168.204.60@tcp req@ffff89a70adc4e00 x1874218681264128/t0(4294968768) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1787397810.767008:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70adc4e00 x1874218681264128/t0(4294968768) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1787397810.767040:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x772:0x0] 00000001:00000040:3.0:1787397810.767263:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 15 00000020:00000040:3.0:1787397810.767267:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=20 00010000:00000040:3.0:1787397810.767299:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968768, xid 1874218681264128 00000100:00000040:3.0:1787397810.767308:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397810.767314:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397810.767800:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:3.0:1787397810.767811:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1787397810.767818:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:3.0:1787397810.767832:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 19 00010000:00080000:3.0:1787397810.767836:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968769 00010000:00080000:3.0:1787397810.767840:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968769 00000100:00000040:2.0:1787397810.770787:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a829848a80 x1874218681263872 msgsize 440 00000100:00100000:2.0:1787397810.770804:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.770963:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681263872 00000100:00100000:3.0:1787397810.770972:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681263872 00000020:00000040:3.0:1787397810.770975:0:24843:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.770980:0:24843:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=20 00000100:00000040:3.0:1787397810.771005:0:24843:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.771050:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 590 00000100:00000040:3.0:1787397810.771066:0:24843:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.771074:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a829848a80 x1874218681263872/t0(4294968769) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.771087:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:2401:x1874218681263872:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.771098:0:24843:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829848a80 x1874218681263872/t0(4294968769) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.771107:0:24843:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968769, current: 4294968769, replaying 00010000:00000040:3.0:1787397810.771110:0:24843:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.771137:0:24843:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848a80 x1874218681263872/t0(4294968769) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.771146:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:2401:x1874218681263872:12345-192.168.204.60@tcp:10:dd.0 Request processed in 60us (359us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.771152:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 590 00000100:00000040:3.0:1787397810.771155:0:24843:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:1.0:1787397810.771279:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968769, next_transno: 4294968769 00010000:00080000:1.0:1787397810.771283:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968769) 00010000:00080000:1.0:1787397810.771292:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681263872 t4294968769 from 192.168.204.60@tcp req@ffff89a829848a80 x1874218681263872/t0(4294968769) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1787397810.771307:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a829848a80 x1874218681263872/t0(4294968769) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1787397810.771336:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x770:0x0] 00000001:00000040:1.0:1787397810.771512:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 16 00000020:00000040:1.0:1787397810.771515:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=21 00010000:00000040:1.0:1787397810.771585:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968769, xid 1874218681263872 00000100:00000040:1.0:1787397810.771596:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:1.0:1787397810.771602:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:1.0:1787397810.771651:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:1.0:1787397810.771659:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1787397810.771664:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:1.0:1787397810.771675:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 20 00010000:00080000:1.0:1787397810.771679:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968770 00010000:00080000:1.0:1787397810.771682:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968770 00000100:00000040:2.0:1787397810.779170:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a82984b100 x1874218681264896 msgsize 440 00000100:00100000:2.0:1787397810.779200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397810.779299:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681264896 00000100:00100000:3.0:1787397810.779317:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681264896 00000020:00000040:3.0:1787397810.779321:0:8441:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:3.0:1787397810.779329:0:8441:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=21 00000100:00000040:3.0:1787397810.779368:0:8441:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1787397810.779725:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 591 00000100:00000040:3.0:1787397810.779732:0:8441:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:3.0:1787397810.779743:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a82984b100 x1874218681264896/t0(4294968770) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.779761:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:2401:x1874218681264896:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:3.0:1787397810.779776:0:8441:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a82984b100 x1874218681264896/t0(4294968770) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1787397810.779802:0:8441:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968770, current: 4294968770, replaying 00010000:00000040:3.0:1787397810.779807:0:8441:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:3.0:1787397810.779847:0:8441:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984b100 x1874218681264896/t0(4294968770) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397810.779869:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:2401:x1874218681264896:12345-192.168.204.60@tcp:10:dd.0 Request processed in 101us (688us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397810.779879:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 591 00000100:00000040:3.0:1787397810.779884:0:8441:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:2.0:1787397810.779913:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968770, next_transno: 4294968770 00010000:00080000:2.0:1787397810.779920:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968770) 00010000:00080000:2.0:1787397810.779935:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681264896 t4294968770 from 192.168.204.60@tcp req@ffff89a82984b100 x1874218681264896/t0(4294968770) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1787397810.779960:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a82984b100 x1874218681264896/t0(4294968770) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1787397810.779997:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x771:0x0] 00000001:00000040:2.0:1787397810.780215:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 17 00000020:00000040:2.0:1787397810.780220:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=22 00010000:00000040:2.0:1787397810.780254:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968770, xid 1874218681264896 00000100:00000040:2.0:1787397810.780265:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:2.0:1787397810.780271:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:2.0:1787397810.780320:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:2.0:1787397810.780330:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1787397810.780350:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:2.0:1787397810.780363:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 21 00010000:00080000:2.0:1787397810.780367:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968771 00010000:00080000:2.0:1787397810.780371:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968771 00000100:00000040:0.0:1787397810.790402:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218aa00 x1874218681266304 msgsize 440 00000100:00100000:0.0:1787397810.790420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397810.790462:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681266304 00000100:00100000:0.0:1787397810.790472:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681266304 00000020:00000040:0.0:1787397810.790484:0:8442:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.790489:0:8442:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=22 00000100:00000040:0.0:1787397810.790514:0:8442:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1787397810.790585:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 592 00000100:00000040:0.0:1787397810.790590:0:8442:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.790599:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218aa00 x1874218681266304/t0(4294968771) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.790613:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2401:x1874218681266304:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:0.0:1787397810.790627:0:8442:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218aa00 x1874218681266304/t0(4294968771) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397810.790637:0:8442:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968771, current: 4294968771, replaying 00010000:00000040:0.0:1787397810.790641:0:8442:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.790655:0:8442:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218aa00 x1874218681266304/t0(4294968771) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.790664:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2401:x1874218681266304:12345-192.168.204.60@tcp:10:dd.0 Request processed in 52us (263us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.790672:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 592 00000100:00000040:0.0:1787397810.790675:0:8442:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:0.0:1787397810.790693:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968771, next_transno: 4294968771 00010000:00080000:0.0:1787397810.790697:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968771) 00010000:00080000:0.0:1787397810.790706:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681266304 t4294968771 from 192.168.204.60@tcp req@ffff89a70218aa00 x1874218681266304/t0(4294968771) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1787397810.790724:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218aa00 x1874218681266304/t0(4294968771) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1787397810.790756:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x773:0x0] 00000001:00000040:0.0:1787397810.790960:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 18 00000020:00000040:0.0:1787397810.790964:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=23 00010000:00000040:0.0:1787397810.791009:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968771, xid 1874218681266304 00000100:00000040:0.0:1787397810.791021:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397810.791027:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397810.791085:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:0.0:1787397810.791094:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1787397810.791099:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:0.0:1787397810.791109:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 22 00010000:00080000:0.0:1787397810.791112:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968772 00010000:00080000:0.0:1787397810.791116:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968772 00000100:00000040:3.0:1787397810.795082:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff89a703509880 x1874218681267584 msgsize 440 00000100:00100000:3.0:1787397810.795110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397810.796722:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267584 00000100:00100000:0.0:1787397810.796736:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267584 00000020:00000040:0.0:1787397810.796739:0:24828:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.796744:0:24828:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=23 00000100:00000040:0.0:1787397810.796768:0:24828:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1787397810.796814:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 593 00000100:00000040:0.0:1787397810.796818:0:24828:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.796826:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a703509880 x1874218681267584/t0(4294968772) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.796838:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:2401:x1874218681267584:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:0.0:1787397810.796848:0:24828:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a703509880 x1874218681267584/t0(4294968772) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397810.796869:0:24828:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968772, current: 4294968772, replaying 00010000:00000040:0.0:1787397810.796872:0:24828:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.796884:0:24828:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a703509880 x1874218681267584/t0(4294968772) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.796905:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:2401:x1874218681267584:12345-192.168.204.60@tcp:10:dd.0 Request processed in 68us (1826us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.796913:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 593 00000100:00000040:0.0:1787397810.796916:0:24828:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:0.0:1787397810.796947:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968772, next_transno: 4294968772 00010000:00080000:0.0:1787397810.796950:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968772) 00010000:00080000:0.0:1787397810.796957:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681267584 t4294968772 from 192.168.204.60@tcp req@ffff89a703509880 x1874218681267584/t0(4294968772) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1787397810.796971:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a703509880 x1874218681267584/t0(4294968772) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1787397810.796999:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x775:0x0] 00000001:00000040:0.0:1787397810.797162:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 19 00000020:00000040:0.0:1787397810.797167:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=24 00010000:00000040:0.0:1787397810.797203:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968772, xid 1874218681267584 00000100:00000040:0.0:1787397810.797212:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397810.797217:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397810.797269:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:0.0:1787397810.797277:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1787397810.797394:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:0.0:1787397810.797404:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 23 00010000:00080000:0.0:1787397810.797408:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968773 00010000:00080000:0.0:1787397810.797411:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968773 00000100:00000040:3.0:1787397810.802098:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a835b6fb80 x1874218681267712 msgsize 440 00000100:00100000:3.0:1787397810.802514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397810.803260:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681267712 00000100:00100000:0.0:1787397810.803276:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681267712 00000020:00000040:0.0:1787397810.803280:0:24830:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.803285:0:24830:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=24 00000100:00000040:0.0:1787397810.803318:0:24830:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1787397810.803372:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 594 00000100:00000040:0.0:1787397810.803376:0:24830:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.803384:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a835b6fb80 x1874218681267712/t0(4294968773) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.803398:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681267712:12345-192.168.204.60@tcp:10:dd.0 00000020:00000040:0.0:1787397810.803411:0:24830:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a835b6fb80 x1874218681267712/t0(4294968773) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1787397810.803421:0:24830:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294968773, current: 4294968773, replaying 00010000:00000040:0.0:1787397810.803425:0:24830:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.803437:0:24830:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a835b6fb80 x1874218681267712/t0(4294968773) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787397810.803447:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681267712:12345-192.168.204.60@tcp:10:dd.0 Request processed in 50us (1350us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.803454:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 594 00000100:00000040:0.0:1787397810.803457:0:24830:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00010000:00080000:0.0:1787397810.804252:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968773, next_transno: 4294968773 00010000:00080000:0.0:1787397810.804259:0:96925:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294968773) 00010000:00080000:0.0:1787397810.804269:0:96925:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681267712 t4294968773 from 192.168.204.60@tcp req@ffff89a835b6fb80 x1874218681267712/t0(4294968773) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1787397810.804287:0:96925:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a835b6fb80 x1874218681267712/t0(4294968773) o10->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 440/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1787397810.804317:0:96925:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x774:0x0] 00000001:00000040:0.0:1787397810.805259:0:96925:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff89a7050a7000 : new cb_count 20 00000020:00000040:0.0:1787397810.805267:0:96925:0:(genops.c:889:class_export_get()) GET export ffff89a7050a7000 refcount=25 00010000:00000040:0.0:1787397810.805313:0:96925:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968753, transno 4294968773, xid 1874218681267712 00000100:00000040:0.0:1787397810.805324:0:96925:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397810.805331:0:96925:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397810.805383:0:96925:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00010000:00080000:0.0:1787397810.805394:0:96925:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1787397810.805403:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:0.0:1787397810.805415:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 24 00010000:00080000:0.0:1787397810.805419:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:0.0:1787397810.805423:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00000100:00000040:0.0:1787397810.815041:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218a680 x1874218681272192 msgsize 328 00000100:00100000:0.0:1787397810.815059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815089:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218a300 x1874218681272320 msgsize 328 00000100:00100000:0.0:1787397810.815094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815110:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a702189180 x1874218681272448 msgsize 328 00000100:00100000:0.0:1787397810.815114:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815144:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218b800 x1874218681272576 msgsize 328 00000100:00100000:0.0:1787397810.815148:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815166:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218ad80 x1874218681272704 msgsize 328 00000100:00100000:0.0:1787397810.815170:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815185:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218bb80 x1874218681272832 msgsize 328 00000100:00100000:0.0:1787397810.815189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815203:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a702188e00 x1874218681272960 msgsize 328 00000100:00100000:0.0:1787397810.815207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:0.0:1787397810.815229:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff89a702189f80 x1874218681273088 msgsize 328 00000100:00100000:0.0:1787397810.815234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397810.815263:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272192 00000100:00100000:0.0:1787397810.815273:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272192 00000020:00000040:0.0:1787397810.815277:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815282:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=25 00000100:00100000:0.0:1787397810.815329:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272320 00000100:00100000:0.0:1787397810.815332:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272320 00000020:00000040:0.0:1787397810.815334:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815336:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=26 00000100:00100000:0.0:1787397810.815350:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272448 00000100:00100000:0.0:1787397810.815352:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272448 00000020:00000040:0.0:1787397810.815354:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815355:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=27 00000100:00100000:0.0:1787397810.815373:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272576 00000100:00100000:0.0:1787397810.815377:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272576 00000020:00000040:0.0:1787397810.815378:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815380:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=28 00000100:00100000:0.0:1787397810.815395:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272704 00000100:00100000:0.0:1787397810.815398:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272704 00000020:00000040:0.0:1787397810.815400:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815402:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=29 00000100:00100000:0.0:1787397810.815414:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272832 00000100:00100000:0.0:1787397810.815417:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272832 00000020:00000040:0.0:1787397810.815419:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815420:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=30 00000100:00100000:0.0:1787397810.815436:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681272960 00000100:00100000:0.0:1787397810.815439:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681272960 00000020:00000040:0.0:1787397810.815440:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815442:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=31 00000100:00100000:0.0:1787397810.815458:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273088 00000100:00100000:0.0:1787397810.815461:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273088 00000020:00000040:0.0:1787397810.815462:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923aa 00000020:00000040:0.0:1787397810.815464:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7050a7000 refcount=32 00000100:00100000:0.0:1787397810.815484:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5060 00000100:00000040:0.0:1787397810.815487:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 1 00000100:00000040:0.0:1787397810.815495:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218a680 x1874218681272192/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815507:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272192:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815550:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218a680 x1874218681272192/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815560:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00010000:00080000:0.0:1787397810.815564:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218a680 x1874218681272192/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815579:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218a680 x1874218681272192/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815588:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272192:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 83us (548us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815595:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5060 00000100:00000040:0.0:1787397810.815598:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00000100:00100000:0.0:1787397810.815609:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5061 00000100:00000040:0.0:1787397810.815612:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 2 00000100:00000040:0.0:1787397810.815616:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218a300 x1874218681272320/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815627:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272320:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815633:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218a300 x1874218681272320/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815639:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 3 00010000:00080000:0.0:1787397810.815642:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218a300 x1874218681272320/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815651:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218a300 x1874218681272320/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815670:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272320:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 45us (578us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815676:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5061 00000100:00000040:0.0:1787397810.815678:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 2 00000100:00100000:0.0:1787397810.815687:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5062 00000100:00000040:0.0:1787397810.815689:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 3 00000100:00000040:0.0:1787397810.815693:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702189180 x1874218681272448/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815704:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272448:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815711:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702189180 x1874218681272448/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815718:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 4 00010000:00080000:0.0:1787397810.815722:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702189180 x1874218681272448/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815730:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189180 x1874218681272448/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815738:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272448:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 37us (626us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815743:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5062 00000100:00000040:0.0:1787397810.815745:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 3 00000100:00100000:0.0:1787397810.815751:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5063 00000100:00000040:0.0:1787397810.815753:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 4 00000100:00000040:0.0:1787397810.815757:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218b800 x1874218681272576/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815773:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272576:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815781:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218b800 x1874218681272576/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815788:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 5 00010000:00080000:0.0:1787397810.815791:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218b800 x1874218681272576/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815799:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b800 x1874218681272576/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815807:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272576:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 36us (661us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815813:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5063 00000100:00000040:0.0:1787397810.815815:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 4 00000100:00100000:0.0:1787397810.815823:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5064 00000100:00000040:0.0:1787397810.815826:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 5 00000100:00000040:0.0:1787397810.815830:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218ad80 x1874218681272704/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815840:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272704:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815846:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218ad80 x1874218681272704/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815852:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 6 00010000:00080000:0.0:1787397810.815870:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218ad80 x1874218681272704/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815888:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218ad80 x1874218681272704/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815895:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272704:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 57us (727us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815900:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5064 00000100:00000040:0.0:1787397810.815902:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 5 00000100:00100000:0.0:1787397810.815910:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5065 00000100:00000040:0.0:1787397810.815912:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 6 00000100:00000040:0.0:1787397810.815915:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218bb80 x1874218681272832/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815924:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272832:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.815930:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a70218bb80 x1874218681272832/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.815937:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 7 00010000:00080000:0.0:1787397810.815940:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218bb80 x1874218681272832/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.815949:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218bb80 x1874218681272832/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815957:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272832:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 33us (769us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.815962:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5065 00000100:00000040:0.0:1787397810.815965:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 6 00000100:00100000:0.0:1787397810.815978:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5066 00000100:00000040:0.0:1787397810.815981:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 7 00000100:00000040:0.0:1787397810.815985:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702188e00 x1874218681272960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.815996:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272960:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.816003:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702188e00 x1874218681272960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.816009:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 8 00010000:00080000:0.0:1787397810.816012:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702188e00 x1874218681272960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.816019:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702188e00 x1874218681272960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.816027:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681272960:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 34us (822us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.816032:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5066 00000100:00000040:0.0:1787397810.816034:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 7 00000100:00100000:0.0:1787397810.816041:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5067 00000100:00000040:0.0:1787397810.816043:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 8 00000100:00000040:0.0:1787397810.816047:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702189f80 x1874218681273088/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.816057:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681273088:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1787397810.816063:0:26164:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff89a702189f80 x1874218681273088/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1787397810.816080:0:26164:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff89a7050a7000 : new rpc_count 9 00010000:00080000:0.0:1787397810.816084:0:26164:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702189f80 x1874218681273088/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397810.816091:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702189f80 x1874218681273088/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397810.816099:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+32:2401:x1874218681273088:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 43us (868us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397810.816104:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5067 00000100:00000040:0.0:1787397810.816105:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7050a7000 : new rpc_count 8 00010000:00080000:0.0:1787397810.816165:0:96925:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:0.0:1787397810.816169:0:96925:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00010000:00000040:0.0:1787397810.816176:0:96925:0:(ldlm_lib.c:2868:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:0.0:1787397810.816179:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.816181:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.816187:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218a680 x1874218681272192/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.816196:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832227:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 7 00000020:00000040:0.0:1787397810.832252:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 31 00010000:00080000:0.0:1787397810.832257:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832259:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832273:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218a300 x1874218681272320/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832282:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832284:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 6 00000020:00000040:0.0:1787397810.832291:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 30 00010000:00080000:0.0:1787397810.832302:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832303:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832308:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702189180 x1874218681272448/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832315:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832317:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 5 00000020:00000040:0.0:1787397810.832322:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 29 00010000:00080000:0.0:1787397810.832324:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832325:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832330:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218b800 x1874218681272576/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832336:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832337:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 4 00000020:00000040:0.0:1787397810.832341:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 28 00010000:00080000:0.0:1787397810.832342:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832343:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832347:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218ad80 x1874218681272704/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832353:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832355:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 3 00000020:00000040:0.0:1787397810.832359:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 27 00010000:00080000:0.0:1787397810.832361:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832362:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832366:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218bb80 x1874218681272832/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832372:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832373:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 2 00000020:00000040:0.0:1787397810.832378:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 26 00010000:00080000:0.0:1787397810.832379:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832381:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832391:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702188e00 x1874218681272960/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832396:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832398:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 1 00000020:00000040:0.0:1787397810.832403:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 25 00010000:00080000:0.0:1787397810.832405:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397810.832406:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397810.832410:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702189f80 x1874218681273088/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:251/0 lens 328/0 e 0 to 0 dl 1787397821 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397810.832416:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1787397810.832418:0:96925:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff89a7050a7000 : new rpc_count 0 00000020:00000040:0.0:1787397810.832422:0:96925:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 24 00010000:00080000:0.0:1787397810.832424:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1787397811.044981:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1787397811.568420:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff89a7033a0000) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568431:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff89a7033a0000) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568434:0:97072:0:(obd_config.c:994:class_incref()) incref MDS (ffff89a70247cd40) now 4 - health_check_show 00000020:00000040:0.0:1787397811.568441:0:97072:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff89a70247cd40) now 4 - health_check_show 00000020:00000040:0.0:1787397811.568443:0:97072:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.160@tcp (ffff89a828c1b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568446:0:97072:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.160@tcp (ffff89a828c1b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568448:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff89a703c8cd40) now 12 - health_check_show 00000020:00000040:0.0:1787397811.568451:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff89a703c8cd40) now 12 - health_check_show 00000020:00000040:0.0:1787397811.568453:0:97072:0:(obd_config.c:994:class_incref()) incref MGS (ffff89a703f58000) now 8 - health_check_show 00000020:00000040:0.0:1787397811.568457:0:97072:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff89a703f58000) now 8 - health_check_show 00000020:00000040:0.0:1787397811.568459:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff89a835498000) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568461:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff89a835498000) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568464:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 12 - health_check_show 00000020:00000040:0.0:1787397811.568466:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 12 - health_check_show 00000020:00000040:0.0:1787397811.568468:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff89a8354999c0) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568471:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff89a8354999c0) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568478:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff89a82e4fb380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568481:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff89a82e4fb380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568483:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff89a7024799c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568485:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff89a7024799c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568487:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff89a7069219c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568489:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff89a7069219c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568491:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff89a703f5cd40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568494:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff89a703f5cd40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568496:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff89a703c899c0) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568497:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff89a703c899c0) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568499:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 16 - health_check_show 00000020:00000040:0.0:1787397811.568501:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 16 - health_check_show 00000020:00000040:0.0:1787397811.568503:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff89a703c8b380) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568505:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff89a703c8b380) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568507:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff89a83b9d3380) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568510:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff89a83b9d3380) now 5 - health_check_show 00000020:00000040:0.0:1787397811.568512:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff89a838780000) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568514:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff89a838780000) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568516:0:97072:0:(obd_config.c:994:class_incref()) incref OSS (ffff89a82e4fcd40) now 4 - health_check_show 00000020:00000040:0.0:1787397811.568726:0:97072:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff89a82e4fcd40) now 4 - health_check_show 00000020:00000040:0.0:1787397811.568730:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff89a83b9d19c0) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568795:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff89a83b9d19c0) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568798:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568800:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff89a70207cd40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568802:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568804:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff89a83b9d4d40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568806:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff89a703f5b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568812:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff89a703f5b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568814:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff89a702478000) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568816:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff89a702478000) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568819:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff89a70207b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568822:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff89a70207b380) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568824:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568854:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - health_check_show 00000020:00000040:0.0:1787397811.568857:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff89a7033a4d40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568859:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff89a7033a4d40) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568861:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff89a7033a19c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568863:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff89a7033a19c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568865:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff89a703f599c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568867:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff89a703f599c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568869:0:97072:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff89a7020799c0) now 6 - health_check_show 00000020:00000040:0.0:1787397811.568871:0:97072:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff89a7020799c0) now 6 - health_check_show 00010000:00010000:2.0:1787397812.070330:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1787397812.718740:0:75623:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1787397812.718779:0:75623:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006bd7ce7c] to pc [ptlrpcd_00_02+2] req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397812.718815:0:94346:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1787397812.718839:0:94346:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b184e971] to pc [ptlrpcd_00_03+3] req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.718860:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.718873:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701149312:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1787397812.718905:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.718914:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397812.718965:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af15180 x1874218701149312 msgsize 224 00000100:00100000:1.0:1787397812.718971:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397812.718992:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.719005:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1699863 usecs (1700 jiffies) 00000100:00100000:1.0:1787397812.719021:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1787397812.719034:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719043:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701149440:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1787397812.719056:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.719064:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397812.719078:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af17800 x1874218701149440 msgsize 224 00000100:00100000:1.0:1787397812.719082:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397812.719097:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.719105:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4015 usecs (5 jiffies) 00000100:00100000:1.0:1787397812.719130:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149312 00000100:00100000:1.0:1787397812.719139:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149312 00000020:00000040:1.0:1787397812.719141:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:1.0:1787397812.719146:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00000040:1.0:1787397812.719167:0:23942:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1787397812.719189:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149440 00000100:00100000:1.0:1787397812.719192:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149440 00000020:00000040:1.0:1787397812.719193:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:1.0:1787397812.719195:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00100000:1.0:1787397812.719210:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00000040:1.0:1787397812.719214:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:1.0:1787397812.719219:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af15180 x1874218701149312/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719229:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701149312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397812.719263:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00010000:00000040:1.0:1787397812.719277:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701149312 00000100:00000040:1.0:1787397812.719289:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:1.0:1787397812.719294:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397812.719317:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.719336:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:1.0:1787397812.719341:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af15180 x1874218701149312/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:253/0 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719349:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701149312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397812.719356:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00000040:1.0:1787397812.719360:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:1.0:1787397812.719371:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00100000:1.0:1787397812.719379:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00000040:1.0:1787397812.719382:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:1.0:1787397812.719386:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af17800 x1874218701149440/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719396:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701149440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397812.719413:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00010000:00000040:1.0:1787397812.719421:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701149440 00000100:00000040:1.0:1787397812.719426:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:1.0:1787397812.719429:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397812.719678:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397812.719701:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:1.0:1787397812.719705:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af17800 x1874218701149440/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:253/0 lens 224/368 e 0 to 0 dl 1787397823 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719714:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701149440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 319us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397812.719720:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00000040:1.0:1787397812.719727:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:1.0:1787397812.719734:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00000040:1.0:1787397812.719781:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1787397812.719787:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1787397812.719798:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352910 avail=317207 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:1.0:1787397812.719805:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719813:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701149440:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1787397812.719832:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1787397812.719836:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1787397812.719843:0:3650:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352803 avail=317100 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023572 state=0: rc = 0 00000100:00000040:1.0:1787397812.719849:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397812.719856:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701149312:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1787397812.719861:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af14380 x1874218701149440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397812.719871:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1787397812.719879:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83af16d80 x1874218701149312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1787397828 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397812.719885:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1787397812.997630:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278ff850 x1874218681273216 msgsize 224 00000100:00100000:3.0:1787397812.997652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:3.0:1787397812.997655:0:3641:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1787397812.997712:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a835b6d880 x1874218681273472 msgsize 224 00000100:00100000:3.0:1787397812.997717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:3.0:1787397812.997748:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a80763aa00 x1874218681273344 msgsize 224 00000100:00100000:3.0:1787397812.997753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00000040:3.0:1787397812.997775:0:3641:0:(events.c:337:request_in_callback()) incoming req@ffff89a8179a2300 x1874218681273600 msgsize 224 00000100:00100000:3.0:1787397812.997780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397812.997824:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273472 00000100:00100000:3.0:1787397812.997834:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273472 00000020:00000040:3.0:1787397812.997838:0:66176:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d190a43 00000020:00000040:3.0:1787397812.997843:0:66176:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1c800 refcount=11 00000020:00000040:3.0:1787397812.997856:0:66176:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 12 - evictor 00000100:00000040:3.0:1787397812.997883:0:66176:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1787397812.997936:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273344 00000100:00100000:3.0:1787397812.997940:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273344 00000020:00000040:3.0:1787397812.997942:0:66176:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19144c 00000020:00000040:3.0:1787397812.997944:0:66176:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b19800 refcount=51 00000020:00000040:3.0:1787397812.997952:0:66176:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 16 - evictor 00000100:00100000:3.0:1787397812.997977:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1454 00000100:00000040:3.0:1787397812.997981:0:66176:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1c800 : new rpc_count 1 00000100:00000040:3.0:1787397812.997989:0:66176:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a835b6d880 x1874218681273472/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998002:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681273472:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:3.0:1787397812.998028:0:66176:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 81604378767, transno 0, xid 1874218681273472 00000100:00000040:3.0:1787397812.998039:0:66176:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998045:0:66176:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998090:0:66176:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998096:0:66176:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a835b6d880 x1874218681273472/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998105:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681273472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 106us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397812.998113:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1454 00000100:00000040:3.0:1787397812.998116:0:66176:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1c800 : new rpc_count 0 00000020:00000040:3.0:1787397812.998128:0:66176:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1c800 : new refcount 10 00000100:00100000:3.0:1787397812.998138:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1455 00000100:00000040:3.0:1787397812.998140:0:66176:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b19800 : new rpc_count 1 00000100:00000040:3.0:1787397812.998145:0:66176:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a80763aa00 x1874218681273344/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998156:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681273344:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:3.0:1787397812.998177:0:66176:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084439, transno 0, xid 1874218681273344 00000100:00000040:3.0:1787397812.998182:0:66176:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998186:0:66176:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998201:0:66176:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998205:0:66176:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a80763aa00 x1874218681273344/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998212:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80763aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681273344:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 59us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397812.998218:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1455 00000100:00000040:3.0:1787397812.998220:0:66176:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b19800 : new rpc_count 0 00000020:00000040:3.0:1787397812.998226:0:66176:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b19800 : new refcount 50 00000100:00100000:3.0:1787397812.998247:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273600 00000100:00100000:3.0:1787397812.998251:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273600 00000020:00000040:3.0:1787397812.998252:0:26161:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1917e1 00000020:00000040:3.0:1787397812.998255:0:26161:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803902000 refcount=7 00000020:00000040:3.0:1787397812.998263:0:26161:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00100000:3.0:1787397812.998286:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2675 00000100:00000040:3.0:1787397812.998289:0:26161:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803902000 : new rpc_count 1 00000100:00000040:3.0:1787397812.998292:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8179a2300 x1874218681273600/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998303:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681273600:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:3.0:1787397812.998313:0:26161:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681273600 00000100:00000040:3.0:1787397812.998317:0:26161:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998320:0:26161:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998333:0:26161:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:3.0:1787397812.998338:0:26161:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8179a2300 x1874218681273600/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:253/0 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397812.998358:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681273600:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 56us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397812.998364:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2675 00000100:00000040:3.0:1787397812.998366:0:26161:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803902000 : new rpc_count 0 00000020:00000040:3.0:1787397812.998372:0:26161:0:(genops.c:900:class_export_put()) PUTting export ffff89a803902000 : new refcount 6 00000100:00080000:3.0:1787397812.998386:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1787397812.998389:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00080000:3.0:1787397812.998393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1787397812.998395:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 16 - evictor 00000100:00080000:3.0:1787397812.998397:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1787397812.998399:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 12 - evictor 00000100:00100000:0.0:1787397812.998653:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273216 00000100:00100000:0.0:1787397812.998659:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273216 00000020:00000040:0.0:1787397812.998661:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913c0 00000020:00000040:0.0:1787397812.998664:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670f000 refcount=10 00000100:00000040:0.0:1787397812.998689:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1787397812.998709:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00000040:0.0:1787397812.998712:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670f000 : new rpc_count 1 00000100:00000040:0.0:1787397812.998717:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278ff850 x1874218681273216/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:253/0 lens 224/0 e 0 to 0 dl 1787397823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397812.998728:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681273216:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000040:0.0:1787397812.998738:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218681273216 00000100:00000040:0.0:1787397812.998742:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a7035b44c0 refcount 11 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397812.998753:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.60@tcp 00000100:00000040:0.0:1787397812.998773:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a7035b44c0 refcount 10 to 192.168.204.60@tcp 00000100:00000040:0.0:1787397812.998779:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278ff850 x1874218681273216/t0(0) o400->e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp:253/0 lens 224/224 e 0 to 0 dl 1787397823 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397812.998787:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681273216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 61us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397812.998794:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 217 00000100:00000040:0.0:1787397812.998796:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670f000 : new rpc_count 0 00000020:00000040:0.0:1787397812.998803:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670f000 : new refcount 9 00010000:00010000:2.0:1787397813.092824:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1787397813.221173:0:94350:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397813.221218:0:94350:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000206e88de] to pc [ptlrpcd_00_00+0] req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397813.221339:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1787397813.221358:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397813.221407:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701149568:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1787397813.221445:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1787397813.221453:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1787397813.221507:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a83af16d80 x1874218701149568 msgsize 224 00000100:00100000:1.0:1787397813.221512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1787397813.221562:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.221571:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149568 00000100:00000040:1.0:1787397813.221575:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6312 usecs (7 jiffies) 00000100:00100000:0.0:1787397813.221579:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149568 00000020:00000040:0.0:1787397813.221582:0:19690:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:0.0:1787397813.221587:0:19690:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000020:00000040:0.0:1787397813.221600:0:19690:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:0.0:1787397813.221636:0:19690:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1787397813.221666:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00000040:0.0:1787397813.221671:0:19690:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397813.221677:0:19690:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a83af16d80 x1874218701149568/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:254/0 lens 224/0 e 0 to 0 dl 1787397824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.221691:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701149568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397813.221730:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:0.0:1787397813.221741:0:19690:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701149568 00000100:00000040:0.0:1787397813.221750:0:19690:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397813.221756:0:19690:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397813.221775:0:19690:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397813.221801:0:19690:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397813.221805:0:19690:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83af16d80 x1874218701149568/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:254/0 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.221825:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701149568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397813.221833:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00000040:0.0:1787397813.221836:0:19690:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:0.0:1787397813.221847:0:19690:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00080000:1.0:1787397813.221984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1787397813.221989:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:1.0:1787397813.222020:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:1.0:1787397813.222026:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1787397813.222038:0:3649:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1787397813.222042:0:3649:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1787397813.222049:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397813.222056:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701149568:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1787397813.222061:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70218b480 x1874218701149568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1787397813.222072:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:0.0:1787397813.225568:0:75627:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397813.225609:0:75627:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000206e88de] to pc [ptlrpcd_00_01+1] req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.225651:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1787397813.225668:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.225682:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701149696:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397813.225716:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397813.225724:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397813.225784:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a702100700 x1874218701149696 msgsize 224 00000100:00100000:0.0:1787397813.225790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397813.225823:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397813.225839:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5375 usecs (6 jiffies) 00000100:00100000:3.0:1787397813.227638:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149696 00000100:00100000:3.0:1787397813.227654:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149696 00000020:00000040:3.0:1787397813.227658:0:8438:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:3.0:1787397813.227664:0:8438:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000020:00000040:3.0:1787397813.227684:0:8438:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:3.0:1787397813.227720:0:8438:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1787397813.227755:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00000040:3.0:1787397813.227759:0:8438:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:3.0:1787397813.227767:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702100700 x1874218701149696/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:254/0 lens 224/0 e 0 to 0 dl 1787397824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397813.227781:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701149696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397813.227821:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:3.0:1787397813.227834:0:8438:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701149696 00000100:00000040:3.0:1787397813.227846:0:8438:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:3.0:1787397813.227853:0:8438:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397813.227904:0:8438:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397813.227962:0:8438:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:3.0:1787397813.227968:0:8438:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702100700 x1874218701149696/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:254/0 lens 224/368 e 0 to 0 dl 1787397824 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397813.227975:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701149696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397813.227982:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00000040:3.0:1787397813.227985:0:8438:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:3.0:1787397813.227998:0:8438:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00080000:1.0:1787397813.228088:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1787397813.228092:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:0.0:1787397813.228248:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:0.0:1787397813.228256:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1787397813.228278:0:3648:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1787397813.228282:0:3648:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1787397813.228291:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397813.228298:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701149696:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1787397813.228305:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70218b480 x1874218701149696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397829 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397813.228313:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1787397814.116692:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1787397814.244668:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244691:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:0.0:1787397814.244719:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 99b57a74-e5dc-42df-b087-b10fad741506->MGS req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244738:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fa6d2ff3] to pc [ptlrpcd_00_02+2] req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.244777:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244784:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1787397814.244803:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244813:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000046612b45] to pc [ptlrpcd_00_03+3] req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.244820:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244826:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bd800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1787397814.244834:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244855:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001230d515] to pc [ptlrpcd_00_00+0] req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.244874:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244880:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1787397814.244888:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244896:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007b93d0b5] to pc [ptlrpcd_00_01+1] req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397814.244905:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397814.244908:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1787397814.244911:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244916:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397814.244921:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244929:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004fe221be] to pc [ptlrpcd_00_02+2] req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.244935:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244939:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7054c2800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1787397814.244944:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244953:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000108e45f7] to pc [ptlrpcd_00_03+3] req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.244971:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.244975:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397814.244982:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.244992:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000286f15a1] to pc [ptlrpcd_00_00+0] req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397814.244999:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397814.245002:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1787397814.245004:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.245009:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397814.245014:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.245021:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000004a79d6c] to pc [ptlrpcd_00_01+1] req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245027:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.245031:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a828a58000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1787397814.245036:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.245044:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c2def6d7] to pc [ptlrpcd_00_02+2] req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245050:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.245054:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a8310a8800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1787397814.245067:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.245075:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000033f93e4b] to pc [ptlrpcd_00_03+3] req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245081:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1787397814.245085:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7054c4000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1787397814.245091:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1787397814.245098:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000005066b51] to pc [ptlrpcd_00_00+0] req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245107:0:65702:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 1 (3698) 00000100:00000040:0.0:1787397814.245128:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245139:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701149952:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245169:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245176:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245216:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a702102d80 x1874218701149952 msgsize 224 00000100:00100000:0.0:1787397814.245233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245271:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245286:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7977 usecs (8 jiffies) 00000100:00000040:0.0:1787397814.245295:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245303:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701150464:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245325:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245332:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245344:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a702103b80 x1874218701150464 msgsize 224 00000100:00100000:0.0:1787397814.245349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245362:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245369:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 80797 usecs (81 jiffies) 00000100:00000040:0.0:1787397814.245376:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245385:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701150976:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245397:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245415:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245427:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a702103480 x1874218701150976 msgsize 224 00000100:00100000:0.0:1787397814.245431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245441:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245448:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 8215 usecs (9 jiffies) 00000100:00100000:0.0:1787397814.245461:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00000040:0.0:1787397814.245466:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245474:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701149824:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245488:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245494:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245509:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fe050 x1874218701149824 msgsize 224 00000100:00100000:0.0:1787397814.245519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245542:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1787397814.245556:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245576:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245584:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701150336:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245598:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245604:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245618:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a702101880 x1874218701150336 msgsize 224 00000100:00100000:0.0:1787397814.245622:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245632:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245641:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5370 usecs (6 jiffies) 00000100:00000040:0.0:1787397814.245645:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245652:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701150848:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245664:0:3651:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245669:0:3651:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245679:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff89a702100a80 x1874218701150848 msgsize 224 00000100:00100000:0.0:1787397814.245683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245693:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245700:0:3651:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7327 usecs (8 jiffies) 00000100:00000040:0.0:1787397814.245719:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245734:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701150080:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245748:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245755:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245768:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a702100e00 x1874218701150080 msgsize 224 00000100:00100000:0.0:1787397814.245771:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245782:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245803:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7483 usecs (8 jiffies) 00000100:00000040:0.0:1787397814.245809:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245817:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701150592:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245829:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245835:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245851:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a70218b480 x1874218701150592 msgsize 224 00000100:00100000:0.0:1787397814.245854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245870:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245878:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3920 usecs (4 jiffies) 00000100:00000040:0.0:1787397814.245884:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245892:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701151104:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245903:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245920:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.245944:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a70ab2d880 x1874218701151104 msgsize 224 00000100:00100000:0.0:1787397814.245948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.245959:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.245968:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 28543 usecs (29 jiffies) 00000100:00100000:0.0:1787397814.245976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1787397814.245981:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.245988:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701150208:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.245999:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246006:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246018:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a70ab2ca80 x1874218701150208 msgsize 224 00000100:00100000:0.0:1787397814.246022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.246034:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246042:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1694700 usecs (1695 jiffies) 00000100:00000040:0.0:1787397814.246047:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246054:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701150720:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.246065:0:3648:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246072:0:3648:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246081:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff89a70ab2ce00 x1874218701150720 msgsize 224 00000100:00100000:0.0:1787397814.246085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1787397814.246096:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246111:0:3648:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6145 usecs (7 jiffies) 00000100:00100000:0.0:1787397814.246134:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149952 00000100:00100000:0.0:1787397814.246140:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149952 00000020:00000040:0.0:1787397814.246144:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915cd 00000020:00000040:0.0:1787397814.246147:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5c000 refcount=5 00000020:00000040:0.0:1787397814.246160:0:66177:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff89a703c88000) now 16 - evictor 00000100:00000040:0.0:1787397814.246181:0:66177:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1787397814.246197:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150464 00000100:00100000:0.0:1787397814.246200:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150464 00000020:00000040:0.0:1787397814.246202:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915d4 00000020:00000040:0.0:1787397814.246204:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5a000 refcount=5 00000100:00100000:0.0:1787397814.246215:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150976 00000100:00100000:0.0:1787397814.246218:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150976 00000020:00000040:0.0:1787397814.246219:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923db 00000020:00000040:0.0:1787397814.246221:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83fa42800 refcount=5 00000100:00100000:0.0:1787397814.246232:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150848 00000100:00100000:0.0:1787397814.246234:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150848 00000020:00000040:0.0:1787397814.246236:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915db 00000020:00000040:0.0:1787397814.246238:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835592000 refcount=5 00000100:00100000:0.0:1787397814.246247:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150080 00000100:00100000:0.0:1787397814.246250:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150080 00000020:00000040:0.0:1787397814.246251:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b364 00000020:00000040:0.0:1787397814.246254:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803e98000 refcount=5 00000020:00000040:0.0:1787397814.246259:0:66177:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff89a83549b380) now 12 - evictor 00000100:00100000:0.0:1787397814.246267:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151104 00000100:00100000:0.0:1787397814.246269:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151104 00000020:00000040:0.0:1787397814.246271:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923f0 00000020:00000040:0.0:1787397814.246273:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024bd800 refcount=5 00000100:00100000:0.0:1787397814.246289:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00000040:0.0:1787397814.246292:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5c000 : new rpc_count 1 00000100:00000040:0.0:1787397814.246297:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702102d80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246319:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701149952:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246342:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701149952 00000100:00000040:0.0:1787397814.246351:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246355:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246371:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246388:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246393:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702102d80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246401:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701149952:12345-0@lo:400:kworker.0 Request processed in 84us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246407:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00000040:0.0:1787397814.246410:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5c000 : new rpc_count 0 00000020:00000040:0.0:1787397814.246420:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5c000 : new refcount 4 00000100:00100000:0.0:1787397814.246428:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00000040:0.0:1787397814.246431:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5a000 : new rpc_count 1 00000100:00000040:0.0:1787397814.246435:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702103b80 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246444:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701150464:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246452:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701150464 00000100:00000040:0.0:1787397814.246457:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246460:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246474:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246489:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246499:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702103b80 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246507:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701150464:12345-0@lo:400:kworker.0 Request processed in 65us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246512:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00000040:0.0:1787397814.246514:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5a000 : new rpc_count 0 00000020:00000040:0.0:1787397814.246543:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5a000 : new refcount 4 00000100:00100000:0.0:1787397814.246554:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00000040:0.0:1787397814.246556:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83fa42800 : new rpc_count 1 00000100:00000040:0.0:1787397814.246560:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702103480 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246570:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701150976:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246579:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701150976 00000100:00000040:0.0:1787397814.246584:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246587:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246601:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246612:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246616:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702103480 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246624:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701150976:12345-0@lo:400:kworker.0 Request processed in 56us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246629:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00000040:0.0:1787397814.246631:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83fa42800 : new rpc_count 0 00000020:00000040:0.0:1787397814.246638:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a83fa42800 : new refcount 4 00000100:00100000:0.0:1787397814.246646:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00000040:0.0:1787397814.246648:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835592000 : new rpc_count 1 00000100:00000040:0.0:1787397814.246658:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702100a80 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246668:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701150848:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246678:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701150848 00000100:00000040:0.0:1787397814.246682:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246685:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246700:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246712:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246716:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702100a80 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246722:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701150848:12345-0@lo:400:kworker.0 Request processed in 56us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246727:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00000040:0.0:1787397814.246729:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835592000 : new rpc_count 0 00000020:00000040:0.0:1787397814.246735:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a835592000 : new refcount 4 00000100:00100000:0.0:1787397814.246743:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00000040:0.0:1787397814.246746:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803e98000 : new rpc_count 1 00000100:00000040:0.0:1787397814.246749:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702100e00 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246758:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701150080:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246768:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701150080 00000100:00000040:0.0:1787397814.246772:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246775:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246801:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246833:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246838:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702100e00 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246846:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701150080:12345-0@lo:400:kworker.0 Request processed in 89us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246851:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00000040:0.0:1787397814.246853:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803e98000 : new rpc_count 0 00000020:00000040:0.0:1787397814.246859:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a803e98000 : new refcount 4 00000100:00100000:0.0:1787397814.246868:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00000040:0.0:1787397814.246870:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7024bd800 : new rpc_count 1 00000100:00000040:0.0:1787397814.246873:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70ab2d880 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246884:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701151104:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.246893:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701151104 00000100:00000040:0.0:1787397814.246898:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.246901:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.246914:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.246925:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.246929:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70ab2d880 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.246936:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701151104:12345-0@lo:400:kworker.0 Request processed in 55us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.246942:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00000040:0.0:1787397814.246944:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7024bd800 : new rpc_count 0 00000020:00000040:0.0:1787397814.246956:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024bd800 : new refcount 4 00000100:00100000:0.0:1787397814.246980:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150592 00000100:00100000:0.0:1787397814.246985:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150592 00000020:00000040:0.0:1787397814.246986:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:0.0:1787397814.246989:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00000040:0.0:1787397814.247000:0:23942:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1787397814.247018:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150208 00000100:00100000:0.0:1787397814.247021:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150208 00000020:00000040:0.0:1787397814.247022:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:0.0:1787397814.247024:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00100000:0.0:1787397814.247037:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00000040:0.0:1787397814.247039:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:0.0:1787397814.247044:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70218b480 x1874218701150592/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247055:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701150592:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.247067:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701150592 00000100:00000040:0.0:1787397814.247071:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.247074:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.247092:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.247104:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.247107:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70218b480 x1874218701150592/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247114:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701150592:12345-0@lo:400:kworker.0 Request processed in 61us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.247120:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00000040:0.0:1787397814.247123:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:0.0:1787397814.247128:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00100000:0.0:1787397814.247137:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00000040:0.0:1787397814.247146:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:0.0:1787397814.247151:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70ab2ca80 x1874218701150208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247160:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701150208:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.247172:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701150208 00000100:00000040:0.0:1787397814.247176:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.247179:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.247193:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.247205:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.247209:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70ab2ca80 x1874218701150208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247216:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701150208:12345-0@lo:400:kworker.0 Request processed in 58us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.247221:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00000040:0.0:1787397814.247223:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:0.0:1787397814.247228:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00100000:0.0:1787397814.247247:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150336 00000100:00100000:0.0:1787397814.247251:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150336 00000020:00000040:0.0:1787397814.247253:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:0.0:1787397814.247255:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000100:00100000:0.0:1787397814.247277:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701150720 00000100:00100000:0.0:1787397814.247280:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701150720 00000020:00000040:0.0:1787397814.247282:0:26164:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:0.0:1787397814.247284:0:26164:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00100000:0.0:1787397814.247300:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00000040:0.0:1787397814.247302:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:0.0:1787397814.247307:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702101880 x1874218701150336/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247327:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701150336:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.247338:0:26164:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701150336 00000100:00000040:0.0:1787397814.247343:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.247346:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1787397814.247363:0:26164:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.247378:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.247381:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702101880 x1874218701150336/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247388:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701150336:12345-0@lo:400:kworker.0 Request processed in 64us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.247394:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00000040:0.0:1787397814.247396:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:0.0:1787397814.247401:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00100000:0.0:1787397814.247409:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00000040:0.0:1787397814.247411:0:26164:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:0.0:1787397814.247414:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a70ab2ce00 x1874218701150720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.247424:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701150720:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1787397814.247431:0:26164:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701150720 00000100:00000040:0.0:1787397814.247436:0:26164:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:0.0:1787397814.247439:0:26164:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1787397814.247814:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701149824 00000100:00100000:3.0:1787397814.247819:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701149824 00000020:00000040:3.0:1787397814.247821:0:94340:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:3.0:1787397814.247824:0:94340:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:3.0:1787397814.247841:0:94340:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1787397814.247861:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1787397814.247863:0:94340:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:3.0:1787397814.247868:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fe050 x1874218701149824/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:255/0 lens 224/0 e 0 to 0 dl 1787397825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397814.247877:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701149824:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1787397814.247887:0:94340:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701149824 00000100:00000040:3.0:1787397814.247891:0:94340:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 67 to 0@lo 00000100:00000040:3.0:1787397814.247894:0:94340:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1787397814.247915:0:94340:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1787397814.247930:0:94340:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:3.0:1787397814.247934:0:94340:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fe050 x1874218701149824/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397814.247954:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701149824:12345-0@lo:400:kworker.0 Request processed in 77us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397814.247960:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1787397814.247962:0:94340:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:3.0:1787397814.247969:0:94340:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00000040:0.0:1787397814.249548:0:26164:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249574:0:26164:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:0.0:1787397814.249591:0:26164:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70ab2ce00 x1874218701150720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:255/0 lens 224/224 e 0 to 0 dl 1787397825 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249599:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701150720:12345-0@lo:400:kworker.0 Request processed in 2177us (3515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397814.249609:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00000040:0.0:1787397814.249611:0:26164:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:0.0:1787397814.249623:0:26164:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00080000:0.0:1787397814.249646:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1787397814.249666:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff89a83549b380) now 12 - evictor 00000100:00080000:0.0:1787397814.249670:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1787397814.249672:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff89a703c88000) now 16 - evictor 00000100:00000040:0.0:1787397814.249719:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1787397814.249726:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249735:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249743:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701150208:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.249754:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:0.0:1787397814.249758:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249764:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249769:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701150720:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.249781:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.249785:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249817:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249823:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701150080:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.249838:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.249841:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249848:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249855:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701150592:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.249866:0:3648:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.249870:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.249878:0:3648:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.249885:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701151104:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.249891:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702103100 x1874218701150208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.249901:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1787397814.249911:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702102680 x1874218701150720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.249918:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1787397814.249922:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702100000 x1874218701150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.249942:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7033bd800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1787397814.249948:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702102a00 x1874218701150592/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.249955:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1787397814.249959:0:3648:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702103800 x1874218701151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.249968:0:3648:0:(genops.c:1244:class_import_put()) import ffff89a7054c4000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1787397814.249995:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250003:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250009:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701149824:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250020:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:0.0:1787397814.250024:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250031:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250037:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701150336:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250048:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.250052:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250060:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250066:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701150848:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250086:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.250091:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250099:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250105:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701149952:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250116:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.250120:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250129:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250135:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701150464:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250145:0:3651:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1787397814.250149:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1787397814.250156:0:3651:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397814.250163:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701150976:0@lo:400:kworker.0 00000100:00000040:0.0:1787397814.250168:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702101c00 x1874218701149824/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.250176:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000100:00000040:0.0:1787397814.250183:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702100380 x1874218701150336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.250188:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1787397814.250202:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702102300 x1874218701150848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.250208:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a828a58000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1787397814.250211:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702101f80 x1874218701149952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.250217:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a7033bb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1787397814.250220:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702101500 x1874218701150464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.250240:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a7054c2800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1787397814.250245:0:3651:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702101180 x1874218701150976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397830 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1787397814.251357:0:3651:0:(genops.c:1244:class_import_put()) import ffff89a8310a8800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000001:00080000:0.0:1787397814.765578:0:96910:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968773 is committed 00000001:00000040:0.0:1787397814.765588:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 19 00000020:00000040:0.0:1787397814.765593:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 23 00000001:00000040:0.0:1787397814.765600:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 18 00000020:00000040:0.0:1787397814.765602:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 22 00000001:00000040:0.0:1787397814.765605:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 17 00000020:00000040:0.0:1787397814.765607:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 21 00000001:00000040:0.0:1787397814.765612:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 16 00000020:00000040:0.0:1787397814.765614:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 20 00000001:00000040:0.0:1787397814.765620:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 15 00000020:00000040:0.0:1787397814.765622:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 19 00000001:00000040:0.0:1787397814.765629:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 14 00000020:00000040:0.0:1787397814.765631:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 18 00000001:00000040:0.0:1787397814.765635:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 13 00000020:00000040:0.0:1787397814.765644:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 17 00000001:00000040:0.0:1787397814.765648:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 12 00000020:00000040:0.0:1787397814.765650:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 16 00000001:00000040:0.0:1787397814.765667:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 11 00000020:00000040:0.0:1787397814.765669:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 15 00000001:00000040:0.0:1787397814.765673:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 10 00000020:00000040:0.0:1787397814.765674:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 14 00000001:00000040:0.0:1787397814.765678:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 9 00000020:00000040:0.0:1787397814.765680:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 13 00000001:00000040:0.0:1787397814.765684:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 8 00000020:00000040:0.0:1787397814.765686:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 12 00000001:00000040:0.0:1787397814.765689:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 7 00000020:00000040:0.0:1787397814.765690:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 11 00000001:00000040:0.0:1787397814.765693:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 6 00000020:00000040:0.0:1787397814.765695:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 10 00000001:00000040:0.0:1787397814.765698:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 5 00000020:00000040:0.0:1787397814.765700:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 9 00000001:00000040:0.0:1787397814.765703:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 4 00000020:00000040:0.0:1787397814.765704:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 8 00000001:00000040:0.0:1787397814.765708:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 3 00000020:00000040:0.0:1787397814.765710:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 7 00000001:00000040:0.0:1787397814.765715:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 2 00000020:00000040:0.0:1787397814.765717:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 6 00000001:00000040:0.0:1787397814.765722:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 1 00000020:00000040:0.0:1787397814.765724:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 5 00000001:00000040:0.0:1787397814.765727:0:96910:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff89a7050a7000 : new cb_count 0 00000020:00000040:0.0:1787397814.765729:0:96910:0:(genops.c:900:class_export_put()) PUTting export ffff89a7050a7000 : new refcount 4 00010000:00010000:0.0:1787397815.141209:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1787397815.268645:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268666:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a8310ac800 refcount=4 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397815.268695:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 99b57a74-e5dc-42df-b087-b10fad741506->MGS req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268713:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a22c9b21] to pc [ptlrpcd_00_01+1] req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.268734:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268740:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bb800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1787397815.268750:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268758:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0d63325] to pc [ptlrpcd_00_02+2] req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.268789:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268795:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7033bd800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1787397815.268803:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268811:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d3fdc99] to pc [ptlrpcd_00_03+3] req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.268848:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268856:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a83563e800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1787397815.268865:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268875:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d61b6cb8] to pc [ptlrpcd_00_00+0] req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397815.268883:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397815.268887:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1787397815.268890:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268896:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a837bc5000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1787397815.268904:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268913:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ccc72383] to pc [ptlrpcd_00_01+1] req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.268919:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268924:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7054c2800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1787397815.268930:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268937:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b369f525] to pc [ptlrpcd_00_02+2] req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.268944:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268950:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a810dbd800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1787397815.268965:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.268973:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000338f92c6] to pc [ptlrpcd_00_03+3] req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397815.268980:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397815.268984:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1787397815.268986:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.268991:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a830a0f800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1787397815.268996:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.269004:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000360bf47d] to pc [ptlrpcd_00_00+0] req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269010:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.269014:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a828a58000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1787397815.269019:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.269026:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b28569f1] to pc [ptlrpcd_00_01+1] req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269033:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.269039:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a8310a8800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1787397815.269046:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.269053:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d51f90fb] to pc [ptlrpcd_00_02+2] req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269071:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1787397815.269088:0:65702:0:(genops.c:1231:class_import_get()) import ffff89a7054c4000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1787397815.269098:0:65702:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1787397815.269107:0:65702:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008d12e0fa] to pc [ptlrpcd_00_03+3] req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269118:0:65702:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3699) 00000100:00000040:2.0:1787397815.269156:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269169:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701151232:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269198:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269207:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269267:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a8278fd450 x1874218701151232 msgsize 224 00000100:00100000:2.0:1787397815.269272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269274:0:3649:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1787397815.269293:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269318:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269326:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701151744:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269340:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269345:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269360:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a702212300 x1874218701151744 msgsize 224 00000100:00100000:2.0:1787397815.269370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269619:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269631:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5372 usecs (6 jiffies) 00000100:00000040:2.0:1787397815.269637:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269644:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701152256:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269658:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269665:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269681:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a702211180 x1874218701152256 msgsize 224 00000100:00100000:2.0:1787397815.269684:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269698:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269706:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7258 usecs (8 jiffies) 00000100:00100000:2.0:1787397815.269720:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:2.0:1787397815.269724:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701151616:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269745:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269752:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269766:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a702213800 x1874218701151616 msgsize 224 00000100:00100000:2.0:1787397815.269779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269794:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269804:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1689583 usecs (1690 jiffies) 00000100:00000040:2.0:1787397815.269821:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269836:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701152128:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269849:0:3649:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269855:0:3649:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269867:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff89a702212d80 x1874218701152128 msgsize 224 00000100:00100000:2.0:1787397815.269871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269886:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269895:0:3649:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6137 usecs (7 jiffies) 00000100:00000040:2.0:1787397815.269918:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269927:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701151360:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.269941:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269947:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.269959:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702213b80 x1874218701151360 msgsize 224 00000100:00100000:2.0:1787397815.269963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.269976:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.269984:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7975 usecs (8 jiffies) 00000100:00000040:2.0:1787397815.269989:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.269997:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701151872:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.270010:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270031:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270044:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702213480 x1874218701151872 msgsize 224 00000100:00100000:2.0:1787397815.270047:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.270061:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270068:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 80426 usecs (81 jiffies) 00000100:00000040:2.0:1787397815.270074:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270082:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701152384:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.270097:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270102:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270112:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702211880 x1874218701152384 msgsize 224 00000100:00100000:2.0:1787397815.270116:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.270127:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270138:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 7270 usecs (8 jiffies) 00000100:00100000:2.0:1787397815.270147:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:2.0:1787397815.270152:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270159:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701151488:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.270171:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270177:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270188:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702210a80 x1874218701151488 msgsize 224 00000100:00100000:2.0:1787397815.270191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.270205:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270221:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7481 usecs (8 jiffies) 00000100:00000040:2.0:1787397815.270227:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270248:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701152000:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.270262:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270268:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270282:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702210e00 x1874218701152000 msgsize 224 00000100:00100000:2.0:1787397815.270286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.270299:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270307:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3988 usecs (4 jiffies) 00000100:00000040:2.0:1787397815.270317:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270324:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701152512:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.270338:0:3650:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270343:0:3650:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270354:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff89a702210700 x1874218701152512 msgsize 224 00000100:00100000:2.0:1787397815.270357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1787397815.270369:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270377:0:3650:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 17245 usecs (18 jiffies) 00000100:00100000:2.0:1787397815.270681:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151232 00000100:00100000:2.0:1787397815.270689:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151232 00000020:00000040:2.0:1787397815.270692:0:94333:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1913e3 00000020:00000040:2.0:1787397815.270703:0:94333:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83670d800 refcount=24 00000100:00000040:2.0:1787397815.270729:0:94333:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1787397815.270759:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00000040:2.0:1787397815.270764:0:94333:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83670d800 : new rpc_count 1 00000100:00000040:2.0:1787397815.270778:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a8278fd450 x1874218701151232/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270790:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701151232:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.270870:0:94333:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701151232 00000100:00000040:2.0:1787397815.270880:0:94333:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.270885:0:94333:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.270907:0:94333:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.270926:0:94333:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.270931:0:94333:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a8278fd450 x1874218701151232/t0(0) o400->99b57a74-e5dc-42df-b087-b10fad741506@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.270939:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701151232:12345-0@lo:400:kworker.0 Request processed in 152us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.270946:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00000040:2.0:1787397815.270949:0:94333:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83670d800 : new rpc_count 0 00000020:00000040:2.0:1787397815.270957:0:94333:0:(genops.c:900:class_export_put()) PUTting export ffff89a83670d800 : new refcount 23 00000100:00100000:2.0:1787397815.270986:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151744 00000100:00100000:2.0:1787397815.270990:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151744 00000020:00000040:2.0:1787397815.270992:0:8501:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b2f4 00000020:00000040:2.0:1787397815.270994:0:8501:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835666000 refcount=5 00000020:00000040:2.0:1787397815.271005:0:8501:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00100000:2.0:1787397815.271033:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152128 00000100:00100000:2.0:1787397815.271036:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152128 00000020:00000040:2.0:1787397815.271037:0:8501:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1914b5 00000020:00000040:2.0:1787397815.271039:0:8501:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83ae97000 refcount=5 00000100:00100000:2.0:1787397815.271072:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00000040:2.0:1787397815.271075:0:8501:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835666000 : new rpc_count 1 00000100:00000040:2.0:1787397815.271079:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702212300 x1874218701151744/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.271088:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701151744:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.271101:0:8501:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968717, transno 0, xid 1874218701151744 00000100:00000040:2.0:1787397815.271106:0:8501:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.271109:0:8501:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.271127:0:8501:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.271139:0:8501:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.271144:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702212300 x1874218701151744/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.271150:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701151744:12345-0@lo:400:kworker.0 Request processed in 64us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.271157:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00000040:2.0:1787397815.271159:0:8501:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835666000 : new rpc_count 0 00000020:00000040:2.0:1787397815.271164:0:8501:0:(genops.c:900:class_export_put()) PUTting export ffff89a835666000 : new refcount 4 00000100:00100000:2.0:1787397815.271172:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00000040:2.0:1787397815.271175:0:8501:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83ae97000 : new rpc_count 1 00000100:00000040:2.0:1787397815.271178:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702212d80 x1874218701152128/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.271188:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701152128:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.271197:0:8501:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294968731, transno 0, xid 1874218701152128 00000100:00000040:2.0:1787397815.271201:0:8501:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.271205:0:8501:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.271225:0:8501:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.271741:0:8501:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.271746:0:8501:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702212d80 x1874218701152128/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.271752:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701152128:12345-0@lo:400:kworker.0 Request processed in 567us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.271759:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00000040:2.0:1787397815.271761:0:8501:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83ae97000 : new rpc_count 0 00000020:00000040:2.0:1787397815.271777:0:8501:0:(genops.c:900:class_export_put()) PUTting export ffff89a83ae97000 : new refcount 4 00000100:00100000:2.0:1787397815.271797:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152256 00000100:00100000:2.0:1787397815.271801:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152256 00000020:00000040:2.0:1787397815.271803:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915db 00000020:00000040:2.0:1787397815.271807:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835592000 refcount=5 00000100:00000040:2.0:1787397815.273595:0:66177:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1787397815.273640:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151360 00000100:00100000:2.0:1787397815.273649:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151360 00000020:00000040:2.0:1787397815.273651:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915cd 00000020:00000040:2.0:1787397815.273656:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5c000 refcount=5 00000100:00100000:2.0:1787397815.273672:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151872 00000100:00100000:2.0:1787397815.273675:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151872 00000020:00000040:2.0:1787397815.273676:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1915d4 00000020:00000040:2.0:1787397815.273678:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a828a5a000 refcount=5 00000100:00100000:2.0:1787397815.273689:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152384 00000100:00100000:2.0:1787397815.273691:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152384 00000020:00000040:2.0:1787397815.273693:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923db 00000020:00000040:2.0:1787397815.273695:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a83fa42800 refcount=5 00000100:00100000:2.0:1787397815.273705:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151488 00000100:00100000:2.0:1787397815.273708:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151488 00000020:00000040:2.0:1787397815.273710:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d18b364 00000020:00000040:2.0:1787397815.273713:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a803e98000 refcount=5 00000100:00100000:2.0:1787397815.273724:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152512 00000100:00100000:2.0:1787397815.273739:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152512 00000020:00000040:2.0:1787397815.273741:0:66177:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d1923f0 00000020:00000040:2.0:1787397815.273743:0:66177:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a7024bd800 refcount=5 00000100:00100000:2.0:1787397815.273782:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00000040:2.0:1787397815.273790:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835592000 : new rpc_count 1 00000100:00000040:2.0:1787397815.273796:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702211180 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.273878:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701152256:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.273902:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701152256 00000100:00000040:2.0:1787397815.273912:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.273918:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.273962:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.273982:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.273987:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702211180 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.273994:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701152256:12345-0@lo:400:kworker.0 Request processed in 189us (4311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.274002:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00000040:2.0:1787397815.274005:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835592000 : new rpc_count 0 00000020:00000040:2.0:1787397815.274013:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a835592000 : new refcount 4 00000100:00100000:2.0:1787397815.274024:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00000040:2.0:1787397815.274026:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5c000 : new rpc_count 1 00000100:00000040:2.0:1787397815.274030:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702213b80 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.274040:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701151360:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.274054:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701151360 00000100:00000040:2.0:1787397815.274065:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.274069:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.274084:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.274114:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.274119:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702213b80 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.274127:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701151360:12345-0@lo:400:kworker.0 Request processed in 89us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.274134:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00000040:2.0:1787397815.274136:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5c000 : new rpc_count 0 00000020:00000040:2.0:1787397815.274142:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5c000 : new refcount 4 00000100:00100000:2.0:1787397815.276010:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00000040:2.0:1787397815.276018:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a828a5a000 : new rpc_count 1 00000100:00000040:2.0:1787397815.276027:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702213480 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276050:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701151872:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.276073:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701151872 00000100:00000040:2.0:1787397815.276081:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.276086:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.276127:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.276147:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.276151:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702213480 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276159:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701151872:12345-0@lo:400:kworker.0 Request processed in 121us (6113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.276179:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00000040:2.0:1787397815.276182:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a828a5a000 : new rpc_count 0 00000020:00000040:2.0:1787397815.276192:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a828a5a000 : new refcount 4 00000100:00100000:2.0:1787397815.276203:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00000040:2.0:1787397815.276206:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a83fa42800 : new rpc_count 1 00000100:00000040:2.0:1787397815.276209:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702211880 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276220:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701152384:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.276229:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701152384 00000100:00000040:2.0:1787397815.276321:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.276326:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.276343:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.276356:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.276360:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702211880 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276367:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701152384:12345-0@lo:400:kworker.0 Request processed in 150us (6254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.276373:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00000040:2.0:1787397815.276375:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a83fa42800 : new rpc_count 0 00000020:00000040:2.0:1787397815.276452:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a83fa42800 : new refcount 4 00000100:00100000:2.0:1787397815.276466:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00000040:2.0:1787397815.276469:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a803e98000 : new rpc_count 1 00000100:00000040:2.0:1787397815.276473:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702210a80 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276484:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701151488:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.276502:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701151488 00000100:00000040:2.0:1787397815.276508:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.276511:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.276560:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.276574:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.276578:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702210a80 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276585:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701151488:12345-0@lo:400:kworker.0 Request processed in 104us (6396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.276591:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00000040:2.0:1787397815.276593:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a803e98000 : new rpc_count 0 00000020:00000040:2.0:1787397815.276599:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a803e98000 : new refcount 4 00000100:00100000:2.0:1787397815.276608:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00000040:2.0:1787397815.276611:0:66177:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a7024bd800 : new rpc_count 1 00000100:00000040:2.0:1787397815.276615:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702210700 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276625:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701152512:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.276634:0:66177:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701152512 00000100:00000040:2.0:1787397815.276639:0:66177:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.276642:0:66177:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.276657:0:66177:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.276670:0:66177:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.276674:0:66177:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702210700 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.276694:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701152512:12345-0@lo:400:kworker.0 Request processed in 70us (6338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.276700:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00000040:2.0:1787397815.276702:0:66177:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a7024bd800 : new rpc_count 0 00000020:00000040:2.0:1787397815.276709:0:66177:0:(genops.c:900:class_export_put()) PUTting export ffff89a7024bd800 : new refcount 4 00000100:00100000:2.0:1787397815.276734:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701151616 00000100:00100000:2.0:1787397815.276741:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701151616 00000020:00000040:2.0:1787397815.276744:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d191445 00000020:00000040:2.0:1787397815.276748:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a829b1e800 refcount=7 00000100:00000040:2.0:1787397815.276762:0:23942:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1787397815.276797:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152000 00000100:00100000:2.0:1787397815.276801:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152000 00000020:00000040:2.0:1787397815.276803:0:23942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x274786fe0d19148b 00000020:00000040:2.0:1787397815.276805:0:23942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff89a835449000 refcount=5 00000100:00100000:2.0:1787397815.277333:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00000040:2.0:1787397815.277336:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a829b1e800 : new rpc_count 1 00000100:00000040:2.0:1787397815.277341:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702213800 x1874218701151616/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.277354:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701151616:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.277369:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1874218701151616 00000100:00000040:2.0:1787397815.277375:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.277379:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.277945:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.277965:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.277971:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702213800 x1874218701151616/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.277979:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701151616:12345-0@lo:400:kworker.0 Request processed in 628us (8211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.277996:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00000040:2.0:1787397815.277999:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a829b1e800 : new rpc_count 0 00000020:00000040:2.0:1787397815.278007:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a829b1e800 : new refcount 6 00000100:00100000:2.0:1787397815.278018:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00000040:2.0:1787397815.278021:0:23942:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff89a835449000 : new rpc_count 1 00000100:00000040:2.0:1787397815.278025:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff89a702210e00 x1874218701152000/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:256/0 lens 224/0 e 0 to 0 dl 1787397826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278035:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701152000:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1787397815.278047:0:23942:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1874218701152000 00000100:00000040:2.0:1787397815.278052:0:23942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff89a809245ac0 refcount 66 to 0@lo 00000100:00000040:2.0:1787397815.278055:0:23942:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1787397815.278071:0:23942:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278082:0:23942:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff89a809245ac0 refcount 65 to 0@lo 00000100:00000040:2.0:1787397815.278086:0:23942:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702210e00 x1874218701152000/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:256/0 lens 224/224 e 0 to 0 dl 1787397826 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278093:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701152000:12345-0@lo:400:kworker.0 Request processed in 60us (7809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397815.278098:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00000040:2.0:1787397815.278100:0:23942:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff89a835449000 : new rpc_count 0 00000020:00000040:2.0:1787397815.278105:0:23942:0:(genops.c:900:class_export_put()) PUTting export ffff89a835449000 : new refcount 4 00000100:00080000:2.0:1787397815.278160:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1787397815.278165:0:6518:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff89a702078000) now 10 - evictor 00000100:00000040:2.0:1787397815.278207:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278215:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278321:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278329:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701151488:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278344:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278347:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278354:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278360:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701152000:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278370:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278375:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278455:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278463:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701152512:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278477:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278481:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278488:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278494:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701151360:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278504:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278513:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278539:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278546:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701151872:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278561:0:3650:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.278565:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278572:0:3650:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278578:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701152384:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278586:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a82984aa00 x1874218701151488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278596:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7033bd800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1787397815.278605:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a83876e300 x1874218701152000/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278613:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a810dbd800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1787397815.278619:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a702212680 x1874218701152512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278625:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7054c4000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1787397815.278629:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829849180 x1874218701151360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278636:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7033bb800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1787397815.278641:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70691c000 x1874218701151872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278658:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a7054c2800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1787397815.278666:0:3650:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70a1a8700 x1874218701152384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.278671:0:3650:0:(genops.c:1244:class_import_put()) import ffff89a8310a8800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1787397815.278699:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1787397815.278704:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278712:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278717:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701151616:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278728:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968731 00000100:00000040:2.0:1787397815.278732:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278739:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278745:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701152128:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278757:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.278765:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.278781:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701151232:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.278794:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968717 00000100:00000040:2.0:1787397815.278799:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.279445:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.279460:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701151744:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.279479:0:3649:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1787397815.279483:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1787397815.279490:0:3649:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397815.279495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701152256:0@lo:400:kworker.0 00000100:00000040:2.0:1787397815.279501:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70691fb80 x1874218701151616/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.279511:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a83563e800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1787397815.279540:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a835b65f80 x1874218701152128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.279548:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a830a0f800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1787397815.279554:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a829848380 x1874218701151232/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.279560:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a8310ac800 refcount=3 obd=MGC192.168.204.160@tcp 00000100:00000040:2.0:1787397815.279565:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a70691ce00 x1874218701151744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.279572:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a837bc5000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1787397815.279576:0:3649:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff89a706f9c380 x1874218701152256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787397831 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1787397815.279582:0:3649:0:(genops.c:1244:class_import_put()) import ffff89a828a58000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000001:02000400:1.0:1787397815.872204:0:97266:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787397816.007887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397816.007935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397816.007969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397816.008002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397816.008032:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273728 00000100:00100000:3.0:1787397816.008042:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273728 00000100:00100000:3.0:1787397816.008090:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 220 00000100:00100000:3.0:1787397816.008099:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681273728:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397816.008167:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681273728:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397816.008176:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 220 00000100:00100000:2.0:1787397816.008443:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273856 00000100:00100000:2.0:1787397816.008448:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273856 00000100:00100000:2.0:1787397816.008501:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681273984 00000100:00100000:2.0:1787397816.008505:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681273984 00000100:00100000:2.0:1787397816.008630:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1468 00000100:00100000:2.0:1787397816.008643:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681273856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397816.008691:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681273856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397816.008698:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1468 00000100:00100000:2.0:1787397816.008714:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1469 00000100:00100000:2.0:1787397816.008722:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681273984:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397816.008751:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681273984:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397816.008772:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1469 00000100:00080000:3.0:1787397816.008974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397816.008979:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397816.009221:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274112 00000100:00100000:1.0:1787397816.009227:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274112 00000100:00100000:1.0:1787397816.009272:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2680 00000100:00100000:1.0:1787397816.009281:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681274112:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397816.009317:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681274112:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397816.009323:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2680 00000100:00080000:0.0:1787397816.009415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787397816.170485:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787397817.166100:0:97318:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397817.166448:0:97318:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397817.189893:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397817.829035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701152640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397817.829157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397817.829228:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397817.829236:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397817.829292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397817.829399:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152640 00000100:00100000:2.0:1787397817.829411:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152640 00000100:00100000:2.0:1787397817.829486:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152768 00000100:00100000:2.0:1787397817.829490:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152768 00000100:00100000:2.0:1787397817.829510:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1787397817.829552:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701152640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397817.829606:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397817.829682:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701152640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397817.829691:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1787397817.829712:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1787397817.829736:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701152768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397817.829758:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397817.829791:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701152768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397817.829798:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1787397817.829851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701152768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397817.829881:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701152640:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397818.214442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397818.340865:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397818.340903:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701152896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397818.341008:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397818.341448:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701152896 00000100:00100000:0.0:1787397818.341460:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701152896 00000100:00100000:0.0:1787397818.341553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1787397818.341568:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701152896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397818.341624:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397818.341821:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397818.341833:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701153024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397818.341870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397818.341981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397818.346258:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701152896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397818.346281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1787397818.346346:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153024 00000100:00100000:0.0:1787397818.346360:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153024 00000100:00100000:0.0:1787397818.346444:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1787397818.346454:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701153024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397818.346491:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397818.346633:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701153024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (4762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397818.346640:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00080000:0.0:1787397818.346681:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397818.346892:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701153024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397818.346952:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701152896:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1787397818.421584:0:97368:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397818.421944:0:97368:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787397819.239343:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397820.261498:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397820.395601:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397820.395608:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1787397820.395626:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397820.395638:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1787397820.395706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701153280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.395781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.395813:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701153792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396220:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396238:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701154304:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396409:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787397820.396416:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701153152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396480:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701153664:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701154176:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396611:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701153408:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396634:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396652:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701153920:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396686:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396706:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701154432:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396754:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397820.396759:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701153536:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396793:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701154048:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.396824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397820.396862:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153280 00000100:00100000:0.0:1787397820.396871:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153280 00000100:00100000:0.0:1787397820.396917:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153792 00000100:00100000:0.0:1787397820.396921:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153792 00000100:00100000:0.0:1787397820.396934:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154304 00000100:00100000:0.0:1787397820.396936:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154304 00000100:00100000:0.0:1787397820.396949:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154176 00000100:00100000:0.0:1787397820.396952:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154176 00000100:00100000:0.0:1787397820.396961:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153408 00000100:00100000:0.0:1787397820.396963:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153408 00000100:00100000:0.0:1787397820.396977:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154432 00000100:00100000:0.0:1787397820.396980:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154432 00000100:00100000:0.0:1787397820.396995:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1787397820.397003:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701153280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397172:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1787397820.397183:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701153792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397227:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701153792:12345-0@lo:400:kworker.0 Request processed in 47us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.397234:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1787397820.397256:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1787397820.397263:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701154304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397507:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701154304:12345-0@lo:400:kworker.0 Request processed in 245us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.397514:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1787397820.397548:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1787397820.397556:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701154176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397586:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701154176:12345-0@lo:400:kworker.0 Request processed in 32us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.397591:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1787397820.397614:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1787397820.397620:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701153408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397659:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701153408:12345-0@lo:400:kworker.0 Request processed in 39us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.397681:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1787397820.397696:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1787397820.397703:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701154432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397733:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701154432:12345-0@lo:400:kworker.0 Request processed in 31us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.397739:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1787397820.397873:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701153408:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397884:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701154432:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397914:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701154176:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397923:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701153792:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.397933:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701154304:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.398027:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701153280:12345-0@lo:400:kworker.0 Request processed in 1024us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397820.398239:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701153280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397820.398274:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1787397820.398910:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153920 00000100:00100000:1.0:1787397820.398918:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153920 00000100:00100000:1.0:1787397820.398959:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153536 00000100:00100000:1.0:1787397820.398962:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153536 00000100:00100000:1.0:1787397820.398977:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1787397820.398985:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701153920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397820.399050:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701153920:12345-0@lo:400:kworker.0 Request processed in 66us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397820.399057:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1787397820.399073:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:1.0:1787397820.399079:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701153536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397820.399107:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701153536:12345-0@lo:400:kworker.0 Request processed in 28us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397820.399112:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:1.0:1787397820.399138:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153664 00000100:00100000:1.0:1787397820.399153:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153664 00000100:00100000:1.0:1787397820.399192:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154048 00000100:00100000:1.0:1787397820.399196:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154048 00000100:00100000:1.0:1787397820.399216:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1787397820.399221:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701153664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397820.399259:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701153664:12345-0@lo:400:kworker.0 Request processed in 35us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397820.399266:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1787397820.399276:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1787397820.399281:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701154048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397820.399308:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701154048:12345-0@lo:400:kworker.0 Request processed in 27us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397820.399314:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1787397820.399572:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701153152 00000100:00100000:1.0:1787397820.399577:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701153152 00000100:00100000:1.0:1787397820.399604:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787397820.399609:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701153152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397820.399644:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701153152:12345-0@lo:400:kworker.0 Request processed in 34us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397820.399649:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787397820.400151:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701153536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.400167:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701154048:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.400178:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701153920:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.400215:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701153152:0@lo:400:kworker.0 00000100:00100000:2.0:1787397820.400227:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701153664:0@lo:400:kworker.0 00000100:00080000:0.0:1787397820.400387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397820.400393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397820.400396:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397821.190859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397821.190907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397821.190941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397821.190972:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397821.191011:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274496 00000100:00100000:3.0:1787397821.191023:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274496 00000100:00100000:3.0:1787397821.191082:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274368 00000100:00100000:3.0:1787397821.191084:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274368 00000100:00100000:3.0:1787397821.191109:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1476 00000100:00100000:3.0:1787397821.191118:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681274496:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397821.191193:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681274496:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397821.191201:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1476 00000100:00100000:3.0:1787397821.191219:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1477 00000100:00100000:3.0:1787397821.191226:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681274368:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397821.191260:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681274368:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397821.191366:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274240 00000100:00100000:0.0:1787397821.191371:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274240 00000100:00100000:0.0:1787397821.191404:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00100000:0.0:1787397821.191412:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681274240:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397821.191441:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681274240:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397821.191447:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 222 00000100:00080000:0.0:1787397821.191474:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397821.191484:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397821.191668:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1477 00000100:00100000:3.0:1787397821.191690:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274624 00000100:00100000:3.0:1787397821.191693:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274624 00000100:00100000:3.0:1787397821.191733:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2683 00000100:00100000:3.0:1787397821.191739:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681274624:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397821.191769:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681274624:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397821.191776:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2683 00000100:00080000:0.0:1787397821.192036:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787397821.287539:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397822.314656:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397822.950492:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701154688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397822.950667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397822.950752:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154688 00000100:00100000:1.0:1787397822.950765:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154688 00000100:00100000:0.0:1787397822.950824:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397822.950858:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1787397822.950866:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397822.950873:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701154688:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397822.950909:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154560 00000100:00100000:0.0:1787397822.950914:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154560 00000004:00000024:1.0:1787397822.950942:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397822.950943:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1787397822.950952:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701154560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397822.950977:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397822.951197:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701154688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 327us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397822.951208:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1787397822.951209:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701154560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397822.951220:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:2.0:1787397822.951248:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397822.951251:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701154688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397823.334280:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397823.461955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397823.461989:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701154816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397823.463156:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701154944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397823.464044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397823.464156:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154944 00000100:00100000:0.0:1787397823.464168:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154944 00000100:00100000:0.0:1787397823.464272:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1787397823.464285:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701154944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397823.464330:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397823.464393:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701154944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397823.464401:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00080000:2.0:1787397823.464484:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397823.464585:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701154944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397823.464889:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397823.465263:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701154816 00000100:00100000:0.0:1787397823.465270:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701154816 00000100:00100000:0.0:1787397823.465414:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1787397823.465425:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701154816:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787397823.465443:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787397823.465451:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397823.465515:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701154816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397823.465558:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1787397823.465650:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701154816:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787397824.359641:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397824.618844:0:97561:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00010000:00010000:1.0:1787397825.380723:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397825.508851:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397825.508859:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1787397825.508876:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397825.508880:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1787397825.508922:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701155200:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.508992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701155712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509061:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701156224:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397825.509107:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701155328:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509142:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701155840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509183:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701156352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397825.509244:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155200 00000100:00100000:0.0:1787397825.509251:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155200 00000100:00100000:0.0:1787397825.509309:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155712 00000100:00100000:0.0:1787397825.509313:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155712 00000100:00100000:0.0:1787397825.509326:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156224 00000100:00100000:0.0:1787397825.509334:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156224 00000100:00100000:0.0:1787397825.509350:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155328 00000100:00100000:0.0:1787397825.509352:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155328 00000100:00100000:0.0:1787397825.509365:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156352 00000100:00100000:0.0:1787397825.509367:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156352 00000100:00100000:0.0:1787397825.509382:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1787397825.509390:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701155200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509448:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701155200:12345-0@lo:400:kworker.0 Request processed in 58us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509456:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1787397825.509475:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1787397825.509480:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701155712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509505:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701155712:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509511:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1787397825.509549:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1787397825.509556:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701156224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509593:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701156224:12345-0@lo:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509600:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1787397825.509611:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1787397825.509616:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701155328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509639:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701155328:12345-0@lo:400:kworker.0 Request processed in 23us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509645:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1787397825.509656:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1787397825.509662:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701156352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509695:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701156352:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509701:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1787397825.509730:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155840 00000100:00100000:0.0:1787397825.509733:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155840 00000100:00100000:0.0:1787397825.509757:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:0.0:1787397825.509762:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701155840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509793:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701155840:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.509799:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00080000:0.0:1787397825.509817:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397825.509821:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397825.509851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701155328:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509862:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701155840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509871:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701156352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509880:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701155200:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701155712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.509897:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701156224:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.509991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701155072:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510028:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397825.510063:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701155584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510088:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397825.510106:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701156096:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397825.510142:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787397825.510148:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701155456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397825.510186:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701155968:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397825.510248:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155456 00000100:00100000:1.0:1787397825.510253:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155456 00000100:00100000:1.0:1787397825.510277:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:1.0:1787397825.510283:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701155456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510318:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701155456:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397825.510330:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:1.0:1787397825.510352:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155584 00000100:00100000:1.0:1787397825.510356:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155584 00000100:00100000:1.0:1787397825.510387:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155968 00000100:00100000:1.0:1787397825.510390:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155968 00000100:00100000:1.0:1787397825.510407:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1787397825.510412:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701155584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510443:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701155584:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397825.510449:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1787397825.510459:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1787397825.510465:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701155968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510491:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701155968:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397825.510497:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00080000:1.0:1787397825.510541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397825.510564:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701155456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510589:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701155968:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510598:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701155584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510617:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156096 00000100:00100000:1.0:1787397825.510620:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156096 00000100:00100000:1.0:1787397825.510639:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1787397825.510645:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397825.510678:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701156096:12345-0@lo:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397825.510692:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1787397825.510716:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701156096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.514999:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701155072 00000100:00100000:0.0:1787397825.515016:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701155072 00000100:00100000:0.0:1787397825.515096:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787397825.515106:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701155072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397825.515227:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701155072:12345-0@lo:400:kworker.0 Request processed in 121us (5196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397825.515250:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787397825.515327:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701155072:0@lo:400:kworker.0 00000001:02000400:2.0:1787397826.029296:0:97609:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00000100:00100000:3.0:1787397826.311895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.311944:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.311985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.312009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397826.312047:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275008 00000100:00100000:0.0:1787397826.312058:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275008 00000100:00100000:2.0:1787397826.312075:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275264 00000100:00100000:2.0:1787397826.312081:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275264 00000100:00100000:0.0:1787397826.312131:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275136 00000100:00100000:0.0:1787397826.312135:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275136 00000100:00100000:2.0:1787397826.312138:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2686 00000100:00100000:2.0:1787397826.312166:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681275264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397826.312167:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1484 00000100:00100000:0.0:1787397826.312191:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681275008:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397826.312259:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681275264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397826.312267:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2686 00000100:00080000:3.0:1787397826.312388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397826.312392:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397826.312394:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397826.314781:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681275008:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2582us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397826.314796:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1484 00000100:00100000:0.0:1787397826.315337:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1485 00000100:00100000:0.0:1787397826.315353:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681275136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397826.315480:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681275136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 132us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397826.315487:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1485 00000100:00100000:0.0:1787397826.315516:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274880 00000100:00100000:0.0:1787397826.315691:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274880 00000100:00100000:0.0:1787397826.315736:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:0.0:1787397826.315743:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681274880:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397826.315773:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681274880:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397826.315779:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 224 00000100:00100000:1.0:1787397826.356373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397826.356448:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681274752 00000100:00100000:0.0:1787397826.356469:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681274752 00000100:00100000:0.0:1787397826.356563:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2687 00000100:00100000:0.0:1787397826.356574:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681274752:12345-192.168.204.60@tcp:8:ptlrpcd_rcv.0 00010000:02000400:0.0:1787397826.356611:0:8501:0:(ldlm_lib.c:963:target_handle_reconnect()) lustre-OST0000: Client 784819ec-79bc-4534-8fa6-902d7a92d2f8 (at 192.168.204.60@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:0.0:1787397826.364087:0:8501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t4294968754 exp ffff89a7050a7000 cur 3705 last 1787397826 00002000:00100000:0.0:1787397826.364109:0:8501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a7050a7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397826.364132:0:8501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.204.60@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1787397826.364160:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1787397826.364169:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397826.364246:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681274752:12345-192.168.204.60@tcp:8:ptlrpcd_rcv.0 Request processed in 7673us (7881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397826.364257:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2687 00000100:00100000:3.0:1787397826.369391:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.369430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.369460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.369493:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.369511:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.369592:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397826.369728:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275392 00000100:00100000:1.0:1787397826.369739:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275392 00000100:00100000:1.0:1787397826.369783:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275520 00000100:00100000:1.0:1787397826.369785:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275520 00000100:00100000:1.0:1787397826.369798:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275648 00000100:00100000:1.0:1787397826.369800:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275648 00000100:00100000:1.0:1787397826.369813:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275776 00000100:00100000:1.0:1787397826.369815:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275776 00000100:00100000:1.0:1787397826.369833:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681275904 00000100:00100000:1.0:1787397826.369835:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681275904 00000100:00100000:1.0:1787397826.369849:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276032 00000100:00100000:1.0:1787397826.369851:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276032 00000100:00100000:1.0:1787397826.369871:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5068 00000100:00100000:1.0:1787397826.369881:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275392:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.369900:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe51f80 x1874218681275392/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.369914:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275392:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 36us (535us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.369921:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5068 00000100:00100000:1.0:1787397826.369931:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5069 00000100:00100000:1.0:1787397826.369937:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275520:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.369945:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe52300 x1874218681275520/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.369971:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275520:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 35us (541us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.369977:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5069 00000100:00100000:1.0:1787397826.369987:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5070 00000100:00100000:1.0:1787397826.369993:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275648:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.370000:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe53100 x1874218681275648/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.370010:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275648:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 17us (549us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.370014:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5070 00000100:00100000:1.0:1787397826.370035:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5071 00000100:00100000:1.0:1787397826.370041:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275776:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.370048:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe53800 x1874218681275776/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.370057:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275776:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 17us (564us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.370062:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5071 00000100:00100000:1.0:1787397826.370068:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5072 00000100:00100000:1.0:1787397826.370073:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275904:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.370080:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe52d80 x1874218681275904/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.370099:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681275904:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 26us (587us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.370104:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5072 00000100:00100000:1.0:1787397826.370113:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5073 00000100:00100000:1.0:1787397826.370119:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681276032:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397826.370126:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe52680 x1874218681276032/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397826.370133:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681276032:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 16us (543us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397826.370138:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5073 00010000:00080000:0.0:1787397826.370383:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370394:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe51f80 x1874218681275392/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370403:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370417:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.370419:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370423:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe52300 x1874218681275520/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370429:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370433:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.370434:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370438:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe53100 x1874218681275648/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370455:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370460:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.370461:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370466:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe53800 x1874218681275776/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370471:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370475:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.370476:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370479:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe52d80 x1874218681275904/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370485:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370487:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.370488:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.370491:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe52680 x1874218681276032/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.370497:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.370500:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1787397826.371278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397826.371359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397826.372412:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276160 00000100:00100000:2.0:1787397826.372425:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276160 00000100:00100000:2.0:1787397826.372488:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276288 00000100:00100000:2.0:1787397826.372491:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276288 00000100:00100000:2.0:1787397826.372543:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5074 00000100:00100000:2.0:1787397826.372565:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681276160:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397826.372582:0:26166:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a80fe50e00 x1874218681276160/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397826.372598:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681276160:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 47us (1324us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397826.372605:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5074 00000100:00100000:2.0:1787397826.372616:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5075 00000100:00100000:2.0:1787397826.372622:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681276288:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397826.372643:0:26166:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70731c700 x1874218681276288/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397826.372652:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681276288:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 31us (1335us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397826.372658:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5075 00010000:00080000:0.0:1787397826.372879:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.372890:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a80fe50e00 x1874218681276160/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.372899:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.372912:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397826.372914:0:96925:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397826.372919:0:96925:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70731c700 x1874218681276288/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:267/0 lens 328/0 e 0 to 0 dl 1787397837 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787397826.372926:0:96925:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:0.0:1787397826.372930:0:96925:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1787397826.404779:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397827.431280:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787397827.714147:0:97706:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787397827.714206:0:97706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.714221:0:97706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.714228:0:97706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.714235:0:97706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.714260:0:97706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787397827.714266:0:97706:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787397827.714292:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397827.714297:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787397827.714303:0:97706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787397827.714325:0:97706:0:(import.c:65:import_set_state_nolock()) ffff89a8310a8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787397827.714379:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397827.714387:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714394:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397827.714398:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714407:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397827.714414:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397827.714419:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787397827.714434:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787397827.714437:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787397827.714462:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714469:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397827.714497:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714504:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d1923bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923c6 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714515:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397827.714516:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397827.714518:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397827.714554:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397827.714572:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701156608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397827.714637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397827.714691:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156608 00000100:00100000:1.0:1787397827.714698:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156608 00000100:00100000:1.0:1787397827.714742:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1787397827.714751:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701156608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397827.714765:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397827.714780:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8016a1a00/0x274786fe0d1923c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1923bf expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.714793:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397827.714840:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701156608:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397827.714848:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1787397827.714903:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701156608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397827.716163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701156480:0@lo:39:umount.0 00000100:00100000:0.0:1787397827.716226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397827.718693:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156480 00000100:00100000:2.0:1787397827.718706:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156480 00000100:00100000:2.0:1787397827.718899:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1787397827.718912:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701156480:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397827.718958:0:66177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923db 00000100:00080000:2.0:1787397827.718968:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a837bb2800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787397827.719033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397827.719087:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3647:x1874218701156480:12345-0@lo:39:umount.0 Request processed in 178us (2859us total) trans 0 rc 0/0 00000100:00080000:3.0:1787397827.719092:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397827.719097:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000020:00000080:2.0:1787397827.719109:0:66177:0:(genops.c:906:class_export_put()) final put ffff89a83fa42800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:0.0:1787397827.719142:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397827.719154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701156480:0@lo:39:umount.0 00000100:00080000:2.0:1787397827.719163:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397827.719168:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000020:00000080:3.0:1787397827.719253:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa42800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397827.719310:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bb2800 for lustre-MDT0000 00000100:00100000:2.0:1787397827.722890:0:97706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787397827.723824:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397827.723830:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787397827.723836:0:97706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787397827.723863:0:97706:0:(import.c:65:import_set_state_nolock()) ffff89a7054c4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397827.724454:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701156736:0@lo:39:umount.0 00000100:00100000:0.0:1787397827.724580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397827.724793:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156736 00000100:00100000:2.0:1787397827.724801:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156736 00000100:00100000:2.0:1787397827.724867:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1787397827.724878:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701156736:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397827.724904:0:77740:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923f0 00000100:00080000:2.0:1787397827.724912:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787397827.724966:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+1:3647:x1874218701156736:12345-0@lo:39:umount.0 Request processed in 90us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397827.724972:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000020:00000080:2.0:1787397827.724982:0:77740:0:(genops.c:906:class_export_put()) final put ffff89a7024bd800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:0.0:1787397827.725065:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397827.725082:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701156736:0@lo:39:umount.0 00010000:00010000:1.0:1787397827.725123:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397827.725149:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397827.725152:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397827.725157:0:97706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787397827.726186:0:97706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726221:0:97706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726228:0:97706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726234:0:97706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726310:0:97706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397827.726319:0:97706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726326:0:97706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726333:0:97706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397827.726339:0:97706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787397827.726364:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1787397827.726381:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7024bd800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787397827.726436:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7024b8800 for lustre-MDT0001 00010000:00010000:2.0:1787397827.726929:0:97706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787397827.726935:0:97706:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1787397827.727065:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397827.727074:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727082:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397827.727086:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727095:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397827.727103:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397827.727108:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787397827.727111:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787397827.727112:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787397827.727114:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787397827.727121:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397827.727129:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397827.727132:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397827.727139:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397827.727145:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727149:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397827.727152:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787397827.727158:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787397827.727161:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1787397827.727162:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787397827.727183:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727188:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727205:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ac00/0x274786fe0d192380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192387 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397827.727218:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397827.727219:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397827.727222:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397827.727231:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397827.727239:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787397827.727242:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397827.727251:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a808719000/0x274786fe0d1923b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1923b8 expref: -99 pid: 96908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397827.727257:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701156864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397827.727265:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397827.727268:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397827.727270:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397827.727283:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701156992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397827.727328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397827.727329:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397827.727386:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156864 00000100:00100000:1.0:1787397827.727393:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156864 00000020:01000004:2.0:1787397827.727439:0:97706:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000100:00100000:1.0:1787397827.727443:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701156992 00000020:01000000:2.0:1787397827.727445:0:97706:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000100:00100000:1.0:1787397827.727447:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701156992 00000020:00000080:2.0:1787397827.727452:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1787397827.727461:0:97706:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:1.0:1787397827.727477:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1787397827.727485:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1787397827.727489:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701156864:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397827.727501:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701156992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397827.727506:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397827.727512:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397827.727553:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74a00/0x274786fe0d192387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192380 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397827.727562:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8016a0c00/0x274786fe0d1923b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1923b1 expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397827.727569:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397827.727575:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397827.727620:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701156864:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397827.727622:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701156992:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397827.727636:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1787397827.727648:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1787397827.727693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835a7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701156992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397827.727716:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701156864:0@lo:103:ldlm_bl.0 00002000:00000080:2.0:1787397827.730396:0:97706:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1787397827.730461:0:97706:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:2.0:1787397827.730968:0:97706:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1787397827.730981:0:97706:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a7050a7000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968773 stale:0 00000020:00080000:2.0:1787397827.730989:0:97706:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a7050a3000 lustre-MDT0000-mdtlov_UUID 0@lo 5 (1 0 0) 0 0 0 0: 0000000000000000 4294968749 stale:0 00000020:00080000:2.0:1787397827.730993:0:97706:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a7050a6000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (1 0 0) 0 0 0 0: 0000000000000000 4294968731 stale:0 00000020:00080000:2.0:1787397827.730999:0:97706:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff89a83b9d19c0) has exports, disconnecting them 00000020:00080000:2.0:1787397827.731003:0:97706:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.60@tcp (ffff89a7050a7000), last request at 1787397826 00000020:00000080:2.0:1787397827.731014:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923aa 00000100:00080000:2.0:1787397827.731027:0:97706:0:(import.c:65:import_set_state_nolock()) ffff89a7024b8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397827.731203:0:97706:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a7050a7000): rc 0 00000020:00000080:2.0:1787397827.731206:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a7050a7000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00080000:2.0:1787397827.731225:0:97706:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a7050a3000), last request at 1787397810 00000020:00000080:2.0:1787397827.731229:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923a3 00000100:00080000:2.0:1787397827.731233:0:97706:0:(import.c:65:import_set_state_nolock()) ffff89a830f73800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787397827.731274:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787397827.731282:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a7000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00080000:2.0:1787397827.731333:0:97706:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7050a3000): rc 0 00000020:00000080:0.0:1787397827.731336:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7024b8000 for lustre-OST0000 00000020:00080000:2.0:1787397827.731337:0:97706:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a7050a6000), last request at 1787397810 00000020:00000080:2.0:1787397827.731340:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19239c 00000100:00080000:2.0:1787397827.731345:0:97706:0:(import.c:65:import_set_state_nolock()) ffff89a7024be000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787397827.731361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787397827.732088:0:97706:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7050a6000): rc 0 00000020:00080000:2.0:1787397827.732123:0:97706:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff89a83b9d19c0) has no exports 00010000:00020000:2.0:1787397827.732127:0:97706:0:(ldlm_lib.c:2990:target_stop_recovery_thread()) lustre-OST0000: Aborting recovery 00010000:00010000:1.0:1787397827.733609:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787397827.737688:0:96925:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00010000:00000400:0.0:1787397827.737713:0:96925:0:(ldlm_lib.c:2390:target_recovery_overseer()) recovery is aborted, evict exports in recovery 00002000:00000080:0.0:1787397827.745746:0:96925:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=c00866c1 len=0 karg=ffff89a83b9d2140 uarg=0000000000000000 00000020:00020000:0.0:1787397827.745796:0:96925:0:(ofd_obd.c:1324:ofd_iocontrol()) lustre-OST0000: iocontrol from 'tgt_recover_0' cmd=c00866c1 _IOWR('f', 193, 8) unrecognized: rc = -25 00010000:00080000:0.0:1787397827.751710:0:96925:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:0.0:1787397827.751731:0:96925:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a829848000 x1874218701149056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:271/0 lens 224/0 e 1 to 0 dl 1787397841 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1787397827.751752:0:96925:0:(genops.c:906:class_export_put()) final put ffff89a7050a3000/lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787397827.751772:0:96925:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a829849500 x1874218701149184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:271/0 lens 224/0 e 1 to 0 dl 1787397841 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1787397827.751785:0:96925:0:(genops.c:906:class_export_put()) final put ffff89a7050a6000/lustre-MDT0001-mdtlov_UUID 00010000:02000000:0.0:1787397827.751789:0:96925:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-OST0000: Recovery over after 0:18, of 3 clients 0 recovered and 3 were evicted. 00000020:00000080:3.0:1787397827.752160:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397827.752219:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397827.752234:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830f73800 for lustre-OST0000 00000020:00000080:3.0:1787397827.752238:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7024be000 for lustre-OST0000 00002000:00080000:0.0:1787397827.753417:0:96925:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787397827.753427:0:96925:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000000:2.0:1787397827.756943:0:97706:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259c1e0 - data ffff89a818838d80/ffff89a80833ac00 00000020:01000000:2.0:1787397827.757247:0:97706:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a8187a4a20 - data ffff89a701d28d80/ffff89a8288cd800 00100000:10000000:2.0:1787397827.771442:0:97706:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787397827.781360:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192395 00000020:00000080:2.0:1787397827.781389:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a7050a1800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787397827.781422:0:97706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a8364e0800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787397827.781450:0:97706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e0800 2 00000020:01000004:2.0:1787397827.781454:0:97706:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a8364e0800 from lustre-OST0000 00000020:00000080:2.0:1787397827.781493:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397827.782351:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7050a1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787397827.783477:0:97706:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787397827.783487:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a702021800/lustre-OST0000_UUID 00000020:00000080:2.0:1787397827.783493:0:97706:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702021800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787397827.783646:0:97706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787397827.783839:0:97706:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1787397827.783912:0:97706:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787397827.783917:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397827.783926:0:97706:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787397827.783936:0:97706:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89a702186800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397827.783943:0:97706:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff89a70207cd40) has exports, disconnecting them 00000020:00080000:2.0:1787397827.783949:0:97706:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89a702186800), last request at 1787397808 00000020:00000080:2.0:1787397827.783954:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923d4 00000020:00080000:2.0:1787397827.783978:0:97706:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a702186800): rc 0 00000020:00000080:2.0:1787397827.783984:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a702186800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787397827.785231:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702186800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787397827.785768:0:97706:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787397827.785774:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397827.785779:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397827.785786:0:97706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397827.785934:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397827.785949:0:97706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787397827.785956:0:97706:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787397827.785961:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397827.785966:0:97706:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787397827.785973:0:97706:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff89a7024ba000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397827.785980:0:97706:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff89a83b9d4d40) has exports, disconnecting them 00000020:00080000:0.0:1787397827.785984:0:97706:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff89a7024ba000), last request at 1787397808 00000020:00000080:0.0:1787397827.785988:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1923e9 00000020:00080000:0.0:1787397827.786004:0:97706:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7024ba000): rc 0 00000020:00000080:0.0:1787397827.786010:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a7024ba000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397827.786897:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8310a8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787397827.786919:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a702027800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787397827.786923:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702027800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787397827.786932:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787397827.787080:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7024ba000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787397827.789199:0:97706:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787397827.789218:0:97706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397827.789224:0:97706:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787397827.789240:0:97706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397827.789316:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7054c4000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397827.789611:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397827.789630:0:97706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787397827.789639:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a817efb800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787397827.789645:0:97706:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efb800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787397827.789654:0:97706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787397827.789816:0:97706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e0800 1 00000020:00000080:1.0:1787397827.789830:0:97706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192379 00000020:00000080:1.0:1787397827.790142:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a703c33000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787397827.790161:0:97706:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787397827.790176:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c33000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787397827.790191:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397827.790201:0:97706:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787397827.790206:0:97706:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff89a838780000) has no exports 00000020:00000080:1.0:1787397827.923803:0:97706:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397827.923822:0:97706:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787397827.923828:0:97706:0:(genops.c:906:class_export_put()) final put ffff89a8364e2000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787397827.923833:0:97706:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787397827.923846:0:97706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787397827.924119:0:97706:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a8364e3000 00000020:02000400:1.0:1787397827.924179:0:97706:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1787397828.070895:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701157120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397828.070968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397828.072104:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157120 00000100:00100000:1.0:1787397828.072117:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157120 00000100:00100000:1.0:1787397828.072411:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:1.0:1787397828.072464:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701157120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397828.072510:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397828.072611:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701157120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397828.072619:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:3.0:1787397828.074589:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397828.074613:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701157248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397828.074678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397828.075419:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157248 00000100:00100000:1.0:1787397828.075550:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157248 00000100:00100000:1.0:1787397828.075601:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:1.0:1787397828.075610:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701157248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397828.075647:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397828.075703:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701157248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397828.075710:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:1.0:1787397828.075788:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701157120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397828.077087:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701157248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397828.453772:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397828.581288:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397828.581360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397828.581429:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157376 00000100:00100000:2.0:1787397828.581437:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157376 00000100:00100000:2.0:1787397828.581492:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1787397828.581502:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701157376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397828.581707:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397828.581757:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701157376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397828.581765:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00080000:2.0:1787397828.581790:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397828.581840:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701157504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397828.581872:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397828.581927:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397828.582060:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157504 00000100:00100000:0.0:1787397828.582065:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157504 00000100:00100000:0.0:1787397828.582273:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1787397828.582281:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701157504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397828.582292:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397828.582326:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701157504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397828.582332:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1787397828.582363:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701157504:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787397828.582794:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397829.484220:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397830.501134:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397830.628878:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397830.628885:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1787397830.628898:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701157632:0@lo:400:kworker.0 00000100:00080000:3.0:1787397830.628904:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397830.628906:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1787397830.628969:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.628969:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701158016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397830.629013:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701158144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701158528:0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.629050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397830.629052:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701158656:0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629074:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.629079:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157632 00000100:00100000:0.0:1787397830.629086:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157632 00000100:00100000:1.0:1787397830.629099:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701157760:0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.629131:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787397830.629133:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701158272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629140:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397830.629180:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397830.629183:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701157632:12345-0@lo:400:kworker.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397830.629185:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701157888:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629191:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787397830.629205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.629224:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158144 00000100:00100000:0.0:1787397830.629227:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158144 00000100:00100000:1.0:1787397830.629236:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701158400:0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629258:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397830.629268:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158528 00000100:00100000:0.0:1787397830.629270:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158528 00000100:00100000:1.0:1787397830.629281:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158016 00000100:00100000:1.0:1787397830.629283:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158016 00000100:00100000:0.0:1787397830.629303:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1787397830.629305:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158400 00000100:00100000:1.0:1787397830.629307:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158400 00000100:00100000:0.0:1787397830.629309:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701158144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629319:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:1.0:1787397830.629324:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701158016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629347:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701158144:12345-0@lo:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397830.629353:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701158016:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397830.629354:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1787397830.629359:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1787397830.629365:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1787397830.629371:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1787397830.629371:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629376:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701158400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629395:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701158528:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397830.629400:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701158400:12345-0@lo:400:kworker.0 Request processed in 24us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397830.629402:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1787397830.629418:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1787397830.629421:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158656 00000100:00100000:0.0:1787397830.629428:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158656 00000100:00100000:0.0:1787397830.629452:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157760 00000100:00100000:0.0:1787397830.629455:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157760 00000100:00100000:0.0:1787397830.629484:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158272 00000100:00100000:0.0:1787397830.629487:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158272 00000100:00100000:0.0:1787397830.629499:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701157888 00000100:00100000:0.0:1787397830.629501:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701157888 00000100:00100000:0.0:1787397830.629516:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787397830.629541:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701158656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629571:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701158656:12345-0@lo:400:kworker.0 Request processed in 49us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397830.629577:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:0.0:1787397830.629589:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1787397830.629595:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701157760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.629621:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701157760:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397830.629626:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1787397830.629633:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.629663:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701158272:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397830.630111:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1787397830.630127:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1787397830.630143:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630176:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701157888:12345-0@lo:400:kworker.0 Request processed in 35us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397830.630182:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1787397830.630237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701158016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630251:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701158528:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630307:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701157888:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630318:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701158400:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630327:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701157760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630335:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701158272:0@lo:400:kworker.0 00000100:00080000:0.0:1787397830.630371:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397830.630375:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397830.630378:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397830.630396:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701158144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630408:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701158656:0@lo:400:kworker.0 00000100:00100000:0.0:1787397830.630416:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701157632:0@lo:400:kworker.0 00000100:00100000:1.0:1787397830.630693:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:2.0:1787397831.430491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397831.430572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397831.430605:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397831.430656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397831.430689:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276800 00000100:00100000:2.0:1787397831.430699:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276800 00000100:00100000:2.0:1787397831.430761:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2690 00000100:00100000:2.0:1787397831.430773:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681276800:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397831.430852:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681276800:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397831.430859:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2690 00000100:00080000:2.0:1787397831.430883:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397831.431180:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276416 00000100:00100000:0.0:1787397831.431186:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276416 00000100:00100000:0.0:1787397831.431365:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 226 00000100:00100000:0.0:1787397831.431375:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681276416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397831.431410:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681276416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397831.431431:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 226 00000100:00100000:3.0:1787397831.431666:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276672 00000100:00100000:3.0:1787397831.431671:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276672 00000100:00100000:3.0:1787397831.431707:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276544 00000100:00100000:3.0:1787397831.431710:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276544 00000100:00100000:3.0:1787397831.431733:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1490 00000100:00100000:3.0:1787397831.431741:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681276672:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397831.431782:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681276672:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397831.431789:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1490 00000100:00100000:3.0:1787397831.431803:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1491 00000100:00100000:3.0:1787397831.431810:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681276544:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397831.431835:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681276544:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397831.431841:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1491 00000100:00080000:0.0:1787397831.433355:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397831.433364:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787397831.526250:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397832.550026:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397833.188787:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701158784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397833.188864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397833.188900:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397833.188906:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701158912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397833.189058:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158784 00000100:00100000:3.0:1787397833.189079:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158784 00000100:00100000:3.0:1787397833.189137:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1787397833.189146:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701158784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397833.189178:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397833.189219:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701158784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397833.189225:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1787397833.189448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397833.189574:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701158912 00000100:00100000:2.0:1787397833.189579:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701158912 00000100:00100000:2.0:1787397833.189617:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1787397833.189625:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701158912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397833.189644:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397833.190541:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701158784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397833.197648:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701158912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8015us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397833.197665:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:0.0:1787397833.197721:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701158912:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397833.573657:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397833.701100:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701159040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397833.701199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397833.701245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397833.701260:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701159168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397833.701292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397833.703436:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159040 00000100:00100000:1.0:1787397833.703450:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159040 00000100:00100000:1.0:1787397833.703554:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159168 00000100:00100000:1.0:1787397833.703558:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159168 00000100:00100000:1.0:1787397833.703585:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:1.0:1787397833.703594:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701159040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397833.703634:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397833.703667:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:3.0:1787397833.703685:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701159168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397833.703697:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397833.703710:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701159040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397833.703717:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:3.0:1787397833.703722:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701159168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397833.703727:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:1.0:1787397833.704029:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701159168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397833.704047:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701159040:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397833.704302:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787397834.596929:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397835.620815:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397835.753431:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397835.753440:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1787397835.753462:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397835.753466:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1787397835.753598:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701159552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397835.753697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.753697:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701159680:0@lo:400:kworker.0 00000100:00100000:3.0:1787397835.754086:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701159424:0@lo:400:kworker.0 00000100:00100000:2.0:1787397835.754650:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701160064:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.754664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.754714:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160192:0@lo:400:kworker.0 00000100:00100000:2.0:1787397835.754727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.754771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.754842:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159552 00000100:00100000:1.0:1787397835.754852:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159552 00000100:00100000:1.0:1787397835.754964:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1787397835.754977:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701159552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755005:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701159296:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755062:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701159552:12345-0@lo:400:kworker.0 Request processed in 88us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397835.755068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.755077:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1787397835.755116:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701159808:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755120:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160192 00000100:00100000:1.0:1787397835.755125:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160192 00000100:00100000:0.0:1787397835.755150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.755244:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159808 00000100:00100000:1.0:1787397835.755249:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159808 00000100:00100000:0.0:1787397835.755261:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701160320:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1787397835.755291:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397835.755342:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160192:12345-0@lo:400:kworker.0 Request processed in 53us (571us total) trans 0 rc 0/0 00000100:00080000:0.0:1787397835.755345:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397835.755351:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00080000:0.0:1787397835.755361:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397835.755377:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1787397835.755387:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701159808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755390:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159296 00000100:00100000:0.0:1787397835.755396:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159296 00000100:00100000:1.0:1787397835.755428:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701159808:12345-0@lo:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397835.755436:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1787397835.755441:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787397835.755450:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701159296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755506:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701159296:12345-0@lo:400:kworker.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397835.755515:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787397835.755583:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160320 00000100:00100000:1.0:1787397835.755588:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160320 00000100:00100000:0.0:1787397835.755605:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701159296:0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755621:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701159808:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755627:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1787397835.755636:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701160320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755683:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701160320:12345-0@lo:400:kworker.0 Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397835.755694:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159680 00000100:00100000:0.0:1787397835.755700:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159680 00000100:00100000:1.0:1787397835.755706:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1787397835.755739:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160064 00000100:00100000:0.0:1787397835.755743:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160064 00000100:00100000:1.0:1787397835.755755:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701160320:0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.755765:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1787397835.755774:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701159680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755806:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701159552:0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.755835:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:1.0:1787397835.755842:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701160064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.758259:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701160064:12345-0@lo:400:kworker.0 Request processed in 2401us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397835.758285:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1787397835.762664:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397835.762782:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701159936:0@lo:400:kworker.0 00000100:00100000:3.0:1787397835.762865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397835.762958:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159424 00000100:00100000:3.0:1787397835.762970:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159424 00000100:00100000:1.0:1787397835.763122:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701159936 00000100:00100000:1.0:1787397835.763127:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701159936 00000100:00100000:1.0:1787397835.763193:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1787397835.763206:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701159936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397835.763287:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701159936:12345-0@lo:400:kworker.0 Request processed in 83us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397835.763294:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1787397835.764637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701159936:0@lo:400:kworker.0 00000100:00100000:2.0:1787397835.764837:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701160064:0@lo:400:kworker.0 00000100:00100000:3.0:1787397835.766460:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1787397835.766482:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701159424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397835.766652:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701159424:12345-0@lo:400:kworker.0 Request processed in 176us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397835.766661:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1787397835.766749:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701159424:0@lo:400:kworker.0 00000100:00100000:0.0:1787397835.766933:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701159680:12345-0@lo:400:kworker.0 Request processed in 11156us (12267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397835.766949:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1787397835.767006:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701159680:0@lo:400:kworker.0 00000100:00080000:1.0:1787397835.768036:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397836.549994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397836.550040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397836.550079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397836.550122:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277056 00000100:00100000:2.0:1787397836.550137:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397836.550141:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277056 00000100:00100000:2.0:1787397836.550198:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277184 00000100:00100000:2.0:1787397836.550209:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277184 00000100:00100000:1.0:1787397836.550249:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1496 00000100:00100000:0.0:1787397836.550313:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277312 00000100:00100000:0.0:1787397836.550318:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277312 00000100:00100000:0.0:1787397836.550386:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2693 00000100:00100000:0.0:1787397836.550396:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681277312:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397836.550503:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681277312:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 109us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397836.550578:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2693 00000100:00080000:0.0:1787397836.550627:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397836.550633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397836.550636:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397836.550769:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681277056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397836.550808:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681277056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 549us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397836.550909:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681276928 00000100:00100000:3.0:1787397836.550917:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681276928 00000100:00100000:3.0:1787397836.550982:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:3.0:1787397836.550993:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681276928:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397836.551058:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681276928:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 68us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397836.551065:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 228 00000100:00100000:1.0:1787397836.555740:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1496 00000100:00100000:2.0:1787397836.557300:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1497 00000100:00100000:2.0:1787397836.557330:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681277184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397836.557500:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681277184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 186us (7363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397836.557510:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1497 00010000:00010000:1.0:1787397836.644951:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397837.672858:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397838.308835:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397838.308860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701160448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397838.308941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397838.312915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397838.312939:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397838.313008:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397838.317886:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160448 00000100:00100000:0.0:1787397838.317912:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160448 00000100:00100000:0.0:1787397838.317995:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160576 00000100:00100000:0.0:1787397838.318000:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160576 00000100:00100000:0.0:1787397838.318021:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1787397838.318031:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701160448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397838.318074:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397838.318175:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701160448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (9233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397838.318183:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1787397838.318203:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1787397838.318210:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397838.318232:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397838.318492:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701160448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397838.318590:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 380us (5581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397838.318597:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:3.0:1787397838.318679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397838.693098:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397838.821702:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397838.821779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397838.823080:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397838.823099:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701160832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397838.823159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397838.823345:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160704 00000100:00100000:2.0:1787397838.823353:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160704 00000100:00100000:2.0:1787397838.823417:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160832 00000100:00100000:2.0:1787397838.823420:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160832 00000100:00100000:2.0:1787397838.823441:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1787397838.823450:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397838.823479:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397838.823560:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701160704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397838.823569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1787397838.823601:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1787397838.823608:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701160832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397838.823619:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397838.823649:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701160832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397838.823655:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:3.0:1787397838.823805:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701160832:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397838.823869:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397838.825819:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701160704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787397839.717649:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397840.742055:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397840.869759:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397840.869766:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1787397840.869784:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397840.869788:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1787397840.869821:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701161088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.869898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397840.869929:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701161600:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.869951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397840.869976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397840.869981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701161216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397840.870032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701161728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397840.870088:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161088 00000100:00100000:3.0:1787397840.870096:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161088 00000100:00100000:3.0:1787397840.870148:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161600 00000100:00100000:3.0:1787397840.870152:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161600 00000100:00100000:3.0:1787397840.870171:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161216 00000100:00100000:3.0:1787397840.870174:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161216 00000100:00100000:3.0:1787397840.870197:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1787397840.870206:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701161088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870260:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701161088:12345-0@lo:400:kworker.0 Request processed in 54us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.870279:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1787397840.870300:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1787397840.870306:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701161600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870334:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701161600:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.870340:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1787397840.870352:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1787397840.870358:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701161216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870385:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701161216:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.870392:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1787397840.870414:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161728 00000100:00100000:3.0:1787397840.870417:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161728 00000100:00100000:3.0:1787397840.870441:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1787397840.870454:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701161728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870486:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701161728:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.870492:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1787397840.870575:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701161216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870588:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701161728:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870598:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701161088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.870607:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701161600:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.870806:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701160960:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.870843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397840.870870:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701161472:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.870892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397840.870912:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701161984:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.870932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397840.870946:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787397840.870952:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701161344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.870972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397840.870989:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701161856:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871007:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397840.871035:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161472 00000100:00100000:1.0:1787397840.871039:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161472 00000100:00100000:1.0:1787397840.871070:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161856 00000100:00100000:1.0:1787397840.871072:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161856 00000100:00100000:1.0:1787397840.871092:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1787397840.871098:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701161472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871134:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701161472:12345-0@lo:400:kworker.0 Request processed in 35us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397840.871151:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1787397840.871165:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1787397840.871171:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701161856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871201:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701161856:12345-0@lo:400:kworker.0 Request processed in 30us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397840.871206:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1787397840.871221:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161344 00000100:00100000:1.0:1787397840.871225:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161344 00000100:00100000:1.0:1787397840.871243:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1787397840.871248:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701161344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871288:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701161344:12345-0@lo:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397840.871294:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1787397840.871328:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701161344:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871338:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701161856:0@lo:400:kworker.0 00000100:00100000:1.0:1787397840.871347:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701161472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.871414:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701160960 00000100:00100000:3.0:1787397840.871418:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701160960 00000100:00100000:3.0:1787397840.871454:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787397840.871461:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701160960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.871495:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701160960:12345-0@lo:400:kworker.0 Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.871501:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787397840.871561:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701160960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.871578:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701161984 00000100:00100000:3.0:1787397840.871581:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701161984 00000100:00100000:3.0:1787397840.871605:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1787397840.871611:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701161984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397840.871642:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701161984:12345-0@lo:400:kworker.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397840.871648:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1787397840.871675:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701161984:0@lo:400:kworker.0 00000100:00080000:0.0:1787397840.871816:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397840.871821:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397840.871824:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397841.672888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397841.672941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397841.672954:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277568 00000100:00100000:3.0:1787397841.672965:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277568 00000100:00100000:2.0:1787397841.672978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397841.673010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397841.673023:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277696 00000100:00100000:3.0:1787397841.673032:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277696 00000100:00100000:2.0:1787397841.673038:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1502 00000100:00100000:2.0:1787397841.673049:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681277568:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397841.673056:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1503 00000100:00100000:3.0:1787397841.673062:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681277696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397841.673138:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277440 00000100:00100000:0.0:1787397841.673138:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277824 00000100:00100000:1.0:1787397841.673142:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277440 00000100:00100000:0.0:1787397841.673142:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277824 00000100:00100000:0.0:1787397841.673177:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2696 00000100:00100000:1.0:1787397841.673178:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 230 00000100:00100000:1.0:1787397841.673184:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681277440:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397841.673267:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681277824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397841.673350:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681277568:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 302us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397841.673359:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1502 00000100:00100000:3.0:1787397841.673961:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681277696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 895us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397841.673971:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1503 00000100:00100000:1.0:1787397841.674058:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681277440:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 872us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397841.674324:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 230 00000100:00080000:1.0:1787397841.674424:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397841.674443:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397841.674446:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397841.674770:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681277824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1584us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397841.674780:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2696 00010000:00010000:1.0:1787397841.766579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397842.695924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397842.696454:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681277952 00000100:00100000:2.0:1787397842.696471:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681277952 00000100:00100000:2.0:1787397842.696737:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5076 00000100:00100000:2.0:1787397842.696747:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1874218681277952:12345-192.168.204.60@tcp:8:ptlrpcd_rcv.0 00010000:00020000:2.0:1787397842.696782:0:26158:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397842.696891:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2401:x1874218681277952:12345-192.168.204.60@tcp:8:ptlrpcd_rcv.0 Request processed in 143us (1057us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397842.696899:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5076 00000100:00100000:3.0:1787397842.709079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397842.709138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397842.709174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397842.709517:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278080 00000100:00100000:0.0:1787397842.709590:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278080 00000100:00100000:0.0:1787397842.709669:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 231 00000100:00100000:0.0:1787397842.709685:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681278080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397842.709793:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681278080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 112us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397842.709801:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 231 00000100:00100000:3.0:1787397842.710169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397842.710278:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278464 00000100:00100000:3.0:1787397842.710284:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278464 00000100:00100000:3.0:1787397842.710328:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2697 00000100:00100000:3.0:1787397842.710337:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681278464:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397842.710426:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681278464:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397842.710433:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2697 00000100:00100000:1.0:1787397842.710810:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278208 00000100:00100000:1.0:1787397842.710817:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278208 00000100:00100000:1.0:1787397842.710859:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278336 00000100:00100000:1.0:1787397842.710862:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278336 00000100:00100000:1.0:1787397842.710887:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1504 00000100:00100000:1.0:1787397842.710894:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681278208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397842.710939:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1505 00000100:00100000:1.0:1787397842.710939:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681278208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397842.711143:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681278336:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397842.711176:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681278336:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397842.711286:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1504 00000100:00100000:3.0:1787397842.716487:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1505 00010000:00010000:1.0:1787397842.788978:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397843.428816:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701162240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397843.428816:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701162112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397843.429856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397843.430091:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162240 00000100:00100000:3.0:1787397843.430102:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162240 00000100:00100000:3.0:1787397843.430164:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:3.0:1787397843.430175:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701162240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397843.430238:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397843.430300:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701162240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397843.430308:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:3.0:1787397843.430366:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701162240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397843.433557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397843.433750:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162112 00000100:00100000:3.0:1787397843.433765:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162112 00000100:00100000:3.0:1787397843.433844:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:3.0:1787397843.433856:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701162112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397843.433927:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397843.434169:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701162112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 314us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397843.434179:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:3.0:1787397843.434254:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701162112:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397843.814290:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397843.940737:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701162496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397843.940865:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397843.940915:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701162368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397843.940938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397843.940985:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162496 00000100:00100000:2.0:1787397843.940996:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162496 00000100:00100000:3.0:1787397843.941053:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162368 00000100:00100000:3.0:1787397843.941059:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162368 00000100:00100000:2.0:1787397843.941076:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1787397843.941088:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701162496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397843.941092:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1787397843.941098:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701162368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397843.941127:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00002000:00000024:2.0:1787397843.941127:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397843.941173:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701162368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397843.941173:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701162496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397843.941200:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00080000:2.0:1787397843.941232:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397843.941278:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701162496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397843.941294:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701162368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397843.941763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00010000:00010000:0.0:1787397844.840264:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787397845.286694:0:98074:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:3.0:1787397845.861811:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397845.989705:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397845.989712:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1787397845.989731:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397845.989734:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1787397845.989893:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701162752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.989964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397845.990125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701163264:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397845.990186:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397845.990193:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701162880:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397845.990233:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701163392:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397845.990297:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162752 00000100:00100000:3.0:1787397845.990304:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162752 00000100:00100000:3.0:1787397845.990365:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163264 00000100:00100000:3.0:1787397845.990369:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163264 00000100:00100000:3.0:1787397845.990385:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162880 00000100:00100000:3.0:1787397845.990387:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162880 00000100:00100000:3.0:1787397845.990409:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1787397845.990418:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701162752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990473:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701162752:12345-0@lo:400:kworker.0 Request processed in 55us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397845.990494:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:3.0:1787397845.990512:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1787397845.990518:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701163264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990569:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701163264:12345-0@lo:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397845.990576:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1787397845.990588:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1787397845.990595:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990620:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701162880:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397845.990626:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:3.0:1787397845.990647:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163392 00000100:00100000:3.0:1787397845.990650:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163392 00000100:00100000:3.0:1787397845.990673:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:3.0:1787397845.990680:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701163392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.990711:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701163392:12345-0@lo:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397845.990718:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00080000:3.0:1787397845.990734:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397845.990738:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397845.990903:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701162624:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.990939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397845.990965:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701163136:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397845.991191:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701163648:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397845.991237:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787397845.991243:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701163008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397845.991294:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701163520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397845.991343:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163136 00000100:00100000:0.0:1787397845.991347:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163136 00000100:00100000:0.0:1787397845.991383:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163520 00000100:00100000:0.0:1787397845.991386:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163520 00000100:00100000:0.0:1787397845.991408:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1787397845.991414:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701163136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991449:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701163136:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397845.991456:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1787397845.991471:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1787397845.991477:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701163520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991503:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701163520:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397845.991509:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1787397845.991547:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163008 00000100:00100000:0.0:1787397845.991551:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163008 00000100:00100000:0.0:1787397845.991577:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:0.0:1787397845.991583:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701163008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991615:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701163008:12345-0@lo:400:kworker.0 Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397845.991621:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00080000:0.0:1787397845.991645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397845.991668:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701163008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991692:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701163520:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991700:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701163136:0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991732:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163648 00000100:00100000:0.0:1787397845.991735:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163648 00000100:00100000:0.0:1787397845.991760:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1787397845.991766:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701163648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397845.991884:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701163648:12345-0@lo:400:kworker.0 Request processed in 118us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397845.991891:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1787397845.991919:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701163648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397845.992186:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701162624 00000100:00100000:1.0:1787397845.992191:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701162624 00000100:00100000:1.0:1787397845.992225:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787397845.992233:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701162624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397845.992274:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701162624:12345-0@lo:400:kworker.0 Request processed in 43us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397845.992280:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787397845.992325:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701162624:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.995615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701162880:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.995669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701163392:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.995683:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701162752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397845.995695:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701163264:0@lo:400:kworker.0 00000100:00000400:0.0:1787397846.500639:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397810/real 1787397810] req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 1 to 1 dl 1787397846 ref 1 fl Rpc:XQr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397846.500673:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=REPLAY_WAIT (now=REPLAY_WAIT) req@ffff89a82984a680 x1874218701149184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 1 to 1 dl 1787397846 ref 1 fl Rpc:XQU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000400:0.0:1787397846.500685:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397810/real 1787397810] req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 1 to 1 dl 1787397846 ref 1 fl Rpc:XQr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397846.500697:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=REPLAY_WAIT (now=REPLAY_WAIT) req@ffff89a829848e00 x1874218701149056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 1 to 1 dl 1787397846 ref 1 fl Rpc:XQU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397846.500713:0:3647:0:(import.c:1541:completed_replay_interpret()) lustre-OST0000-osc-MDT0001: LAST_REPLAY message error: -110, reconnecting 00000100:00080000:0.0:1787397846.500718:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to CONNECTING 00000100:00080000:0.0:1787397846.500723:0:3647:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3689 00000100:00080000:0.0:1787397846.500732:0:3647:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397846.500785:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70731c000 x1874218701163776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397846.500814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701149184:0@lo:400:ldlm_lock_repla.0 00000100:00080000:0.0:1787397846.500820:0:3647:0:(import.c:1541:completed_replay_interpret()) lustre-OST0000-osc-MDT0000: LAST_REPLAY message error: -110, reconnecting 00000100:00080000:0.0:1787397846.500822:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to CONNECTING 00000100:00080000:0.0:1787397846.500826:0:3647:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3689 00000100:00080000:0.0:1787397846.500831:0:3647:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397846.500844:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70731dc00 x1874218701163904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397846.500852:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701149056:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397846.500883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701163776:0@lo:8:ptlrpcd_rcv.0 00000100:00100000:0.0:1787397846.500948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397846.501039:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701163904:0@lo:8:ptlrpcd_rcv.0 00000100:00100000:0.0:1787397846.501063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397846.501640:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163776 00000100:00100000:1.0:1787397846.501649:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163776 00000100:00100000:1.0:1787397846.501682:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701163904 00000100:00100000:1.0:1787397846.501685:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701163904 00000100:00100000:1.0:1787397846.501969:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077 00000100:00100000:1.0:1787397846.501986:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3647:x1874218701163776:12345-0@lo:8:ptlrpcd_rcv.0 00010000:00020000:1.0:1787397846.502008:0:26161:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397846.502061:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3647:x1874218701163776:12345-0@lo:8:ptlrpcd_rcv.0 Request processed in 76us (1113us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397846.502069:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077 00000100:00100000:1.0:1787397846.502097:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00100000:1.0:1787397846.502101:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3647:x1874218701163904:12345-0@lo:8:ptlrpcd_rcv.0 00010000:00020000:1.0:1787397846.502110:0:26161:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397846.502137:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3647:x1874218701163904:12345-0@lo:8:ptlrpcd_rcv.0 Request processed in 33us (1073us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397846.502142:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00080000:0.0:1787397846.502385:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397846.502408:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397846.502413:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701163776:0@lo:8:ptlrpcd_rcv.0 00000100:00080000:0.0:1787397846.502424:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397846.502430:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397846.502433:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701163904:0@lo:8:ptlrpcd_rcv.0 00010000:00010000:0.0:1787397846.886382:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397847.814973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397847.815014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397847.815047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397847.815073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397847.815118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397847.815159:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278848 00000100:00100000:0.0:1787397847.815170:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278848 00000100:00100000:0.0:1787397847.815232:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278720 00000100:00100000:0.0:1787397847.815235:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278720 00000100:00100000:0.0:1787397847.815261:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1510 00000100:00100000:0.0:1787397847.815271:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681278848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397847.815351:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681278848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397847.815360:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1510 00000100:00100000:0.0:1787397847.815382:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1511 00000100:00100000:0.0:1787397847.815390:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681278720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397847.815416:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681278720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397847.815421:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1511 00000100:00100000:0.0:1787397847.815445:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278976 00000100:00100000:0.0:1787397847.815449:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278976 00000100:00100000:0.0:1787397847.815468:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279104 00000100:00100000:0.0:1787397847.815471:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279104 00000100:00100000:0.0:1787397847.815497:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2700 00000100:00100000:0.0:1787397847.815504:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681279104:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397847.815558:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681279104:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397847.815564:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2700 00000100:00100000:0.0:1787397847.815578:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5079 00000100:00100000:0.0:1787397847.815582:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2401:x1874218681278976:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:0.0:1787397847.815611:0:26169:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397847.815655:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2401:x1874218681278976:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 69us (691us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397847.815662:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5079 00000100:00080000:0.0:1787397847.815679:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397847.815684:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397847.815686:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397847.816372:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681278592 00000100:00100000:3.0:1787397847.816379:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681278592 00000100:00100000:3.0:1787397847.816424:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 233 00000100:00100000:3.0:1787397847.816434:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681278592:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397847.816476:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681278592:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397847.816482:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 233 00010000:00010000:1.0:1787397847.908879:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397848.549684:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397848.549706:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701164032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397848.549786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397848.549832:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164032 00000100:00100000:3.0:1787397848.549839:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164032 00000100:00100000:3.0:1787397848.549886:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:3.0:1787397848.549896:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701164032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397848.549930:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397848.549978:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701164032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397848.549985:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:3.0:1787397848.550046:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701164032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397848.550646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397848.550659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701164160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397848.550698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397848.550820:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164160 00000100:00100000:1.0:1787397848.550826:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164160 00000100:00100000:1.0:1787397848.550870:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:1.0:1787397848.550879:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701164160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397848.550902:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397848.550938:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701164160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397848.550946:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:2.0:1787397848.551601:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701164160:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397848.933626:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397849.060997:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397849.061023:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701164288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397849.061112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397849.061164:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164288 00000100:00100000:2.0:1787397849.061177:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164288 00000100:00080000:1.0:1787397849.061245:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397849.061257:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1787397849.061271:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701164288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397849.061312:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397849.061376:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701164288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397849.061404:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:1.0:1787397849.061423:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701164288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397849.066930:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397849.066956:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701164416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397849.067131:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397849.067282:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164416 00000100:00100000:3.0:1787397849.067291:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164416 00000100:00080000:1.0:1787397849.067357:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397849.067367:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:3.0:1787397849.067376:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701164416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397849.067402:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397849.067465:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701164416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397849.067478:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:1.0:1787397849.067507:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701164416:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787397849.957370:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397850.981631:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397851.626914:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701164544:0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.627126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397851.627220:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164544 00000100:00100000:1.0:1787397851.627228:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164544 00000100:00100000:1.0:1787397851.627278:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787397851.627287:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701164544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.628918:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701164672:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.629034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.629102:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164672 00000100:00100000:3.0:1787397851.629109:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164672 00000100:00100000:3.0:1787397851.629161:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1787397851.629170:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701164672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.630698:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701164672:12345-0@lo:400:kworker.0 Request processed in 1519us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397851.630713:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:3.0:1787397851.630762:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397851.630804:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701164672:0@lo:400:kworker.0 00000100:00100000:1.0:1787397851.633169:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701164544:12345-0@lo:400:kworker.0 Request processed in 5873us (6033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397851.633186:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1787397851.633558:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397851.633563:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787397851.633566:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787397851.633606:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701164800:0@lo:400:kworker.0 00000100:00080000:2.0:1787397851.633634:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3725 00000100:00080000:2.0:1787397851.633640:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397851.633646:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397851.633662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.633693:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397851.633699:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701164928:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.633724:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.633756:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164928 00000100:00100000:3.0:1787397851.633764:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164928 00000100:00100000:3.0:1787397851.633806:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1787397851.633814:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701164928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.633862:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701164928:12345-0@lo:400:kworker.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397851.633868:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1787397851.633880:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9fb80 x1874218701165056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397851.633924:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397851.633927:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787397851.633929:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397851.633932:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3725 00000100:00100000:3.0:1787397851.633934:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701164928:0@lo:400:kworker.0 00000100:00080000:2.0:1787397851.633934:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787397851.633938:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397851.633949:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701165440:0@lo:400:kworker.0 00000100:00100000:2.0:1787397851.633949:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835b64380 x1874218701165568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397851.633987:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701165696:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.634147:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165440 00000100:00100000:3.0:1787397851.634151:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165440 00000100:00100000:3.0:1787397851.634173:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1787397851.634180:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701165440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634328:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701165440:12345-0@lo:400:kworker.0 Request processed in 147us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397851.634334:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1787397851.634357:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701165312:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.634398:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787397851.634403:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701165184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.634448:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701165824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397851.634506:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165184 00000100:00100000:3.0:1787397851.634510:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165184 00000100:00100000:3.0:1787397851.634567:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1787397851.634574:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701165184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634608:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701165184:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397851.634614:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00080000:3.0:1787397851.634633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397851.634653:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701165440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.634688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701165184:0@lo:400:kworker.0 00000100:00100000:2.0:1787397851.634890:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397851.635257:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701164800 00000100:00100000:0.0:1787397851.635262:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701164800 00000100:00100000:0.0:1787397851.635311:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165312 00000100:00100000:0.0:1787397851.635314:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165312 00000100:00100000:0.0:1787397851.635334:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165824 00000100:00100000:0.0:1787397851.635337:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165824 00000100:00100000:0.0:1787397851.635355:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:0.0:1787397851.635362:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.635405:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701164800:12345-0@lo:400:kworker.0 Request processed in 43us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397851.635411:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:0.0:1787397851.635426:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787397851.635432:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701165312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.635462:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70ab2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701165312:12345-0@lo:400:kworker.0 Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397851.635467:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1787397851.635500:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787397851.635506:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701165824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.635557:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701165824:12345-0@lo:400:kworker.0 Request processed in 51us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397851.635563:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1787397851.635585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701165056:0@lo:8:kworker.0 00000100:00100000:0.0:1787397851.635617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397851.635636:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701165568:0@lo:8:kworker.0 00000100:00100000:0.0:1787397851.635659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397851.635696:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165696 00000100:00100000:0.0:1787397851.635700:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165696 00000100:00100000:0.0:1787397851.635727:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165056 00000100:00100000:0.0:1787397851.635730:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165056 00000100:00100000:0.0:1787397851.635744:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165568 00000100:00100000:0.0:1787397851.635746:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165568 00000100:00100000:0.0:1787397851.635760:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1787397851.635765:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701165696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.635804:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701165696:12345-0@lo:400:kworker.0 Request processed in 39us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397851.635811:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1787397851.635823:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5080 00000100:00100000:0.0:1787397851.635827:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701165056:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787397851.635845:0:26164:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397851.635874:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701165056:12345-0@lo:8:kworker.0 Request processed in 45us (255us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397851.635879:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5080 00000100:00080000:3.0:1787397851.636338:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397851.636343:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397851.637087:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5081 00000100:00100000:3.0:1787397851.637096:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701165568:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787397851.637114:0:8501:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397851.637162:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701165568:12345-0@lo:8:kworker.0 Request processed in 66us (1501us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397851.637168:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5081 00000100:00100000:3.0:1787397851.637239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701164800:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.637276:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701165824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.637288:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701165312:0@lo:400:kworker.0 00000100:00100000:3.0:1787397851.637315:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701164544:0@lo:400:kworker.0 00000100:00100000:0.0:1787397851.643986:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701165696:0@lo:400:kworker.0 00000100:00080000:0.0:1787397851.644040:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397851.644046:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397851.644050:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701165056:0@lo:8:kworker.0 00000100:00080000:0.0:1787397851.644074:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397851.644079:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397851.644082:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701165568:0@lo:8:kworker.0 00000020:01000004:3.0:1787397852.004925:0:98424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397852.004930:0:98424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787397852.004931:0:98424:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787397852.005038:0:98424:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a70a905000 00000020:01000004:3.0:1787397852.005065:0:98424:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787397852.005080:0:98424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397852.005095:0:98424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89a838783380) 00000020:00000080:3.0:1787397852.005113:0:98424:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1787397852.005134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787397852.072593:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397852.075035:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787397852.075631:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787397852.075802:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787397852.076402:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787397852.077284:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787397852.077557:0:98424:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1787397852.084503:0:98424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787397852.085053:0:98424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787397852.085068:0:98424:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787397852.085080:0:98424:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192428 00000020:01000004:0.0:1787397852.085087:0:98424:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787397852.085112:0:98424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787397852.085115:0:98424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787397852.085122:0:98424:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787397852.085150:0:98424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787397852.085155:0:98424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397852.095073:0:98424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397852.095114:0:98424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787397852.095123:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397852.095125:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397852.095126:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397852.095127:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397852.095128:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397852.095130:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397852.095131:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397852.095133:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397852.095134:0:98424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397852.095138:0:98424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787397852.095140:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397852.095141:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397852.095142:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397852.095143:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397852.095144:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397852.095145:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397852.095146:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397852.095147:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397852.095148:0:98424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397852.095175:0:98424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787397852.095198:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701165952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397852.095270:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.095360:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a706ca0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397852.096094:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701165952 00000100:00100000:0.0:1787397852.096104:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701165952 00000100:00100000:0.0:1787397852.096194:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787397852.096205:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:98424:x1874218701165952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787397852.096237:0:94333:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787397852.096240:0:94333:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787397852.096245:0:94333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787397852.096549:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:98424:x1874218701165952:12345-0@lo:253:mount.lustre.0 Request processed in 345us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.096556:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787397852.096674:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701165952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787397852.096687:0:98424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787397852.096690:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787397852.096691:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787397852.096699:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397852.096700:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397852.096701:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397852.096702:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397852.096704:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397852.096705:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397852.096706:0:98424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787397852.096730:0:98424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a70a905000 from lustre-OST0000 10000000:01000000:3.0:1787397852.096757:0:98424:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787397852.096760:0:98424:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787397852.096769:0:98424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:3.0:1787397852.096779:0:98424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397852.096869:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.096905:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.097183:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166080 00000100:00100000:2.0:1787397852.097189:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166080 00000100:00100000:3.0:1787397852.097204:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397852.097297:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787397852.097305:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:98424:x1874218701166080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397852.097378:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:98424:x1874218701166080:12345-0@lo:501:mount.lustre.0 Request processed in 74us (471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397852.097386:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787397852.097405:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787397852.097418:0:98424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787397852.097436:0:98424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787397852.097443:0:98424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.097452:0:98424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397852.097478:0:98424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a70a905000 10000000:01000000:3.0:1787397852.097483:0:98424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787397852.097489:0:98424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787397852.097491:0:98424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397852.097495:0:98424:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787397852.097505:0:98424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397852.097720:0:98424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.097730:0:98424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.097740:0:98424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397852.097753:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397852.097780:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.097839:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.097865:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166208 00000100:00100000:1.0:1787397852.097869:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166208 00000100:00100000:1.0:1787397852.097927:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787397852.097935:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:98424:x1874218701166208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397852.097945:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397852.097957:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b200/0x274786fe0d192436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19242f expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.097990:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b200/0x274786fe0d192436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19242f expref: 22 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.098001:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b200/0x274786fe0d192436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19242f expref: 22 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.098016:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b200, rc 0) 00000100:00100000:1.0:1787397852.098061:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166208:12345-0@lo:101:mount.lustre.0 Request processed in 127us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.098067:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787397852.098119:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397852.098130:0:98424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.098138:0:98424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397852.099164:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1787397852.099778:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397852.100039:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787397852.100091:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787397852.100105:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787397852.100118:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787397852.100131:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787397852.100143:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787397852.100156:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787397852.100168:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787397852.100192:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787397852.100205:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787397852.100218:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787397852.100230:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787397852.100246:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787397852.100252:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787397852.100325:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.100384:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.100825:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787397852.100918:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166336 00000100:00100000:0.0:1787397852.100925:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166336 00000100:00100000:0.0:1787397852.101074:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787397852.101084:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397852.101198:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166336:12345-0@lo:501:mount.lustre.0 Request processed in 115us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.101206:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787397852.101391:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.101423:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397852.101467:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.101491:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787397852.101625:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166464 00000100:00100000:2.0:1787397852.101630:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166464 00000100:00100000:2.0:1787397852.101654:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787397852.101728:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397852.101861:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166464:12345-0@lo:503:mount.lustre.0 Request processed in 135us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.101868:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787397852.102116:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787397852.102495:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787397852.103863:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397852.103934:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.104083:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397852.104498:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166592 00000100:00100000:2.0:1787397852.104505:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166592 00000100:00100000:2.0:1787397852.104589:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787397852.104599:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397852.104752:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166592:12345-0@lo:502:mount.lustre.0 Request processed in 154us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.104759:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787397852.105213:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787397852.105436:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787397852.105466:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787397852.105478:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787397852.105491:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787397852.105509:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787397852.105644:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787397852.105732:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787397852.105749:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787397852.105774:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787397852.105788:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787397852.105802:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787397852.105815:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787397852.105846:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397852.105893:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.105925:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.107075:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166720 00000100:00100000:1.0:1787397852.107085:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166720 00000100:00100000:1.0:1787397852.107138:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787397852.107146:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.107633:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166720:12345-0@lo:502:mount.lustre.0 Request processed in 486us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.107643:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787397852.108222:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397852.108303:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1787397852.108319:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787397852.109365:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397852.109374:0:98428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787397852.109381:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.109384:0:98428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787397852.109442:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397852.109457:0:98428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89a70207cd40) 00000020:00000080:0.0:1787397852.109483:0:98428:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787397852.109490:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787397852.109743:0:98428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a905000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787397852.109751:0:98428:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787397852.109758:0:98428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192444 00010000:00010000:0.0:1787397852.115160:0:98428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:0.0:1787397852.115844:0:98428:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968731 srv lr: 4294968753 lx: 1874218701047552 gen 0 00000001:00080000:0.0:1787397852.115881:0:98428:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968749 srv lr: 4294968753 lx: 1874218701128064 gen 0 00000001:00080000:0.0:1787397852.115894:0:98428:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 4294968773 srv lr: 4294968753 lx: 1874218681267712 gen 0 00000001:00000004:0.0:1787397852.115910:0:98428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 4294968773 00080000:10000000:0.0:1787397852.117493:0:98428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787397852.121585:0:98428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787397852.121605:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397852.121611:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121613:0:98428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787397852.121617:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397852.121620:0:98428:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1787397852.121621:0:98428:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397852.121622:0:98428:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397852.121624:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397852.121626:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121627:0:98428:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397852.121629:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397852.121632:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121633:0:98428:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787397852.121636:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787397852.121638:0:98428:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787397852.121640:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397852.121642:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121644:0:98428:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787397852.121646:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397852.121648:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121649:0:98428:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787397852.121653:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787397852.121814:0:98428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397852.121818:0:98428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397852.121820:0:98428:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787397852.121823:0:98428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1787397852.122053:0:98424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787397852.122084:0:98424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787397852.122108:0:98424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.122119:0:98424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397852.122127:0:98424:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a70a905000 from 1 10000000:01000000:3.0:1787397852.122130:0:98424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397852.122165:0:98424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.122174:0:98424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.122184:0:98424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397852.122209:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397852.122276:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.122323:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.122384:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166848 00000100:00100000:1.0:1787397852.122391:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166848 00000100:00100000:1.0:1787397852.122441:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787397852.122451:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:98424:x1874218701166848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397852.122463:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397852.122477:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b000/0x274786fe0d192467 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192460 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.122499:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b000/0x274786fe0d192467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192460 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.122510:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b000/0x274786fe0d192467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192460 expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.122519:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:1.0:1787397852.122600:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701166848:12345-0@lo:101:mount.lustre.0 Request processed in 150us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.122609:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787397852.122795:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397852.122817:0:98424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.122826:0:98424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397852.124173:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1787397852.124415:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397852.124604:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787397852.124628:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787397852.124642:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787397852.124657:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787397852.124747:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787397852.124766:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787397852.124771:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 6 count 7 00000100:00100000:3.0:1787397852.124843:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.124896:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.124932:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701166976 00000100:00100000:3.0:1787397852.124940:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701166976 00000100:00100000:3.0:1787397852.125239:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787397852.125248:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701166976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.125350:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701166976:12345-0@lo:501:mount.lustre.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.125358:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787397852.125396:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397852.125417:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701166976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.125446:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397852.125499:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.125552:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.125666:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167104 00000100:00100000:1.0:1787397852.125672:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167104 00000100:00100000:1.0:1787397852.125703:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787397852.125709:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397852.125796:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167104:12345-0@lo:503:mount.lustre.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.125804:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787397852.125856:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167104:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787397852.127739:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787397852.127829:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.127894:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.127938:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366859c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397852.128098:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167232 00000100:00100000:3.0:1787397852.128106:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167232 00000100:00100000:3.0:1787397852.128154:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787397852.128163:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397852.128283:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167232:12345-0@lo:502:mount.lustre.0 Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.128291:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787397852.128427:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397852.129099:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787397852.129133:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787397852.129154:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787397852.129169:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787397852.129182:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:2.0:1787397852.129210:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397852.129255:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.129292:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70305c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.129562:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167360 00000100:00100000:1.0:1787397852.129569:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167360 00000100:00100000:1.0:1787397852.129607:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787397852.129615:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.130191:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167360:12345-0@lo:502:mount.lustre.0 Request processed in 575us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.130200:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787397852.130380:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787397852.130453:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787397852.130463:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1787397852.138646:0:98432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397852.138840:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397852.138843:0:98432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787397852.138854:0:98432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70a905000 00000020:00000080:3.0:1787397852.138857:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787397852.138866:0:98432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397852.138870:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397852.138872:0:98432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787397852.138874:0:98432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787397852.138876:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397852.138878:0:98432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787397852.138881:0:98432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a70a905000 00000020:00000080:3.0:1787397852.138884:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787397852.138991:0:98432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787397852.138995:0:98432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787397852.138997:0:98432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787397852.139000:0:98432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:0.0:1787397852.139164:0:98424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787397852.139192:0:98424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397852.139219:0:98424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397852.139232:0:98424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397852.139300:0:98424:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787397852.139302:0:98424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a70a905000 10000000:01000000:0.0:1787397852.139305:0:98424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a70a905000 10000000:01000000:0.0:1787397852.139309:0:98424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787397852.139315:0:98424:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a70a905000 from 1 10000000:01000000:0.0:1787397852.139317:0:98424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397852.139352:0:98424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397852.139360:0:98424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397852.139371:0:98424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397852.139393:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397852.139459:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397852.139501:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397852.139639:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167488 00000100:00100000:3.0:1787397852.139651:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167488 00000100:00100000:3.0:1787397852.139710:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787397852.139720:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:98424:x1874218701167488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397852.139733:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397852.139746:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74200/0x274786fe0d192475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19246e expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.139768:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74200/0x274786fe0d192475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19246e expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.139778:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74200/0x274786fe0d192475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19246e expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.139786:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74200, rc 0) 00000100:00100000:3.0:1787397852.139835:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167488:12345-0@lo:101:mount.lustre.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.139843:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787397852.141391:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397852.141415:0:98424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397852.141426:0:98424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787397852.146279:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000040:00080000:1.0:1787397852.146604:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397852.146826:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787397852.146852:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787397852.146867:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787397852.146893:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787397852.146908:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787397852.146928:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787397852.146940:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787397852.146954:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787397852.146968:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787397852.146980:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787397852.146991:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787397852.147004:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787397852.147016:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787397852.147030:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787397852.147054:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787397852.147069:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787397852.147085:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787397852.147099:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787397852.147113:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787397852.147128:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787397852.147142:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787397852.147153:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787397852.147166:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787397852.147181:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787397852.147195:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787397852.147211:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787397852.147224:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787397852.147237:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787397852.147253:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787397852.147267:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787397852.147279:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787397852.147295:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787397852.147310:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787397852.147323:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787397852.147337:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787397852.147354:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787397852.147379:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787397852.147401:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787397852.147417:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787397852.147429:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787397852.147441:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787397852.147453:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787397852.147466:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787397852.147478:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787397852.147490:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787397852.147502:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787397852.147514:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787397852.147557:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787397852.147679:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787397852.147701:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787397852.147715:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787397852.147727:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].52, 224 off17176 00000040:00080000:1.0:1787397852.147739:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].53, 112 off17288 00000040:00080000:1.0:1787397852.147750:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].54, 224 off17512 00000040:00080000:1.0:1787397852.147763:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].55, 224 off17736 00000040:00080000:1.0:1787397852.147775:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].56, 136 off17872 00000040:00080000:1.0:1787397852.147787:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].57, 224 off18096 00000040:00080000:1.0:1787397852.147800:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].58, 224 off18320 00000040:00080000:1.0:1787397852.147815:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].59, 136 off18456 00000040:00080000:1.0:1787397852.147828:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].60, 224 off18680 00000040:00080000:1.0:1787397852.147841:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].61, 224 off18904 00000040:00080000:1.0:1787397852.147852:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].62, 112 off19016 00000040:00080000:1.0:1787397852.147869:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].63, 224 off19240 00000040:00080000:1.0:1787397852.147874:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 63 count 63 00000100:00100000:1.0:1787397852.147975:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397852.148055:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.148101:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397852.148376:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167616 00000100:00100000:3.0:1787397852.148384:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167616 00000100:00100000:3.0:1787397852.148435:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787397852.148443:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397852.148588:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167616:12345-0@lo:501:mount.lustre.0 Request processed in 145us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.148595:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787397852.149203:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397852.149261:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397852.149312:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.149375:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397852.149482:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167744 00000100:00100000:3.0:1787397852.149487:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167744 00000100:00100000:3.0:1787397852.149686:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787397852.149695:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397852.149855:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167744:12345-0@lo:503:mount.lustre.0 Request processed in 159us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.149865:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787397852.149995:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787397852.150463:0:98424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787397852.150567:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397852.150630:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.151235:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.151274:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701167872 00000100:00100000:1.0:1787397852.151281:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701167872 00000100:00100000:1.0:1787397852.151329:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787397852.151338:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.151465:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701167872:12345-0@lo:502:mount.lustre.0 Request processed in 128us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.151473:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787397852.151555:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701167872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787397852.151962:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787397852.151992:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787397852.152006:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787397852.152022:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787397852.152037:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787397852.152066:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787397852.152085:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787397852.152101:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787397852.152118:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787397852.152138:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787397852.152153:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787397852.152167:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787397852.152183:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787397852.152203:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787397852.152221:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787397852.152237:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787397852.152254:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787397852.152282:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787397852.152302:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787397852.152317:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787397852.152330:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787397852.152342:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787397852.152354:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787397852.152368:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787397852.152381:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787397852.152896:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787397852.152925:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787397852.152939:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787397852.152956:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787397852.152970:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787397852.152983:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787397852.152996:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787397852.153008:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787397852.153023:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787397852.153036:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787397852.153233:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787397852.153254:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787397852.153275:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787397852.153295:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787397852.153317:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787397852.153336:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787397852.153350:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787397852.153362:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787397852.153376:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787397852.153401:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787397852.153417:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787397852.153430:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787397852.153442:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787397852.153494:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701168000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.155883:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.155941:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168000 00000100:00100000:1.0:1787397852.155950:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168000 00000100:00100000:1.0:1787397852.156009:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787397852.156019:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701168000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.156165:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701168000:12345-0@lo:502:mount.lustre.0 Request processed in 147us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.156173:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787397852.156232:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.156254:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701168000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787397852.156457:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787397852.156486:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000040:00080000:1.0:1787397852.156500:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787397852.156513:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].52, 224 off17176 00000040:00080000:1.0:1787397852.156556:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].53, 112 off17288 00000040:00080000:1.0:1787397852.156570:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].54, 224 off17512 00000040:00080000:1.0:1787397852.156582:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].55, 224 off17736 00000040:00080000:1.0:1787397852.156592:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].56, 136 off17872 00000040:00080000:1.0:1787397852.156604:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].57, 224 off18096 00000040:00080000:1.0:1787397852.156616:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].58, 224 off18320 00000040:00080000:1.0:1787397852.156629:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].59, 136 off18456 00000040:00080000:1.0:1787397852.156640:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].60, 224 off18680 00000040:00080000:1.0:1787397852.156652:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].61, 224 off18904 00000040:00080000:1.0:1787397852.158017:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].62, 112 off19016 00000100:00100000:1.0:1787397852.158080:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701168128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.158145:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.158182:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168128 00000100:00100000:1.0:1787397852.158189:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168128 00000100:00100000:1.0:1787397852.158234:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787397852.158242:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701168128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397852.158331:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701168128:12345-0@lo:502:mount.lustre.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.158339:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787397852.158388:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a834788300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.158422:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701168128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787397852.160664:0:98424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].63, 224 off19240 00000040:00080000:1.0:1787397852.160688:0:98424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:1.0:1787397852.162067:0:98435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787397852.162083:0:98435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89a7033a3380) 00000020:00000080:1.0:1787397852.162112:0:98435:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787397852.162608:0:98435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a905000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397852.162612:0:98435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a905000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397852.162615:0:98435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a905000 3 00010000:00080000:0.0:1787397852.162654:0:98435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a702025800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397852.167368:0:98435:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:0.0:1787397852.169805:0:98435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787397852.169870:0:98435:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397852.169888:0:98435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x274786fe0d192483 00000100:00080000:0.0:1787397852.169899:0:98435:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397852.169905:0:98435:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a702025800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397852.169946:0:98435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a836041f80 x1874218701168256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397852.169988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701168256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397852.170074:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397852.170135:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168256 00000100:00100000:0.0:1787397852.170142:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168256 00000100:00100000:0.0:1787397852.170177:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:0.0:1787397852.170185:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701168256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787397852.170212:0:74374:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:0.0:1787397852.170246:0:74374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d19248a 00000004:00100000:0.0:1787397852.170263:0:74374:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397852.170299:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a817efd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397852.170352:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701168256:12345-0@lo:38:llog_process_th.0 Request processed in 166us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.170360:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:0.0:1787397852.172750:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787397852.172770:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:0.0:1787397852.172783:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787397852.172789:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787397852.172792:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702025800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397852.172822:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701168256:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787397852.172869:0:98435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787397852.174642:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701168384:0@lo:400:kworker.0 00000100:00100000:0.0:1787397852.174714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.175468:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168384 00000100:00100000:2.0:1787397852.175478:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168384 00000100:00100000:2.0:1787397852.175572:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1787397852.175582:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701168384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397852.175645:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701168384:12345-0@lo:400:kworker.0 Request processed in 65us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.176581:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1787397852.176791:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701168384:0@lo:400:kworker.0 00000020:01000004:2.0:1787397852.178000:0:98435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787397852.178017:0:98435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89a83b9d19c0) 00000020:00000080:2.0:1787397852.178055:0:98435:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787397852.178238:0:98435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a70a905000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787397852.178242:0:98435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a905000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787397852.178245:0:98435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a905000 3 00010000:00080000:2.0:1787397852.178273:0:98435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a836570000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787397852.182054:0:98435:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:2.0:1787397852.182176:0:98435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787397852.182225:0:98435:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787397852.182240:0:98435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x274786fe0d192498 00000100:00080000:2.0:1787397852.182251:0:98435:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787397852.182257:0:98435:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a836570000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397852.182301:0:98435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a1a8000 x1874218701168640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397852.182348:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701168640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397852.182417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.182477:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168640 00000100:00100000:2.0:1787397852.182484:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168640 00000100:00100000:2.0:1787397852.182517:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1787397852.182546:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701168640:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787397852.182578:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3731 last 0 00000020:00000080:2.0:1787397852.182609:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d19249f 00000004:00100000:2.0:1787397852.182623:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397852.182653:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a836140800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397852.182704:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701168640:12345-0@lo:38:llog_process_th.0 Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.182711:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1787397852.182752:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397852.182761:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000100:00080000:2.0:1787397852.182768:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787397852.182772:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787397852.182775:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836570000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787397852.182781:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701168640:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787397852.185861:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397852.185867:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397852.185870:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397852.185878:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3730 00000100:00080000:1.0:1787397852.185883:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397852.185890:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397852.185910:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a81816e680 x1874218701168896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397852.185940:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701168896:0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.186067:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168896 00000100:00100000:1.0:1787397852.186076:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168896 00000100:00100000:1.0:1787397852.186116:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082 00000100:00100000:1.0:1787397852.186123:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701168896:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186186:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701168896:12345-0@lo:8:kworker.0 Request processed in 62us (181us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397852.186193:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082 00000100:00080000:1.0:1787397852.186237:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397852.186241:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787397852.186245:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701168896:0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186297:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701169024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.186324:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.186352:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169024 00000100:00100000:1.0:1787397852.186356:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169024 00000100:00100000:1.0:1787397852.186388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1787397852.186394:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701169024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.186433:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701169024:12345-0@lo:400:kworker.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.186440:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1787397852.186468:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701169024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.186495:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397852.186501:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701169152:0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.186554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.186582:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169152 00000100:00100000:1.0:1787397852.186586:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169152 00000100:00100000:1.0:1787397852.186613:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:1.0:1787397852.186619:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701169152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.186652:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701169152:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.186682:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:1.0:1787397852.186712:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701169152:0@lo:400:kworker.0 00000100:00080000:1.0:1787397852.186747:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397852.186750:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397852.186752:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397852.186755:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3730 00000100:00080000:1.0:1787397852.186758:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397852.186762:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397852.186775:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a81816ce00 x1874218701169408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397852.186792:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701169408:0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.186842:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169408 00000100:00100000:1.0:1787397852.186846:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169408 00000100:00100000:1.0:1787397852.186864:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5083 00000100:00100000:1.0:1787397852.186869:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218701169408:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186906:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218701169408:12345-0@lo:8:kworker.0 Request processed in 35us (88us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787397852.186912:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5083 00000100:00080000:1.0:1787397852.186938:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397852.186942:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787397852.186945:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701169408:0@lo:8:kworker.0 00000100:00100000:1.0:1787397852.186983:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701169664:0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.187005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.187052:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169664 00000100:00100000:1.0:1787397852.187057:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169664 00000100:00100000:1.0:1787397852.187082:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1787397852.187088:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701169664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397852.187121:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701169664:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.187128:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1787397852.187155:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701169664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187249:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701168512:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.187401:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701169280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.187454:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397852.187460:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701168768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187480:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.187497:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701169536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.187566:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169280 00000100:00100000:3.0:1787397852.187571:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169280 00000100:00100000:3.0:1787397852.187595:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168768 00000100:00100000:3.0:1787397852.187597:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168768 00000100:00100000:3.0:1787397852.187611:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1787397852.187616:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701169280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187651:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701169280:12345-0@lo:400:kworker.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.187657:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1787397852.187671:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1787397852.187676:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701168768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187700:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701168768:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.187715:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1787397852.187744:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701168768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397852.187752:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701169280:0@lo:400:kworker.0 00000100:00080000:2.0:1787397852.188972:0:98435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787397852.189012:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169536 00000100:00100000:2.0:1787397852.189018:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169536 00000100:00100000:2.0:1787397852.189080:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:2.0:1787397852.189087:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701169536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397852.189140:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701169536:12345-0@lo:400:kworker.0 Request processed in 54us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.189147:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:2.0:1787397852.189193:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701169536:0@lo:400:kworker.0 00000100:00100000:2.0:1787397852.189213:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701168512 00000100:00100000:2.0:1787397852.189216:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701168512 00000100:00100000:2.0:1787397852.189240:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:2.0:1787397852.189252:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701168512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397852.189282:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701168512:12345-0@lo:400:kworker.0 Request processed in 32us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.189288:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:2.0:1787397852.189310:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701168512:0@lo:400:kworker.0 00000040:00080000:2.0:1787397852.191253:0:98435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64 count 63 00000020:01000000:0.0:1787397852.191432:0:98424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1787397852.191462:0:98424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397852.191482:0:98424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397852.191494:0:98424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397852.191568:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787397852.191570:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397852.191572:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397852.191573:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397852.191574:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397852.191575:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397852.191577:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397852.191579:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397852.191580:0:98424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397852.191585:0:98424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787397852.191587:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397852.191588:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397852.191589:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397852.191590:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397852.191592:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397852.191593:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397852.191594:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397852.191595:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397852.191595:0:98424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397852.191621:0:98424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787397852.191641:0:98424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701169792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397852.192203:0:98424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397852.192317:0:98424:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397852.192376:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701169792 00000100:00100000:1.0:1787397852.192384:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701169792 00000100:00100000:1.0:1787397852.192463:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787397852.192472:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701169792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397852.192498:0:94333:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397852.192509:0:94333:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787397852.200686:0:94333:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397852.200707:0:94333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787397852.201087:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:98424:x1874218701169792:12345-0@lo:253:mount.lustre.0 Request processed in 8611us (8878us total) trans 0 rc 0/0 20000000:01000000:2.0:1787397852.201088:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787397852.201093:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1787397852.201100:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00010000:2.0:1787397852.201115:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.201130:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.201137:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.201159:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.201168:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397852.201309:0:98424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:98424:1874218701169792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397852.201322:0:98424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787397852.201325:0:98424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397852.201326:0:98424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787397852.201328:0:98424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397852.201329:0:98424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397852.201330:0:98424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397852.201331:0:98424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397852.201333:0:98424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397852.201335:0:98424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397852.201336:0:98424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787397852.201351:0:98424:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787397852.201481:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 9 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.201499:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 9 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397852.201917:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701169920:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397852.202024:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.202034:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397852.202056:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701170048:0@lo:104: 00000100:00100000:2.0:1787397852.202088:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787397852.202123:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.202131:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397852.202138:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701170176:0@lo:104: 00000100:00100000:2.0:1787397852.202158:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397852.202173:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397852.202189:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170048 00000100:00100000:2.0:1787397852.202194:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170048 00000100:00100000:2.0:1787397852.202237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170176 00000100:00100000:2.0:1787397852.202240:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170176 00000100:00100000:2.0:1787397852.202256:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787397852.202279:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787397852.202288:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701170176:12345-0@lo:104: 00010000:00010000:1.0:1787397852.202302:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202352:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787397852.202358:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701170176:12345-0@lo:104: Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.202365:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:1.0:1787397852.202391:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397852.202396:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202403:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397852.202406:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202413:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397852.202419:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397852.202425:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787397852.202451:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202457:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397852.202476:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202482:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a808718200/0x274786fe0d1923fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192405 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202494:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397852.202495:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397852.202497:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397852.202508:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701170304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397852.202566:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397852.202601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170304 00000100:00100000:1.0:1787397852.202610:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170304 00010000:00010000:1.0:1787397852.202628:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 24 pid: 94334 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397852.202666:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1787397852.202673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701170304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397852.202683:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397852.202687:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 24 pid: 94334 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202695:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 24 pid: 94334 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.202711:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397852.202739:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701170304:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.202745:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1787397852.202787:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701170304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397852.202811:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a808718600/0x274786fe0d192405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1923fe expref: 23 pid: 94334 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397852.202827:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701170176:0@lo:104: 00000100:00100000:2.0:1787397852.203313:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701170048:12345-0@lo:104: 00010000:00010000:2.0:1787397852.203326:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.203482:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787397852.203489:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701170048:12345-0@lo:104: Request processed in 1226us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397852.203519:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00010000:00010000:3.0:1787397852.203615:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397852.203631:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203638:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397852.203642:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203650:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397852.203664:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397852.203670:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397852.203702:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203708:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397852.203722:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203728:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a808718c00/0x274786fe0d19240c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192413 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203741:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397852.203749:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397852.203750:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397852.203793:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701170432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397852.203824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397852.203895:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170432 00000100:00100000:3.0:1787397852.203902:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170432 00010000:00010000:3.0:1787397852.203924:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397852.203961:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1787397852.203969:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701170432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397852.203978:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397852.203982:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.203991:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 23 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397852.204003:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397852.204032:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701170432:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397852.204039:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1787397852.204109:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701170432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397852.204339:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a808718800/0x274786fe0d192413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d19240c expref: 22 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397852.204350:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701170048:0@lo:104: 00010000:00080000:0.0:1787397852.206550:0:98424:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968773 00010000:00080000:0.0:1787397852.207200:0:98440:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 98440 00010000:02000000:0.0:1787397852.207216:0:98440:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1787397852.207221:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787397852.207225:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1787397852.207663:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701169920:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397852.207693:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787397852.207785:0:98424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787397852.207833:0:98424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787397852.207851:0:98424:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787397852.207885:0:98424:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787397852.208712:0:98424:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397852.208946:0:98424:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787397852.230012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.231684:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279232 00000100:00100000:1.0:1787397852.231697:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279232 00010000:00010000:1.0:1787397852.231737:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397852.231775:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2652 00000100:00100000:1.0:1787397852.231784:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681279232:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397852.231799:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397852.231805:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231818:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231835:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75200/0x274786fe0d19241a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8570 expref: 10 pid: 94333 timeout: 3831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231850:0:19659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231857:0:19659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397852.231873:0:19659:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030780541s 00010000:00010000:1.0:1787397852.231878:0:19659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231884:0:19659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231896:0:19659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231903:0:19659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231909:0:19659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397852.231914:0:19659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231921:0:19659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231943:0:19659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397852.231953:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397852.232011:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2404:x1874218681279232:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 227us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397852.232018:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2652 00010000:00010000:2.0:1787397852.232078:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.232086:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397852.232092:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a808719400/0x274786fe0d1924a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397852.933733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397852.933772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397852.933805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397852.933838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397852.933866:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279360 00000100:00100000:0.0:1787397852.933880:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279360 00000100:00100000:0.0:1787397852.933942:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279488 00000100:00100000:0.0:1787397852.933945:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279488 00000100:00100000:0.0:1787397852.933974:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1520 00000100:00100000:0.0:1787397852.933984:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681279360:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397852.934075:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681279360:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.934091:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1520 00000100:00100000:0.0:1787397852.934110:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1521 00000100:00100000:0.0:1787397852.934116:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681279488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397852.934145:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681279488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.934151:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1521 00000100:00100000:0.0:1787397852.934169:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279744 00000100:00100000:0.0:1787397852.934173:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279744 00000100:00100000:0.0:1787397852.934201:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279616 00000100:00100000:0.0:1787397852.934205:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279616 00000100:00100000:0.0:1787397852.934223:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2705 00000100:00100000:0.0:1787397852.934229:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681279744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397852.934255:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681279744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.934261:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2705 00000100:00100000:0.0:1787397852.934273:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5084 00000100:00100000:0.0:1787397852.934277:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681279616:12345-192.168.204.60@tcp:8:kworker.0 00010000:00080000:0.0:1787397852.934751:0:26166:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a836493800, cookie 0x274786fe0d192459 00010000:00080000:0.0:1787397852.934760:0:26166:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t4294968754 exp ffff89a836493800 cur 3732 last 1787397852 00010000:02000400:0.0:1787397852.934768:0:26166:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1787397852.934774:0:26166:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1787397852.934787:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a836493800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787397852.934798:0:26166:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787397852.934942:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a709122000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397852.934976:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681279616:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 696us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397852.934984:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5084 00000100:00080000:0.0:1787397852.935006:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397852.935010:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397852.935012:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397852.942134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.942333:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681279872 00000100:00100000:1.0:1787397852.942342:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681279872 00000100:00100000:1.0:1787397852.942388:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280000 00000100:00100000:1.0:1787397852.942404:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280000 00000100:00100000:1.0:1787397852.942422:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280128 00000100:00100000:1.0:1787397852.942425:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280128 00000100:00100000:1.0:1787397852.942439:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280256 00000100:00100000:1.0:1787397852.942441:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280256 00000100:00100000:1.0:1787397852.942454:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280384 00000100:00100000:1.0:1787397852.942456:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280384 00000100:00100000:1.0:1787397852.942468:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280512 00000100:00100000:1.0:1787397852.942471:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280512 00000100:00100000:1.0:1787397852.942490:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5085 00000100:00100000:1.0:1787397852.942500:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681279872:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397852.942519:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a83af17b80 x1874218681279872/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.942609:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5086 00000100:00100000:2.0:1787397852.942620:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280000:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397852.942630:0:8501:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a83af14380 x1874218681280000/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397852.943244:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681279872:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 742us (1116us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397852.943254:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5085 00000100:00100000:1.0:1787397852.943270:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5087 00000100:00100000:1.0:1787397852.943277:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280128:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397852.943287:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a83af17480 x1874218681280128/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397852.943320:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5088 00000100:00100000:3.0:1787397852.943332:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280256:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787397852.943342:0:26160:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b42300 x1874218681280256/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.944761:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280000:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 2137us (2580us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397852.944770:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5086 00000100:00100000:2.0:1787397852.944795:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5089 00000100:00100000:2.0:1787397852.944807:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280384:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397852.944820:0:8501:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b41c00 x1874218681280384/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.944841:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280384:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 40us (2575us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397852.944847:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5089 00000100:00100000:2.0:1787397852.944857:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5090 00000100:00100000:2.0:1787397852.944863:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280512:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397852.944872:0:8501:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b40e00 x1874218681280512/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.944881:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280512:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 19us (2591us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397852.944886:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5090 00000100:00100000:1.0:1787397852.945001:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280128:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 1723us (2791us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397852.945007:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5087 00010000:00080000:0.0:1787397852.945112:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1787397852.945123:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1787397852.945141:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681280256:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 1810us (2891us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397852.945149:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5088 00000100:00100000:0.0:1787397852.945186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397852.945348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397852.947169:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280640 00000100:00100000:1.0:1787397852.947184:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280640 00000100:00100000:1.0:1787397852.947268:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280768 00000100:00100000:1.0:1787397852.947272:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280768 00000100:00100000:2.0:1787397852.947342:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5091 00000100:00100000:2.0:1787397852.947354:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681280640:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397852.947373:0:26165:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a836040000 x1874218681280640/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.947395:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681280640:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 44us (2211us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397852.947403:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5091 00000100:00100000:2.0:1787397852.947413:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5092 00000100:00100000:2.0:1787397852.947581:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681280768:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1787397852.947591:0:26165:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702188000 x1874218681280768/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397852.947612:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681280768:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 193us (2265us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397852.947618:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5092 00010000:00080000:0.0:1787397852.947663:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000004:1.0:1787397852.984379:0:98489:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397852.984753:0:98489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397853.029960:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787397853.413501:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787397853.413510:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 126 10000000:01000000:2.0:1787397853.413515:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397853.413843:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.413855:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.413865:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397853.413892:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397853.413963:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397853.414013:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025becc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397853.414200:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170560 00000100:00100000:3.0:1787397853.414217:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170560 00000100:00100000:3.0:1787397853.414308:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787397853.414321:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701170560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397853.414345:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.414368:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1924ad expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.414402:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1924ad expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.414416:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1924ad expref: 23 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.414427:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75c00, rc 0) 00000100:00100000:3.0:1787397853.414571:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701170560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397853.414579:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787397853.414824:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397853.414847:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.414858:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397853.414965:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397853.415029:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397853.415071:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704753e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397853.415434:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170688 00000100:00100000:2.0:1787397853.415448:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170688 00000100:00100000:2.0:1787397853.415513:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787397853.415543:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701170688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397853.415566:0:94340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787397853.415590:0:94340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397853.415594:0:94340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 126 00000100:00100000:2.0:1787397853.415715:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701170688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.415731:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787397853.416970:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170688:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787397853.417078:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a817efe800 already not connected (conn 10, was 0): DISCONN 00010000:00080000:0.0:1787397853.417094:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a817efe800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.160@tcp, moved to head 00000100:00080000:0.0:1787397853.417102:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397853.417111:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397853.417175:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70218a300 x1874218701170816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787397853.417251:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397853.417263:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.417275:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397853.417288:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397853.417292:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 126 10000000:01000000:0.0:1787397853.417295:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397853.417325:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.417334:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.417344:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397853.417365:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397853.417433:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397853.417472:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170944 00000100:00100000:0.0:1787397853.417484:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397853.417486:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170944 00000100:00100000:2.0:1787397853.417586:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787397853.417598:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701170944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397853.417614:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397853.417633:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1924bb expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.417659:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1924bb expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.417668:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1924bb expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.417678:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808719e00, rc 0) 00000100:00100000:2.0:1787397853.417749:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701170944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.417755:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787397853.417963:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701170816:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1787397853.418015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397853.418937:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701170816 00000100:00100000:2.0:1787397853.418945:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701170816 00000100:00100000:2.0:1787397853.418981:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5093 00000100:00100000:2.0:1787397853.418987:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3647:x1874218701170816:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1787397853.419026:0:26166:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a703c36000, cookie 0x274786fe0d192452 00010000:00080000:2.0:1787397853.419035:0:26166:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968749 exp ffff89a703c36000 cur 3732 last 1787397852 00002000:00100000:2.0:1787397853.419056:0:26166:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a703c36000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787397853.419077:0:26166:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787397853.419080:0:26166:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787397853.419180:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701170944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397853.419212:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.419228:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397853.419240:0:26166:0:(import.c:65:import_set_state_nolock()) ffff89a836143000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397853.419322:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701170816:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 332us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397853.419334:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701171072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397853.419335:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5093 00000100:00100000:0.0:1787397853.419413:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397853.419468:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f600 going to sleep for 11 seconds 00010000:00080000:3.0:1787397853.419483:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70218a300 x1874218701170816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397853.419501:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787397853.419546:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1787397853.419551:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1787397853.419554:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 2 00000100:00080000:3.0:1787397853.419558:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a817efe800 from lustre-OST0000_UUID committed 4294968749 last 0 00000100:00080000:3.0:1787397853.419561:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1787397853.421733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701170816:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1787397853.422241:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171072 00000100:00100000:2.0:1787397853.422250:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171072 00000100:00100000:2.0:1787397853.422300:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787397853.422309:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701171072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397853.422336:0:94335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787397853.422356:0:94335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397853.422359:0:94335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 126 00000100:00100000:2.0:1787397853.422497:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701171072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.422517:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787397853.422597:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701171072:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1787397853.422637:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a83670c800 already not connected (conn 10, was 0): DISCONN 00010000:00080000:2.0:1787397853.422649:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a83670c800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.160@tcp, moved to head 00000100:00080000:2.0:1787397853.422654:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397853.422661:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397853.422686:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a829848e00 x1874218701171200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1787397853.422727:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397853.422736:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397853.422752:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787397853.422814:0:98510:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1787397853.422822:0:98510:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1787397853.422829:0:98510:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1787397853.422876:0:98510:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787397853.423000:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701171200:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1787397853.423050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397853.423085:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701171328:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1787397853.423108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397853.423146:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171200 00000100:00100000:3.0:1787397853.423152:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171200 00000100:00100000:3.0:1787397853.423179:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094 00000100:00100000:3.0:1787397853.423185:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701171200:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787397853.423211:0:8501:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a703c34000, cookie 0x274786fe0d19244b 00010000:00080000:3.0:1787397853.423217:0:8501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff89a703c34000 cur 3732 last 1787397852 00002000:00100000:3.0:1787397853.423233:0:8501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a703c34000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787397853.423237:0:8501:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787397853.423240:0:8501:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1787397853.423272:0:8501:0:(import.c:65:import_set_state_nolock()) ffff89a8364e0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397853.423323:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701171200:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 137us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397853.423330:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094 00000100:00100000:3.0:1787397853.423344:0:8501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171328 00000100:00100000:3.0:1787397853.423348:0:8501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171328 00000100:00100000:3.0:1787397853.423389:0:8501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:3.0:1787397853.423400:0:8501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701171328:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787397853.423413:0:8501:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70a1a8000 x1874218701171328/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397853.423423:0:8501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701171328:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 30us (315us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397853.423429:0:8501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00010000:00080000:3.0:1787397853.423450:0:98440:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1787397853.423455:0:98440:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294968774 00010000:00080000:3.0:1787397853.423458:0:98440:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:3.0:1787397853.423462:0:98440:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:3.0:1787397853.423485:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a829848e00 x1874218701171200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397853.423496:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787397853.423505:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1787397853.423509:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1787397853.423511:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 2 00000100:00080000:3.0:1787397853.423514:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83670c800 from lustre-OST0000_UUID committed 4294968731 last 0 00000100:00080000:3.0:1787397853.423517:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787397853.429834:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701171200:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787397853.430075:0:98511:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1787397853.430082:0:98511:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1787397853.430089:0:98511:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1787397853.430139:0:98511:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787397853.430229:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701171456:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397853.430340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397853.430481:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171456 00000100:00100000:2.0:1787397853.430493:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171456 00000100:00100000:2.0:1787397853.430597:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:2.0:1787397853.430609:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701171456:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1787397853.431133:0:26158:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70218b800 x1874218701171456/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397853.431162:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701171456:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 557us (824us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397853.431173:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00010000:00080000:3.0:1787397853.431248:0:98440:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968774 00010000:00080000:3.0:1787397853.431254:0:98440:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00010000:00080000:3.0:1787397853.431279:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.431283:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.431296:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a83af17b80 x1874218681279872/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.431320:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.431361:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1924c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84eb expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431398:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1924c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431422:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1924c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431435:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75200, rc 0) 00010000:00080000:3.0:1787397853.431604:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:3.0:1787397853.431638:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.431640:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.431647:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a83af14380 x1874218681280000/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.431659:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.431673:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d1924d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d847b expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431688:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d1924d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431698:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d1924d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431714:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74a00, rc 0) 00010000:00080000:3.0:1787397853.431737:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.431743:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.431745:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.431752:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b41c00 x1874218681280384/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.431762:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.431774:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1924d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84d6 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431790:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1924d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431814:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1924d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431821:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75400, rc 0) 00010000:00080000:3.0:1787397853.431841:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.431851:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.431853:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.431858:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b40e00 x1874218681280512/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.431868:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.431880:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1924de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8497 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431906:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1924de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431917:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1924de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.431925:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75000, rc 0) 00010000:00080000:3.0:1787397853.431958:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.431966:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.431968:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.431975:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a83af17480 x1874218681280128/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.431985:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.431997:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c36eacbf/0x274786fe0d1924e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84c1 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432011:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c36eacbf/0x274786fe0d1924e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432034:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c36eacbf/0x274786fe0d1924e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432043:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583a00, rc 0) 00010000:00080000:3.0:1787397853.432067:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.432075:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.432082:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.432090:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b42300 x1874218681280256/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.432101:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.432113:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1924ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d84ba expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432129:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1924ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432138:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1924ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432147:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582a00, rc 0) 00010000:00080000:3.0:1787397853.432167:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.432175:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.432176:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.432182:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a836040000 x1874218681280640/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.432192:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.432206:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d1924f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8489 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432224:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d1924f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432237:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d1924f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432255:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582600, rc 0) 00010000:00080000:3.0:1787397853.432280:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.432289:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787397853.432291:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1787397853.432297:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702188000 x1874218681280768/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:293/0 lens 328/0 e 0 to 0 dl 1787397863 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787397853.432309:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397853.432323:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d1924fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8458 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432341:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d1924fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432354:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d1924fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397853.432363:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582400, rc 0) 00010000:00080000:3.0:1787397853.432392:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1787397853.432404:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1787397853.441576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.441760:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681280896 00000100:00100000:1.0:1787397853.441769:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681280896 00000100:00100000:1.0:1787397853.441812:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281024 00000100:00100000:1.0:1787397853.441815:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281024 00000100:00100000:1.0:1787397853.441829:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281152 00000100:00100000:1.0:1787397853.441833:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281152 00000100:00100000:1.0:1787397853.441848:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281280 00000100:00100000:1.0:1787397853.441851:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281280 00000100:00100000:1.0:1787397853.441866:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281408 00000100:00100000:1.0:1787397853.441869:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281408 00000100:00100000:1.0:1787397853.441883:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281536 00000100:00100000:1.0:1787397853.441886:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281536 00000100:00100000:1.0:1787397853.441899:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281664 00000100:00100000:1.0:1787397853.441901:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281664 00000100:00100000:1.0:1787397853.441929:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5095 00000100:00100000:1.0:1787397853.441938:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681280896:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1787397853.441961:0:26168:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b40a80 x1874218681280896/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397853.441983:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5096 00000100:00100000:1.0:1787397853.441986:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681280896:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 47us (419us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397853.441998:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5095 00000100:00100000:3.0:1787397853.442009:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281024:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787397853.442050:0:26163:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b41500 x1874218681281024/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397853.442052:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5097 00000100:00100000:1.0:1787397853.442073:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281152:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787397853.442076:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281024:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 76us (456us total) trans 0 rc 0/-999 00010000:00080000:1.0:1787397853.442091:0:26168:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a829b41180 x1874218681281152/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397853.442106:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5096 00000100:00100000:1.0:1787397853.442115:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281152:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 46us (470us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397853.442123:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5097 00000100:00100000:3.0:1787397853.442132:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5098 00000100:00100000:1.0:1787397853.442142:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5099 00000100:00100000:3.0:1787397853.442150:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281280:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787397853.442162:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281408:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787397853.442168:0:26163:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a828cfb100 x1874218681281280/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397853.442179:0:26168:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a828cf8e00 x1874218681281408/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397853.442194:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281280:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 46us (519us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397853.442206:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281408:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 45us (514us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397853.442216:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5098 00000100:00100000:1.0:1787397853.442229:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5099 00000100:00100000:3.0:1787397853.442238:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5100 00000100:00100000:1.0:1787397853.442248:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5101 00000100:00100000:3.0:1787397853.442255:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281536:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787397853.442267:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281664:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1787397853.442271:0:26163:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a836691180 x1874218681281536/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397853.442283:0:26168:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a836692d80 x1874218681281664/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397853.442293:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281536:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 41us (583us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397853.442329:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5100 00000100:00100000:1.0:1787397853.442335:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:2401:x1874218681281664:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 65us (596us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397853.442344:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5101 00010000:00080000:1.0:1787397853.442403:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442411:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b40a80 x1874218681280896/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442435:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442462:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d192501 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d842e expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442488:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d192501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442505:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d192501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442514:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00010000:00080000:1.0:1787397853.442594:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.442607:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.442609:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442613:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b41500 x1874218681281024/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442623:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442634:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a05bc45/0x274786fe0d192508 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8569 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442647:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a05bc45/0x274786fe0d192508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442657:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a05bc45/0x274786fe0d192508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442676:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ae00, rc 0) 00010000:00080000:1.0:1787397853.442696:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.442703:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.442704:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442710:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a829b41180 x1874218681281152/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442719:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442730:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d19250f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8435 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442743:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d19250f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442753:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d19250f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442759:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720ac00, rc 0) 00010000:00080000:1.0:1787397853.442778:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.442784:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.442786:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442790:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a828cfb100 x1874218681281280/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442799:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442808:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016fb901d/0x274786fe0d192516 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8562 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442835:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016fb901d/0x274786fe0d192516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442845:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016fb901d/0x274786fe0d192516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442852:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00010000:00080000:1.0:1787397853.442870:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.442876:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.442878:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442883:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a828cf8e00 x1874218681281408/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442892:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442902:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007136c84/0x274786fe0d19251d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8412 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442915:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007136c84/0x274786fe0d19251d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442924:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007136c84/0x274786fe0d19251d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.442930:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a800, rc 0) 00010000:00080000:1.0:1787397853.442946:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.442954:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.442961:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.442967:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a836691180 x1874218681281536/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.442977:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.442989:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d9cb438/0x274786fe0d192524 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8554 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443001:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d9cb438/0x274786fe0d192524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443011:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d9cb438/0x274786fe0d192524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443034:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00010000:00080000:1.0:1787397853.443053:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.443060:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397853.443061:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397853.443066:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a836692d80 x1874218681281664/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397853.443073:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.443083:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d19252b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8419 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443097:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d19252b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443105:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d19252b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.443118:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00010000:00080000:1.0:1787397853.443135:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397853.443143:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1787397853.455791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.455840:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.455866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.455897:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.455943:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.455985:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281792 00000100:00100000:0.0:1787397853.455998:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281792 00000100:00100000:0.0:1787397853.456087:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681281920 00000100:00100000:0.0:1787397853.456092:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681281920 00000100:00100000:0.0:1787397853.456114:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282048 00000100:00100000:0.0:1787397853.456117:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282048 00000100:00100000:0.0:1787397853.456146:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282176 00000100:00100000:0.0:1787397853.456150:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282176 00000100:00100000:0.0:1787397853.456177:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282304 00000100:00100000:0.0:1787397853.456181:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282304 00000100:00100000:0.0:1787397853.456216:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5102 00000100:00100000:0.0:1787397853.456243:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681281792:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397853.456270:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218ad80 x1874218681281792/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397853.456296:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681281792:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 58us (520us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397853.456304:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5102 00000100:00100000:0.0:1787397853.456317:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5103 00000100:00100000:0.0:1787397853.456324:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681281920:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397853.456332:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218bb80 x1874218681281920/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397853.456342:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681281920:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 19us (502us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397853.456348:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5103 00000100:00100000:0.0:1787397853.456356:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5104 00000100:00100000:0.0:1787397853.456366:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282048:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397853.456373:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702188e00 x1874218681282048/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397853.456381:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282048:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 21us (516us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397853.456386:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5104 00000100:00100000:0.0:1787397853.456393:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5105 00000100:00100000:0.0:1787397853.456401:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282176:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397853.456420:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a702189f80 x1874218681282176/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397853.456428:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282176:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 31us (532us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397853.456434:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5105 00000100:00100000:0.0:1787397853.456442:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5106 00000100:00100000:0.0:1787397853.456448:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282304:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397853.456455:0:26167:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70218a680 x1874218681282304/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397853.456462:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:2401:x1874218681282304:12345-192.168.204.60@tcp:101:ldlm_lock_repla.0 Request processed in 16us (522us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397853.456467:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5106 00010000:00080000:0.0:1787397853.456500:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397853.456509:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218ad80 x1874218681281792/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397853.456578:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397853.456611:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192532 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d852a expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456647:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456669:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456694:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0200, rc 0) 00010000:00080000:0.0:1787397853.456768:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787397853.456783:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397853.456786:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397853.456791:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218bb80 x1874218681281920/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397853.456801:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397853.456814:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d192539 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d83fd expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456829:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d192539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456840:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d192539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456848:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0c00, rc 0) 00010000:00080000:0.0:1787397853.456866:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787397853.456871:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397853.456873:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397853.456877:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702188e00 x1874218681282048/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397853.456886:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397853.456896:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d192540 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8531 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456920:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d192540 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456931:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d192540 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.456939:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8016a0e00, rc 0) 00010000:00080000:0.0:1787397853.456957:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787397853.456962:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397853.456964:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397853.456969:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a702189f80 x1874218681282176/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397853.456978:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397853.456988:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d192547 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8515 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457000:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d192547 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457010:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d192547 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457032:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00010000:00080000:0.0:1787397853.457049:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787397853.457054:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787397853.457061:0:98440:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1787397853.457067:0:98440:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.60@tcp: req@ffff89a70218a680 x1874218681282304/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 328/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397853.457077:0:98440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397853.457089:0:98440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d19254e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8500 expref: -99 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457106:0:98440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d19254e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457118:0:98440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d19254e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 25 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397853.457127:0:98440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74600, rc 0) 00010000:00080000:0.0:1787397853.457147:0:98440:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1787397853.457154:0:98440:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1787397853.463202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397853.464339:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282432 00000100:00100000:2.0:1787397853.464359:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282432 00000100:00100000:2.0:1787397853.464443:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2708 00000100:00100000:2.0:1787397853.464456:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2401:x1874218681282432:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1787397853.464483:0:15073:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a828411180 x1874218681282432/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397853.464539:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2401:x1874218681282432:12345-192.168.204.60@tcp:400:ptlrpcd_rcv.0 Request processed in 68us (1330us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397853.464548:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2708 00010000:00080000:3.0:1787397853.464682:0:98440:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787397853.464842:0:98440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934592 00000001:00100000:2.0:1787397853.475688:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:2.0:1787397853.475704:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787397853.475712:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787397853.476607:0:98440:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:3.0:1787397853.476752:0:98440:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a70a1a8000 x1874218701171328/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787397853.476931:0:98440:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a70218b800 x1874218701171456/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787397853.476985:0:98440:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a828411180 x1874218681282432/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 224/0 e 0 to 0 dl 1787397864 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787397853.477142:0:98440:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00002000:00080000:3.0:1787397853.478419:0:98440:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787397853.478432:0:98440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00080000:0.0:1787397853.478606:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787397853.478622:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a70691ce00 x1874218701171456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397869 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397853.478636:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a70691ce00 x1874218701171456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397869 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397853.478644:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1787397853.478669:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1787397853.478673:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397853.478678:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70691ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701171456:0@lo:400:ldlm_lock_repla.0 00000100:00080000:0.0:1787397853.478699:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787397853.478704:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a702189180 x1874218701171328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397869 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397853.478720:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a702189180 x1874218701171328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397869 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397853.478726:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1787397853.478741:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1787397853.478744:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397853.478748:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701171328:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787397853.478945:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701171712:0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1787397853.479035:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397853.479070:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787397853.479081:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75625:1874218701171968:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787397853.479089:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397853.479103:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701171584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397853.479123:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397853.479146:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be900 going to sleep for 11 seconds 00000100:00100000:0.0:1787397853.479147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397853.479194:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171584 00000100:00100000:0.0:1787397853.479202:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171584 00000100:00100000:2.0:1787397853.479368:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1787397853.479382:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701171584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397853.479407:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 853440 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397853.479579:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171712 00000100:00100000:0.0:1787397853.479583:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171712 00000100:00100000:0.0:1787397853.479612:0:26161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171968 00000100:00100000:0.0:1787397853.479615:0:26161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171968 00000100:00100000:0.0:1787397853.479635:0:26161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107 00000100:00100000:0.0:1787397853.479642:0:26161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701171712:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787397853.479961:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701171584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 581us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.479971:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1787397853.484466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.484623:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268736 00000100:00100000:3.0:1787397853.484639:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268736 00002000:00100000:3.0:1787397853.484730:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff89a82984a300 x1874218681268736/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.484744:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82984a300 with x1874218681268736 ext(0->1023) 00002000:00010000:3.0:1787397853.484765:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82984a300 00000100:00100000:3.0:1787397853.484815:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 595 00000100:00100000:3.0:1787397853.484827:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:2404:x1874218681268736:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:2.0:1787397853.486676:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108 00000100:00100000:2.0:1787397853.486701:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:75625:x1874218701171968:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787397853.488440:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701171584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397853.488589:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701171840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397853.488674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397853.488736:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701171840 00000100:00100000:0.0:1787397853.488744:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701171840 00000100:00100000:0.0:1787397853.488790:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1787397853.488809:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701171840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397853.488836:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 853440 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787397853.488883:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701171840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397853.488891:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1787397853.488927:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701171840:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1787397853.490155:0:26161:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787397853.490168:0:26161:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x7a1:0x0] 00000100:00100000:1.0:1787397853.490190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.490418:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681268864 00000100:00100000:1.0:1787397853.490432:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681268864 00000100:00100000:1.0:1787397853.490487:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5109 00000100:00100000:1.0:1787397853.490498:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+26:2404:x1874218681268864:12345-192.168.204.60@tcp:16:kworker.0 00000100:00100000:0.0:1787397853.491571:0:26161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:94348:x1874218701171712:12345-0@lo:7:osp-pre-0-0.0 Request processed in 11921us (12528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397853.491585:0:26161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107 00000100:00100000:1.0:1787397853.491885:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701171712:0@lo:7:osp-pre-0-0.0 00000004:00080000:1.0:1787397853.491905:0:94348:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x7a1:0x0] 00002000:00080000:2.0:1787397853.495437:0:26162:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787397853.495464:0:26162:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x261:0x0] 00000100:00100000:2.0:1787397853.495707:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:75625:x1874218701171968:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9009us (16577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.495722:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108 00000100:00100000:0.0:1787397853.499998:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75625:1874218701171968:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787397853.500034:0:75625:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x261:0x0] 00000100:00100000:0.0:1787397853.502573:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+28:2404:x1874218681268736:12345-192.168.204.60@tcp:4:dd.0 Request processed in 17698us (18087us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787397853.502589:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 595 00002000:00100000:0.0:1787397853.502604:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff89a82984a300 x1874218681268736/t8589934593(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.502615:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82984a300 with x1874218681268736 ext(0->1023) 00002000:00010000:0.0:1787397853.502628:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82984a300 00000100:00100000:1.0:1787397853.502731:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:2404:x1874218681268864:12345-192.168.204.60@tcp:16:kworker.0 Request processed in 11322us (11634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397853.502748:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5109 00000100:00100000:1.0:1787397853.511637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.512070:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282816 00000100:00100000:3.0:1787397853.512086:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282816 00002000:00100000:3.0:1787397853.513272:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff89a705388000 x1874218681282816/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.513292:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a705388000 with x1874218681282816 ext(0->1023) 00002000:00010000:3.0:1787397853.513303:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a705388000 00000100:00100000:3.0:1787397853.513370:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 596 00000100:00100000:3.0:1787397853.513389:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+27:2402:x1874218681282816:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:2.0:1787397853.520862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:2402:x1874218681282816:12345-192.168.204.60@tcp:4:dd.0 Request processed in 7463us (9223us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787397853.520891:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 596 00002000:00100000:2.0:1787397853.520910:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff89a705388000 x1874218681282816/t8589934594(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.520931:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a705388000 with x1874218681282816 ext(0->1023) 00002000:00010000:2.0:1787397853.520941:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a705388000 00000100:00100000:1.0:1787397853.526519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.526863:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681282944 00000100:00100000:0.0:1787397853.526881:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681282944 00002000:00100000:0.0:1787397853.526973:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff89a70538b480 x1874218681282944/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.526988:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70538b480 with x1874218681282944 ext(0->1023) 00002000:00010000:0.0:1787397853.527009:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70538b480 00000100:00100000:0.0:1787397853.527069:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 597 00000100:00100000:0.0:1787397853.527082:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+29:2403:x1874218681282944:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.530962:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:2403:x1874218681282944:12345-192.168.204.60@tcp:4:dd.0 Request processed in 3872us (4445us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787397853.530977:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 597 00002000:00100000:0.0:1787397853.530998:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff89a70538b480 x1874218681282944/t8589934595(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.531009:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70538b480 with x1874218681282944 ext(0->1023) 00002000:00010000:0.0:1787397853.531025:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70538b480 00000100:00100000:1.0:1787397853.542631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.543201:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283072 00000100:00100000:3.0:1787397853.543216:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283072 00002000:00100000:3.0:1787397853.543271:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff89a705388e00 x1874218681283072/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.543283:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a705388e00 with x1874218681283072 ext(0->1023) 00002000:00010000:3.0:1787397853.543304:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a705388e00 00000100:00100000:3.0:1787397853.543348:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 598 00000100:00100000:3.0:1787397853.543358:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+31:2402:x1874218681283072:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:3.0:1787397853.545452:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:2402:x1874218681283072:12345-192.168.204.60@tcp:4:dd.0 Request processed in 2084us (2825us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787397853.545466:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 598 00002000:00100000:3.0:1787397853.545477:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff89a705388e00 x1874218681283072/t8589934596(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.545488:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a705388e00 with x1874218681283072 ext(0->1023) 00002000:00010000:3.0:1787397853.545495:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a705388e00 00000100:00100000:1.0:1787397853.556622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397853.556798:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283200 00000100:00100000:2.0:1787397853.556830:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283200 00002000:00100000:2.0:1787397853.556921:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff89a82e4f5880 x1874218681283200/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.556936:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5880 with x1874218681283200 ext(0->1023) 00002000:00010000:2.0:1787397853.556944:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5880 00000100:00100000:2.0:1787397853.556989:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 599 00000100:00100000:2.0:1787397853.557002:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+33:2402:x1874218681283200:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:2.0:1787397853.560675:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:2402:x1874218681283200:12345-192.168.204.60@tcp:4:dd.0 Request processed in 3664us (4056us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787397853.560690:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 599 00002000:00100000:2.0:1787397853.560704:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff89a82e4f5880 x1874218681283200/t8589934597(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.560714:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5880 with x1874218681283200 ext(0->1023) 00002000:00010000:2.0:1787397853.560722:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5880 00000100:00100000:0.0:1787397853.573897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397853.574459:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283328 00000100:00100000:2.0:1787397853.574476:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283328 00002000:00100000:2.0:1787397853.574576:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff89a70218a300 x1874218681283328/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.574587:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70218a300 with x1874218681283328 ext(0->1023) 00002000:00010000:2.0:1787397853.574593:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70218a300 00000100:00100000:2.0:1787397853.574621:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 600 00000100:00100000:2.0:1787397853.574630:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+35:2403:x1874218681283328:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.578756:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:2403:x1874218681283328:12345-192.168.204.60@tcp:4:dd.0 Request processed in 4108us (4866us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787397853.578781:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 600 00002000:00100000:0.0:1787397853.578798:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff89a70218a300 x1874218681283328/t8589934598(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.578811:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70218a300 with x1874218681283328 ext(0->1023) 00002000:00010000:0.0:1787397853.578820:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70218a300 00000100:00100000:1.0:1787397853.596483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.596609:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283456 00000100:00100000:1.0:1787397853.596622:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283456 00002000:00100000:1.0:1787397853.596666:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff89a82e4f4380 x1874218681283456/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.596677:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f4380 with x1874218681283456 ext(0->1023) 00002000:00010000:1.0:1787397853.596692:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f4380 00000100:00100000:1.0:1787397853.596721:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 601 00000100:00100000:1.0:1787397853.596729:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+37:2402:x1874218681283456:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:1.0:1787397853.602286:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:2402:x1874218681283456:12345-192.168.204.60@tcp:4:dd.0 Request processed in 5543us (5803us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787397853.602302:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 601 00002000:00100000:1.0:1787397853.602315:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff89a82e4f4380 x1874218681283456/t8589934599(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.602326:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f4380 with x1874218681283456 ext(0->1023) 00002000:00010000:1.0:1787397853.602333:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f4380 00000100:00100000:3.0:1787397853.608717:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.614077:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283584 00000100:00100000:0.0:1787397853.614094:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283584 00002000:00100000:0.0:1787397853.614237:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff89a70691c000 x1874218681283584/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.614249:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70691c000 with x1874218681283584 ext(0->1023) 00002000:00010000:0.0:1787397853.614257:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70691c000 00000100:00100000:0.0:1787397853.614379:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 602 00000100:00100000:0.0:1787397853.614398:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+39:2403:x1874218681283584:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.616852:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:2403:x1874218681283584:12345-192.168.204.60@tcp:4:dd.0 Request processed in 2446us (8140us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787397853.616866:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 602 00002000:00100000:0.0:1787397853.616878:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff89a70691c000 x1874218681283584/t8589934600(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.616888:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70691c000 with x1874218681283584 ext(0->1023) 00002000:00010000:0.0:1787397853.616894:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70691c000 00000100:00100000:3.0:1787397853.630722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.631004:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283712 00000100:00100000:0.0:1787397853.631025:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283712 00002000:00100000:0.0:1787397853.631082:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff89a70691ce00 x1874218681283712/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.631094:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70691ce00 with x1874218681283712 ext(0->1023) 00002000:00010000:0.0:1787397853.631099:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70691ce00 00000100:00100000:0.0:1787397853.631213:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 603 00000100:00100000:0.0:1787397853.631225:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+41:2402:x1874218681283712:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.634043:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70691ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+43:2402:x1874218681283712:12345-192.168.204.60@tcp:4:dd.0 Request processed in 2809us (3701us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787397853.634060:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 603 00002000:00100000:0.0:1787397853.634073:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff89a70691ce00 x1874218681283712/t8589934601(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.634086:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a70691ce00 with x1874218681283712 ext(0->1023) 00002000:00010000:0.0:1787397853.634092:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a70691ce00 00000100:00100000:0.0:1787397853.645692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.648315:0:24843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283840 00000100:00100000:1.0:1787397853.648330:0:24843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283840 00002000:00100000:1.0:1787397853.648435:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff89a80fe51f80 x1874218681283840/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.648447:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80fe51f80 with x1874218681283840 ext(0->1023) 00002000:00010000:1.0:1787397853.648454:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80fe51f80 00000100:00100000:1.0:1787397853.648502:0:24843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 604 00000100:00100000:1.0:1787397853.648511:0:24843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+43:2402:x1874218681283840:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.660742:0:24843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:784819ec-79bc-4534-8fa6-902d7a92d2f8+45:2402:x1874218681283840:12345-192.168.204.60@tcp:4:dd.0 Request processed in 12219us (15051us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787397853.660757:0:24843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 604 00002000:00100000:0.0:1787397853.660769:0:24843:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff89a80fe51f80 x1874218681283840/t8589934602(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.660780:0:24843:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80fe51f80 with x1874218681283840 ext(0->1023) 00002000:00010000:0.0:1787397853.660788:0:24843:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80fe51f80 00000100:00100000:2.0:1787397853.669582:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397853.669615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701172096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397853.669709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397853.669820:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172096 00000100:00100000:0.0:1787397853.669820:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397853.669828:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172096 00000100:00100000:0.0:1787397853.669830:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701172224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397853.669860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397853.669870:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172224 00000100:00100000:3.0:1787397853.669873:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172224 00000100:00100000:3.0:1787397853.669890:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:3.0:1787397853.669912:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701172096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397853.669951:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397853.670010:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701172096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397853.670093:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701172096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397853.671830:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:0.0:1787397853.671855:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701172224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397853.671895:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397853.672002:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701172224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397853.672010:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:0.0:1787397853.672091:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701172224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397853.674553:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:3.0:1787397853.677643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397853.677698:0:24842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681283968 00000100:00100000:2.0:1787397853.677709:0:24842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681283968 00002000:00100000:2.0:1787397853.677759:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff89a81816e680 x1874218681283968/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.677770:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816e680 with x1874218681283968 ext(0->1023) 00002000:00010000:2.0:1787397853.677775:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816e680 00000100:00100000:2.0:1787397853.677808:0:24842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 605 00000100:00100000:2.0:1787397853.677818:0:24842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+45:2405:x1874218681283968:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:2.0:1787397853.679317:0:24842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+47:2405:x1874218681283968:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1491us (1712us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787397853.679330:0:24842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 605 00002000:00100000:2.0:1787397853.679340:0:24842:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff89a81816e680 x1874218681283968/t8589934603(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787397853.679351:0:24842:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816e680 with x1874218681283968 ext(0->1023) 00002000:00010000:2.0:1787397853.679357:0:24842:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816e680 00000100:00100000:3.0:1787397853.687891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.687969:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284096 00000100:00100000:1.0:1787397853.687981:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284096 00002000:00100000:1.0:1787397853.688044:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff89a81816ea00 x1874218681284096/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.688055:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816ea00 with x1874218681284096 ext(0->1023) 00002000:00010000:1.0:1787397853.688061:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816ea00 00000100:00100000:1.0:1787397853.688105:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 606 00000100:00100000:1.0:1787397853.688114:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+47:2404:x1874218681284096:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:1.0:1787397853.692056:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+49:2404:x1874218681284096:12345-192.168.204.60@tcp:4:dd.0 Request processed in 3931us (4162us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787397853.692082:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 606 00002000:00100000:1.0:1787397853.692098:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff89a81816ea00 x1874218681284096/t8589934604(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.692109:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816ea00 with x1874218681284096 ext(0->1023) 00002000:00010000:1.0:1787397853.692117:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816ea00 00000100:00100000:0.0:1787397853.703081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.703291:0:24831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284224 00000100:00100000:3.0:1787397853.703302:0:24831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284224 00002000:00100000:3.0:1787397853.703354:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff89a80fe53100 x1874218681284224/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.703366:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80fe53100 with x1874218681284224 ext(0->1023) 00002000:00010000:3.0:1787397853.703372:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80fe53100 00000100:00100000:3.0:1787397853.703429:0:24831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 607 00000100:00100000:3.0:1787397853.703447:0:24831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+49:2405:x1874218681284224:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:3.0:1787397853.706554:0:24831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681284224:12345-192.168.204.60@tcp:4:dd.0 Request processed in 3106us (3472us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787397853.706569:0:24831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 607 00002000:00100000:3.0:1787397853.706581:0:24831:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff89a80fe53100 x1874218681284224/t8589934605(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.706591:0:24831:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a80fe53100 with x1874218681284224 ext(0->1023) 00002000:00010000:3.0:1787397853.706597:0:24831:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a80fe53100 00000100:00100000:3.0:1787397853.718105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.718293:0:24832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284352 00000100:00100000:1.0:1787397853.718304:0:24832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284352 00002000:00100000:1.0:1787397853.718362:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff89a81816ce00 x1874218681284352/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.718373:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816ce00 with x1874218681284352 ext(0->1023) 00002000:00010000:1.0:1787397853.718378:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816ce00 00000100:00100000:1.0:1787397853.718404:0:24832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 608 00000100:00100000:1.0:1787397853.718414:0:24832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681284352:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:3.0:1787397853.721673:0:24832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+53:2404:x1874218681284352:12345-192.168.204.60@tcp:4:dd.0 Request processed in 3249us (3564us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787397853.721687:0:24832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 608 00002000:00100000:3.0:1787397853.721700:0:24832:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff89a81816ce00 x1874218681284352/t8589934606(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.721710:0:24832:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816ce00 with x1874218681284352 ext(0->1023) 00002000:00010000:3.0:1787397853.721718:0:24832:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816ce00 00000100:00100000:1.0:1787397853.726002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.726106:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284480 00000100:00100000:0.0:1787397853.726117:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284480 00002000:00100000:0.0:1787397853.726169:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff89a82e4f7100 x1874218681284480/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.726180:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f7100 with x1874218681284480 ext(0->1023) 00002000:00010000:0.0:1787397853.726186:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f7100 00000100:00100000:0.0:1787397853.726236:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 609 00000100:00100000:0.0:1787397853.726247:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+53:2405:x1874218681284480:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.727862:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+55:2405:x1874218681284480:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1607us (1860us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787397853.727874:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 609 00002000:00100000:0.0:1787397853.727883:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff89a82e4f7100 x1874218681284480/t8589934607(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.727892:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f7100 with x1874218681284480 ext(0->1023) 00002000:00010000:0.0:1787397853.727897:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f7100 00000100:00100000:1.0:1787397853.736560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.737078:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284608 00000100:00100000:3.0:1787397853.737088:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284608 00002000:00100000:3.0:1787397853.737136:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff89a82e4f5180 x1874218681284608/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.737169:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5180 with x1874218681284608 ext(0->1023) 00002000:00010000:3.0:1787397853.737174:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5180 00000100:00100000:3.0:1787397853.737235:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 610 00000100:00100000:3.0:1787397853.737244:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+55:2405:x1874218681284608:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:3.0:1787397853.738616:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:2405:x1874218681284608:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1367us (2092us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787397853.738637:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 610 00002000:00100000:3.0:1787397853.738646:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff89a82e4f5180 x1874218681284608/t8589934608(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.738655:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f5180 with x1874218681284608 ext(0->1023) 00002000:00010000:3.0:1787397853.738661:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f5180 00000100:00100000:3.0:1787397853.743405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.743475:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284736 00000100:00100000:0.0:1787397853.743485:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284736 00002000:00100000:0.0:1787397853.743589:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff89a81816c380 x1874218681284736/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.743599:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816c380 with x1874218681284736 ext(0->1023) 00002000:00010000:0.0:1787397853.743604:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816c380 00000100:00100000:0.0:1787397853.743632:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 611 00000100:00100000:0.0:1787397853.743642:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:2404:x1874218681284736:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.745141:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:2404:x1874218681284736:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1494us (1814us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1787397853.745153:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 611 00002000:00100000:0.0:1787397853.745162:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff89a81816c380 x1874218681284736/t8589934609(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.745172:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a81816c380 with x1874218681284736 ext(0->1023) 00002000:00010000:0.0:1787397853.745178:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a81816c380 00000100:00100000:1.0:1787397853.748035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397853.748147:0:24828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284864 00000100:00100000:0.0:1787397853.748158:0:24828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284864 00002000:00100000:0.0:1787397853.748211:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff89a82e4f6d80 x1874218681284864/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.748223:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f6d80 with x1874218681284864 ext(0->1023) 00002000:00010000:0.0:1787397853.748229:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f6d80 00000100:00100000:0.0:1787397853.748264:0:24828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 612 00000100:00100000:0.0:1787397853.748273:0:24828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:2405:x1874218681284864:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:0.0:1787397853.750253:0:24828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:2405:x1874218681284864:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1974us (2219us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787397853.750267:0:24828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 612 00002000:00100000:0.0:1787397853.750277:0:24828:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff89a82e4f6d80 x1874218681284864/t8589934610(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787397853.750287:0:24828:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a82e4f6d80 with x1874218681284864 ext(0->1023) 00002000:00010000:0.0:1787397853.750293:0:24828:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a82e4f6d80 00000100:00100000:1.0:1787397853.769712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397853.772186:0:24830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681284992 00000100:00100000:3.0:1787397853.772203:0:24830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681284992 00002000:00100000:3.0:1787397853.772264:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff89a8178dd880 x1874218681284992/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.772275:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178dd880 with x1874218681284992 ext(0->1023) 00002000:00010000:3.0:1787397853.772281:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178dd880 00000100:00100000:3.0:1787397853.772322:0:24830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 613 00000100:00100000:3.0:1787397853.772331:0:24830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:2404:x1874218681284992:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:3.0:1787397853.779063:0:24830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:2404:x1874218681284992:12345-192.168.204.60@tcp:4:dd.0 Request processed in 6723us (9351us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787397853.779077:0:24830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 613 00002000:00100000:3.0:1787397853.779097:0:24830:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff89a8178dd880 x1874218681284992/t8589934611(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787397853.779107:0:24830:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a8178dd880 with x1874218681284992 ext(0->1023) 00002000:00010000:3.0:1787397853.779114:0:24830:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a8178dd880 00000100:00100000:3.0:1787397853.783349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.785910:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285120 00000100:00100000:1.0:1787397853.785924:0:24833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285120 00002000:00100000:1.0:1787397853.785984:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff89a835b64380 x1874218681285120/t0(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/0 e 0 to 0 dl 1787397864 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.786022:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b64380 with x1874218681285120 ext(0->1023) 00002000:00010000:1.0:1787397853.786029:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b64380 00000100:00100000:1.0:1787397853.786062:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 614 00000100:00100000:1.0:1787397853.786072:0:24833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+63:2405:x1874218681285120:12345-192.168.204.60@tcp:4:dd.0 00000100:00100000:1.0:1787397853.787898:0:24833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:2405:x1874218681285120:12345-192.168.204.60@tcp:4:dd.0 Request processed in 1820us (4552us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787397853.787911:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 614 00002000:00100000:1.0:1787397853.787920:0:24833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff89a835b64380 x1874218681285120/t8589934612(0) o4->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:294/0 lens 1512/448 e 0 to 0 dl 1787397864 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787397853.787930:0:24833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89a835b64380 with x1874218681285120 ext(0->1023) 00002000:00010000:1.0:1787397853.787935:0:24833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89a835b64380 00000100:00100000:3.0:1787397853.956321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397853.956505:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285248 00000100:00100000:1.0:1787397853.956515:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285248 00000100:00100000:1.0:1787397853.959923:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 258 00000100:00100000:1.0:1787397853.959946:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681285248:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397853.959964:0:94340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397853.959984:0:94340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8577 expref: -99 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.960024:0:94340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.960050:0:94340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397853.960072:0:94340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63400, rc 0) 00000100:00100000:1.0:1787397853.960143:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681285248:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 205us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397853.960152:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 258 00000100:00100000:2.0:1787397853.974822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397853.974869:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285376 00000100:00100000:2.0:1787397853.974878:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285376 00000100:00100000:2.0:1787397853.974925:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 259 00000100:00100000:2.0:1787397853.974935:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681285376:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787397853.974959:0:94335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787397853.974976:0:94335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787397853.974983:0:94335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 126 00000100:00100000:3.0:1787397853.980348:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681285376:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 5402us (5520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397853.980366:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 259 00010000:00010000:3.0:1787397854.052632:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397854.180668:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701172352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397854.180740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397854.180797:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172352 00000100:00100000:1.0:1787397854.180805:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172352 00000100:00100000:1.0:1787397854.180858:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1787397854.180867:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701172352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397854.180895:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397854.180939:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a807638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701172352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397854.180946:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00080000:1.0:1787397854.180967:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397854.181021:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701172352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397854.181093:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701172480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397854.181124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397854.181158:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172480 00000100:00100000:0.0:1787397854.181162:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172480 00000100:00100000:0.0:1787397854.181192:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1787397854.181198:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701172480:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787397854.181206:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787397854.181208:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397854.181246:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701172480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397854.181254:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:1.0:1787397854.181640:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701172480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787397855.076762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397856.100910:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397857.124817:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397857.253227:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701172992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253333:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701173504:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253390:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701174016:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787397857.253455:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701172608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253509:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701173120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253570:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701173632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253606:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701174144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253659:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701172736:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253683:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253699:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701173248:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253733:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701173760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253769:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787397857.253776:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701172864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253813:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253832:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701173376:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253853:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253870:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701173888:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.253888:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397857.253919:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172992 00000100:00100000:0.0:1787397857.253926:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172992 00000100:00100000:0.0:1787397857.253979:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173504 00000100:00100000:0.0:1787397857.253983:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173504 00000100:00100000:0.0:1787397857.254002:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1787397857.254009:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701172992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254067:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701172992:12345-0@lo:400:kworker.0 Request processed in 57us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254074:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1787397857.254093:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:0.0:1787397857.254099:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701173504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254126:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701173504:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254132:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:0.0:1787397857.254156:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174016 00000100:00100000:0.0:1787397857.254160:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174016 00000100:00100000:0.0:1787397857.254191:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174144 00000100:00100000:0.0:1787397857.254194:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174144 00000100:00100000:0.0:1787397857.254208:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172736 00000100:00100000:0.0:1787397857.254210:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172736 00000100:00100000:0.0:1787397857.254222:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172864 00000100:00100000:0.0:1787397857.254224:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172864 00000100:00100000:0.0:1787397857.254236:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173376 00000100:00100000:0.0:1787397857.254245:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173376 00000100:00100000:0.0:1787397857.254261:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173888 00000100:00100000:0.0:1787397857.254263:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173888 00000100:00100000:0.0:1787397857.254277:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1787397857.254282:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701174016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254314:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701174016:12345-0@lo:400:kworker.0 Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254320:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1787397857.254332:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1787397857.254337:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701174144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254359:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701174144:12345-0@lo:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254364:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1787397857.254373:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1787397857.254378:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701172736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254402:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701172736:12345-0@lo:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254407:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1787397857.254416:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1787397857.254421:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701172864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254460:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701172864:12345-0@lo:400:kworker.0 Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254465:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1787397857.254475:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1787397857.254480:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701173376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254501:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701173376:12345-0@lo:400:kworker.0 Request processed in 21us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254512:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:0.0:1787397857.254544:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1787397857.254550:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701173888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254578:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701173888:12345-0@lo:400:kworker.0 Request processed in 28us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254583:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1787397857.254602:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701172608 00000100:00100000:0.0:1787397857.254605:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701172608 00000100:00100000:0.0:1787397857.254632:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787397857.254638:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701172608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254666:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701172608:12345-0@lo:400:kworker.0 Request processed in 28us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254671:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787397857.254696:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173120 00000100:00100000:0.0:1787397857.254700:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173120 00000100:00100000:0.0:1787397857.254724:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173632 00000100:00100000:0.0:1787397857.254727:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173632 00000100:00100000:0.0:1787397857.254741:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173248 00000100:00100000:0.0:1787397857.254743:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173248 00000100:00100000:0.0:1787397857.254757:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701173760 00000100:00100000:0.0:1787397857.254758:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701173760 00000100:00100000:0.0:1787397857.254772:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1787397857.254777:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701173120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254806:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701173120:12345-0@lo:400:kworker.0 Request processed in 28us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254811:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1787397857.254824:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1787397857.254836:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701173632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254865:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701173632:12345-0@lo:400:kworker.0 Request processed in 30us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254871:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1787397857.254881:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1787397857.254887:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701173248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254913:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701173248:12345-0@lo:400:kworker.0 Request processed in 27us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254918:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1787397857.254929:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:0.0:1787397857.254934:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701173760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.254977:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70731dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701173760:12345-0@lo:400:kworker.0 Request processed in 42us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397857.254983:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00080000:0.0:1787397857.255031:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397857.255035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397857.255037:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397857.255039:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397857.255083:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701172864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255094:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701173376:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255103:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701173888:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255112:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701172736:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255121:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701173248:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255130:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701173760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255180:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701172608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255191:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701173120:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255200:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701173632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255209:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701174144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255219:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83678e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701172992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255228:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701173504:0@lo:400:kworker.0 00000100:00100000:0.0:1787397857.255239:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701174016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397858.069061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397858.069107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397858.069149:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397858.069167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397858.069234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397858.069518:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285504 00000100:00100000:3.0:1787397858.069560:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285504 00000100:00100000:3.0:1787397858.069638:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00100000:3.0:1787397858.069648:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681285504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397858.069720:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681285504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397858.069728:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 261 00000100:00100000:0.0:1787397858.071019:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285632 00000100:00100000:0.0:1787397858.071028:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285632 00000100:00100000:0.0:1787397858.071102:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285760 00000100:00100000:0.0:1787397858.071106:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285760 00000100:00100000:0.0:1787397858.071135:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1528 00000100:00100000:0.0:1787397858.071144:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681285632:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397858.071203:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681285632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 59us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397858.071211:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1528 00000100:00100000:0.0:1787397858.071228:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1529 00000100:00100000:0.0:1787397858.071235:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681285760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:2.0:1787397858.071351:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397858.071355:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397858.071513:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681285888 00000100:00100000:2.0:1787397858.071518:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681285888 00000100:00100000:2.0:1787397858.071577:0:26168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286016 00000100:00100000:2.0:1787397858.071580:0:26168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286016 00000100:00100000:2.0:1787397858.071605:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2713 00000100:00100000:2.0:1787397858.071613:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:2403:x1874218681285888:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397858.071650:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+65:2403:x1874218681285888:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397858.071657:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2713 00000100:00100000:2.0:1787397858.071671:0:26168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2714 00000100:00100000:2.0:1787397858.071678:0:26168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681286016:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397858.071703:0:26168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681286016:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397858.071708:0:26168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2714 00000100:00080000:2.0:1787397858.071758:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397858.071761:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397858.072744:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681285760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1505us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397858.072754:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1529 00010000:00010000:3.0:1787397858.148793:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397858.788963:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701174272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397858.789046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397858.789474:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701174400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397858.789549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397858.789652:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174400 00000100:00100000:0.0:1787397858.789660:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174400 00000100:00100000:2.0:1787397858.789692:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174272 00000100:00100000:2.0:1787397858.789699:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174272 00000100:00100000:0.0:1787397858.789712:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1787397858.789723:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701174400:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397858.789733:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1787397858.789742:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701174272:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1787397858.789772:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 161170880 pending 573440 free 3923431424 avail 3691909120 00000004:00000024:2.0:1787397858.789791:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397858.789936:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701174400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397858.789944:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1787397858.789996:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701174400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397858.792186:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701174528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397858.792252:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397858.792577:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701174272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2834us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397858.792587:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1787397858.792615:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174528 00000100:00100000:2.0:1787397858.792621:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174528 00000100:00100000:2.0:1787397858.792654:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1787397858.792661:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701174528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397858.792699:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397858.794089:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701174656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397858.794148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397858.794207:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174656 00000100:00100000:3.0:1787397858.794214:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174656 00000100:00100000:3.0:1787397858.794317:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1787397858.794326:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701174656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397858.794348:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 161170880 pending 573440 free 3923431424 avail 3691909120 00000100:00100000:3.0:1787397858.794389:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701174656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397858.794404:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:3.0:1787397858.794458:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701174656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397858.796767:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701174528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4095us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397858.796783:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:0.0:1787397858.798729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701174528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397858.798804:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701174272:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397859.175270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397859.301771:0:98781:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787397859.305968:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701174912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397859.306055:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397859.306104:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701174784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397859.306127:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397859.306174:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174912 00000100:00100000:0.0:1787397859.306184:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174912 00000100:00100000:0.0:1787397859.306237:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701174784 00000100:00100000:0.0:1787397859.306241:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701174784 00000100:00100000:0.0:1787397859.306260:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1787397859.306268:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701174912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397859.306314:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397859.306362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701174912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397859.306369:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1787397859.306387:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1787397859.306393:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701174784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397859.306402:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1787397859.306426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83678ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701174784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397859.306432:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00080000:0.0:1787397859.306447:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397859.306486:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701174912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397859.306499:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701174784:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787397859.819298:0:98425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934612 is committed 00010000:00010000:0.0:1787397860.199023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397860.312215:0:98833:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397860.318380:0:98833:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787397861.184504:0:98883:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397861.184767:0:98883:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397861.220698:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397862.246188:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397862.382463:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701175040:0@lo:400:kworker.0 00000100:00100000:1.0:1787397862.382634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397862.382714:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701175552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.382740:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175040 00000100:00100000:2.0:1787397862.382758:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175040 00000100:00100000:2.0:1787397862.382871:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787397862.382888:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701175040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.382983:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701175040:12345-0@lo:400:kworker.0 Request processed in 101us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.382996:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787397862.383070:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701175168:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.383139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397862.383191:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701175680:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.383264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.383661:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701175424:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.383903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.383974:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701175936:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.384127:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701176192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.384147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397862.384173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.384181:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701176448:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.384213:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397862.384223:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701175296:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.384231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.384261:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397862.384269:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701176064:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.384277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397862.384307:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701175808:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.384308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.384335:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701176576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.384395:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175424 00000100:00100000:3.0:1787397862.384403:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175424 00000100:00100000:3.0:1787397862.384749:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175936 00000100:00100000:3.0:1787397862.384754:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175936 00000100:00100000:3.0:1787397862.384777:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1787397862.384786:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701175424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.384856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.384869:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701175424:12345-0@lo:400:kworker.0 Request processed in 82us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397862.384878:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1787397862.384885:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701176320:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.384912:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1787397862.384918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.384923:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701175936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.384964:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175168 00000100:00100000:3.0:1787397862.384966:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701175936:12345-0@lo:400:kworker.0 Request processed in 46us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.384970:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175168 00000100:00100000:3.0:1787397862.384977:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1787397862.385044:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176448 00000100:00100000:2.0:1787397862.385048:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176448 00000100:00100000:2.0:1787397862.385066:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175296 00000100:00100000:2.0:1787397862.385069:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175296 00000100:00100000:2.0:1787397862.385082:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175808 00000100:00100000:2.0:1787397862.385084:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175808 00000100:00100000:2.0:1787397862.385101:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176320 00000100:00100000:2.0:1787397862.385103:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176320 00000100:00100000:3.0:1787397862.385107:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:3.0:1787397862.385120:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701175168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.385123:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1787397862.385136:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701176448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.385172:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701175168:12345-0@lo:400:kworker.0 Request processed in 55us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397862.385181:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1787397862.385181:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701176448:12345-0@lo:400:kworker.0 Request processed in 46us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.385192:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:3.0:1787397862.385206:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1787397862.385216:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:3.0:1787397862.385218:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701175296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.385228:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701175808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.385263:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701175296:12345-0@lo:400:kworker.0 Request processed in 49us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397862.385274:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1787397862.385274:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701175808:12345-0@lo:400:kworker.0 Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.385293:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:3.0:1787397862.385418:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1787397862.385427:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701176320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.386739:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175680 00000100:00100000:2.0:1787397862.386813:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175680 00000100:00100000:2.0:1787397862.386879:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176192 00000100:00100000:2.0:1787397862.386883:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176192 00000100:00100000:2.0:1787397862.386911:0:26169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176064 00000100:00100000:2.0:1787397862.386914:0:26169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176064 00000100:00100000:2.0:1787397862.386941:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1787397862.386950:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701175680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387018:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701175680:12345-0@lo:400:kworker.0 Request processed in 69us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.387025:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1787397862.387041:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:2.0:1787397862.387047:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701176192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387077:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701176192:12345-0@lo:400:kworker.0 Request processed in 31us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.387082:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:2.0:1787397862.387093:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:2.0:1787397862.387099:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701176064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387124:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701176064:12345-0@lo:400:kworker.0 Request processed in 25us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.387129:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00080000:2.0:1787397862.387173:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397862.387179:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397862.387181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397862.387184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397862.387240:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701175296:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387268:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701175808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387285:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701175168:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387298:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701175680:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.387311:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701176192:0@lo:400:kworker.0 00000100:00100000:1.0:1787397862.388018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397862.388053:0:26157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701175552 00000100:00100000:1.0:1787397862.388059:0:26157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701175552 00000100:00100000:1.0:1787397862.388109:0:26157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1787397862.388118:0:26157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701175552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397862.388158:0:26157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701175552:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397862.388165:0:26157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1787397862.388211:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701175552:0@lo:400:kworker.0 00000100:00100000:1.0:1787397862.388240:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701175040:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.389980:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701176320:12345-0@lo:400:kworker.0 Request processed in 4545us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397862.390047:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1787397862.390099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.390165:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70ab2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701175424:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.390189:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701175936:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.390208:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701176448:0@lo:400:kworker.0 00000100:00100000:3.0:1787397862.390265:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701176064:0@lo:400:kworker.0 00000100:00080000:3.0:1787397862.390565:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397862.390852:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a80fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701176320:0@lo:400:kworker.0 00000100:00100000:2.0:1787397862.393442:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176576 00000100:00100000:2.0:1787397862.393458:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176576 00000100:00100000:2.0:1787397862.393563:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:2.0:1787397862.393574:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701176576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787397862.393606:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397862.393674:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701176576:12345-0@lo:400:kworker.0 Request processed in 101us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.393681:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1787397862.393743:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701176576:0@lo:400:kworker.0 00000020:01000004:1.0:1787397862.952190:0:98980:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787397862.978807:0:98980:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787397862.978885:0:98980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.978902:0:98980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.978911:0:98980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.978918:0:98980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.979055:0:98980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787397862.979078:0:98980:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787397862.979103:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787397862.979107:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787397862.979113:0:98980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397862.979141:0:98980:0:(import.c:65:import_set_state_nolock()) ffff89a702025800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787397862.980487:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397862.980503:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.980516:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397862.980532:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.980618:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397862.980627:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397862.980633:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397862.980650:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787397862.980653:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787397862.980765:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.980906:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397862.980950:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.980960:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0600/0x274786fe0d19246e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192475 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.981046:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397862.981049:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397862.981050:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397862.981973:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397862.982596:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701176832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397862.982653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701176704:0@lo:39:umount.0 00000100:00100000:2.0:1787397862.982678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397862.982689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397862.982732:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176832 00000100:00100000:2.0:1787397862.982740:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176832 00000100:00100000:2.0:1787397862.982806:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1787397862.982815:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701176832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397862.982846:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397862.982865:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74200/0x274786fe0d192475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19246e expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.982879:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397862.982919:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701176832:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.982927:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1787397862.982943:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701176832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397862.982982:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176704 00000100:00100000:2.0:1787397862.982986:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176704 00000100:00100000:2.0:1787397862.983023:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1787397862.983030:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701176704:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397862.983074:0:74374:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19248a 00000100:00080000:2.0:1787397862.983085:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a817efd800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787397862.983150:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:3647:x1874218701176704:12345-0@lo:39:umount.0 Request processed in 120us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.983157:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000020:00000080:2.0:1787397862.983163:0:74374:0:(genops.c:906:class_export_put()) final put ffff89a817efa000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787397862.983537:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efa000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397862.983594:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efd800 for lustre-MDT0000 00000100:00080000:1.0:1787397862.983871:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702025800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787397862.983899:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701176704:0@lo:39:umount.0 00000100:00080000:3.0:1787397862.983921:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787397862.983926:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787397862.983931:0:98980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787397862.984052:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397862.986138:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397862.986147:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787397862.986154:0:98980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787397862.986181:0:98980:0:(import.c:65:import_set_state_nolock()) ffff89a836570000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787397862.986577:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701176960:0@lo:39:umount.0 00000100:00100000:1.0:1787397862.986654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397862.986874:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701176960 00000100:00100000:2.0:1787397862.986884:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701176960 00000100:00100000:2.0:1787397862.986937:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1787397862.986946:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701176960:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787397862.987073:0:66178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19249f 00000100:00080000:2.0:1787397862.987084:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a836140800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787397862.987597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397862.988655:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836570000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787397862.988676:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701176960:0@lo:39:umount.0 00000100:00100000:2.0:1787397862.988684:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+1:3647:x1874218701176960:12345-0@lo:39:umount.0 Request processed in 1736us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397862.988698:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000020:00000080:2.0:1787397862.988714:0:66178:0:(genops.c:906:class_export_put()) final put ffff89a836140000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787397862.989068:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836140000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787397862.989136:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836140800 for lustre-MDT0001 00000100:00080000:2.0:1787397862.991682:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397862.991705:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397862.991714:0:98980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787397862.995140:0:98980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995161:0:98980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995261:0:98980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995269:0:98980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995301:0:98980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397862.995309:0:98980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995316:0:98980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995323:0:98980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995329:0:98980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.995339:0:98980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787397862.995344:0:98980:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787397862.995441:0:98980:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787397862.995446:0:98980:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787397862.995451:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787397862.995510:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397862.995513:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397862.995545:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.995546:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995567:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc1466c20) 00010000:00010000:1.0:1787397862.995568:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397862.995577:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397862.995577:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.995599:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995601:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397862.995615:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397862.995641:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1787397862.995645:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397862.995646:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787397862.995649:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787397862.995658:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397862.995661:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787397862.995663:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787397862.995693:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995693:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995702:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397862.995713:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397862.995740:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995749:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d19242f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192436 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397862.995763:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397862.995765:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397862.995767:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397862.995861:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701177216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397862.995928:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397862.995999:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177216 00000100:00100000:3.0:1787397862.996006:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177216 00010000:00010000:1.0:1787397862.996071:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.996078:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe75800/0x274786fe0d192460 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192467 expref: -99 pid: 98424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397862.996088:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397862.996090:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397862.996092:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397862.996103:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701177088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397862.996135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787397862.996166:0:98980:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1787397862.996174:0:98980:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a836493800 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 8589934612 stale:0 00000020:00080000:2.0:1787397862.996190:0:98980:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a703c36000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968749 stale:0 00000020:00080000:2.0:1787397862.996196:0:98980:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff89a703c34000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968731 stale:0 00000020:00080000:2.0:1787397862.996208:0:98980:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff89a70207cd40) has exports, disconnecting them 00000020:00080000:2.0:1787397862.996214:0:98980:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.60@tcp (ffff89a836493800), last request at 1787397858 00000020:00000080:2.0:1787397862.996229:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192459 00000020:00010000:2.0:1787397862.996239:0:98980:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a836493800: total 0 00000100:00080000:2.0:1787397862.996245:0:98980:0:(import.c:65:import_set_state_nolock()) ffff89a709122000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787397862.996294:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a836493800: total 0 00010000:00010000:2.0:1787397862.996297:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397862.996332:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a836493800, canceled 0 locks, left on hash table 20. 00002000:00010000:2.0:1787397862.996360:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996387:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a1f021/0x274786fe0d192540 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8531 expref: 24 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996410:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996419:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d9cb438/0x274786fe0d192524 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8554 expref: 23 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996433:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996442:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016fb901d/0x274786fe0d192516 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8562 expref: 22 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996457:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996466:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d19250f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8435 expref: 21 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996482:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996502:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38538f5/0x274786fe0d192501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d842e expref: 20 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996518:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996569:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c36eacbf/0x274786fe0d1924e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c1 expref: 19 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996590:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996599:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b15fc7e8/0x274786fe0d19254e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8500 expref: 18 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996615:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996624:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007136c84/0x274786fe0d19251d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8412 expref: 17 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996639:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996648:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d1924c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84eb expref: 16 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996663:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996672:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c7eb75/0x274786fe0d192532 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d852a expref: 15 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996688:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996710:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d192539 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83fd expref: 14 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996726:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996734:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a05bc45/0x274786fe0d192508 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8569 expref: 13 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996748:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996757:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d1924d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d847b expref: 12 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996785:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996806:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1924ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ba expref: 11 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996823:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996842:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb369ba2/0x274786fe0d1924f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8489 expref: 10 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996858:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996867:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d19252b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8419 expref: 9 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996880:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996897:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e4fd29f/0x274786fe0d1924fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8458 expref: 8 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996914:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996924:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b61345/0x274786fe0d1924de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8497 expref: 7 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996940:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996949:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f84df52d/0x274786fe0d1924d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84d6 expref: 6 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787397862.996975:0:56852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397862.996987:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044009fc4/0x274786fe0d192547 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8515 expref: 5 pid: 98440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397862.997015:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a836493800, canceled 20 locks, left on hash table 0. 00010000:00010000:2.0:1787397863.001618:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397863.001625:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397863.001629:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787397863.001687:0:98980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00000020:00080000:2.0:1787397863.003518:0:98980:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a836493800): rc 0 00000020:00080000:2.0:1787397863.003605:0:98980:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a703c36000), last request at 1787397862 00000020:00000080:2.0:1787397863.003615:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192452 00000100:00080000:2.0:1787397863.003626:0:98980:0:(import.c:65:import_set_state_nolock()) ffff89a836143000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397863.003683:0:98980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00000020:00080000:2.0:1787397863.003759:0:98980:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a703c36000): rc 0 00000020:00080000:2.0:1787397863.003763:0:98980:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff89a703c34000), last request at 1787397862 00000020:00000080:2.0:1787397863.007697:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19244b 00000100:00080000:2.0:1787397863.007712:0:98980:0:(import.c:65:import_set_state_nolock()) ffff89a8364e0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397863.007872:0:98980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00000020:00080000:2.0:1787397863.007969:0:98980:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a703c34000): rc 0 00000020:00080000:2.0:1787397863.008031:0:98980:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff89a70207cd40) has no exports 00010000:00010000:0.0:1787397863.010355:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397863.010367:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397863.010721:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177088 00000100:00100000:3.0:1787397863.010731:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177088 00000100:00100000:3.0:1787397863.010804:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1787397863.010813:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701177216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397863.010838:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397863.010858:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b200/0x274786fe0d192436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19242f expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397863.010893:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397863.010950:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701177216:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (15022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397863.010956:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1787397863.010974:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787397863.010980:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701177088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397863.010986:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397863.010995:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b000/0x274786fe0d192467 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192460 expref: 22 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397863.011003:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397863.011025:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701177088:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (14889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397863.011030:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787397863.011103:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701177216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397863.011401:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701177088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397863.174867:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397863.175005:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286272 00000100:00100000:0.0:1787397863.175015:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286272 00000100:00100000:0.0:1787397863.175134:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1536 00000100:00100000:0.0:1787397863.175145:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681286272:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397863.175248:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681286272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 104us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397863.175256:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1536 00000100:00080000:3.0:1787397863.175884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397863.182180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397863.182315:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286144 00000100:00100000:3.0:1787397863.182327:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286144 00000100:00100000:3.0:1787397863.182427:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 263 00000100:00100000:3.0:1787397863.182438:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681286144:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397863.182563:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681286144:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397863.182573:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 263 00000100:00100000:1.0:1787397863.189030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397863.189087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397863.189346:0:26167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286656 00000100:00100000:0.0:1787397863.189357:0:26167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286656 00000100:00100000:0.0:1787397863.189450:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2719 00000100:00100000:0.0:1787397863.189461:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681286656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397863.189560:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681286656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 101us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397863.189570:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2719 00000100:00100000:2.0:1787397863.189740:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286400 00000100:00100000:2.0:1787397863.189745:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286400 00000100:00100000:2.0:1787397863.189973:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1537 00000100:00100000:2.0:1787397863.189983:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681286400:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:3.0:1787397863.190024:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397863.190025:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681286400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1005us total) trans 0 rc 0/0 00000100:00080000:3.0:1787397863.190032:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397863.190036:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1537 00000100:00100000:1.0:1787397863.191405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397863.191595:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286528 00000100:00100000:0.0:1787397863.191603:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286528 00000100:00100000:0.0:1787397863.191651:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5110 00000100:00100000:0.0:1787397863.191659:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2405:x1874218681286528:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:0.0:1787397863.191667:0:26158:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:0.0:1787397863.191727:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2405:x1874218681286528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 67us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787397863.191735:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5110 00000100:00100000:0.0:1787397863.193802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397863.193955:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286784 00000100:00100000:2.0:1787397863.193965:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286784 00000100:00100000:2.0:1787397863.194014:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5111 00000100:00100000:2.0:1787397863.194023:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874218681286784:12345-192.168.204.60@tcp:8:ptlrpcd_01_01.0 00010000:02000000:2.0:1787397863.194047:0:8437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:2.0:1787397863.199617:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874218681286784:12345-192.168.204.60@tcp:8:ptlrpcd_01_01.0 Request processed in 5579us (5808us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397863.199634:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5111 00010000:00010000:0.0:1787397863.269084:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397863.908935:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397863.908970:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701177344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397863.909118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397863.909500:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177344 00000100:00100000:0.0:1787397863.909511:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177344 00000100:00100000:0.0:1787397863.909601:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1787397863.909611:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1874218701177344:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1787397863.909622:0:8439:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787397863.909681:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1874218701177344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (562us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787397863.909689:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1787397863.909718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701177472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397863.909756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397863.909931:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177472 00000100:00100000:3.0:1787397863.909936:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177472 00000100:00100000:3.0:1787397863.909975:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:3.0:1787397863.909982:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701177472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397863.910024:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397863.910073:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701177472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397863.910080:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:02020000:1.0:1787397863.910400:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787397863.910406:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787397863.910419:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787397863.910424:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1787397863.910447:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1787397863.910450:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397863.910455:0:3650:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3732 00000100:00080000:1.0:1787397863.910462:0:3650:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397863.910491:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702137b80 x1874218701177728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397863.910554:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701177728:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:1.0:1787397863.910613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397863.910688:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701177600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397863.910723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397863.910901:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177728 00000100:00100000:0.0:1787397863.910906:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177728 00000100:00100000:0.0:1787397863.910934:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5112 00000100:00100000:0.0:1787397863.910941:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f52c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701177728:12345-0@lo:8:ptlrpcd_00_02.0 00010000:02000000:0.0:1787397863.910965:0:8435:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787397863.911907:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177600 00000100:00100000:1.0:1787397863.911919:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177600 00000100:00100000:1.0:1787397863.911983:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1787397863.911992:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701177600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397863.912034:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397863.912111:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701177600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397863.912119:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1787397863.912216:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701177472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397863.912407:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397863.912456:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397863.912638:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701177600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397863.912718:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177856 00000100:00100000:1.0:1787397863.912724:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177856 00000100:00100000:1.0:1787397863.912763:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1787397863.912770:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1874218701177856:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1787397863.912778:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787397863.913920:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1874218701177856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1141us (1455us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397863.913947:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:02020000:3.0:1787397863.916082:0:3650:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787397863.916092:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397863.916099:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397863.916106:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1787397863.919121:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1787397863.919142:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397863.919155:0:3650:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3732 00000100:00080000:3.0:1787397863.919170:0:3650:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397863.919232:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70aa91180 x1874218701177984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397863.920677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701177984:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:2.0:1787397863.920793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397863.921518:0:26163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701177984 00000100:00100000:3.0:1787397863.921556:0:26163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701177984 00000100:00100000:3.0:1787397863.921702:0:26163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5113 00000100:00100000:3.0:1787397863.921712:0:26163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701177984:12345-0@lo:8:ptlrpcd_00_02.0 00010000:02000000:3.0:1787397863.921771:0:26163:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787397863.921870:0:26163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3647:x1874218701177984:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 157us (1077us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397863.921879:0:26163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5113 00000100:00080000:1.0:1787397863.921970:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397863.921977:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397863.921982:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701177984:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:0.0:1787397863.927733:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f52c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701177728:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 16783us (17111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397863.927752:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5112 00000100:00080000:1.0:1787397863.930712:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397863.930731:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397863.930739:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701177728:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:1.0:1787397864.292768:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397864.420957:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397864.420990:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701178112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397864.421093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397864.421487:0:19690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178112 00000100:00100000:2.0:1787397864.421497:0:19690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178112 00000100:00100000:0.0:1787397864.421552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701178240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397864.421584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397864.422005:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397864.424901:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178240 00000100:00100000:1.0:1787397864.424930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178240 00000100:00100000:2.0:1787397864.425027:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1787397864.425044:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701178112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397864.425097:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397864.425224:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701178112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397864.425232:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1787397864.425254:0:19690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1787397864.425261:0:19690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701178240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397864.425272:0:19690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1787397864.425307:0:19690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701178240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397864.425314:0:19690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1787397864.425615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701178240:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787397864.426180:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397864.426258:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701178112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787397865.317298:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397866.340811:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397867.365091:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397867.494722:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397867.494729:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397867.494732:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397867.494750:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3743 00000100:00080000:0.0:1787397867.494756:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397867.494763:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397867.494787:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701178752:0@lo:400:kworker.0 00000100:00100000:0.0:1787397867.494802:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a836043480 x1874218701178880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397867.494839:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397867.494843:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397867.494859:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787397867.494865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397867.494868:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3743 00000100:00080000:0.0:1787397867.494872:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397867.494877:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397867.494892:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706f9fb80 x1874218701179392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397867.494914:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701179520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.494942:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.494960:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397867.494966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701178368:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.494994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.495021:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701179008:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.495042:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.495067:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701179648:0@lo:400:kworker.0 00000100:00100000:0.0:1787397867.495089:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701178496:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.495096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.495132:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178752 00000100:00100000:0.0:1787397867.495134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.495140:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178752 00000100:00100000:2.0:1787397867.495188:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1787397867.495196:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701178752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397867.495262:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179648 00000100:00100000:3.0:1787397867.495267:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179648 00000100:00100000:3.0:1787397867.495603:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178496 00000100:00100000:3.0:1787397867.495608:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178496 00000100:00100000:3.0:1787397867.495651:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:3.0:1787397867.495658:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701179648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397867.495840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701178880:0@lo:8:kworker.0 00000100:00100000:2.0:1787397867.495980:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701178752:12345-0@lo:400:kworker.0 Request processed in 783us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.495987:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1787397867.496013:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179520 00000100:00100000:2.0:1787397867.496016:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179520 00000100:00100000:2.0:1787397867.496042:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179008 00000100:00100000:2.0:1787397867.496045:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179008 00000100:00100000:2.0:1787397867.496079:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:2.0:1787397867.496085:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701179520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.496129:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701179520:12345-0@lo:400:kworker.0 Request processed in 44us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.496136:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:2.0:1787397867.496147:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:2.0:1787397867.496163:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701179008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.496626:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701179008:12345-0@lo:400:kworker.0 Request processed in 462us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.496633:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:2.0:1787397867.496653:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178368 00000100:00100000:2.0:1787397867.496656:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178368 00000100:00100000:2.0:1787397867.496689:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787397867.496696:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701178368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.496822:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701178368:12345-0@lo:400:kworker.0 Request processed in 126us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.496828:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787397867.496953:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:2.0:1787397867.496963:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701178496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.496995:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701178496:12345-0@lo:400:kworker.0 Request processed in 34us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.497002:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:2.0:1787397867.497065:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701178368:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.497079:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701179008:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.497090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701179520:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.497099:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701178752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397867.497145:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701179648:12345-0@lo:400:kworker.0 Request processed in 1485us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397867.497152:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:3.0:1787397867.497184:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701178624:0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.498676:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701179648:0@lo:400:kworker.0 00000100:00080000:2.0:1787397867.498815:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397867.498822:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397867.503136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397867.503205:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701179392:0@lo:8:kworker.0 00000100:00100000:1.0:1787397867.503255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397867.503322:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178880 00000100:00100000:1.0:1787397867.503329:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178880 00000100:00100000:1.0:1787397867.503360:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179392 00000100:00100000:1.0:1787397867.503362:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179392 00000100:00100000:1.0:1787397867.503377:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5114 00000100:00100000:1.0:1787397867.503383:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701178880:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1787397867.503405:0:8436:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787397867.503972:0:26162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115 00000100:00100000:2.0:1787397867.503979:0:26162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1874218701179392:12345-0@lo:8:kworker.0 00010000:02000000:2.0:1787397867.503992:0:26162:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787397867.504048:0:26162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3647:x1874218701179392:12345-0@lo:8:kworker.0 Request processed in 67us (792us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397867.504055:0:26162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115 00000100:00100000:3.0:1787397867.505494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397867.505548:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701179264:0@lo:400:kworker.0 00000100:00100000:3.0:1787397867.505594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397867.505653:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179264 00000100:00100000:3.0:1787397867.505661:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179264 00000100:00100000:3.0:1787397867.505707:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1787397867.505714:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701179264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397867.505781:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701179264:12345-0@lo:400:kworker.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397867.505788:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1787397867.505834:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701179264:0@lo:400:kworker.0 00000100:00080000:3.0:1787397867.505893:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397867.505898:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397867.505901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701179392:0@lo:8:kworker.0 00000100:00100000:0.0:1787397867.505973:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701178496:0@lo:400:kworker.0 00000100:00100000:0.0:1787397867.505981:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701179136:0@lo:400:kworker.0 00000100:00100000:0.0:1787397867.506009:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397867.506104:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701178624 00000100:00100000:2.0:1787397867.506109:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701178624 00000100:00100000:2.0:1787397867.506322:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179136 00000100:00100000:2.0:1787397867.506332:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179136 00000100:00100000:2.0:1787397867.506355:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1787397867.506363:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701178624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.506407:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701178624:12345-0@lo:400:kworker.0 Request processed in 46us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.506413:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1787397867.506428:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1787397867.506434:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701179136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397867.506463:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701179136:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397867.506469:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1787397867.506559:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701178624:0@lo:400:kworker.0 00000100:00080000:0.0:1787397867.506619:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397867.506639:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701179136:0@lo:400:kworker.0 00000100:00100000:1.0:1787397867.519087:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701178880:12345-0@lo:8:kworker.0 Request processed in 15691us (15947us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397867.519101:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5114 00000100:00080000:0.0:1787397867.519754:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397867.519761:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397867.519765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701178880:0@lo:8:kworker.0 00000100:00100000:1.0:1787397868.292891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397868.293097:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681286912 00000100:00100000:2.0:1787397868.293112:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681286912 00000100:00100000:2.0:1787397868.293201:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 265 00000100:00100000:2.0:1787397868.293214:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681286912:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397868.293318:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681286912:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 106us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397868.293345:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 265 00000100:00100000:1.0:1787397868.309010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397868.309056:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397868.309103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397868.309242:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287424 00000100:00100000:0.0:1787397868.309265:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287424 00000100:00100000:0.0:1787397868.309370:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2722 00000100:00100000:0.0:1787397868.309381:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681287424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397868.309468:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681287424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397868.309475:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2722 00000100:00100000:2.0:1787397868.309567:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287040 00000100:00100000:2.0:1787397868.309578:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287040 00000100:00100000:2.0:1787397868.309638:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287168 00000100:00100000:2.0:1787397868.309642:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287168 00000100:00100000:2.0:1787397868.309673:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1542 00000100:00100000:2.0:1787397868.309682:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681287040:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397868.309768:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681287040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 86us (774us total) trans 0 rc 0/0 00000100:00080000:1.0:1787397868.309770:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397868.309778:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397868.309782:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397868.309820:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1542 00000100:00100000:1.0:1787397868.309831:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1543 00000100:00100000:1.0:1787397868.309848:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681287168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397868.309893:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681287168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 53us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397868.309901:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1543 00000100:00100000:0.0:1787397868.311603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397868.312474:0:25908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287296 00000100:00100000:1.0:1787397868.312490:0:25908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287296 00000100:00100000:1.0:1787397868.312589:0:25908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5116 00000100:00100000:1.0:1787397868.312600:0:25908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2401:x1874218681287296:12345-192.168.204.60@tcp:8:kworker.0 00010000:02000000:1.0:1787397868.312642:0:25908:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:1.0:1787397868.312744:0:25908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2401:x1874218681287296:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 144us (1152us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397868.312754:0:25908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5116 00010000:00010000:0.0:1787397868.391942:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397868.521258:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787397868.521270:0:98425:0:(genops.c:906:class_export_put()) final put ffff89a703c34000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787397868.521312:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397868.521315:0:98425:0:(genops.c:906:class_export_put()) final put ffff89a703c36000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787397868.521321:0:98425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787397868.521323:0:98425:0:(genops.c:906:class_export_put()) final put ffff89a836493800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787397868.521435:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c34000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397868.521510:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c36000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397868.521565:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836493800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:3.0:1787397868.521594:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8364e0800 for lustre-OST0000 00000020:00000080:3.0:1787397868.521601:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836143000 for lustre-OST0000 00000020:00000080:3.0:1787397868.521606:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a709122000 for lustre-OST0000 00000100:00100000:3.0:1787397869.029843:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397869.029878:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701179776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397869.029986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397869.030201:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179776 00000100:00100000:2.0:1787397869.030210:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179776 00000100:00100000:2.0:1787397869.030279:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1787397869.030290:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701179776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397869.030336:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397869.030388:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701179776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397869.030396:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:0.0:1787397869.030560:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397869.030572:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701179904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397869.030609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397869.030882:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701179904 00000100:00100000:2.0:1787397869.030888:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701179904 00000100:00100000:2.0:1787397869.030931:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1787397869.030937:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701179904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397869.030965:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397869.031015:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701179904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397869.031021:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:1.0:1787397869.031122:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701179904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397869.031446:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701179776:0@lo:41:osp-pre-0-1.0 00000020:01000000:2.0:1787397869.094443:0:98980:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a83b0945a0 - data ffff89a701d5c798/ffff89a7025a0800 00000020:01000000:2.0:1787397869.094670:0:98980:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7022007e0 - data ffff89a701c05ca8/ffff89a830b5f400 00100000:10000000:2.0:1787397869.104449:0:98980:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787397869.117966:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192444 00000020:00000080:3.0:1787397869.117977:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a703c37800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787397869.118001:0:98980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a905000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787397869.118005:0:98980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a905000 2 00000020:01000004:3.0:1787397869.118008:0:98980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70a905000 from lustre-OST0000 00000020:00000080:0.0:1787397869.118150:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703c37800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787397869.118403:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397869.118418:0:98980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787397869.118422:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a83fa40800/lustre-OST0000_UUID 00000020:00000080:3.0:1787397869.118424:0:98980:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa40800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787397869.118432:0:98980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787397869.118490:0:98980:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1787397869.118496:0:98980:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787397869.118500:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397869.118793:0:98980:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787397869.118804:0:98980:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89a817efb800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397869.118809:0:98980:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff89a7033a3380) has exports, disconnecting them 00000020:00080000:3.0:1787397869.118814:0:98980:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89a817efb800), last request at 1787397852 00000020:00000080:3.0:1787397869.118818:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192483 00000020:00080000:3.0:1787397869.118830:0:98980:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817efb800): rc 0 00000020:00000080:3.0:1787397869.118837:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a817efb800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787397869.119141:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efb800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787397869.123597:0:98980:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787397869.123605:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397869.123609:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787397869.123616:0:98980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787397869.123780:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787397869.123798:0:98980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787397869.123805:0:98980:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787397869.123810:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787397869.123815:0:98980:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787397869.123822:0:98980:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff89a836145000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397869.123828:0:98980:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff89a83b9d19c0) has exports, disconnecting them 00000020:00080000:0.0:1787397869.123832:0:98980:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff89a836145000), last request at 1787397852 00000020:00000080:0.0:1787397869.123837:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192498 00000020:00080000:0.0:1787397869.123854:0:98980:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a836145000): rc 0 00000020:00000080:0.0:1787397869.123861:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a836145000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397869.124853:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702025800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787397869.124865:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a836574000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787397869.124868:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836574000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787397869.124878:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787397869.125059:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836145000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787397869.125103:0:98980:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787397869.125107:0:98980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397869.125113:0:98980:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787397869.125118:0:98980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397869.125134:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836570000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787397869.129200:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397869.129219:0:98980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787397869.129226:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a836145800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787397869.129230:0:98980:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836145800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787397869.129238:0:98980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787397869.129881:0:98980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a905000 1 00000020:00000080:1.0:1787397869.129893:0:98980:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192428 00000020:00000080:1.0:1787397869.129900:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a702325000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787397869.129914:0:98980:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787397869.129929:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702325000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787397869.129947:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397869.129954:0:98980:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787397869.129957:0:98980:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff89a838783380) has no exports 00000020:00000080:1.0:1787397869.196407:0:98980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397869.196425:0:98980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787397869.196431:0:98980:0:(genops.c:906:class_export_put()) final put ffff89a70a905800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787397869.196436:0:98980:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70a905800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787397869.196447:0:98980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787397869.196737:0:98980:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a70a904800 00000020:02000400:1.0:1787397869.196797:0:98980:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787397869.416765:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397869.540750:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701180160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397869.540830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397869.540879:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701180032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397869.540901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397869.540990:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180160 00000100:00100000:3.0:1787397869.540999:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180160 00000100:00100000:3.0:1787397869.541057:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180032 00000100:00100000:3.0:1787397869.541060:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180032 00000100:00100000:3.0:1787397869.541080:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:3.0:1787397869.541088:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701180160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397869.541118:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1787397869.541240:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:1.0:1787397869.541250:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701180032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397869.541262:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1787397869.541564:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701180160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 435us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397869.541572:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00080000:3.0:1787397869.541596:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397869.541864:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701180160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397869.541916:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701180032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 668us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397869.541923:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:2.0:1787397869.546937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701180032:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787397870.438246:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397871.466972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397872.485920:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397872.613976:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397872.613983:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397872.613987:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397872.613995:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3746 00000100:00080000:3.0:1787397872.614015:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397872.614023:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397872.614048:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70aa90700 x1874218701180800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397872.614089:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397872.614098:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787397872.614100:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397872.614104:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3746 00000100:00080000:3.0:1787397872.614107:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787397872.614112:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397872.614125:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70aa91500 x1874218701181312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397872.614300:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701180288:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614427:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614469:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701180928:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614661:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701181568:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614710:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397872.614734:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181568 00000100:00100000:3.0:1787397872.614737:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787397872.614742:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181568 00000100:00100000:3.0:1787397872.614743:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701180672:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614766:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614784:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701181440:0@lo:400:kworker.0 00000100:00100000:1.0:1787397872.614785:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:1.0:1787397872.614793:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397872.614840:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701181568:12345-0@lo:400:kworker.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.614845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701180416:0@lo:400:kworker.0 00000100:00100000:1.0:1787397872.614847:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1787397872.614868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614899:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701181056:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.614918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614939:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397872.614945:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701180544:0@lo:400:kworker.0 00000100:00100000:1.0:1787397872.614964:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180416 00000100:00100000:1.0:1787397872.614968:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180416 00000100:00100000:3.0:1787397872.614978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.614994:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701181184:0@lo:400:kworker.0 00000100:00100000:1.0:1787397872.614997:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181056 00000100:00100000:1.0:1787397872.615000:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181056 00000100:00100000:3.0:1787397872.615014:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397872.615015:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180544 00000100:00100000:1.0:1787397872.615017:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180544 00000100:00100000:1.0:1787397872.615032:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:1.0:1787397872.615038:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701180416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615043:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180288 00000100:00100000:3.0:1787397872.615046:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180288 00000100:00100000:1.0:1787397872.615071:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701180416:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615072:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787397872.615077:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1787397872.615078:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397872.615087:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1787397872.615092:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615103:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701180288:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615109:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787397872.615111:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701181056:12345-0@lo:400:kworker.0 Request processed in 20us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397872.615116:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:1.0:1787397872.615125:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1787397872.615130:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701180544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615135:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180928 00000100:00100000:3.0:1787397872.615138:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180928 00000100:00100000:3.0:1787397872.615160:0:26164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181440 00000100:00100000:1.0:1787397872.615161:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701180544:12345-0@lo:400:kworker.0 Request processed in 31us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615163:0:26164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181440 00000100:00100000:1.0:1787397872.615167:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1787397872.615182:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1787397872.615188:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615216:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701180928:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615222:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:3.0:1787397872.615232:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1787397872.615237:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615258:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701181440:12345-0@lo:400:kworker.0 Request processed in 22us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615264:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1787397872.615290:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180672 00000100:00100000:3.0:1787397872.615293:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180672 00000100:00100000:3.0:1787397872.615325:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181184 00000100:00100000:3.0:1787397872.615333:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181184 00000100:00100000:3.0:1787397872.615348:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:3.0:1787397872.615353:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701180672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615385:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701180672:12345-0@lo:400:kworker.0 Request processed in 32us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615391:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:3.0:1787397872.615403:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:3.0:1787397872.615408:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701181184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615433:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701181184:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.615439:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00080000:3.0:1787397872.615459:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397872.615463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397872.615465:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397872.615511:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701180544:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615545:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701181184:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615557:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701180416:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615566:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701181056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397872.615580:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701180800:0@lo:8:kworker.0 00000100:00100000:3.0:1787397872.615609:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701180672:0@lo:400:kworker.0 00000100:00100000:0.0:1787397872.615609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.615619:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701181440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701180288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397872.615627:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701181312:0@lo:8:kworker.0 00000100:00100000:3.0:1787397872.615636:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701180928:0@lo:400:kworker.0 00000100:00100000:3.0:1787397872.615658:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701181568:0@lo:400:kworker.0 00000100:00100000:0.0:1787397872.615658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397872.615692:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701180800 00000100:00100000:0.0:1787397872.615696:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701180800 00000100:00100000:0.0:1787397872.615727:0:26160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181312 00000100:00100000:0.0:1787397872.615730:0:26160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181312 00000100:00100000:0.0:1787397872.615747:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5117 00000100:00100000:0.0:1787397872.615752:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3647:x1874218701180800:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787397872.615770:0:26160:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397872.615802:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3647:x1874218701180800:12345-0@lo:8:kworker.0 Request processed in 49us (192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397872.615807:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5117 00000100:00100000:0.0:1787397872.615818:0:26160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118 00000100:00100000:0.0:1787397872.615822:0:26160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3647:x1874218701181312:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787397872.615831:0:26160:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397872.615851:0:26160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3647:x1874218701181312:12345-0@lo:8:kworker.0 Request processed in 27us (192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397872.615856:0:26160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118 00000100:00080000:0.0:1787397872.615886:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397872.615891:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397872.615894:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701180800:0@lo:8:kworker.0 00000100:00080000:0.0:1787397872.615903:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397872.615905:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397872.615908:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701181312:0@lo:8:kworker.0 00000020:01000004:1.0:1787397872.688287:0:99182:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787397872.698856:0:99182:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787397872.698911:0:99182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.698927:0:99182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.698946:0:99182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.698953:0:99182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.698976:0:99182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787397872.698981:0:99182:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787397872.699009:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397872.699014:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787397872.699019:0:99182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787397872.699043:0:99182:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787397872.700363:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397872.700374:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397872.700404:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397872.700408:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397872.700417:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397872.700423:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397872.700428:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397872.700431:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397872.700434:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397872.700467:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397872.700474:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397872.700514:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397872.700544:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d19197e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191985 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397872.700557:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397872.700559:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397872.700560:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397872.700581:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701181696:0@lo:39:umount.0 00000100:00100000:0.0:1787397872.700656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.701222:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701181824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397872.701601:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181696 00000100:00100000:0.0:1787397872.701616:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181696 00000100:00100000:0.0:1787397872.701678:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1787397872.701687:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701181696:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787397872.701721:0:66177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1915cd 00000100:00080000:0.0:1787397872.701731:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a828a5b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787397872.701790:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+1:3647:x1874218701181696:12345-0@lo:39:umount.0 Request processed in 104us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397872.701797:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000020:00000080:0.0:1787397872.701808:0:66177:0:(genops.c:906:class_export_put()) final put ffff89a828a5c000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1787397872.701835:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397872.701861:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397872.701871:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701181696:0@lo:39:umount.0 00000100:00080000:2.0:1787397872.703717:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397872.703738:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397872.703745:0:99182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787397872.704500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787397872.704610:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397872.704684:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5b800 for lustre-MDT0000 00000100:00100000:3.0:1787397872.704703:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181824 00000100:00100000:3.0:1787397872.704710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181824 00000100:00100000:3.0:1787397872.704762:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1787397872.704770:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701181824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397872.704785:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397872.704804:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74c00/0x274786fe0d191985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19197e expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397872.704820:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397872.704872:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+20:3650:x1874218701181824:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.706452:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1787397872.706536:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701181824:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787397872.706692:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397872.706697:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787397872.706703:0:99182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787397872.706724:0:99182:0:(import.c:65:import_set_state_nolock()) ffff89a7033bd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397872.706767:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701181952:0@lo:39:umount.0 00000100:00100000:0.0:1787397872.706824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.706900:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701181952 00000100:00100000:3.0:1787397872.706906:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701181952 00000100:00100000:3.0:1787397872.706951:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1787397872.706960:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874218701181952:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787397872.706985:0:67264:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b364 00000100:00080000:3.0:1787397872.706995:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a803e99000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787397872.707051:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+1:3647:x1874218701181952:12345-0@lo:39:umount.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.707057:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000020:00000080:3.0:1787397872.707078:0:67264:0:(genops.c:906:class_export_put()) final put ffff89a803e98000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1787397872.707099:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397872.707119:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e98000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787397872.707158:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a803e99000 for lustre-MDT0001 00000100:00080000:3.0:1787397872.707182:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397872.707191:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701181952:0@lo:39:umount.0 00000100:00080000:2.0:1787397872.707199:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397872.707202:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787397872.707206:0:99182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787397872.709958:0:99182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.709975:0:99182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.709982:0:99182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.709988:0:99182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710011:0:99182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397872.710018:0:99182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710025:0:99182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710030:0:99182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710052:0:99182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710068:0:99182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787397872.710073:0:99182:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787397872.710119:0:99182:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787397872.710124:0:99182:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1787397872.710137:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397872.710142:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710150:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397872.710154:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710163:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397872.710171:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397872.710176:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397872.710179:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787397872.710180:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787397872.710212:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710219:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397872.710240:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710256:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d19198c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191993 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710268:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397872.710271:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710277:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397872.710280:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710286:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397872.710292:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397872.710297:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787397872.710299:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787397872.710301:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787397872.710313:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710318:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397872.710332:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d22200/0x274786fe0d191572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d191579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397872.710359:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397872.710361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397872.710362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397872.710380:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701182080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397872.710442:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397872.711999:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701182208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397872.712059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397872.712120:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787397872.712184:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397872.712197:0:99182:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1787397872.712204:0:99182:0:(genops.c:1840:print_export_data()) lustre-OST0001: ACTIVE ffff89a803902000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397872.712210:0:99182:0:(genops.c:1840:print_export_data()) lustre-OST0001: ACTIVE ffff89a83ae97000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968731 stale:0 00000020:00080000:2.0:1787397872.712214:0:99182:0:(genops.c:1840:print_export_data()) lustre-OST0001: ACTIVE ffff89a835666000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968717 stale:0 00000020:00080000:2.0:1787397872.712218:0:99182:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff89a702078000) has exports, disconnecting them 00000020:00080000:2.0:1787397872.712222:0:99182:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 192.168.204.60@tcp (ffff89a803902000), last request at 1787397868 00000020:00000080:2.0:1787397872.712229:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1917e1 00000020:00010000:2.0:1787397872.712238:0:99182:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a803902000: total 0 00000100:00080000:2.0:1787397872.712243:0:99182:0:(import.c:65:import_set_state_nolock()) ffff89a7054c5000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787397872.712760:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182080 00000100:00100000:3.0:1787397872.712766:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182208 00000100:00100000:1.0:1787397872.712768:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182080 00000100:00100000:3.0:1787397872.712772:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182208 00000100:00100000:1.0:1787397872.712839:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1787397872.712851:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1787397872.712853:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701182080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397872.712863:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701182208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397872.712869:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397872.712883:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397872.712890:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab400/0x274786fe0d191993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19198c expref: 21 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397872.712896:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800031600/0x274786fe0d191579 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191572 expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397872.712909:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397872.712912:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1787397872.713080:0:99182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968731 00000020:00010000:0.0:1787397872.713108:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a803902000: total 0 00010000:00010000:0.0:1787397872.713166:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a803902000, canceled 0 locks, left on hash table 2. 00000020:00080000:2.0:1787397872.713338:0:99182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a803902000): rc 0 00000020:00080000:2.0:1787397872.713342:0:99182:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 0@lo (ffff89a83ae97000), last request at 1787397872 00000020:00000080:2.0:1787397872.713347:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1914b5 00000100:00080000:2.0:1787397872.713352:0:99182:0:(import.c:65:import_set_state_nolock()) ffff89a83ae92000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787397872.713370:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787397872.713403:0:99182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968731 00000020:00080000:2.0:1787397872.713439:0:99182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83ae97000): rc 0 00000020:00080000:2.0:1787397872.713443:0:99182:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 0@lo (ffff89a835666000), last request at 1787397872 00000020:00000080:2.0:1787397872.713446:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2f4 00000100:00080000:2.0:1787397872.713466:0:99182:0:(import.c:65:import_set_state_nolock()) ffff89a835663800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397872.713488:0:99182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968731 00010000:00010000:0.0:1787397872.713750:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a52c549/0x274786fe0d19184a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d823d expref: 4 pid: 26163 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787397872.713759:0:99182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a835666000): rc 0 00010000:00010000:0.0:1787397872.713786:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d191897 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8259 expref: 3 pid: 26166 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787397872.713789:0:99182:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff89a702078000) has no exports 00010000:00010000:0.0:1787397872.713803:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a803902000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787397872.720442:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397872.720449:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397872.720451:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397872.728093:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397872.731078:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701182080:12345-0@lo:103:ldlm_bl.0 Request processed in 18220us (20625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397872.731094:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1787397872.731233:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701182080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397872.731765:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701182208:12345-0@lo:103:ldlm_bl.0 Request processed in 18901us (19701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397872.731775:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1787397872.731825:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701182208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397873.416640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397873.416708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397873.416744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397873.416779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397873.416780:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287552 00000100:00100000:3.0:1787397873.416792:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287552 00000100:00100000:0.0:1787397873.416814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397873.416843:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287936 00000100:00100000:0.0:1787397873.416848:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287936 00000100:00100000:3.0:1787397873.416852:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 267 00000100:00100000:3.0:1787397873.416865:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681287552:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397873.416877:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288064 00000100:00100000:0.0:1787397873.416881:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288064 00000100:00100000:0.0:1787397873.416905:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5119 00000100:00100000:0.0:1787397873.416911:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681287936:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:0.0:1787397873.416934:0:26166:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397873.417074:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287808 00000100:00100000:1.0:1787397873.417079:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287808 00000100:00100000:2.0:1787397873.417180:0:26169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5120 00000100:00100000:2.0:1787397873.417186:0:26169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2403:x1874218681288064:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:2.0:1787397873.417193:0:26169:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397873.418110:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681287680 00000100:00100000:1.0:1787397873.418119:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681287680 00000100:00100000:1.0:1787397873.418161:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1548 00000100:00100000:1.0:1787397873.418182:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681287808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397873.419377:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2401:x1874218681287936:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 2457us (2749us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397873.419382:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681287552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2517us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397873.419409:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 267 00000100:00100000:3.0:1787397873.419469:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1549 00000100:00100000:3.0:1787397873.419479:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681287680:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397873.419538:0:26169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2403:x1874218681288064:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2334us (2708us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397873.419540:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681287808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1348us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397873.419555:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1548 00000100:00100000:0.0:1787397873.419694:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5119 00000100:00080000:0.0:1787397873.419747:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397873.419753:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681287680:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 274us (2971us total) trans 0 rc 0/0 00000100:00080000:0.0:1787397873.419755:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397873.419764:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1549 00000100:00100000:2.0:1787397873.419827:0:26169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5120 00000100:00100000:2.0:1787397873.432252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397873.432560:0:26159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288192 00000100:00100000:1.0:1787397873.432569:0:26159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288192 00000100:00100000:1.0:1787397873.432616:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5121 00000100:00100000:1.0:1787397873.432642:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2401:x1874218681288192:12345-192.168.204.60@tcp:8:ptlrpcd_00_01.0 00010000:02000000:1.0:1787397873.432667:0:26159:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:1.0:1787397873.447484:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2401:x1874218681288192:12345-192.168.204.60@tcp:8:ptlrpcd_00_01.0 Request processed in 14847us (15230us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397873.447502:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5121 00010000:00010000:2.0:1787397873.509588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397874.153696:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397874.153720:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701182336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397874.153796:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397874.154467:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701182464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397874.155551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397874.166660:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182336 00000100:00100000:1.0:1787397874.166679:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182336 00000100:00100000:3.0:1787397874.166786:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182464 00000100:00100000:3.0:1787397874.166792:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182464 00000100:00100000:1.0:1787397874.166860:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1787397874.166872:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701182336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397874.166916:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397874.167024:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701182336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (13228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397874.167031:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1787397874.167092:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:1.0:1787397874.167099:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701182464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397874.167129:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397874.167162:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701182464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (11612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397874.167167:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:3.0:1787397874.175770:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701182336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397874.177778:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701182464:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397874.533008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397874.661293:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397874.661319:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701182720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397874.661393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397874.661499:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182720 00000100:00100000:1.0:1787397874.661508:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182720 00000100:00100000:1.0:1787397874.661589:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1787397874.661597:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3649:x1874218701182720:12345-0@lo:13:osp-pre-1-1.0 00000020:00080000:1.0:1787397874.661635:0:8438:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787397874.661676:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701182592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397874.661681:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3649:x1874218701182720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (289us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397874.661689:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1787397874.661705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397874.661736:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182592 00000100:00100000:1.0:1787397874.661739:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182592 00000100:00100000:1.0:1787397874.661773:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:1.0:1787397874.661778:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3651:x1874218701182592:12345-0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1787397874.661783:0:8439:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:02020000:0.0:1787397874.661811:0:3649:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787397874.661817:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0001-osc-MDT0001 of lustre-OST0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787397874.661821:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787397874.661826:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1787397874.661850:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1787397874.661853:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397874.661858:0:3649:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 2791 00000100:00080000:0.0:1787397874.661864:0:3649:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397874.661888:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702188e00 x1874218701182848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397874.662106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701182848:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1787397874.664067:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3651:x1874218701182592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2280us (2353us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397874.664084:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:02020000:2.0:1787397874.666502:0:3651:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787397874.666510:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0001-osc-MDT0000 of lustre-OST0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787397874.666516:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787397874.666535:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:2.0:1787397874.666610:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1787397874.666614:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397874.666619:0:3651:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3620 00000100:00080000:2.0:1787397874.666629:0:3651:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397874.666673:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702352a00 x1874218701182976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397874.666699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397874.666746:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701182976:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1787397874.666769:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182848 00000100:00100000:3.0:1787397874.666773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397874.666776:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182848 00000100:00100000:1.0:1787397874.666810:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701182976 00000100:00100000:1.0:1787397874.666813:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701182976 00000100:00100000:3.0:1787397874.666824:0:26167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5122 00000100:00100000:1.0:1787397874.666829:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5123 00000100:00100000:3.0:1787397874.666832:0:26167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701182848:12345-0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1787397874.666834:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701182976:12345-0@lo:8:ptlrpcd_00_03.0 00010000:02000000:3.0:1787397874.666854:0:26167:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787397874.666898:0:26167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3647:x1874218701182848:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 65us (198us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397874.666917:0:26167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5122 00000100:00080000:2.0:1787397874.666918:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397874.666938:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397874.666941:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701182848:0@lo:8:ptlrpcd_00_01.0 00010000:02000000:1.0:1787397874.667190:0:8436:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787397874.667271:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701182976:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 435us (495us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397874.667279:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5123 00000100:00080000:2.0:1787397874.667326:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397874.667330:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397874.667333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701182976:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:2.0:1787397875.558004:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397876.582648:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397877.604854:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397877.734734:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397877.734742:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397877.734746:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397877.734756:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3751 00000100:00080000:0.0:1787397877.734762:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397877.734769:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397877.734794:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70218b800 x1874218701183360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397877.734811:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397877.734815:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787397877.734817:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397877.734821:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3753 00000100:00080000:0.0:1787397877.734823:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397877.734827:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397877.734839:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702188e00 x1874218701183488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397877.734868:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397877.734871:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787397877.734887:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397877.734892:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3751 00000100:00080000:0.0:1787397877.734894:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397877.734899:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397877.734913:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8047c9500 x1874218701183872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397877.734922:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397877.734926:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787397877.734928:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787397877.734930:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701183232:0@lo:400:kworker.0 00000100:00080000:0.0:1787397877.734933:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3753 00000100:00080000:0.0:1787397877.734940:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787397877.734943:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397877.734957:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70731e300 x1874218701184000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397877.734991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701183616:0@lo:400:kworker.0 00000100:00100000:3.0:1787397877.735008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397877.735034:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397877.735089:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183616 00000100:00100000:0.0:1787397877.735091:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183232 00000100:00100000:0.0:1787397877.735097:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183232 00000100:00100000:3.0:1787397877.735098:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183616 00000100:00100000:3.0:1787397877.735149:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1787397877.735159:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701183616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397877.735213:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701183616:12345-0@lo:400:kworker.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397877.735221:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1787397877.735264:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701183616:0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701183104:0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.735654:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701184128:0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735681:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.735705:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397877.735711:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701183744:0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.735762:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183744 00000100:00100000:2.0:1787397877.735766:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183744 00000100:00100000:2.0:1787397877.735793:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:2.0:1787397877.735800:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735843:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701183232:12345-0@lo:400:kworker.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397877.735850:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:2.0:1787397877.735863:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1787397877.735868:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701183744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735897:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701183744:12345-0@lo:400:kworker.0 Request processed in 29us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397877.735916:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1787397877.735943:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8179a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701183744:0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.735965:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701183360:0@lo:8:kworker.0 00000100:00100000:2.0:1787397877.735991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.736011:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701183488:0@lo:8:kworker.0 00000100:00100000:2.0:1787397877.736043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.736057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701183872:0@lo:8:kworker.0 00000100:00100000:2.0:1787397877.736077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.736090:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701184000:0@lo:8:kworker.0 00000100:00100000:2.0:1787397877.736121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397877.736344:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183360 00000100:00100000:2.0:1787397877.736349:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183360 00000100:00100000:2.0:1787397877.736372:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183488 00000100:00100000:2.0:1787397877.736375:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183488 00000100:00100000:2.0:1787397877.736395:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183872 00000100:00100000:2.0:1787397877.736397:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183872 00000100:00100000:2.0:1787397877.736412:0:26158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184000 00000100:00100000:2.0:1787397877.736414:0:26158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184000 00000100:00100000:3.0:1787397877.736422:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701183104 00000100:00100000:3.0:1787397877.736428:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701183104 00000100:00100000:2.0:1787397877.736433:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5124 00000100:00100000:2.0:1787397877.736439:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3647:x1874218701183360:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787397877.736460:0:26158:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397877.736470:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787397877.736480:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3649:x1874218701183104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397877.736502:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3647:x1874218701183360:12345-0@lo:8:kworker.0 Request processed in 61us (509us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397877.736509:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5124 00000100:00100000:2.0:1787397877.736550:0:26158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5125 00000100:00100000:2.0:1787397877.736555:0:26158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3647:x1874218701183488:12345-0@lo:8:kworker.0 00010000:02000000:2.0:1787397877.736574:0:26158:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787397877.736633:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3649:x1874218701183104:12345-0@lo:400:kworker.0 Request processed in 154us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397877.736640:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787397877.736675:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5126 00000100:00100000:3.0:1787397877.736682:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701183872:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787397877.736685:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184128 00000100:00100000:1.0:1787397877.736691:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184128 00010000:00020000:3.0:1787397877.736695:0:26164:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397877.736729:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701183872:12345-0@lo:8:kworker.0 Request processed in 45us (649us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397877.736729:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1787397877.736738:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701184128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397877.736739:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5126 00000100:00100000:3.0:1787397877.736760:0:26164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127 00000100:00100000:3.0:1787397877.736766:0:26164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701184000:12345-0@lo:8:kworker.0 00010000:02000000:3.0:1787397877.736776:0:26164:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787397877.736780:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701184128:12345-0@lo:400:kworker.0 Request processed in 43us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397877.736794:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1787397877.736814:0:26164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3647:x1874218701184000:12345-0@lo:8:kworker.0 Request processed in 46us (690us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397877.736832:0:26164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127 00000100:00100000:3.0:1787397877.736884:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701183104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397877.736901:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701183232:0@lo:400:kworker.0 00000100:00100000:3.0:1787397877.736905:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701184128:0@lo:400:kworker.0 00000100:00080000:3.0:1787397877.736961:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397877.736966:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397877.736969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701183360:0@lo:8:kworker.0 00000100:00080000:3.0:1787397877.736979:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397877.736983:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397877.736985:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701183872:0@lo:8:kworker.0 00000100:00080000:3.0:1787397877.736993:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397877.736996:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397877.736998:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70731e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701184000:0@lo:8:kworker.0 00000100:00100000:0.0:1787397877.758586:0:26158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8179a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3647:x1874218701183488:12345-0@lo:8:kworker.0 Request processed in 22021us (22533us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397877.758601:0:26158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5125 00000100:00080000:2.0:1787397877.758856:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397877.758862:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397877.758866:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701183488:0@lo:8:kworker.0 00000100:00100000:3.0:1787397878.542503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397878.542577:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288448 00000100:00100000:0.0:1787397878.542591:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288448 00000100:00100000:3.0:1787397878.542661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397878.542674:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1552 00000100:00100000:3.0:1787397878.542684:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397878.542684:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681288448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397878.542701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397878.542726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397878.542747:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288704 00000100:00100000:3.0:1787397878.542750:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288704 00000100:00100000:0.0:1787397878.542762:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681288448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397878.542770:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288832 00000100:00100000:3.0:1787397878.542772:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288832 00000100:00100000:0.0:1787397878.542784:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1552 00000100:00100000:3.0:1787397878.542787:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5128 00000100:00100000:0.0:1787397878.542800:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288576 00000100:00100000:0.0:1787397878.542803:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288576 00000100:00100000:3.0:1787397878.542808:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681288704:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:3.0:1787397878.542831:0:8435:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397878.542841:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1553 00000100:00100000:0.0:1787397878.542847:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681288576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397878.542864:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681288704:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 56us (179us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397878.542867:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681288576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 21us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397878.542872:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5128 00000100:00100000:0.0:1787397878.542873:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1553 00000100:00100000:3.0:1787397878.542884:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5129 00000100:00100000:3.0:1787397878.542888:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681288832:12345-192.168.204.60@tcp:8:kworker.0 00010000:02000000:3.0:1787397878.542898:0:8435:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:3.0:1787397878.542917:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681288832:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 27us (214us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397878.542922:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288320 00000100:00100000:3.0:1787397878.542924:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5129 00000100:00100000:0.0:1787397878.542925:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288320 00000100:00100000:0.0:1787397878.542950:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00100000:0.0:1787397878.542956:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681288320:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397878.542981:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681288320:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397878.542987:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 269 00000100:00080000:2.0:1787397878.543419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397878.543424:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787397878.632999:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787397878.765599:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787397878.765614:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a835666000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787397878.765715:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397878.765719:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a83ae97000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787397878.769836:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397878.769836:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835666000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787397878.769848:0:9516:0:(genops.c:906:class_export_put()) final put ffff89a803902000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787397878.769941:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83ae97000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787397878.769964:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803902000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:0.0:1787397878.769992:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835663800 for lustre-OST0001 00000020:00000080:0.0:1787397878.769999:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae92000 for lustre-OST0001 00000020:00000080:0.0:1787397878.770003:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7054c5000 for lustre-OST0001 00000100:00100000:1.0:1787397879.269126:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701184256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397879.269219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397879.269282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397879.269290:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701184384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397879.269316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397879.269397:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184256 00000100:00100000:3.0:1787397879.269412:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184256 00000100:00100000:2.0:1787397879.269414:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184384 00000100:00100000:2.0:1787397879.269418:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184384 00000100:00100000:2.0:1787397879.269493:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1787397879.269505:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701184384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397879.269595:0:8445:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397879.269998:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701184384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 495us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397879.270008:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:0.0:1787397879.270603:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701184384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397879.274006:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1787397879.274042:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701184256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397879.274112:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397879.274260:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701184256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 238us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397879.274269:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:0.0:1787397879.275837:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701184256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397879.654971:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397880.677052:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397881.702111:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397882.725555:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397882.853512:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397882.853537:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397882.853542:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397882.853550:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1787397882.853555:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397882.853564:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397882.853569:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701184512:0@lo:400:kworker.0 00000100:00100000:1.0:1787397882.853589:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702136300 x1874218701184768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397882.853606:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397882.853610:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397882.853612:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397882.853616:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1787397882.853619:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787397882.853623:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397882.853636:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702135180 x1874218701184896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397882.853655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397882.853691:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397882.853694:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397882.853696:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397882.853700:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1787397882.853703:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1787397882.853706:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1787397882.853709:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397882.853716:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701184640:0@lo:400:kworker.0 00000100:00100000:1.0:1787397882.853725:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702135f80 x1874218701185280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397882.853735:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397882.853739:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397882.853740:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397882.853744:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1787397882.853749:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1787397882.853750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787397882.853756:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397882.853770:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702135c00 x1874218701185408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397882.853791:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184512 00000100:00100000:3.0:1787397882.853800:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184512 00000100:00100000:1.0:1787397882.853820:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184640 00000100:00100000:1.0:1787397882.853826:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184640 00000100:00100000:3.0:1787397882.853848:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787397882.853859:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701184512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397882.853865:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:1.0:1787397882.853879:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701184640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397882.853927:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701184512:12345-0@lo:400:kworker.0 Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397882.853935:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787397882.853950:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701184640:12345-0@lo:400:kworker.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397882.853958:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:3.0:1787397882.853996:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701185536:0@lo:400:kworker.0 00000100:00100000:3.0:1787397882.854027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397882.854080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701184640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397882.854090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701184512:0@lo:400:kworker.0 00000100:00100000:2.0:1787397882.854468:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701184768:0@lo:8:kworker.0 00000100:00100000:2.0:1787397882.854507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397882.854562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701184896:0@lo:8:kworker.0 00000100:00100000:2.0:1787397882.854599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397882.854615:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701185280:0@lo:8:kworker.0 00000100:00100000:2.0:1787397882.854635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397882.854651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701185408:0@lo:8:kworker.0 00000100:00100000:2.0:1787397882.854673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397882.854714:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184768 00000100:00100000:1.0:1787397882.854717:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185536 00000100:00100000:2.0:1787397882.854720:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184768 00000100:00100000:1.0:1787397882.854730:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185536 00000100:00100000:2.0:1787397882.854750:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701184896 00000100:00100000:2.0:1787397882.854756:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701184896 00000100:00100000:1.0:1787397882.854773:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:2.0:1787397882.854780:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185280 00000100:00100000:1.0:1787397882.854783:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701185536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397882.854785:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185280 00000100:00100000:2.0:1787397882.854803:0:26165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185408 00000100:00100000:2.0:1787397882.854808:0:26165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185408 00000100:00100000:2.0:1787397882.854827:0:26165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130 00000100:00100000:2.0:1787397882.854834:0:26165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3647:x1874218701184768:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787397882.854839:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701185536:12345-0@lo:400:kworker.0 Request processed in 56us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397882.854847:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00010000:00020000:2.0:1787397882.854856:0:26165:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397882.854874:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131 00000100:00100000:1.0:1787397882.854880:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701184896:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1787397882.854892:0:26159:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787397882.854925:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701184896:12345-0@lo:8:kworker.0 Request processed in 44us (325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397882.854932:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131 00000100:00100000:1.0:1787397882.854944:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132 00000100:00100000:1.0:1787397882.854948:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701185280:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787397882.854957:0:26159:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397882.854993:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701185280:12345-0@lo:8:kworker.0 Request processed in 44us (357us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397882.854999:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132 00000100:00100000:1.0:1787397882.855023:0:26159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133 00000100:00100000:1.0:1787397882.855027:0:26159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701185408:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1787397882.855036:0:26159:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787397882.855059:0:26159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3647:x1874218701185408:12345-0@lo:8:kworker.0 Request processed in 31us (386us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397882.855065:0:26159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133 00000100:00100000:1.0:1787397882.855107:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701185536:0@lo:400:kworker.0 00000100:00080000:1.0:1787397882.855229:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397882.855238:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397882.855241:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701184896:0@lo:8:kworker.0 00000100:00080000:1.0:1787397882.855251:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397882.855253:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397882.855255:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701185280:0@lo:8:kworker.0 00000100:00080000:1.0:1787397882.855262:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397882.855264:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397882.855267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701185408:0@lo:8:kworker.0 00000100:00100000:2.0:1787397882.856066:0:26165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3647:x1874218701184768:12345-0@lo:8:kworker.0 Request processed in 1227us (1553us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397882.856077:0:26165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130 00000100:00100000:0.0:1787397882.856636:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701185152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397882.856699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397882.856742:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397882.856750:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701185024:0@lo:400:kworker.0 00000100:00100000:0.0:1787397882.856778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397882.856809:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185024 00000100:00100000:0.0:1787397882.856816:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185024 00000100:00100000:0.0:1787397882.856857:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1787397882.856865:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701185024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397882.856910:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701185024:12345-0@lo:400:kworker.0 Request processed in 46us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397882.856917:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1787397882.856962:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701185024:0@lo:400:kworker.0 00000100:00100000:2.0:1787397882.857626:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185152 00000100:00100000:2.0:1787397882.857632:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185152 00000100:00100000:2.0:1787397882.857684:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:2.0:1787397882.857693:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701185152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397882.857743:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701185152:12345-0@lo:400:kworker.0 Request processed in 52us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397882.857750:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00080000:1.0:1787397882.857882:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397882.857889:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397882.857893:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701184768:0@lo:8:kworker.0 00000100:00100000:0.0:1787397882.857936:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701185152:0@lo:400:kworker.0 00000100:00100000:0.0:1787397883.655036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397883.655076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397883.655186:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289344 00000100:00100000:2.0:1787397883.655215:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289344 00000100:00100000:2.0:1787397883.655271:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289472 00000100:00100000:2.0:1787397883.655274:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289472 00000100:00100000:2.0:1787397883.655304:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5134 00000100:00100000:2.0:1787397883.655311:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681289344:12345-192.168.204.60@tcp:8:kworker.0 00010000:00020000:2.0:1787397883.655335:0:15073:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397883.655403:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5135 00000100:00100000:2.0:1787397883.655415:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681289344:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 99us (385us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397883.655416:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874218681289472:12345-192.168.204.60@tcp:8:kworker.0 00000100:00100000:2.0:1787397883.655438:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5134 00010000:02000000:3.0:1787397883.655447:0:8437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:3.0:1787397883.655478:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70adc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874218681289472:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 66us (401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397883.655485:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5135 00000100:00100000:2.0:1787397883.659994:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397883.660043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397883.660084:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397883.660197:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289216 00000100:00100000:3.0:1787397883.660207:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289216 00000100:00100000:3.0:1787397883.660276:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289088 00000100:00100000:3.0:1787397883.660280:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289088 00000100:00100000:3.0:1787397883.660303:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1556 00000100:00100000:3.0:1787397883.660312:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681289216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397883.660390:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681289216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397883.660398:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1556 00000100:00100000:3.0:1787397883.660416:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1557 00000100:00100000:3.0:1787397883.660433:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681289088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397883.660477:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681289088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 55us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397883.660484:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1557 00000100:00080000:2.0:1787397883.660762:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397883.660767:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397883.661026:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681288960 00000100:00100000:0.0:1787397883.661031:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681288960 00000100:00100000:0.0:1787397883.661087:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 271 00000100:00100000:0.0:1787397883.661095:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681288960:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397883.661133:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681288960:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397883.661140:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 271 00010000:00010000:2.0:1787397883.748837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397884.388813:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397884.388831:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701185664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397884.388936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397884.389094:0:23942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185664 00000100:00100000:3.0:1787397884.389103:0:23942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185664 00000100:00100000:3.0:1787397884.389158:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1787397884.389167:0:23942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701185664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397884.389201:0:23942:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397884.389268:0:23942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701185664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397884.389276:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:2.0:1787397884.389313:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701185664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397884.389343:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701185792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397884.389372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397884.389456:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185792 00000100:00100000:2.0:1787397884.389461:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185792 00000100:00100000:2.0:1787397884.389497:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1787397884.389504:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701185792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397884.389543:0:8446:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397884.390046:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701185792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 542us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397884.390054:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:0.0:1787397884.396108:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701185792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397884.773353:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397885.797424:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397886.820843:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1787397886.949279:0:99182:0:(genops.c:1873:obd_exports_barrier()) lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:2.0:1787397886.970062:0:99182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7024d55a0 - data ffff89a827f35798/ffff89a82f60b000 00000020:01000000:2.0:1787397886.970333:0:99182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a8187a4000 - data ffff89a827f37e58/ffff89a836486400 00100000:10000000:2.0:1787397886.981742:0:99182:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787397886.994978:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b866 00000020:00000080:1.0:1787397886.994989:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a7025d2000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787397886.995012:0:99182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a702023000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787397886.995017:0:99182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a702023000 2 00000020:01000004:1.0:1787397886.995019:0:99182:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a702023000 from lustre-OST0001 00000020:00000080:1.0:1787397886.995046:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397886.995058:0:99182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787397886.995061:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a7025d4000/lustre-OST0001_UUID 00000020:00000080:1.0:1787397886.995063:0:99182:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d4000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787397886.995070:0:99182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:01000004:1.0:1787397886.995214:0:99182:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787397886.995218:0:99182:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787397886.995222:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397886.995228:0:99182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787397886.995234:0:99182:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89a7033bc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787397886.995248:0:99182:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff89a7033a4d40) has exports, disconnecting them 00000020:00080000:1.0:1787397886.995253:0:99182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89a7033bc000), last request at 1787394371 00000020:00000080:1.0:1787397886.995257:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b890 00000020:00080000:1.0:1787397886.995266:0:99182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7033bc000): rc 0 00000020:00000080:1.0:1787397886.995271:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a7033bc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787397886.995676:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787397886.995690:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7033bc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787397886.999616:0:99182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787397886.999626:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397886.999630:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397886.999637:0:99182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787397886.999803:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397886.999818:0:99182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787397886.999826:0:99182:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787397886.999834:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397886.999839:0:99182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787397886.999846:0:99182:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff89a7033b8800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397886.999853:0:99182:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff89a7033a19c0) has exports, disconnecting them 00000020:00080000:2.0:1787397886.999857:0:99182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff89a7033b8800), last request at 1787394371 00000020:00000080:2.0:1787397886.999862:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b8a5 00000020:00080000:2.0:1787397886.999880:0:99182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7033b8800): rc 0 00000020:00000080:2.0:1787397886.999885:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a7033b8800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787397887.001102:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7033bb800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787397887.001117:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a703376000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787397887.001121:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703376000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787397887.001135:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787397887.001222:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7033b8800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787397887.001254:0:99182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787397887.001259:0:99182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787397887.001262:0:99182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787397887.001267:0:99182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397887.001285:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7033bd800 for lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787397887.001404:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397887.001414:0:99182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787397887.001417:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a7033be800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787397887.001420:0:99182:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7033be800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787397887.001424:0:99182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787397887.001470:0:99182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a702023000 1 00000020:00000080:3.0:1787397887.001477:0:99182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d14b835 00000020:00000080:3.0:1787397887.001482:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a837bb0800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787397887.001490:0:99182:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787397887.001498:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787397887.001507:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397887.001513:0:99182:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787397887.001516:0:99182:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff89a70207b380) has no exports 00000020:00000080:2.0:1787397887.105932:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397887.105951:0:99182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787397887.105957:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a8369cc800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787397887.105961:0:99182:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8369cc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787397887.105972:0:99182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787397887.106093:0:99182:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a836497000 00000020:01000000:2.0:1787397887.106115:0:99182:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787397887.106120:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397887.106125:0:99182:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787397887.106129:0:99182:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff89a82e4fcd40) has no exports 00000020:00000080:2.0:1787397887.106181:0:99182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397887.106187:0:99182:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787397887.106191:0:99182:0:(genops.c:906:class_export_put()) final put ffff89a829b2d800/OSS_uuid 00000020:00000080:2.0:1787397887.106193:0:99182:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b2d800/OSS_uuid for OSS 00000020:01000000:2.0:1787397887.106197:0:99182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787397887.106347:0:26169:0:(service.c:3183:ptlrpc_main()) ll_ost00_018: service thread [ffff89a7059e3400:26169] 18 exiting: rc = 0 00000100:00100000:1.0:1787397887.106377:0:26160:0:(service.c:3183:ptlrpc_main()) ll_ost00_009: service thread [ffff89a81782b400:26160] 9 exiting: rc = 0 00000100:00100000:3.0:1787397887.106385:0:26158:0:(service.c:3183:ptlrpc_main()) ll_ost00_007: service thread [ffff89a703f8ee00:26158] 7 exiting: rc = 0 00000100:00100000:2.0:1787397887.106470:0:26165:0:(service.c:3183:ptlrpc_main()) ll_ost00_014: service thread [ffff89a81782b600:26165] 14 exiting: rc = 0 00000100:00100000:0.0:1787397887.107295:0:26166:0:(service.c:3183:ptlrpc_main()) ll_ost00_015: service thread [ffff89a807620000:26166] 15 exiting: rc = 0 00000100:00100000:1.0:1787397887.107482:0:26159:0:(service.c:3183:ptlrpc_main()) ll_ost00_008: service thread [ffff89a703f8fc00:26159] 8 exiting: rc = 0 00000100:00100000:1.0:1787397887.107563:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff89a83649ea00:8436] 1 exiting: rc = 0 00000100:00100000:1.0:1787397887.107643:0:26163:0:(service.c:3183:ptlrpc_main()) ll_ost00_012: service thread [ffff89a706c1be00:26163] 12 exiting: rc = 0 00000100:00100000:1.0:1787397887.107712:0:8501:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89a702464e00:8501] 3 exiting: rc = 0 00000100:00100000:1.0:1787397887.107785:0:26167:0:(service.c:3183:ptlrpc_main()) ll_ost00_016: service thread [ffff89a817e0d600:26167] 16 exiting: rc = 0 00000100:00100000:1.0:1787397887.107848:0:25908:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff89a820300000:25908] 5 exiting: rc = 0 00000100:00100000:1.0:1787397887.107935:0:26164:0:(service.c:3183:ptlrpc_main()) ll_ost00_013: service thread [ffff89a82f213000:26164] 13 exiting: rc = 0 00000100:00100000:3.0:1787397887.108882:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff89a835641200:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1787397887.108954:0:26157:0:(service.c:3183:ptlrpc_main()) ll_ost00_006: service thread [ffff89a704509600:26157] 6 exiting: rc = 0 00000100:00100000:2.0:1787397887.109036:0:15073:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff89a83577ee00:15073] 4 exiting: rc = 0 00000100:00100000:2.0:1787397887.109135:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff89a83649e200:8437] 2 exiting: rc = 0 00000100:00100000:2.0:1787397887.109243:0:26161:0:(service.c:3183:ptlrpc_main()) ll_ost00_010: service thread [ffff89a8076e1c00:26161] 10 exiting: rc = 0 00000100:00100000:2.0:1787397887.109311:0:26162:0:(service.c:3183:ptlrpc_main()) ll_ost00_011: service thread [ffff89a704e8c400:26162] 11 exiting: rc = 0 00000100:00100000:2.0:1787397887.109413:0:26168:0:(service.c:3183:ptlrpc_main()) ll_ost00_017: service thread [ffff89a817df5000:26168] 17 exiting: rc = 0 00000100:00100000:3.0:1787397887.109718:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109727:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109735:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109742:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109749:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109757:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109764:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109771:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109777:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109783:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109790:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109797:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109803:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109808:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109815:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109821:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109827:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109834:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109840:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109847:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109854:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109863:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109885:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109892:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109898:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.109905:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110646:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110657:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110663:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110671:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110676:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110683:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110691:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110698:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110704:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110710:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110717:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110723:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110728:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110734:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110741:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110746:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110776:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110783:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110788:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110793:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110799:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110806:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110813:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110819:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110825:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110831:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110852:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110860:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110866:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110872:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110878:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110900:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110914:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110920:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110926:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110932:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110937:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.110942:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.114259:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89a83649fc00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1787397887.114875:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89a83649f200:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1787397887.114940:0:19690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff89a704a4aa00:19690] 2 exiting: rc = 0 00000100:00100000:2.0:1787397887.115133:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115159:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115167:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115172:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115179:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115184:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115189:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115196:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115202:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115208:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115215:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115225:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115232:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115239:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115245:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115252:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115258:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115265:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115271:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115278:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115284:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115303:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115309:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115315:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115320:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115327:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115333:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115338:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115345:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115350:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115366:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115374:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115379:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115383:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115388:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115393:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115397:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115402:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115406:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115412:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115417:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115423:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115428:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115433:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115438:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115443:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115449:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115454:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115459:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115463:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115468:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115472:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115477:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115482:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115487:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115492:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115506:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115512:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115518:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115624:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115631:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115637:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115643:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.115655:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.118834:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89a82f47c400:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1787397887.119049:0:24832:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_006: service thread [ffff89a704b69400:24832] 6 exiting: rc = 0 00000100:00100000:3.0:1787397887.119251:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89a8354b7200:8440] 0 exiting: rc = 1 00000100:00100000:3.0:1787397887.119420:0:24831:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff89a705862000:24831] 5 exiting: rc = 0 00000100:00100000:2.0:1787397887.119475:0:24842:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_008: service thread [ffff89a81789c000:24842] 8 exiting: rc = 0 00000100:00100000:0.0:1787397887.119929:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89a82f47c800:8442] 2 exiting: rc = 0 00000100:00100000:0.0:1787397887.120344:0:24828:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff89a836065000:24828] 3 exiting: rc = 0 00000100:00100000:0.0:1787397887.120496:0:24843:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_009: service thread [ffff89a817812a00:24843] 9 exiting: rc = 0 00000100:00100000:3.0:1787397887.121843:0:24830:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff89a704b64800:24830] 4 exiting: rc = 0 00000100:00100000:1.0:1787397887.122122:0:24833:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_007: service thread [ffff89a705863400:24833] 7 exiting: rc = 0 00000100:00100000:3.0:1787397887.130476:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130489:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130495:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130501:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130506:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130512:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130517:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130747:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130777:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130785:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130794:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130802:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130811:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130818:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130824:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130830:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130835:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130842:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130848:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130855:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130862:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130868:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130875:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130882:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130902:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130908:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130914:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130920:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130928:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130935:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130947:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.130959:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.131018:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132094:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132105:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132111:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132116:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132124:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132130:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132138:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132145:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132150:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132155:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132173:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132180:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132188:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.132194:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133469:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133485:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133490:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133497:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133502:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133508:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133513:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133519:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133541:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133576:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133587:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133596:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133613:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133624:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133633:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133641:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397887.133648:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787397887.150620:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89a835468800:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1787397887.150625:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89a835469400:8443] 0 exiting: rc = 1 00000100:00100000:2.0:1787397887.160676:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160687:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160693:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160699:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160704:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160709:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160714:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160719:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160724:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160729:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160745:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160751:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160756:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160762:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160767:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160772:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160777:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160782:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160787:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160792:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160797:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160802:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160807:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160839:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160844:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160849:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160855:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160860:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160866:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160870:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160875:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160880:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160885:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160891:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160896:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160901:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160907:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160912:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160927:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160933:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160939:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160944:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160949:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160954:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160959:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.160964:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162454:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162465:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162470:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162474:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162479:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162484:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162489:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162495:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162501:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162506:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162511:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162517:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162563:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162569:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162575:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162580:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162584:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787397887.162592:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.166166:0:23942:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_002: service thread [ffff89a82887ac00:23942] 2 exiting: rc = 0 00000100:00100000:1.0:1787397887.174330:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89a82f5f3600:8445] 0 exiting: rc = 1 00000100:00100000:0.0:1787397887.175722:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89a82f5fb600:8446] 1 exiting: rc = 0 00000100:00100000:1.0:1787397887.176436:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176455:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176475:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176484:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176491:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176499:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176506:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176513:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176540:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176549:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176557:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176563:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176585:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176592:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176599:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176605:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176613:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176620:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176629:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176635:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176641:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176647:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176654:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176661:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176667:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176675:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176683:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176691:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176699:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176707:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176714:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176722:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176729:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176736:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176744:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176751:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176758:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176765:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176772:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176780:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176789:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176797:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176804:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176819:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176827:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176834:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176841:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176857:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176863:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176870:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176878:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176885:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176893:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176902:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176911:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176918:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176924:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176940:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176947:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176955:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176961:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176976:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176984:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787397887.176993:0:99182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787397887.190139:0:99182:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00010000:00010000:2.0:1787397887.845353:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787397887.972902:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397887.972909:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397887.972912:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397887.972921:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3762 00000100:00080000:1.0:1787397887.972925:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397887.972933:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397887.972957:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702136300 x1874218701186176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397887.972973:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397887.972976:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397887.972978:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397887.972981:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3762 00000100:00080000:1.0:1787397887.972984:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787397887.972994:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397887.973008:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702135c00 x1874218701186304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397887.973750:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701186048:0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.974128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397887.974184:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397887.974193:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701185920:0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.974226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397887.974477:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701186048 00000100:00100000:2.0:1787397887.974485:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701186048 00000100:00100000:2.0:1787397887.974559:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397887.974568:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701186048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.974639:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701186048:12345-0@lo:400:kworker.0 Request processed in 72us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397887.974647:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397887.974671:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701185920 00000100:00100000:2.0:1787397887.974676:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701185920 00000100:00100000:2.0:1787397887.974701:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787397887.974708:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3650:x1874218701185920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.974744:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3650:x1874218701185920:12345-0@lo:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397887.974749:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787397887.975008:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701185920:0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.975054:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701186048:0@lo:400:kworker.0 00000100:00080000:1.0:1787397887.976196:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397887.976202:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397887.976205:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397887.976211:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3762 00000100:00080000:1.0:1787397887.976215:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397887.976221:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397887.976241:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702137b80 x1874218701186688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397887.976263:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397887.976267:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397887.976268:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397887.976271:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3762 00000100:00080000:1.0:1787397887.976275:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787397887.976279:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397887.976321:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397887.976348:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701186432:0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.976400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397887.976435:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702135500 x1874218701186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397887.976444:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701186432 00000100:00100000:2.0:1787397887.976449:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701186432 00000100:00100000:1.0:1787397887.976468:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701186176:0@lo:8:kworker.0 00000100:00100000:2.0:1787397887.976487:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000400:00000100:1.0:1787397887.976493:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874218701186176 offset 0 length 520: 4 00000100:00100000:2.0:1787397887.976494:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701186432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397887.976507:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701186304:0@lo:8:kworker.0 00000400:00000100:1.0:1787397887.976537:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874218701186304 offset 0 length 520: 4 00000100:00100000:1.0:1787397887.976549:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701186688:0@lo:8:kworker.0 00000100:00100000:2.0:1787397887.976550:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701186432:12345-0@lo:400:kworker.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397887.976558:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000400:00000100:1.0:1787397887.976575:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874218701186688 offset 0 length 520: 4 00000100:00100000:1.0:1787397887.976586:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701186816:0@lo:8:kworker.0 00000100:00100000:2.0:1787397887.976596:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701186432:0@lo:400:kworker.0 00000400:00000100:1.0:1787397887.976597:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874218701186816 offset 0 length 520: 4 00000100:00100000:1.0:1787397887.976625:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701186560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397887.976917:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701186944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397887.976950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397887.976995:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397887.977025:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701186944 00000100:00100000:2.0:1787397887.977030:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701186944 00000100:00100000:2.0:1787397887.977076:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1787397887.977081:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701186944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397887.977119:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701186944:12345-0@lo:400:kworker.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397887.977125:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1787397887.977161:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701186944:0@lo:400:kworker.0 00000100:00100000:0.0:1787397887.978334:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701186560 00000100:00100000:0.0:1787397887.978354:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701186560 00000100:00100000:0.0:1787397887.978399:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787397887.978408:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397887.978474:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701186560:12345-0@lo:400:kworker.0 Request processed in 67us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397887.978482:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787397887.978621:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701186560:0@lo:400:kworker.0 00000100:00100000:3.0:1787397888.789812:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397888.789879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:3.0:1787397888.789907:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 28 match 1874218681289984 offset 0 length 520: 4 00000100:00100000:3.0:1787397888.789927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397888.789957:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289856 00000100:00100000:3.0:1787397888.789967:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289856 00000100:00100000:3.0:1787397888.790026:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289728 00000100:00100000:3.0:1787397888.790029:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289728 00000100:00100000:3.0:1787397888.790054:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1560 00000100:00100000:3.0:1787397888.790064:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681289856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397888.790147:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681289856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397888.790155:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1560 00000100:00100000:3.0:1787397888.790174:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1561 00000100:00100000:3.0:1787397888.790181:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681289728:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397888.790205:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681289728:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397888.790211:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1561 00000100:00080000:3.0:1787397888.790227:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397888.790231:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:3.0:1787397888.790254:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 28 match 1874218681290112 offset 0 length 520: 4 00000100:00100000:1.0:1787397888.790968:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681289600 00000100:00100000:1.0:1787397888.790977:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681289600 00000100:00100000:1.0:1787397888.791025:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 273 00000100:00100000:1.0:1787397888.791032:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681289600:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397888.791073:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681289600:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397888.791081:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 273 00010000:00010000:2.0:1787397888.868797:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397889.508933:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701187072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397889.509010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397889.509094:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187072 00000100:00100000:2.0:1787397889.509103:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187072 00000100:00100000:2.0:1787397889.509152:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787397889.509160:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701187072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397889.509193:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397889.509244:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701187072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397889.509252:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787397889.509300:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701187072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397889.509562:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701187200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397889.509595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397889.509681:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187200 00000100:00100000:0.0:1787397889.509687:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187200 00000100:00100000:0.0:1787397889.509729:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397889.509737:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701187200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397889.509759:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397889.509804:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701187200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397889.509819:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787397889.509924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701187200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397889.893748:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397890.917857:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397891.941865:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397892.964942:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787397893.092738:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397893.092745:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397893.092747:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397893.092751:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397893.092780:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397893.092783:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787397893.092785:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397893.092788:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787397893.092814:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701187584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.092990:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701187328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.093043:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397893.093080:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701187840:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.093108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397893.093129:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397893.093134:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701187456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.093171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397893.093218:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187456 00000100:00100000:1.0:1787397893.093232:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187456 00000100:00100000:1.0:1787397893.093288:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787397893.093295:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701187456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.093347:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701187456:12345-0@lo:400:kworker.0 Request processed in 52us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397893.093355:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787397893.093396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701187456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397893.093752:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187328 00000100:00100000:2.0:1787397893.093757:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187328 00000100:00100000:2.0:1787397893.093801:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787397893.093809:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3650:x1874218701187328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397893.093847:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:3650:x1874218701187328:12345-0@lo:400:kworker.0 Request processed in 39us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397893.093984:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787397893.094018:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187840 00000100:00100000:2.0:1787397893.094022:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187840 00000100:00100000:2.0:1787397893.094051:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1787397893.094057:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703646c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701187840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397893.094088:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703646c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701187840:12345-0@lo:400:kworker.0 Request processed in 31us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397893.094094:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1787397893.094836:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701187328:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.094864:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701187840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397893.095612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397893.095646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397893.095657:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701187712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397893.095692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397893.095730:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187584 00000100:00100000:0.0:1787397893.095736:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187584 00000100:00100000:0.0:1787397893.095778:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1787397893.095785:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701187584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397893.095830:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701187584:12345-0@lo:400:kworker.0 Request processed in 44us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397893.095838:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1787397893.095888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701187584:0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.096321:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187712 00000100:00100000:1.0:1787397893.096326:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187712 00000100:00100000:1.0:1787397893.096363:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787397893.096370:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701187712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397893.096414:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701187712:12345-0@lo:400:kworker.0 Request processed in 44us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397893.096420:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787397893.096446:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701187712:0@lo:400:kworker.0 00000100:00100000:3.0:1787397893.895484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397893.895589:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397893.895622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397893.895732:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290240 00000100:00100000:1.0:1787397893.895745:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290240 00000100:00100000:1.0:1787397893.895804:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 275 00000100:00100000:1.0:1787397893.895814:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681290240:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397893.895859:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290368 00000100:00100000:2.0:1787397893.895863:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290368 00000100:00100000:1.0:1787397893.895885:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681290240:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397893.895893:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 275 00000100:00100000:2.0:1787397893.895901:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290496 00000100:00100000:2.0:1787397893.895903:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290496 00000100:00100000:2.0:1787397893.895925:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1564 00000100:00100000:2.0:1787397893.895932:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681290368:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397893.895964:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2404:x1874218681290368:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397893.895970:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1564 00000100:00100000:2.0:1787397893.895982:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1565 00000100:00100000:2.0:1787397893.895988:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681290496:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397893.896009:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681290496:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 21us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397893.896015:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1565 00000100:00080000:2.0:1787397893.896031:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397893.896035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787397893.989105:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397894.630129:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701187968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397894.631140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397894.635504:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397894.635539:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701188096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397894.636405:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701187968 00000100:00100000:1.0:1787397894.636430:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701187968 00000100:00100000:1.0:1787397894.636482:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397894.636493:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701187968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397894.636543:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397894.636624:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701187968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397894.636631:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787397894.636685:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701187968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397894.638642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397894.638696:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188096 00000100:00100000:3.0:1787397894.638703:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188096 00000100:00100000:3.0:1787397894.638745:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397894.638755:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701188096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397894.638786:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397894.638829:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701188096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397894.638836:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397894.638882:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701188096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397895.019851:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397896.036699:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787397896.555076:0:99634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397896.555080:0:99634:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787397896.555082:0:99634:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787397896.555214:0:99634:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a8364e2000 00000020:01000004:3.0:1787397896.555500:0:99634:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787397896.555514:0:99634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397896.555855:0:99634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89a838784d40) 00000020:00000080:3.0:1787397896.555877:0:99634:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787397896.610972:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787397896.614841:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787397896.615369:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787397896.615594:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787397896.615945:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787397896.616178:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787397896.616359:0:99634:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787397896.619777:0:99634:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787397896.620023:0:99634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787397896.620037:0:99634:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787397896.620050:0:99634:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192563 00000020:01000004:2.0:1787397896.620056:0:99634:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787397896.620078:0:99634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787397896.620081:0:99634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787397896.620087:0:99634:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787397896.620092:0:99634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787397896.620102:0:99634:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89a83b9d0000) 00000020:00000080:2.0:1787397896.620112:0:99634:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787397896.621195:0:99634:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787397896.621341:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787397896.621347:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787397896.628591:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787397896.628608:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787397896.632444:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787397896.632459:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787397896.635210:0:99634:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397896.635410:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787397896.635426:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787397896.636491:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787397896.636501:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787397896.661225:0:99634:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397896.661478:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787397896.661485:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787397896.670265:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787397896.670288:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787397896.671517:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787397896.671677:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787397896.674440:0:99634:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787397896.674963:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787397896.674969:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787397896.675473:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787397896.675479:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787397896.740163:0:99634:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787397896.741311:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787397896.741320:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787397896.744586:0:99634:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787397896.744600:0:99634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787397896.746027:0:99634:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787397896.746061:0:99634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787397896.746142:0:99634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787397896.758350:0:99634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787397896.758393:0:99634:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787397896.758403:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787397896.758405:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.758406:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.758407:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.758408:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.758409:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.758411:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.758413:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.758414:0:99634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397896.758418:0:99634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787397896.758420:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397896.758421:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.758422:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.758423:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.758424:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.758425:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.758426:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.758427:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.758428:0:99634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787397896.758453:0:99634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787397896.758475:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397896.758581:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.758632:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8052f2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.758642:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188224 00000100:00100000:0.0:1787397896.758651:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188224 00000100:00100000:0.0:1787397896.758728:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787397896.758737:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:99634:x1874218701188224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787397896.758771:0:94334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787397896.758775:0:94334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787397896.758780:0:94334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787397896.760318:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:99634:x1874218701188224:12345-0@lo:253:mount.lustre.0 Request processed in 1575us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.760336:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787397896.760487:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397896.760500:0:99634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787397896.760504:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397896.760505:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.760507:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.760508:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.760509:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.760510:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.760512:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.760513:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.760515:0:99634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397896.760567:0:99634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a8364e2000 from lustre-OST0000 10000000:01000000:2.0:1787397896.760604:0:99634:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787397896.760607:0:99634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787397896.760628:0:99634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:2.0:1787397896.760642:0:99634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397896.760745:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397896.760840:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.760980:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8052f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.767956:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188352 00000100:00100000:1.0:1787397896.767971:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188352 00000100:00100000:1.0:1787397896.768059:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787397896.768069:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:99634:x1874218701188352:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397896.771071:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:99634:x1874218701188352:12345-0@lo:501:mount.lustre.0 Request processed in 2994us (10222us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397896.771087:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787397896.771119:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188352:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787397896.771146:0:99634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787397896.771191:0:99634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787397896.771201:0:99634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397896.771213:0:99634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397896.771244:0:99634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a8364e2000 10000000:01000000:3.0:1787397896.771249:0:99634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787397896.771255:0:99634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787397896.771260:0:99634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397896.771264:0:99634:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787397896.771268:0:99634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397896.771300:0:99634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397896.771308:0:99634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397896.771319:0:99634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397896.771358:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397896.771397:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397896.771439:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.771506:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188480 00000100:00100000:1.0:1787397896.771512:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188480 00000100:00100000:1.0:1787397896.771655:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787397896.771664:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:99634:x1874218701188480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397896.771678:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397896.771701:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63000/0x274786fe0d192578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192571 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.771725:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63000/0x274786fe0d192578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192571 expref: 19 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.771737:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63000/0x274786fe0d192578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192571 expref: 19 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.771746:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00000100:00100000:1.0:1787397896.771899:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188480:12345-0@lo:101:mount.lustre.0 Request processed in 236us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.771906:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787397896.777826:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397896.777860:0:99634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397896.777876:0:99634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397896.780155:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:0.0:1787397896.782482:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397896.786550:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1787397896.786621:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:0.0:1787397896.786637:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:0.0:1787397896.786651:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:0.0:1787397896.786665:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:0.0:1787397896.786677:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:0.0:1787397896.786688:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:0.0:1787397896.786699:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:0.0:1787397896.786710:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:0.0:1787397896.786720:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:0.0:1787397896.786731:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:0.0:1787397896.786743:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:0.0:1787397896.786764:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:0.0:1787397896.786769:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:0.0:1787397896.792400:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397896.792475:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.792544:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397896.792973:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188608 00000100:00100000:3.0:1787397896.792980:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188608 00000100:00100000:3.0:1787397896.793085:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787397896.793096:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397896.793267:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188608:12345-0@lo:501:mount.lustre.0 Request processed in 172us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.793277:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787397896.793359:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397896.793395:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397896.793444:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.802138:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188736 00000100:00100000:1.0:1787397896.802156:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188736 00000100:00100000:3.0:1787397896.802262:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787397896.802277:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397896.802461:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188736:12345-0@lo:503:mount.lustre.0 Request processed in 187us (9015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.802470:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787397896.803101:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.803133:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188736:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787397896.806470:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787397896.806599:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397896.806682:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.806727:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397896.806830:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188864 00000100:00100000:3.0:1787397896.806839:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188864 00000100:00100000:3.0:1787397896.806888:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787397896.806910:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397896.807208:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188864:12345-0@lo:502:mount.lustre.0 Request processed in 303us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.807217:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787397896.808579:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397896.810161:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1787397896.811418:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:0.0:1787397896.811448:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:0.0:1787397896.811463:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:0.0:1787397896.811476:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:0.0:1787397896.811489:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:0.0:1787397896.811504:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:0.0:1787397896.811517:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:0.0:1787397896.811943:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:0.0:1787397896.811957:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:0.0:1787397896.811969:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:0.0:1787397896.811980:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:0.0:1787397896.812040:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397896.812128:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.812242:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.815756:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701188992 00000100:00100000:1.0:1787397896.815772:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701188992 00000100:00100000:1.0:1787397896.816121:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787397896.816133:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397896.816339:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701188992:12345-0@lo:502:mount.lustre.0 Request processed in 207us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.816347:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787397896.816448:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701188992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397896.816557:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:0.0:1787397896.816573:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787397896.819147:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397896.819160:0:99651:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787397896.819176:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397896.819178:0:99651:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787397896.819185:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397896.819201:0:99651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89a70207b380) 00000020:00000080:0.0:1787397896.819228:0:99651:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787397896.819235:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787397896.819308:0:99651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e2000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787397896.819317:0:99651:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787397896.819323:0:99651:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x274786fe0d192586 00010000:00010000:1.0:1787397896.823794:0:99651:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787397896.824504:0:99651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 8589934612 00080000:10000000:1.0:1787397896.827396:0:99651:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:1.0:1787397896.832107:0:99651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787397896.832119:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397896.832126:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832128:0:99651:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787397896.832145:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397896.832148:0:99651:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787397896.832150:0:99651:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397896.832152:0:99651:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397896.832153:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397896.832156:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832157:0:99651:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787397896.832160:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397896.832174:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832176:0:99651:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787397896.832179:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787397896.832181:0:99651:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787397896.832184:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397896.832186:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832188:0:99651:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787397896.832190:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397896.832192:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832193:0:99651:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787397896.832196:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787397896.832228:0:99651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397896.832231:0:99651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397896.832233:0:99651:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787397896.832236:0:99651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:0.0:1787397896.833468:0:99634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787397896.833550:0:99634:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787397896.833566:0:99634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833579:0:99634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397896.833588:0:99634:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a8364e2000 from 1 10000000:01000000:0.0:1787397896.833591:0:99634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787397896.833630:0:99634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833639:0:99634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833650:0:99634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397896.833678:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397896.833749:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.833795:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189120 00000100:00100000:0.0:1787397896.833802:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189120 00000100:00100000:0.0:1787397896.833848:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787397896.833858:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:99634:x1874218701189120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397896.833872:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397896.833886:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75000/0x274786fe0d192594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19258d expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833911:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75000/0x274786fe0d192594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19258d expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833935:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75000/0x274786fe0d192594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19258d expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.833944:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00000100:00100000:0.0:1787397896.833981:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189120:12345-0@lo:101:mount.lustre.0 Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.833988:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787397896.834031:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347eca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.834056:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397896.834070:0:99634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.834078:0:99634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397896.836424:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:0.0:1787397896.836749:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397896.836930:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1787397896.836955:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:0.0:1787397896.836967:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:0.0:1787397896.836980:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:0.0:1787397896.836992:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:0.0:1787397896.837007:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:0.0:1787397896.837011:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:0.0:1787397896.837078:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397896.837134:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.837180:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8347ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.837362:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189248 00000100:00100000:1.0:1787397896.837369:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189248 00000100:00100000:1.0:1787397896.837415:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787397896.837423:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397896.837549:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189248:12345-0@lo:501:mount.lustre.0 Request processed in 125us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.837556:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787397896.837650:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397896.837685:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397896.837728:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397896.837759:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.837818:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189376 00000100:00100000:0.0:1787397896.837823:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189376 00000100:00100000:0.0:1787397896.837864:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787397896.837871:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397896.837943:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189376:12345-0@lo:503:mount.lustre.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.837949:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787397896.838078:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189376:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787397896.838440:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787397896.838499:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397896.838571:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397896.838597:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.838731:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189504 00000100:00100000:1.0:1787397896.838737:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189504 00000100:00100000:1.0:1787397896.838784:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787397896.838799:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397896.838905:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189504:12345-0@lo:502:mount.lustre.0 Request processed in 106us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.838911:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787397896.839133:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787397896.839338:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1787397896.839365:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:3.0:1787397896.839377:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:3.0:1787397896.839387:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:3.0:1787397896.839399:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000100:00100000:3.0:1787397896.839419:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397896.839455:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397896.839487:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.839551:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189632 00000100:00100000:0.0:1787397896.839555:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189632 00000100:00100000:0.0:1787397896.839584:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787397896.839591:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397896.839670:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189632:12345-0@lo:502:mount.lustre.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.839676:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787397896.840447:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787397896.840513:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:3.0:1787397896.840547:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787397896.843152:0:99655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397896.843174:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397896.843176:0:99655:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787397896.843184:0:99655:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a8364e2000 00000020:00000080:0.0:1787397896.843187:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397896.843196:0:99655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397896.843199:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397896.843201:0:99655:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787397896.843204:0:99655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397896.843206:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397896.843208:0:99655:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787397896.843211:0:99655:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a8364e2000 00000020:00000080:0.0:1787397896.843214:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397896.843279:0:99655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397896.843282:0:99655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397896.843284:0:99655:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787397896.843302:0:99655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000020:01000000:2.0:1787397896.845506:0:99634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787397896.845577:0:99634:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787397896.845604:0:99634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.845619:0:99634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397896.845681:0:99634:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787397896.845684:0:99634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a8364e2000 10000000:01000000:2.0:1787397896.845688:0:99634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a8364e2000 10000000:01000000:2.0:1787397896.845692:0:99634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787397896.845698:0:99634:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a8364e2000 from 1 10000000:01000000:2.0:1787397896.845701:0:99634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787397896.846461:0:99634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.846474:0:99634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.846485:0:99634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397896.846508:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397896.846607:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.846672:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8052f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397896.847465:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189760 00000100:00100000:0.0:1787397896.847473:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189760 00000100:00100000:0.0:1787397896.847552:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787397896.847564:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:99634:x1874218701189760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397896.847578:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397896.847595:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74600/0x274786fe0d1925a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19259b expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.847621:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74600/0x274786fe0d1925a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19259b expref: 21 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.847631:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74600/0x274786fe0d1925a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19259b expref: 21 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.847639:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74600, rc 0) 00000100:00100000:0.0:1787397896.847695:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701189760:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.847703:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787397896.847992:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397896.848009:0:99634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.848019:0:99634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397896.858899:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64 count 63 00000040:00080000:2.0:1787397896.859434:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397896.859754:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:2.0:1787397896.860213:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:2.0:1787397896.860237:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:2.0:1787397896.860252:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:2.0:1787397896.860266:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:2.0:1787397896.860280:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:2.0:1787397896.860292:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:2.0:1787397896.860303:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:2.0:1787397896.860317:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:2.0:1787397896.860331:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:2.0:1787397896.860345:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:2.0:1787397896.860359:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:2.0:1787397896.860373:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:2.0:1787397896.860389:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:2.0:1787397896.860401:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:2.0:1787397896.860414:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:2.0:1787397896.860425:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:2.0:1787397896.860435:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:2.0:1787397896.860445:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:2.0:1787397896.860454:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:2.0:1787397896.860472:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:2.0:1787397896.860482:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:2.0:1787397896.860492:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:2.0:1787397896.860505:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:2.0:1787397896.860539:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 160 off12472 00000040:00080000:2.0:1787397896.860557:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12696 00000040:00080000:2.0:1787397896.860572:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12920 00000040:00080000:2.0:1787397896.860591:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off13000 00000040:00080000:2.0:1787397896.860601:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13224 00000040:00080000:2.0:1787397896.860615:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13448 00000040:00080000:2.0:1787397896.860626:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13536 00000040:00080000:2.0:1787397896.860636:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13664 00000040:00080000:2.0:1787397896.860645:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13808 00000040:00080000:2.0:1787397896.860657:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13936 00000040:00080000:2.0:1787397896.860670:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14160 00000040:00080000:2.0:1787397896.860682:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14384 00000040:00080000:2.0:1787397896.860693:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14464 00000040:00080000:2.0:1787397896.860706:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14688 00000040:00080000:2.0:1787397896.860718:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14912 00000040:00080000:2.0:1787397896.860732:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 88 off15000 00000040:00080000:2.0:1787397896.860745:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 128 off15128 00000040:00080000:2.0:1787397896.860759:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].42, 144 off15272 00000040:00080000:2.0:1787397896.860774:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].43, 128 off15400 00000040:00080000:2.0:1787397896.861330:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].44, 224 off15624 00000040:00080000:2.0:1787397896.861345:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].45, 224 off15848 00000040:00080000:2.0:1787397896.861359:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].46, 80 off15928 00000040:00080000:2.0:1787397896.861372:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].47, 224 off16152 00000040:00080000:2.0:1787397896.861383:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].48, 232 off16384 00000040:00080000:2.0:1787397896.861585:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].49, 224 off16608 00000040:00080000:2.0:1787397896.861607:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].50, 120 off16728 00000040:00080000:2.0:1787397896.861620:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].51, 224 off16952 00000040:00080000:2.0:1787397896.861632:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].52, 224 off17176 00000040:00080000:2.0:1787397896.861645:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].53, 112 off17288 00000040:00080000:2.0:1787397896.861668:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].54, 224 off17512 00000040:00080000:2.0:1787397896.861680:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].55, 224 off17736 00000040:00080000:2.0:1787397896.861691:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].56, 136 off17872 00000040:00080000:2.0:1787397896.861702:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].57, 224 off18096 00000040:00080000:2.0:1787397896.861714:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].58, 224 off18320 00000040:00080000:2.0:1787397896.861725:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].59, 136 off18456 00000040:00080000:2.0:1787397896.861737:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].60, 224 off18680 00000040:00080000:2.0:1787397896.861750:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].61, 224 off18904 00000040:00080000:2.0:1787397896.861763:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].62, 112 off19016 00000040:00080000:2.0:1787397896.861792:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].63, 224 off19240 00000040:00080000:2.0:1787397896.861799:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 63 count 63 00000100:00100000:2.0:1787397896.863025:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397896.863393:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.863439:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8052f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397896.864203:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701189888 00000100:00100000:3.0:1787397896.864214:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701189888 00000100:00100000:3.0:1787397896.864273:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787397896.864283:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701189888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397896.865006:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701189888:12345-0@lo:501:mount.lustre.0 Request processed in 722us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.865016:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787397896.865369:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701189888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397896.865417:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397896.865465:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.865550:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8052f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.866294:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190016 00000100:00100000:1.0:1787397896.866302:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190016 00000100:00100000:1.0:1787397896.866388:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787397896.866398:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397896.866549:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190016:12345-0@lo:503:mount.lustre.0 Request processed in 152us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.866558:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787397896.866646:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787397896.867084:0:99634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787397896.867341:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397896.867392:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.867510:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397896.867633:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190144 00000100:00100000:3.0:1787397896.867640:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190144 00000100:00100000:3.0:1787397896.867686:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787397896.867695:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397896.867856:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190144:12345-0@lo:502:mount.lustre.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.867864:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787397896.868014:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397896.868205:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1787397896.868233:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:2.0:1787397896.868248:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:2.0:1787397896.868273:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:2.0:1787397896.868288:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:2.0:1787397896.868302:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:2.0:1787397896.868315:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:2.0:1787397896.868328:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:2.0:1787397896.868339:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:2.0:1787397896.868351:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:2.0:1787397896.868364:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:2.0:1787397896.868375:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:2.0:1787397896.868387:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:2.0:1787397896.868399:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:2.0:1787397896.868411:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:2.0:1787397896.868422:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:2.0:1787397896.868435:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:2.0:1787397896.868447:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:2.0:1787397896.868461:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:2.0:1787397896.868473:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:2.0:1787397896.868485:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:2.0:1787397896.868497:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:2.0:1787397896.868511:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:2.0:1787397896.868544:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:2.0:1787397896.868559:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 160 off12472 00000040:00080000:2.0:1787397896.868572:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12696 00000040:00080000:2.0:1787397896.868583:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12920 00000040:00080000:2.0:1787397896.868595:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off13000 00000040:00080000:2.0:1787397896.868608:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13224 00000040:00080000:2.0:1787397896.868622:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13448 00000040:00080000:2.0:1787397896.868635:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13536 00000040:00080000:2.0:1787397896.868647:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13664 00000040:00080000:2.0:1787397896.868660:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13808 00000040:00080000:2.0:1787397896.868671:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13936 00000040:00080000:2.0:1787397896.868681:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14160 00000040:00080000:2.0:1787397896.868691:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14384 00000040:00080000:2.0:1787397896.868710:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14464 00000040:00080000:2.0:1787397896.868721:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14688 00000040:00080000:2.0:1787397896.868731:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14912 00000040:00080000:2.0:1787397896.868742:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 88 off15000 00000040:00080000:2.0:1787397896.868752:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 128 off15128 00000040:00080000:2.0:1787397896.868763:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].42, 144 off15272 00000040:00080000:2.0:1787397896.868773:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].43, 128 off15400 00000040:00080000:2.0:1787397896.869075:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].44, 224 off15624 00000040:00080000:2.0:1787397896.869088:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].45, 224 off15848 00000040:00080000:2.0:1787397896.869101:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].46, 80 off15928 00000040:00080000:2.0:1787397896.869113:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].47, 224 off16152 00000040:00080000:2.0:1787397896.869126:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].48, 232 off16384 00000100:00100000:2.0:1787397896.869178:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397896.869233:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.869306:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397896.869342:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190272 00000100:00100000:3.0:1787397896.869349:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190272 00000100:00100000:3.0:1787397896.869410:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787397896.869419:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397896.869513:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190272:12345-0@lo:502:mount.lustre.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397896.869542:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787397896.869653:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397896.869813:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].49, 224 off16608 00000040:00080000:2.0:1787397896.869836:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].50, 120 off16728 00000040:00080000:2.0:1787397896.869864:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].51, 224 off16952 00000040:00080000:2.0:1787397896.869880:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].52, 224 off17176 00000040:00080000:2.0:1787397896.869893:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].53, 112 off17288 00000040:00080000:2.0:1787397896.869906:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].54, 224 off17512 00000040:00080000:2.0:1787397896.869917:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].55, 224 off17736 00000040:00080000:2.0:1787397896.869928:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].56, 136 off17872 00000040:00080000:2.0:1787397896.869942:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].57, 224 off18096 00000040:00080000:2.0:1787397896.869954:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].58, 224 off18320 00000040:00080000:2.0:1787397896.869966:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].59, 136 off18456 00000040:00080000:2.0:1787397896.869978:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].60, 224 off18680 00000040:00080000:2.0:1787397896.869991:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].61, 224 off18904 00000040:00080000:2.0:1787397896.870003:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].62, 112 off19016 00000100:00100000:2.0:1787397896.870025:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787397896.870066:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.870087:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397896.870281:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190400 00000100:00100000:1.0:1787397896.870287:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190400 00000100:00100000:1.0:1787397896.870328:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787397896.870335:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397896.870419:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701190400:12345-0@lo:502:mount.lustre.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.870425:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787397896.870515:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701190400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397896.870577:0:99634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].63, 224 off19240 00000040:00080000:2.0:1787397896.870585:0:99634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:1.0:1787397896.871362:0:99658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787397896.871377:0:99658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89a7033a3380) 00000020:00000080:1.0:1787397896.871400:0:99658:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787397896.871646:0:99658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787397896.871650:0:99658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a8364e2000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787397896.871653:0:99658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e2000 3 00010000:00080000:1.0:1787397896.871683:0:99658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a817ecb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397896.877839:0:99658:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787397896.877999:0:99658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787397896.878050:0:99658:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787397896.878063:0:99658:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x274786fe0d1925b0 00000100:00080000:1.0:1787397896.878074:0:99658:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397896.878081:0:99658:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397896.878114:0:99658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702134380 x1874218701190528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397896.878149:0:99658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787397896.878205:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.878209:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.878212:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.878215:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.878239:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.878242:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.878245:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.878248:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787397896.878283:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701190656:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.878349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.878386:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397896.878392:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701191040:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.878416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.878451:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701190784:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.878474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.878495:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397896.878500:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701190912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.878551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.879109:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701190528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397896.879148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.879208:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191040 00000100:00100000:2.0:1787397896.879217:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191040 00000100:00100000:2.0:1787397896.879257:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190784 00000100:00100000:2.0:1787397896.879260:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190784 00000100:00100000:2.0:1787397896.879276:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190528 00000100:00100000:2.0:1787397896.879278:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190528 00000100:00100000:2.0:1787397896.879305:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1787397896.879315:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701191040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397896.879376:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701191040:12345-0@lo:400:kworker.0 Request processed in 62us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.879377:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:2.0:1787397896.879383:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:0.0:1787397896.879383:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701190528:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397896.879401:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1787397896.879406:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701190784:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787397896.879410:0:66176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3776 last 0 00000100:00100000:2.0:1787397896.879436:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701190784:12345-0@lo:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397896.879442:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000020:00000080:0.0:1787397896.879453:0:66176:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d1925b7 00000004:00100000:0.0:1787397896.879473:0:66176:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787397896.879615:0:66176:0:(import.c:65:import_set_state_nolock()) ffff89a8364e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397896.879661:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701190528:12345-0@lo:38:llog_process_th.0 Request processed in 276us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.879667:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:2.0:1787397896.880003:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397896.880012:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:2.0:1787397896.880019:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787397896.880023:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787397896.880030:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787397896.880037:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701190528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397896.880100:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190656 00000100:00100000:1.0:1787397896.880105:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190656 00000100:00100000:1.0:1787397896.880125:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701190912 00000100:00100000:1.0:1787397896.880128:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701190912 00000100:00100000:1.0:1787397896.880140:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787397896.880146:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701190656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.880196:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701190656:12345-0@lo:400:kworker.0 Request processed in 50us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.880202:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787397896.880215:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397896.880220:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701190912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.880248:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701190912:12345-0@lo:400:kworker.0 Request processed in 28us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.880253:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397896.880294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701191040:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.880305:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701190656:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.880333:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701190912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397896.880344:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701190784:0@lo:400:kworker.0 00000020:01000004:2.0:1787397896.881186:0:99658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787397896.881199:0:99658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89a83b9d19c0) 00000020:00000080:2.0:1787397896.881222:0:99658:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787397896.882641:0:99658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a8364e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397896.882648:0:99658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a8364e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787397896.882652:0:99658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a8364e2000 3 00010000:00080000:0.0:1787397896.882686:0:99658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a8364ea800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397896.885296:0:99658:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787397896.885408:0:99658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787397896.885454:0:99658:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397896.885467:0:99658:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x274786fe0d1925c5 00000100:00080000:0.0:1787397896.885477:0:99658:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397896.885483:0:99658:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397896.885519:0:99658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bfd880 x1874218701191168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397896.885570:0:99658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787397896.885608:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701191168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397896.885679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.885735:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191168 00000100:00100000:2.0:1787397896.885741:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191168 00000100:00100000:2.0:1787397896.885773:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00080000:1.0:1787397896.885811:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.885816:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.885818:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.885822:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.885833:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.885836:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787397896.885838:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397896.885841:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787397896.886000:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701191168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787397896.886025:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3776 last 0 00000020:00000080:2.0:1787397896.886054:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d1925cc 00000004:00100000:2.0:1787397896.886068:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397896.886095:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a817ecc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397896.886151:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701191168:12345-0@lo:38:llog_process_th.0 Request processed in 152us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397896.886158:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1787397896.886208:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397896.886216:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000100:00080000:2.0:1787397896.886223:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787397896.886228:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787397896.886230:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787397896.886237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701191168:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787397896.886420:0:99658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64 count 63 00000020:01000000:2.0:1787397896.886567:0:99634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1787397896.886604:0:99634:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397896.886623:0:99634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.886634:0:99634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397896.886679:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787397896.886682:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.886684:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.886685:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.886686:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.886687:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.886689:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.886690:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.886692:0:99634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397896.886697:0:99634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787397896.886699:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397896.886700:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.886702:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.886703:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.886704:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.886705:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.886706:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.886707:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.886708:0:99634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397896.886724:0:99634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787397896.886737:0:99634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701191296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397896.887939:0:99634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397896.887989:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191296 00000100:00100000:2.0:1787397896.887997:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191296 00000100:00100000:2.0:1787397896.888048:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787397896.888057:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701191296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787397896.888085:0:94340:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787397896.888104:0:94340:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787397896.888230:0:99634:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f1900 going to sleep for 11 seconds 20000000:01000000:2.0:1787397896.897197:0:94340:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397896.897214:0:94340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787397896.897465:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397896.897470:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397896.897494:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897515:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1924ad expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897547:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1924bb expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897558:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 9 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897564:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897623:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 9 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897637:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 9 pid: 94340 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397896.897653:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191424:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397896.897749:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.897758:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 21 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397896.897767:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191552:0@lo:104: 00000100:00100000:0.0:1787397896.898199:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787397896.898232:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 21 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397896.898241:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 21 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397896.898250:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191680:0@lo:104: 00000100:00100000:0.0:1787397896.898273:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397896.898299:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81142f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397896.898398:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787397896.898414:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191552 00000100:00100000:2.0:1787397896.898420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191552 00000100:00100000:2.0:1787397896.898455:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191680 00000100:00100000:2.0:1787397896.898457:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191680 00000100:00100000:2.0:1787397896.898470:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787397896.898479:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701191552:12345-0@lo:104: 00010000:00010000:2.0:1787397896.898493:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898566:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787397896.898572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701191552:12345-0@lo:104: Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397896.898578:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787397896.898595:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787397896.898601:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a837bea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701191680:12345-0@lo:104: 00010000:00010000:2.0:1787397896.898608:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898639:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787397896.898644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a837bea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701191680:12345-0@lo:104: Request processed in 43us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397896.898649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:2.0:1787397896.898702:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397896.898708:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898722:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397896.898727:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898735:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397896.898742:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397896.898747:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397896.898795:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898801:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397896.898822:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898828:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a1c00/0x274786fe0d1924bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924c2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.898844:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787397896.898979:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191552:0@lo:104: 00000100:00100000:0.0:1787397896.898988:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191680:0@lo:104: 00000100:00100000:0.0:1787397896.899038:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:99634:x1874218701191296:12345-0@lo:253:mount.lustre.0 Request processed in 10981us (12261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397896.899052:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00010000:2.0:1787397896.899149:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.899157:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397896.899160:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.899187:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397896.899194:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397896.899199:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397896.899222:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.899228:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397896.899240:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.899246:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a808719200/0x274786fe0d1924ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1924b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.899259:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397896.899261:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397896.899262:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397896.899283:0:99634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:99634:1874218701191296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397896.899295:0:99634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787397896.899298:0:99634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397896.899300:0:99634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397896.899301:0:99634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397896.899302:0:99634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397896.899304:0:99634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397896.899305:0:99634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397896.899306:0:99634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397896.899308:0:99634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397896.899310:0:99634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787397896.899332:0:99634:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787397896.900008:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397896.900025:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701191808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397896.900069:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.900128:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701191936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397896.900151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397896.900204:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191808 00000100:00100000:1.0:1787397896.900210:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191808 00010000:00010000:1.0:1787397896.900232:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 21 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397896.900257:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701191936 00000100:00100000:1.0:1787397896.900259:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701191936 00010000:00010000:1.0:1787397896.900270:0:19659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 22 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397896.900287:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:1.0:1787397896.900295:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701191808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397896.900307:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397896.900313:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 22 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900322:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 22 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900347:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a808719e00/0x274786fe0d1924c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1924bb expref: 22 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900361:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397896.900390:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701191808:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.900397:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:1.0:1787397896.900410:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1787397896.900415:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+20:3650:x1874218701191936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397896.900421:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397896.900424:0:19659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 20 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900431:0:19659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 20 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900439:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75c00/0x274786fe0d1924b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1924ad expref: 20 pid: 94334 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397896.900447:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397896.900466:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+19:3650:x1874218701191936:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397896.900471:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1787397896.900499:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701191936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397896.900540:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701191808:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787397896.902281:0:99634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901888 00002000:00080000:2.0:1787397896.904575:0:99634:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787397896.904583:0:99634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787397896.904620:0:99634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787397896.904662:0:99634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787397896.904680:0:99634:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787397896.904699:0:99634:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787397896.905572:0:99634:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397896.905788:0:99634:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787397896.913976:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701191424:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397896.914020:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397896.917012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397896.917057:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290624 00000100:00100000:2.0:1787397896.917066:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290624 00010000:00010000:2.0:1787397896.917097:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397896.917128:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2655 00000100:00100000:2.0:1787397896.917138:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681290624:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397896.917152:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397896.917157:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917180:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917198:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63400/0x274786fe0d192555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8577 expref: 10 pid: 94340 timeout: 3876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917224:0:19662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917232:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397896.917248:0:19662:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030780541s 00010000:00010000:2.0:1787397896.917252:0:19662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917259:0:19662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917265:0:19662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917272:0:19662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917278:0:19662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397896.917282:0:19662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917292:0:19662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917304:0:19662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917314:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397896.917379:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2405:x1874218681290624:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 242us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397896.917386:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2655 00010000:00010000:2.0:1787397896.917432:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917439:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397896.917446:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74c00/0x274786fe0d1925d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397897.061737:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787397897.798857:0:99711:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397897.799263:0:99711:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397898.093865:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397898.180710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397898.181691:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290752 00000100:00100000:3.0:1787397898.181705:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290752 00000100:00100000:3.0:1787397898.181779:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 295 00000100:00100000:3.0:1787397898.181803:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681290752:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397898.181822:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397898.181843:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d857e expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.181872:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 10 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.181882:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 10 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.181896:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582600, rc 0) 00000100:00100000:3.0:1787397898.181964:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681290752:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397898.181971:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 295 00000100:00100000:0.0:1787397898.188720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397898.188812:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681290880 00000100:00100000:3.0:1787397898.188823:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681290880 00000100:00100000:3.0:1787397898.188879:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 296 00000100:00100000:3.0:1787397898.188889:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681290880:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397898.188916:0:94333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1787397898.188935:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397898.188938:0:94333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:0.0:1787397898.191909:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8075ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681290880:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 3009us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397898.191924:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 296 10000000:01000000:0.0:1787397898.660563:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397898.660572:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 127 10000000:01000000:0.0:1787397898.660578:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397898.660626:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.660639:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.660650:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397898.660677:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397898.660748:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397898.660784:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192064 00000100:00100000:3.0:1787397898.660793:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192064 00000100:00100000:0.0:1787397898.660805:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81142f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397898.660909:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787397898.660921:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701192064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397898.660934:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397898.660957:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1925e1 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.660982:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.660993:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.661001:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582400, rc 0) 00000100:00100000:3.0:1787397898.661060:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701192064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397898.661067:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787397898.661329:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397898.661345:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.661355:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397898.661421:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397898.661476:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397898.661496:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81142f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397898.661588:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192192 00000100:00100000:1.0:1787397898.661594:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192192 00000100:00100000:1.0:1787397898.661665:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787397898.661675:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701192192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397898.661691:0:94340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397898.661709:0:94340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397898.661712:0:94340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:0.0:1787397898.662114:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397898.662116:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701192192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 441us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397898.662138:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1787397898.662177:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a817efe800 already not connected (conn 17, was 0): CONNECTING 00010000:00080000:0.0:1787397898.662262:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a817efe800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.160@tcp, moved to head 10000000:01000000:0.0:1787397898.662288:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397898.662297:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.662307:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397898.662317:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397898.662319:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 127 10000000:01000000:0.0:1787397898.662322:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397898.662346:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.662354:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.662363:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397898.662378:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397898.662418:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397898.662451:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836022540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397898.662552:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192320 00000100:00100000:3.0:1787397898.662558:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192320 00000100:00100000:3.0:1787397898.662593:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787397898.662602:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701192320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397898.662612:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397898.662624:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1925ef expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.662641:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1925ef expref: 21 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.662651:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1925ef expref: 21 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397898.662658:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582a00, rc 0) 00000100:00100000:3.0:1787397898.662724:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701192320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397898.662744:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787397898.662771:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397898.662783:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.662792:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397898.662830:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397898.662861:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397898.662885:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836022540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397898.663209:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192448 00000100:00100000:3.0:1787397898.663214:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192448 00000100:00100000:3.0:1787397898.663251:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787397898.663259:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701192448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397898.663272:0:94340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787397898.663286:0:94340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397898.663289:0:94340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:3.0:1787397898.663359:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701192448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397898.663366:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787397898.663451:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701192448:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787397898.663483:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a83670c800 already not connected (conn 17, was 0): CONNECTING 00010000:00080000:0.0:1787397898.663491:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a83670c800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.160@tcp, moved to head 10000000:01000000:0.0:1787397898.663511:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397898.663517:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397898.663554:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397899.012646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397899.012829:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291008 00000100:00100000:3.0:1787397899.012840:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291008 00000100:00100000:3.0:1787397899.012902:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 301 00000100:00100000:3.0:1787397899.012912:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681291008:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397899.012983:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681291008:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397899.012989:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 301 00000100:00100000:1.0:1787397899.018929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397899.021034:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291136 00000100:00100000:2.0:1787397899.021050:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291136 00000100:00100000:2.0:1787397899.021190:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1568 00000100:00100000:2.0:1787397899.021201:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681291136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397899.021319:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2405:x1874218681291136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 118us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397899.021327:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1568 00000100:00080000:1.0:1787397899.023087:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397899.028949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397899.029142:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291264 00000100:00100000:0.0:1787397899.029152:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291264 00000100:00100000:0.0:1787397899.029329:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1569 00000100:00100000:0.0:1787397899.029341:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681291264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397899.029427:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2404:x1874218681291264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397899.029436:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1569 00000100:00080000:1.0:1787397899.029804:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787397899.112256:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397899.748780:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397899.748796:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701192704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397899.748864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397899.748952:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192704 00000100:00100000:1.0:1787397899.748965:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192704 00000100:00100000:1.0:1787397899.749024:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787397899.749034:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701192704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397899.749069:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397899.749135:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701192704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397899.749144:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787397899.749171:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701192576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397899.749199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397899.749245:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701192704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397899.749267:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192576 00000100:00100000:1.0:1787397899.749270:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192576 00000100:00100000:1.0:1787397899.749303:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787397899.749308:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701192576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397899.749326:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397899.749359:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701192576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397899.749370:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787397899.749418:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701192576:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787397900.137015:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397901.156771:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397902.184242:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397902.308900:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397902.308906:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397902.308909:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397902.308912:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397902.308926:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397902.308929:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397902.308941:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397902.308944:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787397902.308994:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701192832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397902.309127:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701193344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397902.309197:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397902.309205:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701193216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397902.309293:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193344 00000100:00100000:3.0:1787397902.309299:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701192960:0@lo:400:kworker.0 00000100:00100000:1.0:1787397902.309303:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193344 00000100:00100000:3.0:1787397902.309326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397902.309348:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701193472:0@lo:400:kworker.0 00000100:00100000:1.0:1787397902.309366:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1787397902.309374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397902.309379:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701193344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309399:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397902.309406:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701193088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397902.309457:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701193344:12345-0@lo:400:kworker.0 Request processed in 80us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397902.309466:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701193600:0@lo:400:kworker.0 00000100:00100000:1.0:1787397902.309467:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1787397902.309490:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193472 00000100:00100000:1.0:1787397902.309495:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193472 00000100:00100000:3.0:1787397902.309499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397902.309555:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193088 00000100:00100000:1.0:1787397902.309559:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193088 00000100:00100000:3.0:1787397902.309567:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192832 00000100:00100000:3.0:1787397902.309572:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192832 00000100:00100000:1.0:1787397902.309576:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193600 00000100:00100000:1.0:1787397902.309581:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193600 00000100:00100000:1.0:1787397902.309605:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1787397902.309610:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787397902.309615:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701193472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309623:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701192832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309662:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701192832:12345-0@lo:400:kworker.0 Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397902.309674:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701193472:12345-0@lo:400:kworker.0 Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397902.309684:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787397902.309687:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:1.0:1787397902.309706:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1787397902.309725:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701193088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309728:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193216 00000100:00100000:3.0:1787397902.309733:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193216 00000100:00100000:3.0:1787397902.309755:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701192960 00000100:00100000:3.0:1787397902.309758:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701192960 00000100:00100000:1.0:1787397902.309765:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701193088:12345-0@lo:400:kworker.0 Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397902.309773:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1787397902.309777:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397902.309786:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701193216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397902.309808:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:1.0:1787397902.309818:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701193600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309824:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701193216:12345-0@lo:400:kworker.0 Request processed in 39us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397902.309831:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397902.309847:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787397902.309855:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701193600:12345-0@lo:400:kworker.0 Request processed in 39us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397902.309857:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397902.309869:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00080000:1.0:1787397902.309895:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397902.309896:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701192960:12345-0@lo:400:kworker.0 Request processed in 40us (568us total) trans 0 rc 0/0 00000100:00080000:1.0:1787397902.309901:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397902.309905:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397902.309962:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701193088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309974:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701193600:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309982:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701192960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.309991:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701193472:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.310017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701193216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.310024:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701192832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397902.310033:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701193344:0@lo:400:kworker.0 00010000:00010000:0.0:1787397903.206047:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397903.342879:0:100001:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787397904.136090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397904.136134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397904.136161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397904.136188:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291648 00000100:00100000:1.0:1787397904.136197:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291648 00000100:00100000:1.0:1787397904.136257:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291520 00000100:00100000:1.0:1787397904.136261:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291520 00000100:00100000:1.0:1787397904.136283:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1574 00000100:00100000:1.0:1787397904.136291:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681291648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397904.136361:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681291648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397904.136368:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1574 00000100:00100000:1.0:1787397904.136384:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1575 00000100:00100000:1.0:1787397904.136390:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681291520:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397904.136414:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681291520:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397904.136428:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1575 00000100:00080000:1.0:1787397904.136449:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397904.136453:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397904.137125:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291392 00000100:00100000:3.0:1787397904.137141:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291392 00000100:00100000:3.0:1787397904.137183:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 303 00000100:00100000:3.0:1787397904.137191:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681291392:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397904.137232:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681291392:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397904.137239:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 303 00000020:00000004:2.0:1787397904.181445:0:100053:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397904.182353:0:100053:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397904.230752:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397904.869172:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701193728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397904.869256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397904.869326:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193728 00000100:00100000:3.0:1787397904.869335:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193728 00000100:00100000:3.0:1787397904.869398:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787397904.869408:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701193728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397904.869449:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397904.869506:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701193728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397904.869513:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787397904.869598:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701193728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397904.872299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397904.872323:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701193856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397904.872568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397904.873001:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193856 00000100:00100000:1.0:1787397904.873020:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193856 00000100:00100000:1.0:1787397904.873082:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787397904.873093:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701193856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397904.873133:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397904.873194:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701193856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397904.873201:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397904.874119:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701193856:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1787397905.054284:0:100103:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397905.055211:0:100103:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397905.259753:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397906.285208:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397907.302499:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397907.431899:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397907.431906:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397907.431909:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397907.431912:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397907.431931:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397907.431940:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397907.431943:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397907.431946:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787397907.432028:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701194368:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432159:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787397907.432166:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701194240:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432214:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701194752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432268:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701193984:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432318:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701194496:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432352:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397907.432356:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701194112:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432385:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701194624:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.432401:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397907.432435:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194368 00000100:00100000:3.0:1787397907.432442:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194368 00000100:00100000:3.0:1787397907.432478:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194112 00000100:00100000:3.0:1787397907.432481:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194112 00000100:00100000:3.0:1787397907.432496:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397907.432504:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701194368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.434752:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701194368:12345-0@lo:400:kworker.0 Request processed in 2240us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.434766:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397907.434804:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397907.434814:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701194112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.434866:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701194112:12345-0@lo:400:kworker.0 Request processed in 56us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.434873:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787397907.434904:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194240 00000100:00100000:3.0:1787397907.434912:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194240 00000100:00100000:3.0:1787397907.434950:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194752 00000100:00100000:3.0:1787397907.434965:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194752 00000100:00100000:3.0:1787397907.434992:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194496 00000100:00100000:3.0:1787397907.434995:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194496 00000100:00100000:3.0:1787397907.435006:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194624 00000100:00100000:3.0:1787397907.435008:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194624 00000100:00100000:3.0:1787397907.435022:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1787397907.435028:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701194240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435060:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701194240:12345-0@lo:400:kworker.0 Request processed in 32us (2865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.435067:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1787397907.435079:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1787397907.435085:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701194752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435112:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701194752:12345-0@lo:400:kworker.0 Request processed in 28us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.435118:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1787397907.435130:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:3.0:1787397907.435145:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701194496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435176:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701194496:12345-0@lo:400:kworker.0 Request processed in 31us (2840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.435183:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:3.0:1787397907.435196:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1787397907.435202:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701194624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435227:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701194624:12345-0@lo:400:kworker.0 Request processed in 26us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.435232:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1787397907.435255:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701193984 00000100:00100000:3.0:1787397907.435258:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701193984 00000100:00100000:3.0:1787397907.435284:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787397907.435290:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701193984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435319:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701193984:12345-0@lo:400:kworker.0 Request processed in 30us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397907.435325:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787397907.435389:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701194240:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435402:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701194752:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435412:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701194368:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435451:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701194112:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435462:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701194624:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435470:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701193984:0@lo:400:kworker.0 00000100:00100000:3.0:1787397907.435480:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701194496:0@lo:400:kworker.0 00000100:00080000:3.0:1787397907.435519:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397907.435542:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397908.325069:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397909.267037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397909.267094:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397909.267183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397909.267443:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291776 00000100:00100000:3.0:1787397909.267458:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291776 00000100:00100000:3.0:1787397909.267570:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 305 00000100:00100000:3.0:1787397909.267582:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681291776:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397909.267853:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681291776:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 271us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397909.267864:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 305 00000100:00100000:3.0:1787397909.267915:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681291904 00000100:00100000:3.0:1787397909.267929:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681291904 00000100:00100000:3.0:1787397909.267977:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292032 00000100:00100000:3.0:1787397909.267980:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292032 00000100:00100000:3.0:1787397909.268007:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1580 00000100:00100000:3.0:1787397909.268014:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681291904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397909.268057:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681291904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397909.268064:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1580 00000100:00100000:3.0:1787397909.268078:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1581 00000100:00100000:3.0:1787397909.268084:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681292032:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397909.268111:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681292032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397909.268117:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1581 00000100:00080000:3.0:1787397909.268473:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397909.268480:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787397909.358813:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397909.990723:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701194880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397909.992351:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397909.992448:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397909.992462:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701195008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397909.993671:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701194880 00000100:00100000:2.0:1787397909.993695:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701194880 00000100:00100000:1.0:1787397909.994464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397909.995471:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195008 00000100:00100000:3.0:1787397909.995508:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195008 00000100:00100000:2.0:1787397909.996965:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787397909.997001:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701194880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397909.997065:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397909.999599:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701194880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397910.005002:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701194880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7923us (12558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397910.005024:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787397910.005081:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397910.005101:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701195008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397910.005154:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397910.005749:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701195008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 657us (11289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397910.005759:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397910.006063:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701195008:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397910.372826:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397911.399751:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397912.228668:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397887/real 1787397887] req@ffff89a702136300 x1874218701186176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228701:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a702136300 x1874218701186176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228712:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397887/real 1787397887] req@ffff89a702135c00 x1874218701186304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228723:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a702135c00 x1874218701186304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228754:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397887/real 1787397887] req@ffff89a702137b80 x1874218701186688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228766:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a702137b80 x1874218701186688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228774:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397887/real 1787397887] req@ffff89a702135500 x1874218701186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.228784:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a702135500 x1874218701186816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787397912 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397912.228802:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.228824:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787397912.228828:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701186176:0@lo:8:kworker.0 00000100:00080000:2.0:1787397912.228834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.228839:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787397912.228841:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701186304:0@lo:8:kworker.0 00000100:00080000:2.0:1787397912.228845:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.228849:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787397912.228851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701186688:0@lo:8:kworker.0 00000100:00080000:2.0:1787397912.228855:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.228868:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787397912.228872:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701186816:0@lo:8:kworker.0 00000100:00080000:1.0:1787397912.229035:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397912.229040:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397912.229048:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397912.229053:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397912.229061:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a83670c800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397912.229083:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee6680 x1874218701195392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397912.229096:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397912.229098:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397912.229100:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397912.229102:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:1.0:1787397912.229105:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397912.229108:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397912.229118:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee5500 x1874218701195520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397912.229137:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397912.229139:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787397912.229141:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397912.229143:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397912.229147:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a817efe800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397912.229155:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee6300 x1874218701195904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397912.229163:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397912.229165:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787397912.229167:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397912.229170:0:65702:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3767 00000100:00080000:1.0:1787397912.229172:0:65702:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787397912.229182:0:65702:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397912.229199:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a704ee7b80 x1874218701196032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397912.229239:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701195264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397912.229300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397912.229328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701196288:0@lo:400:kworker.0 00000100:00100000:1.0:1787397912.229374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397912.229392:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397912.229398:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701195648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397912.229425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397912.229441:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701196416:0@lo:400:kworker.0 00000100:00100000:1.0:1787397912.229463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397912.229580:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701195776:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.229611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397912.229637:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397912.229644:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701195136:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.229670:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397912.229694:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701196160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.229713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397912.229740:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195264 00000100:00100000:3.0:1787397912.229748:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195264 00000100:00100000:3.0:1787397912.229781:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195776 00000100:00100000:3.0:1787397912.229784:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195776 00000100:00100000:3.0:1787397912.229800:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397912.229808:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701195264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.229873:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701195264:12345-0@lo:400:kworker.0 Request processed in 53us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.229880:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787397912.229898:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397912.229904:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701195776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.229936:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701195776:12345-0@lo:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.229942:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397912.229963:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196288 00000100:00100000:3.0:1787397912.229966:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196288 00000100:00100000:3.0:1787397912.229998:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195648 00000100:00100000:3.0:1787397912.230001:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195648 00000100:00100000:3.0:1787397912.230015:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196416 00000100:00100000:3.0:1787397912.230018:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196416 00000100:00100000:3.0:1787397912.230043:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196160 00000100:00100000:3.0:1787397912.230046:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196160 00000100:00100000:3.0:1787397912.230060:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1787397912.230065:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701196288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230097:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701196288:12345-0@lo:400:kworker.0 Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.230102:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1787397912.230114:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1787397912.230120:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701195648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230145:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701195648:12345-0@lo:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.230151:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1787397912.230160:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1787397912.230165:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701196416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230185:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701196416:12345-0@lo:400:kworker.0 Request processed in 21us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.230191:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1787397912.230199:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:3.0:1787397912.230204:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701196160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230227:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701196160:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.230233:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:3.0:1787397912.230255:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195136 00000100:00100000:3.0:1787397912.230258:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195136 00000100:00100000:3.0:1787397912.230278:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787397912.230284:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701195136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230319:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701195136:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.230325:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1787397912.230352:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397912.230356:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397912.230388:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701195136:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230401:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701196160:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230410:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701195776:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230436:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701195648:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230445:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701196416:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701195264:0@lo:400:kworker.0 00000100:00100000:3.0:1787397912.230461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701196288:0@lo:400:kworker.0 00000100:00100000:2.0:1787397912.230562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701195392:0@lo:8:kworker.0 00000100:00100000:2.0:1787397912.230593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.230621:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701195520:0@lo:8:kworker.0 00000100:00100000:2.0:1787397912.230640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.230655:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701195904:0@lo:8:kworker.0 00000100:00100000:2.0:1787397912.230670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.230684:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701196032:0@lo:8:kworker.0 00000100:00100000:2.0:1787397912.230701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.230727:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195392 00000100:00100000:2.0:1787397912.230730:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195392 00000100:00100000:2.0:1787397912.230743:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195520 00000100:00100000:2.0:1787397912.230745:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195520 00000100:00100000:2.0:1787397912.230752:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701195904 00000100:00100000:2.0:1787397912.230754:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701195904 00000100:00100000:2.0:1787397912.230760:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196032 00000100:00100000:2.0:1787397912.230761:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196032 00000100:00100000:2.0:1787397912.230770:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397912.230774:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701195392:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787397912.230799:0:99640:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:2.0:1787397912.230828:0:99640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1925fd 00002000:00100000:2.0:1787397912.230841:0:99640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a817ec9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787397912.230845:0:99640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787397912.230848:0:99640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397912.231033:0:99640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787397912.231055:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397912.231091:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701195392:12345-0@lo:8:kworker.0 Request processed in 315us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397912.231097:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397912.231111:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787397912.231115:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701195520:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787397912.231131:0:99640:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397912.231153:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701195520:12345-0@lo:8:kworker.0 Request processed in 37us (512us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397912.231159:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787397912.231168:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787397912.231172:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701195904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787397912.231183:0:99640:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t4294968749 exp 0000000000000000 cur 3791 last 0 00000020:00000080:2.0:1787397912.231197:0:99640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192604 00002000:00100000:2.0:1787397912.231202:0:99640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a817ec9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787397912.231206:0:99640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787397912.231208:0:99640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787397912.231229:0:99640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787397912.231241:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a836570800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397912.231267:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701195904:12345-0@lo:8:kworker.0 Request processed in 93us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397912.231273:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787397912.231284:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787397912.231288:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701196032:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787397912.231298:0:99640:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397912.231320:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701196032:12345-0@lo:8:kworker.0 Request processed in 30us (618us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397912.231326:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787397912.231354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a704ee6680 x1874218701195392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397912.231367:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:2.0:1787397912.231388:0:3647:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0000-osc-MDT0001: evicting (reconnect/recover flags not set: 4) req@ffff89a704ee6680 x1874218701195392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397922 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397912.231395:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:2.0:1787397912.231400:0:3647:0:(import.c:1662:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. 00000100:00080000:2.0:1787397912.241764:0:3647:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0000_UUID@0@lo; invalidating 00000100:00100000:2.0:1787397912.244725:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701195392:0@lo:8:kworker.0 00000100:00080000:2.0:1787397912.245281:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.245289:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397912.245294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701195520:0@lo:8:kworker.0 00010000:00080000:2.0:1787397912.245320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a704ee6300 x1874218701195904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397912.245339:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:2.0:1787397912.245360:0:3647:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0000-osc-MDT0000: evicting (reconnect/recover flags not set: 4) req@ffff89a704ee6300 x1874218701195904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397922 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397912.245368:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:2.0:1787397912.245375:0:3647:0:(import.c:1662:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. 00000100:00080000:3.0:1787397912.261600:0:100416:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00000100:00080000:3.0:1787397912.261608:0:100416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397912.261621:0:100416:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff89a83af25180 x1874218701177344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787397879 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397912.261647:0:100416:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 3 00000004:00080000:3.0:1787397912.261665:0:100416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397912.261668:0:100416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787397912.261741:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701177344:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397912.261880:0:100416:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1787397912.261885:0:100416:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787397912.261889:0:100416:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787397912.261892:0:100416:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1787397912.284676:0:3647:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0000_UUID@0@lo; invalidating 00000100:00100000:2.0:1787397912.284838:0:75625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75625:1874218701196672:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787397912.284877:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701196544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397912.284987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.285199:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196544 00000100:00100000:0.0:1787397912.285221:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196544 00000100:00100000:2.0:1787397912.285272:0:75625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.285308:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787397912.285321:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701196544:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397912.285324:0:75625:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787397912.285353:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397912.285361:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196672 00002000:00000024:0.0:1787397912.285362:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923431424 avail 3691909120 00000100:00100000:2.0:1787397912.285370:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196672 00000100:00100000:0.0:1787397912.285436:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701196544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397912.285446:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787397912.285452:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787397912.285481:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:75625:x1874218701196672:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:1.0:1787397912.285613:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a81816e300 x1874218701196544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397912.285638:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701196544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397912.288267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701195904:0@lo:8:kworker.0 00000100:00080000:2.0:1787397912.288329:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397912.288335:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787397912.288339:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701196032:0@lo:8:kworker.0 00000100:00080000:3.0:1787397912.288451:0:100417:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00000100:00080000:3.0:1787397912.288460:0:100417:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787397912.288472:0:100417:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff89a83af24700 x1874218701177856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787397879 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397912.288501:0:100417:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968749 gen 3 00000004:00080000:3.0:1787397912.288553:0:100417:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787397912.288565:0:100417:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787397912.288704:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701177856:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787397912.289837:0:100417:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1787397912.289846:0:100417:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1787397912.289853:0:100417:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1787397912.289857:0:100417:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397912.292292:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701196928:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787397912.292395:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.292445:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.292680:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397912.292709:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701196800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397912.292787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397912.297296:0:99641:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787397912.297322:0:99641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787397912.297564:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196800 00000100:00100000:0.0:1787397912.297578:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196800 00000100:00100000:0.0:1787397912.297679:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787397912.297694:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701196800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397912.297733:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923431424 avail 3691909120 00000100:00100000:0.0:1787397912.297871:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701196800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397912.297879:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787397912.299196:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787397912.299903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a81816d180 x1874218701196800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397912.300186:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701196928 00000100:00100000:1.0:1787397912.300196:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701196928 00000100:00100000:1.0:1787397912.300355:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787397912.300374:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701196928:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1787397912.300758:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701196800:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787397912.308544:0:99640:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787397912.308555:0:99640:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x261:0x0] 00000100:00100000:0.0:1787397912.308902:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:75625:x1874218701196672:12345-0@lo:7:osp-pre-0-1.0 Request processed in 23437us (23923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397912.308924:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787397912.309378:0:75625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a81816f100 x1874218701196672/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787397928 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397912.309398:0:75625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75625:1874218701196672:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787397912.309415:0:75625:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x261:0x0] 00002000:00080000:3.0:1787397912.316346:0:100418:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787397912.316359:0:100418:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x7a1:0x0] 00000100:00100000:3.0:1787397912.316577:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94348:x1874218701196928:12345-0@lo:7:osp-pre-0-0.0 Request processed in 16199us (24177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.316597:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787397912.317182:0:94348:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a81816dc00 x1874218701196928/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787397928 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397912.317204:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94348:1874218701196928:0@lo:7:osp-pre-0-0.0 00000004:00080000:0.0:1787397912.317222:0:94348:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x7a1:0x0] 00010000:00010000:1.0:1787397912.429619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787397912.850924:0:100451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397912.850930:0:100451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787397912.850932:0:100451:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787397912.851229:0:100451:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a83ae93000 00000020:01000004:3.0:1787397912.851247:0:100451:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787397912.851263:0:100451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397912.851275:0:100451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89a8387819c0) 00000020:00000080:3.0:1787397912.851293:0:100451:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787397912.936387:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397912.938492:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787397912.941373:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787397912.941698:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787397912.941908:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787397912.942177:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787397912.942374:0:100451:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1787397912.949033:0:100451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787397912.949267:0:100451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787397912.949283:0:100451:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787397912.949295:0:100451:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x274786fe0d192612 00000020:01000004:0.0:1787397912.949302:0:100451:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787397912.949325:0:100451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787397912.949329:0:100451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787397912.949335:0:100451:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787397912.949364:0:100451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787397912.949369:0:100451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787397912.964417:0:100451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787397912.964470:0:100451:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787397912.964475:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787397912.964476:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397912.964477:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397912.964478:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397912.964479:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397912.964481:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397912.964483:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397912.964485:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397912.964486:0:100451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787397912.964491:0:100451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787397912.964493:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397912.964495:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787397912.964501:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397912.964502:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397912.964503:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397912.964504:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397912.964505:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787397912.964506:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397912.964507:0:100451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787397912.964806:0:100451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787397912.964829:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397912.964914:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397912.965054:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197056 00000100:00100000:1.0:1787397912.965063:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197056 00000100:00100000:1.0:1787397912.965123:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787397912.965132:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:100451:x1874218701197056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397912.965167:0:94334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787397912.965169:0:94334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787397912.965174:0:94334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787397912.968755:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:100451:x1874218701197056:12345-0@lo:253:mount.lustre.0 Request processed in 3614us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397912.968771:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787397912.969011:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397912.969047:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787397912.969064:0:100451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787397912.969068:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787397912.969070:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787397912.969071:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397912.969073:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397912.969074:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397912.969075:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397912.969077:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397912.969079:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397912.969080:0:100451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787397912.969125:0:100451:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a83ae93000 from lustre-OST0001 10000000:01000000:2.0:1787397912.969161:0:100451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787397912.969164:0:100451:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787397912.969174:0:100451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:2.0:1787397912.969187:0:100451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397912.969296:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397912.969333:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.969399:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.970622:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197184 00000100:00100000:3.0:1787397912.970647:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197184 00000100:00100000:2.0:1787397912.970927:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787397912.970939:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:100451:x1874218701197184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397912.971073:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:100451:x1874218701197184:12345-0@lo:501:mount.lustre.0 Request processed in 135us (1738us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397912.971081:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787397912.971163:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787397912.971185:0:100451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787397912.971226:0:100451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787397912.971233:0:100451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397912.971243:0:100451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397912.971276:0:100451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a83ae93000 10000000:01000000:0.0:1787397912.971280:0:100451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787397912.971286:0:100451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787397912.971289:0:100451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787397912.971294:0:100451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787397912.971297:0:100451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787397912.971324:0:100451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397912.971333:0:100451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397912.971342:0:100451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397912.971369:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397912.971405:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.971686:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.971806:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197312 00000100:00100000:3.0:1787397912.971812:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197312 00000100:00100000:3.0:1787397912.971864:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1787397912.971873:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:100451:x1874218701197312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397912.971883:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397912.971899:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aba00/0x274786fe0d192620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192619 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397912.971922:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aba00/0x274786fe0d192620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192619 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397912.971933:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aba00/0x274786fe0d192620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192619 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397912.971942:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:3.0:1787397912.971976:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197312:12345-0@lo:101:mount.lustre.0 Request processed in 105us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.971982:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787397912.972058:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787397912.972071:0:100451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397912.972080:0:100451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397912.973179:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787397912.973835:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397912.979680:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787397912.979737:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787397912.979750:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787397912.979762:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787397912.979773:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787397912.979784:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787397912.979808:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787397912.979812:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787397912.979941:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397912.980011:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.980047:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787397912.980123:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197440 00000100:00100000:2.0:1787397912.980130:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197440 00000100:00100000:2.0:1787397912.980181:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787397912.980190:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397912.980320:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197440:12345-0@lo:501:mount.lustre.0 Request processed in 131us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397912.980331:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787397912.980432:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397912.980867:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397912.980920:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397912.980986:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83822e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.981030:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197568 00000100:00100000:3.0:1787397912.981036:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197568 00000100:00100000:3.0:1787397912.981106:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787397912.981115:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397912.981252:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197568:12345-0@lo:503:mount.lustre.0 Request processed in 138us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.981260:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787397912.981351:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197568:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787397912.982027:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787397912.982124:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397912.982171:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.982252:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.982313:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197696 00000100:00100000:3.0:1787397912.982318:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197696 00000100:00100000:3.0:1787397912.982360:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787397912.982373:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397912.982942:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197696:12345-0@lo:502:mount.lustre.0 Request processed in 568us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397912.982952:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787397912.983037:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397912.983204:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787397912.983233:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787397912.983248:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787397912.983261:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787397912.983274:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787397912.983287:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787397912.983300:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787397912.983312:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787397912.983323:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787397912.983348:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397912.983388:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397912.983421:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397912.983480:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197824 00000100:00100000:3.0:1787397912.983484:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197824 00000100:00100000:3.0:1787397912.983518:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787397912.983704:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397912.983791:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197824:12345-0@lo:502:mount.lustre.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397912.983958:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397912.984004:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787397912.984013:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00100000:3.0:1787397912.984661:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000020:01000000:1.0:1787397912.984930:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787397912.984939:0:100455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787397912.984947:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397912.984949:0:100455:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787397912.984955:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397912.984969:0:100455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89a7033a19c0) 00000020:00000080:1.0:1787397912.984995:0:100455:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787397912.985001:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787397912.985068:0:100455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a83ae93000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787397912.985084:0:100455:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787397912.985090:0:100455:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x274786fe0d19262e 00010000:00010000:2.0:1787397912.990934:0:100455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787397912.991335:0:100455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294968731 00080000:10000000:2.0:1787397912.993026:0:100455:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787397912.994399:0:100455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787397912.994416:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397912.994425:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397912.994427:0:100455:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787397912.994431:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397912.994435:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397912.994437:0:100455:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787397912.994440:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787397912.994442:0:100455:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787397912.994444:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397912.994454:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397912.994455:0:100455:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787397912.994658:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397912.994664:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397912.994665:0:100455:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787397912.994669:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787397912.994696:0:100455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397912.994698:0:100455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397912.994700:0:100455:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787397912.994703:0:100455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787397913.001358:0:100451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787397913.001411:0:100451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787397913.001429:0:100451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.001441:0:100451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397913.001470:0:100451:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a83ae93000 from 1 10000000:01000000:1.0:1787397913.001473:0:100451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787397913.001510:0:100451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.001517:0:100451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.001673:0:100451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397913.001700:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787397913.001773:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397913.001807:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397913.001890:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701197952 00000100:00100000:3.0:1787397913.001897:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701197952 00000100:00100000:3.0:1787397913.001947:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787397913.001955:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701197952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397913.001968:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397913.001981:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab600/0x274786fe0d19263c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192635 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.002005:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab600/0x274786fe0d19263c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192635 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.002016:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab600/0x274786fe0d19263c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192635 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.002024:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:3.0:1787397913.002059:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701197952:12345-0@lo:101:mount.lustre.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.002074:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787397913.002168:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701197952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397913.002180:0:100451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.002189:0:100451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787397913.003117:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787397913.003379:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787397913.003779:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787397913.003805:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787397913.003823:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787397913.003828:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787397913.003907:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397913.003958:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397913.010314:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397913.010693:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198080 00000100:00100000:0.0:1787397913.010704:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198080 00000100:00100000:0.0:1787397913.010762:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787397913.010772:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397913.010945:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198080:12345-0@lo:501:mount.lustre.0 Request processed in 174us (6985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.010952:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787397913.011298:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397913.011347:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397913.011393:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397913.011421:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397913.011630:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198208 00000100:00100000:3.0:1787397913.011635:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198208 00000100:00100000:3.0:1787397913.011670:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787397913.011677:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397913.011767:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8356a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198208:12345-0@lo:503:mount.lustre.0 Request processed in 90us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.011774:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787397913.011863:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787397913.012199:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787397913.012257:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397913.012289:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397913.012308:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397913.012373:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198336 00000100:00100000:0.0:1787397913.012377:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198336 00000100:00100000:0.0:1787397913.012398:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787397913.012404:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397913.012819:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198336:12345-0@lo:502:mount.lustre.0 Request processed in 413us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.012826:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787397913.015300:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787397913.015513:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787397913.015657:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787397913.015674:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787397913.015687:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787397913.015698:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000100:00100000:1.0:1787397913.015733:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397913.015805:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397913.015837:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397913.015912:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198464 00000100:00100000:3.0:1787397913.015918:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198464 00000100:00100000:3.0:1787397913.015965:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787397913.015974:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397913.016094:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198464:12345-0@lo:502:mount.lustre.0 Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.016102:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787397913.016182:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397913.016222:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787397913.016230:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1787397913.016885:0:100459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397913.016894:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397913.016896:0:100459:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787397913.016902:0:100459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a83ae93000 00000020:00000080:2.0:1787397913.016905:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787397913.016912:0:100459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397913.016914:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397913.016915:0:100459:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787397913.016917:0:100459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787397913.016920:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397913.016921:0:100459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787397913.016924:0:100459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a83ae93000 00000020:00000080:2.0:1787397913.016926:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787397913.017477:0:100459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787397913.017482:0:100459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787397913.017483:0:100459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787397913.017486:0:100459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1787397913.020059:0:100451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1787397913.020105:0:100451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397913.020132:0:100451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.020145:0:100451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397913.020202:0:100451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787397913.020205:0:100451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a83ae93000 10000000:01000000:3.0:1787397913.020207:0:100451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a83ae93000 10000000:01000000:3.0:1787397913.020211:0:100451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397913.020221:0:100451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a83ae93000 from 1 10000000:01000000:3.0:1787397913.020223:0:100451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397913.020255:0:100451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.020264:0:100451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.020275:0:100451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.020297:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397913.020353:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.023124:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397913.023207:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198592 00000100:00100000:1.0:1787397913.023218:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198592 00000100:00100000:1.0:1787397913.023294:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787397913.023305:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:100451:x1874218701198592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397913.023325:0:94333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397913.023348:0:94333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62c00/0x274786fe0d19264a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192643 expref: -99 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.023376:0:94333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62c00/0x274786fe0d19264a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192643 expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.023386:0:94333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62c00/0x274786fe0d19264a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192643 expref: 24 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.023396:0:94333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00000100:00100000:1.0:1787397913.023641:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198592:12345-0@lo:101:mount.lustre.0 Request processed in 338us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397913.023648:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787397913.023738:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397913.023756:0:100451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.023766:0:100451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397913.025081:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1787397913.025344:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397913.025719:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787397913.025746:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787397913.025759:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787397913.025771:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787397913.025783:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787397913.025794:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787397913.025806:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787397913.025829:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787397913.025839:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787397913.025864:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787397913.025877:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787397913.025889:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787397913.025901:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787397913.025914:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787397913.025927:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787397913.025942:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787397913.025955:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787397913.025969:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787397913.025983:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787397913.025995:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787397913.026009:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787397913.026022:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787397913.026035:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787397913.026050:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787397913.026063:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787397913.026077:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787397913.026088:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787397913.026098:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787397913.026112:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787397913.026123:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787397913.026136:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787397913.026148:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787397913.026161:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787397913.026173:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787397913.026187:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787397913.026199:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787397913.026210:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787397913.026222:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787397913.026235:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1787397913.026247:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1787397913.026273:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1787397913.026287:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1787397913.026299:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1787397913.026310:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1787397913.026322:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1787397913.026335:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1787397913.026353:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1787397913.026358:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1787397913.026443:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397913.028168:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.028258:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397913.028314:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198720 00000100:00100000:0.0:1787397913.028323:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198720 00000100:00100000:0.0:1787397913.028413:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787397913.028423:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787397913.029812:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70278ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198720:12345-0@lo:501:mount.lustre.0 Request processed in 1384us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.029831:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787397913.033308:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397913.033374:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397913.033447:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.033677:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397913.033755:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198848 00000100:00100000:0.0:1787397913.033762:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198848 00000100:00100000:0.0:1787397913.033814:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787397913.033823:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397913.033954:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198848:12345-0@lo:503:mount.lustre.0 Request processed in 131us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.033963:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787397913.034075:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787397913.035822:0:100451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787397913.035936:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397913.036012:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.036091:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397913.038492:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701198976 00000100:00100000:1.0:1787397913.038506:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701198976 00000100:00100000:1.0:1787397913.039037:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787397913.039050:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397913.039221:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701198976:12345-0@lo:502:mount.lustre.0 Request processed in 173us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397913.039230:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787397913.040612:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701198976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397913.040833:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787397913.040877:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787397913.040890:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787397913.040901:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787397913.040912:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787397913.040923:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787397913.040933:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787397913.040943:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787397913.040954:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787397913.040965:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787397913.040975:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787397913.040986:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787397913.040998:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787397913.041012:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787397913.041024:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787397913.041036:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787397913.041050:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787397913.041062:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787397913.041076:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787397913.041087:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787397913.041107:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787397913.041120:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787397913.041130:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787397913.041141:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787397913.041151:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787397913.041162:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787397913.041172:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787397913.041182:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787397913.041194:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787397913.041204:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787397913.041215:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787397913.041225:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787397913.041236:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787397913.041246:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787397913.041257:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787397913.041267:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787397913.041277:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787397913.041288:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787397913.041298:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787397913.041308:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787397913.041318:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787397913.041329:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787397913.041340:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787397913.041350:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787397913.041360:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787397913.041371:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787397913.041381:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787397913.041391:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787397913.041429:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701199104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397913.041501:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397913.041562:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397913.041763:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199104 00000100:00100000:1.0:1787397913.041776:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199104 00000100:00100000:1.0:1787397913.041824:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787397913.041833:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701199104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787397913.041946:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701199104:12345-0@lo:502:mount.lustre.0 Request processed in 113us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397913.041954:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787397913.042182:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701199104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787397913.042328:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787397913.042349:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:0.0:1787397913.042360:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787397913.042370:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:0.0:1787397913.042381:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:0.0:1787397913.042393:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:0.0:1787397913.042403:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:0.0:1787397913.042413:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:0.0:1787397913.042423:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:0.0:1787397913.042433:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:0.0:1787397913.042443:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:0.0:1787397913.042454:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:0.0:1787397913.042672:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:0.0:1787397913.042686:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000100:00100000:0.0:1787397913.042713:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701199232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787397913.042758:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397913.042828:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397913.045698:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199232 00000100:00100000:3.0:1787397913.045714:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199232 00000100:00100000:3.0:1787397913.045830:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787397913.045841:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701199232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787397913.046008:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701199232:12345-0@lo:502:mount.lustre.0 Request processed in 168us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.046016:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787397913.046103:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701199232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787397913.046180:0:100451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1787397913.046192:0:100451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:0.0:1787397913.048058:0:100462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787397913.048078:0:100462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89a702078000) 00000020:00000080:0.0:1787397913.048106:0:100462:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1787397913.048269:0:100462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a83ae93000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787397913.048274:0:100462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a83ae93000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787397913.048276:0:100462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a83ae93000 3 00010000:00080000:0.0:1787397913.048306:0:100462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a835664800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397913.054072:0:100462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787397913.054176:0:100462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787397913.054225:0:100462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397913.054239:0:100462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x274786fe0d192658 00000100:00080000:0.0:1787397913.054248:0:100462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397913.054254:0:100462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397913.054294:0:100462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bff100 x1874218701199360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397913.054330:0:100462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787397913.054392:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397913.054395:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787397913.054397:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397913.054401:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3791 00000100:00080000:0.0:1787397913.054404:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397913.054407:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397913.054418:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bfea00 x1874218701199744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397913.054454:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397913.054471:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787397913.054473:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397913.054477:0:83690:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3791 00000100:00080000:0.0:1787397913.054479:0:83690:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397913.054483:0:83690:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397913.054494:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bfca80 x1874218701200256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397913.054651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701199360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397913.054723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054760:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701199744:0@lo:8:kworker.0 00000100:00100000:2.0:1787397913.054794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054809:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701200256:0@lo:8:kworker.0 00000100:00100000:2.0:1787397913.054840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054889:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701199872:0@lo:400:kworker.0 00000100:00100000:2.0:1787397913.054913:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054929:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701200512:0@lo:400:kworker.0 00000100:00100000:2.0:1787397913.054946:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054960:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787397913.054964:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701200000:0@lo:400:kworker.0 00000100:00100000:2.0:1787397913.054983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.054999:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701200640:0@lo:400:kworker.0 00000100:00100000:2.0:1787397913.055018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.055123:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199744 00000100:00100000:2.0:1787397913.055131:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199744 00000100:00100000:2.0:1787397913.055155:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200256 00000100:00100000:2.0:1787397913.055157:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200256 00000100:00100000:2.0:1787397913.055175:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787397913.055182:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701199744:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787397913.055233:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701199744:12345-0@lo:8:kworker.0 Request processed in 50us (438us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787397913.055239:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787397913.055253:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787397913.055257:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701200256:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787397913.055284:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701200256:12345-0@lo:8:kworker.0 Request processed in 26us (444us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787397913.055289:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787397913.055325:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397913.055329:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787397913.055339:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701199744:0@lo:8:kworker.0 00000100:00080000:2.0:1787397913.055350:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787397913.055353:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787397913.055355:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701200256:0@lo:8:kworker.0 00000100:00100000:3.0:1787397913.055744:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701199488:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.055779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.055804:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701200128:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.055826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.055871:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397913.055878:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701199616:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.055900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.055915:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701200384:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.055936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.055963:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199360 00000100:00100000:3.0:1787397913.055968:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199360 00000100:00100000:3.0:1787397913.055992:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199872 00000100:00100000:3.0:1787397913.055995:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199872 00000100:00100000:3.0:1787397913.056018:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200512 00000100:00100000:3.0:1787397913.056021:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200512 00000100:00100000:3.0:1787397913.056032:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200640 00000100:00100000:3.0:1787397913.056035:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200640 00000100:00100000:3.0:1787397913.056046:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200384 00000100:00100000:3.0:1787397913.056048:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200384 00000100:00100000:3.0:1787397913.056061:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:3.0:1787397913.056067:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701199872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056113:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701199872:12345-0@lo:400:kworker.0 Request processed in 45us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056120:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:3.0:1787397913.056133:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1787397913.056139:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701200512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056164:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701200512:12345-0@lo:400:kworker.0 Request processed in 26us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056181:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1787397913.056193:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:3.0:1787397913.056198:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701200640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056223:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701200640:12345-0@lo:400:kworker.0 Request processed in 26us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056228:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:3.0:1787397913.056238:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:3.0:1787397913.056243:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701200384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056270:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701200384:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056275:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:3.0:1787397913.056285:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1787397913.056289:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701199360:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787397913.056307:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 3792 last 0 00000020:00000080:3.0:1787397913.056336:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d19265f 00000004:00100000:3.0:1787397913.056349:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397913.056374:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a702027000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397913.056407:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701199360:12345-0@lo:38:llog_process_th.0 Request processed in 116us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056413:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1787397913.056437:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200000 00000100:00100000:3.0:1787397913.056440:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200000 00000100:00100000:3.0:1787397913.056454:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199488 00000100:00100000:3.0:1787397913.056608:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199488 00000100:00100000:3.0:1787397913.056628:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787397913.056643:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701200000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056676:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701200000:12345-0@lo:400:kworker.0 Request processed in 34us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056681:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787397913.056693:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787397913.056698:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701199488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056723:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701199488:12345-0@lo:400:kworker.0 Request processed in 25us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056728:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787397913.056750:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200128 00000100:00100000:3.0:1787397913.056754:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200128 00000100:00100000:3.0:1787397913.056771:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701199616 00000100:00100000:3.0:1787397913.056774:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701199616 00000100:00100000:3.0:1787397913.056784:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787397913.056789:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701200128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056814:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701200128:12345-0@lo:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056819:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787397913.056828:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787397913.056832:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701199616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056864:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701199616:12345-0@lo:400:kworker.0 Request processed in 31us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.056870:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787397913.056924:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701200000:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056935:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701200640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056954:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701199872:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.056962:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701200512:0@lo:400:kworker.0 00010000:00080000:3.0:1787397913.056991:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a835bfd500 x1874218701199616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397913.057002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701199616:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.057010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701200384:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.057017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701199488:0@lo:400:kworker.0 00010000:00080000:3.0:1787397913.057025:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a835bfdf80 x1874218701200128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397913.057034:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701200128:0@lo:400:kworker.0 00000100:00100000:3.0:1787397913.057060:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397913.057067:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:3.0:1787397913.057074:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787397913.057079:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787397913.057081:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787397913.057086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701199360:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787397913.060921:0:100462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787397913.060939:0:100462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff89a70207cd40) 00000020:00000080:0.0:1787397913.060970:0:100462:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1787397913.061253:0:100462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a83ae93000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787397913.061258:0:100462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a83ae93000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787397913.061261:0:100462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a83ae93000 3 00010000:00080000:0.0:1787397913.061296:0:100462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a80570d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397913.063154:0:100462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787397913.063257:0:100462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787397913.063307:0:100462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397913.063319:0:100462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x274786fe0d19266d 00000100:00080000:0.0:1787397913.063331:0:100462:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397913.063337:0:100462:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397913.063372:0:100462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bfd880 x1874218701200768/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397913.063449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701200768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787397913.063566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397913.063746:0:100462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1787397913.065840:0:100462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000100:00100000:3.0:1787397913.066733:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200768 00000100:00100000:3.0:1787397913.066744:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200768 00000020:01000000:2.0:1787397913.067163:0:100451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1787397913.067202:0:100451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787397913.067221:0:100451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397913.067234:0:100451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787397913.067291:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787397913.067293:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787397913.067294:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397913.067295:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397913.067296:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397913.067297:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397913.067299:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397913.067300:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397913.067302:0:100451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397913.067305:0:100451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787397913.067307:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787397913.067308:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787397913.067309:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397913.067310:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397913.067311:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397913.067313:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397913.067314:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397913.067315:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397913.067315:0:100451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787397913.067341:0:100451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787397913.067362:0:100451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701200896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397913.067441:0:100451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397913.067489:0:100451:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397913.067562:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701200896 00000100:00100000:1.0:1787397913.067568:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701200896 00000100:00100000:1.0:1787397913.067609:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787397913.067618:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:100451:x1874218701200896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397913.067644:0:94333:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787397913.067656:0:94333:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787397913.070710:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:3.0:1787397913.070721:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701200768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787397913.070764:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 3792 last 0 00000020:00000080:3.0:1787397913.070807:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x274786fe0d192674 00000004:00100000:3.0:1787397913.070838:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787397913.070880:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a702027800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397913.070965:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874218701200768:12345-0@lo:38:llog_process_th.0 Request processed in 243us (7398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.070973:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1787397913.072676:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787397913.072692:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 19 00000100:00080000:2.0:1787397913.072702:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787397913.072708:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787397913.072711:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787397913.072720:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701200768:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787397913.076485:0:94333:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787397913.076509:0:94333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787397913.076721:0:94337:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787397913.076727:0:94337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787397913.076751:0:94337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076771:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076781:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076787:0:94337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1925ef expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076794:0:94337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076840:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.076866:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 24 pid: 94335 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.076894:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201024:0@lo:104: 00000100:00100000:3.0:1787397913.076968:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397913.077019:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077028:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.077037:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201152:0@lo:104: 00000100:00100000:3.0:1787397913.077063:0:94337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787397913.077090:0:94337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077099:0:94337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 9 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.077110:0:94337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201280:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397913.077165:0:94337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397913.077197:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201024 00000100:00100000:3.0:1787397913.077206:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201024 00000100:00100000:3.0:1787397913.077245:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201152 00000100:00100000:3.0:1787397913.077248:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201152 00000100:00100000:3.0:1787397913.077263:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787397913.077271:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701201024:12345-0@lo:104: 00010000:00010000:3.0:1787397913.077285:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077347:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787397913.077353:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:94337:x1874218701201024:12345-0@lo:104: Request processed in 83us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.077360:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787397913.077379:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787397913.077386:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701201152:12345-0@lo:104: 00010000:00010000:3.0:1787397913.077393:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077425:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787397913.077430:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:94337:x1874218701201152:12345-0@lo:104: Request processed in 46us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.077436:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787397913.077890:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201024:0@lo:104: 00000100:00100000:3.0:1787397913.077900:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201152:0@lo:104: 00010000:00010000:3.0:1787397913.077912:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397913.077918:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077926:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397913.077930:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.077938:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397913.077946:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397913.077959:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397913.078048:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078055:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397913.078072:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078080:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d1925ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078090:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397913.078093:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078098:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397913.078100:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078106:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397913.078111:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397913.078115:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397913.078126:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078131:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397913.078143:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078148:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1925e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1925e8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078161:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397913.078162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397913.078164:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397913.078170:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397913.078189:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701201408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397913.078222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.078245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397913.078251:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701201536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397913.078270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397913.078300:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201408 00000100:00100000:3.0:1787397913.078304:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201408 00010000:00010000:3.0:1787397913.078324:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 25 pid: 94335 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.078343:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201536 00000100:00100000:3.0:1787397913.078345:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201536 00010000:00010000:3.0:1787397913.078356:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 26 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.078370:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:3.0:1787397913.078376:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834538c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+26:3648:x1874218701201408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397913.078386:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397913.078391:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 26 pid: 94335 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078411:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 26 pid: 94335 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078423:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582a00/0x274786fe0d1925f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1925ef expref: 26 pid: 94335 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.078437:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397913.078474:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834538c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+25:3648:x1874218701201408:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.078480:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1787397913.078666:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1787397913.078676:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701201536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397913.078684:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397913.078689:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.078698:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.078708:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582400/0x274786fe0d1925e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1925e1 expref: 24 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397913.078718:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397913.078740:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701201536:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397913.078756:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:3.0:1787397913.078870:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701201536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397913.078878:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701201408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397913.081239:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:100451:x1874218701200896:12345-0@lo:253:mount.lustre.0 Request processed in 13615us (13790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.081254:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787397913.081333:0:100451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:100451:1874218701200896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787397913.081348:0:100451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787397913.081351:0:100451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787397913.081354:0:100451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787397913.081355:0:100451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397913.081356:0:100451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397913.081358:0:100451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397913.081359:0:100451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397913.081361:0:100451:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787397913.081363:0:100451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397913.081364:0:100451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787397913.081380:0:100451:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787397913.085745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397913.085836:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292160 00000100:00100000:0.0:1787397913.085854:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292160 00010000:00010000:0.0:1787397913.085888:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 10 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397913.085930:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2658 00000100:00100000:0.0:1787397913.085940:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681292160:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397913.085954:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397913.085961:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 10 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.085977:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 10 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086026:0:19660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086034:0:19660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397913.086053:0:19660:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.030780541s 00010000:00010000:0.0:1787397913.086059:0:19660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086068:0:19660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086075:0:19660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086082:0:19660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086088:0:19660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397913.086093:0:19660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086101:0:19660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086110:0:19660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397913.086122:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397913.086186:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681292160:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 247us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397913.086194:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2658 00010000:00010000:3.0:1787397913.086865:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582600/0x274786fe0d1925da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d857e expref: 9 pid: 94334 timeout: 3892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397913.086880:0:94337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94337:1874218701201280:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397913.086919:0:94337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.086928:0:94337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.086933:0:94337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397913.086939:0:94337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d19267b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787397913.091177:0:100451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787397913.093952:0:100451:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787397913.093962:0:100451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787397913.094003:0:100451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787397913.094050:0:100451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787397913.094068:0:100451:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787397913.094086:0:100451:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787397913.095019:0:100451:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787397913.095281:0:100451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787397913.356042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397913.356082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397913.356102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397913.356125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397913.356246:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292288 00000100:00100000:3.0:1787397913.356256:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292288 00000100:00100000:3.0:1787397913.356313:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292416 00000100:00100000:3.0:1787397913.356316:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292416 00000100:00100000:3.0:1787397913.357017:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1590 00000100:00100000:3.0:1787397913.357029:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681292288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397913.357121:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2402:x1874218681292288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 93us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.357129:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1590 00000100:00100000:3.0:1787397913.357147:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1591 00000100:00100000:3.0:1787397913.357154:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681292416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397913.357181:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681292416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.357201:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1591 00000100:00100000:3.0:1787397913.357224:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292544 00000100:00100000:3.0:1787397913.357229:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292544 00000100:00100000:3.0:1787397913.357247:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292672 00000100:00100000:3.0:1787397913.357249:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292672 00000100:00100000:3.0:1787397913.357263:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787397913.357268:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681292544:12345-192.168.204.60@tcp:8:kworker.0 00010000:00080000:3.0:1787397913.357294:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t8589934593 exp 0000000000000000 cur 3792 last 0 00000020:00000080:3.0:1787397913.357320:0:100418:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d192682 00002000:00100000:3.0:1787397913.357331:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a702024800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397913.357342:0:100418:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397913.357962:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397913.357990:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a702026000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397913.358039:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681292544:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 768us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.358047:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787397913.358066:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787397913.358071:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681292672:12345-192.168.204.60@tcp:8:kworker.0 00010000:00080000:3.0:1787397913.358091:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3792 last 0 00000020:00000080:3.0:1787397913.358108:0:100418:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d192689 00002000:00100000:3.0:1787397913.358114:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a702025800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397913.358121:0:100418:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397913.358234:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787397913.358263:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a702022800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397913.358297:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681292672:12345-192.168.204.60@tcp:8:kworker.0 Request processed in 224us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397913.358304:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00080000:3.0:1787397913.358332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397913.358336:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787397913.444751:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397913.987207:0:100516:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397913.987453:0:100516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787397914.468988:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397914.500908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397914.502618:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292800 00000100:00100000:0.0:1787397914.502633:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292800 00000100:00100000:0.0:1787397914.502693:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 326 00000100:00100000:0.0:1787397914.502703:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681292800:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397914.502734:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397914.502763:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74400/0x274786fe0d192690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8585 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.502788:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74400/0x274786fe0d192690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8585 expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.502800:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74400/0x274786fe0d192690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8585 expref: 10 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.502809:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:0.0:1787397914.502879:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681292800:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 177us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.502886:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 326 00000100:00100000:2.0:1787397914.510648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397914.511209:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681292928 00000100:00100000:0.0:1787397914.511220:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681292928 00000100:00100000:0.0:1787397914.511308:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 327 00000100:00100000:0.0:1787397914.511318:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681292928:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397914.511343:0:94340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1787397914.511365:0:94340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397914.511372:0:94340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000100:00100000:0.0:1787397914.513601:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681292928:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 2265us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.513615:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 327 10000000:01000000:3.0:1787397914.597710:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787397914.597719:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a70a901000 from 128 10000000:01000000:3.0:1787397914.597724:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397914.597783:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397914.597796:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397914.597807:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397914.597844:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701201664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397914.597918:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397914.597958:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8068f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397914.600883:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201664 00000100:00100000:0.0:1787397914.600900:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201664 00000100:00100000:0.0:1787397914.600964:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787397914.600976:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701201664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397914.600994:0:94335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397914.601013:0:94335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74800/0x274786fe0d19269e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192697 expref: -99 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601040:0:94335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74800/0x274786fe0d19269e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192697 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601052:0:94335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74800/0x274786fe0d19269e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192697 expref: 23 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601061:0:94335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74800, rc 0) 00000100:00100000:0.0:1787397914.601134:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701201664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.601140:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1787397914.601196:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701201664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397914.601215:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601224:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397914.601303:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701201792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787397914.601339:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397914.601366:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d10c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397914.601381:0:94333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201792 00000100:00100000:0.0:1787397914.601385:0:94333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201792 00000100:00100000:0.0:1787397914.601408:0:94333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787397914.601414:0:94333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701201792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397914.601427:0:94333:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787397914.601445:0:94333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397914.601448:0:94333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000100:00100000:0.0:1787397914.601548:0:94333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701201792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.601555:0:94333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787397914.601584:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701201792:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1787397914.601631:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a830a0f800 already not connected (conn 7, was 0): DISCONN 00010000:00080000:0.0:1787397914.601643:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a830a0f800@lustre-OST0001-osc-MDT0000: found existing conn 192.168.204.160@tcp, moved to head 00000100:00080000:0.0:1787397914.601649:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397914.601655:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a830a0f800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397914.601677:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bff800 x1874218701201920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787397914.601711:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787397914.601718:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601726:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397914.601740:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787397914.601742:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 128 10000000:01000000:0.0:1787397914.601745:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787397914.601762:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601786:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397914.601794:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397914.601807:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701202048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397914.601844:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397914.601858:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a801254780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397914.601872:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701201920:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787397914.601898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397914.601931:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701201920 00000100:00100000:0.0:1787397914.601935:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701201920 00000100:00100000:0.0:1787397914.601957:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787397914.601963:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701201920:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1787397914.601986:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3793 last 0 00000020:00000080:0.0:1787397914.602012:0:100418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d1926ac 00002000:00100000:0.0:1787397914.602025:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a70378f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787397914.602029:0:100418:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787397914.602031:0:100418:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397914.602193:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787397914.602217:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a70378a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397914.602259:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701201920:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 294us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.602266:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787397914.602301:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bff800 x1874218701201920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397914.602314:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787397914.602326:0:3647:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0001-osc-MDT0000: evicting (reconnect/recover flags not set: 4) req@ffff89a835bff800 x1874218701201920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397939 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397914.602334:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:0.0:1787397914.602338:0:3647:0:(import.c:1662:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. 00000100:00100000:1.0:1787397914.602606:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202048 00000100:00100000:1.0:1787397914.602614:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202048 00000100:00100000:1.0:1787397914.602644:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787397914.602652:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701202048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397914.602660:0:94334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397914.602672:0:94334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62400/0x274786fe0d1926b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1926a5 expref: -99 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397914.602690:0:94334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62400/0x274786fe0d1926b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1926a5 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397914.602700:0:94334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62400/0x274786fe0d1926b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1926a5 expref: 24 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397914.602707:0:94334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62400, rc 0) 00000100:00100000:1.0:1787397914.602738:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701202048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397914.602745:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1787397914.602830:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701202048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397914.602842:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397914.602850:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397914.602897:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701202176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397914.602929:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397914.602952:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b5dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787397914.602964:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202176 00000100:00100000:1.0:1787397914.602967:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202176 00000100:00100000:1.0:1787397914.602988:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787397914.602994:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701202176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787397914.603006:0:94334:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787397914.603020:0:94334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787397914.603022:0:94334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000100:00100000:1.0:1787397914.603091:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701202176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397914.603099:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787397914.603129:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701202176:0@lo:256:ll_cfg_requeue.0 00000100:00080000:1.0:1787397914.603157:0:6519:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a837bc5000 already not connected (conn 7, was 0): DISCONN 00010000:00080000:1.0:1787397914.603165:0:6519:0:(ldlm_lib.c:85:import_set_conn()) imp ffff89a837bc5000@lustre-OST0001-osc-MDT0001: found existing conn 192.168.204.160@tcp, moved to head 00000100:00080000:1.0:1787397914.603168:0:6519:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397914.603173:0:6519:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a837bc5000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397914.603191:0:6519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705984e00 x1874218701202304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1787397914.603228:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787397914.603235:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397914.603242:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787397914.622221:0:3647:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0001_UUID@0@lo; invalidating 00000100:00100000:0.0:1787397914.622979:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701201920:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787397914.623017:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701202304:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1787397914.623090:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397914.623131:0:100550:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0001-osc-MDT0000 to lustre-OST0001_UUID@0@lo 00000100:00080000:0.0:1787397914.623136:0:100550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787397914.623144:0:100550:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff89a70218ad80 x1874218701182592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787397890 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397914.623159:0:100550:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968731 gen 3 00000004:00080000:0.0:1787397914.623169:0:100550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397914.623172:0:100550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787397914.623186:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701182592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397914.623625:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202304 00000100:00100000:3.0:1787397914.623635:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202304 00000100:00100000:3.0:1787397914.624255:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787397914.624263:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701202304:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1787397914.624299:0:99640:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3793 last 0 00000020:00000080:3.0:1787397914.624329:0:99640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1926ba 00002000:00100000:3.0:1787397914.624343:0:99640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89a702324800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787397914.624348:0:99640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787397914.624356:0:99640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1787397914.624470:0:100550:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1787397914.624481:0:100550:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1787397914.624491:0:100550:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1787397914.624494:0:100550:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787397914.624567:0:94350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701202560:0@lo:7:osp-pre-1-0.0 00000100:00100000:0.0:1787397914.624615:0:94350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397914.624637:0:94350:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835b9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397914.624648:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397914.624656:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701202432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397914.624685:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397914.624712:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202560 00000100:00100000:0.0:1787397914.624717:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202560 00000100:00100000:0.0:1787397914.624758:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00002000:00080000:3.0:1787397914.625549:0:99640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787397914.625583:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a702325800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397914.625750:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701202304:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 1486us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397914.625760:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787397914.625876:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787397914.625913:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705984e00 x1874218701202304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397914.625930:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787397914.625944:0:3647:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0001-osc-MDT0001: evicting (reconnect/recover flags not set: 4) req@ffff89a705984e00 x1874218701202304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397939 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397914.625946:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94350:x1874218701202560:12345-0@lo:7:osp-pre-1-0.0 00000100:00080000:3.0:1787397914.625951:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:3.0:1787397914.625957:0:3647:0:(import.c:1662:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0001: This client was evicted by lustre-OST0001; in progress operations using this service will fail. 00000100:00100000:0.0:1787397914.626192:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202432 00000100:00100000:0.0:1787397914.627985:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202432 00000100:00100000:0.0:1787397914.628053:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397914.628064:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701202432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397914.628091:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922485248 avail 3690962944 00000100:00100000:0.0:1787397914.628170:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701202432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.628177:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787397914.629461:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfd180 x1874218701202432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397914.629486:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701202432:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1787397914.639491:0:100418:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787397914.639506:0:100418:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000401:0x781:0x0] 00000100:00100000:0.0:1787397914.639622:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94350:x1874218701202560:12345-0@lo:7:osp-pre-1-0.0 Request processed in 14853us (15001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.639632:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787397914.639700:0:94350:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bff480 x1874218701202560/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787397930 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397914.639716:0:94350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94350:1874218701202560:0@lo:7:osp-pre-1-0.0 00000004:00080000:0.0:1787397914.639729:0:94350:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x2c0000401:0x781:0x0] 00000100:00080000:3.0:1787397914.653249:0:3647:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0001_UUID@0@lo; invalidating 00000100:00100000:3.0:1787397914.653792:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701202304:0@lo:8:ll_cfg_requeue.0 00000100:00080000:1.0:1787397914.655768:0:100551:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0001-osc-MDT0001 to lustre-OST0001_UUID@0@lo 00000100:00080000:1.0:1787397914.655774:0:100551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397914.655784:0:100551:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff89a702137100 x1874218701182720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1787397890 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397914.655801:0:100551:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968717 gen 3 00000004:00080000:1.0:1787397914.655828:0:100551:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397914.655830:0:100551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787397914.656058:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701182720:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787397914.658017:0:100551:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1787397914.658026:0:100551:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1787397914.658035:0:100551:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1787397914.658039:0:100551:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1787397914.658627:0:75627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:75627:1874218701202816:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787397914.658711:0:75627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397914.658740:0:75627:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8068f1300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397914.658754:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397914.658765:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701202688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397914.658801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397914.658842:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202816 00000100:00100000:3.0:1787397914.658850:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202816 00000100:00100000:3.0:1787397914.658911:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397914.658919:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:75627:x1874218701202816:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787397914.662578:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202688 00000100:00100000:0.0:1787397914.662594:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202688 00000100:00100000:0.0:1787397914.662653:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397914.662664:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701202688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397914.662764:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922485248 avail 3690962944 00000100:00100000:0.0:1787397914.662991:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701202688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 203us (4062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397914.663001:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787397914.663062:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a704ee4000 x1874218701202688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397914.663087:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701202688:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787397914.666143:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787397914.668504:0:99640:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787397914.668517:0:99640:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x261:0x0] 00000100:00100000:2.0:1787397914.668676:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:75627:x1874218701202816:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9750us (9957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397914.668688:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787397914.669049:0:75627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a704ee6a00 x1874218701202816/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787397930 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397914.669066:0:75627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:75627:1874218701202816:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787397914.669080:0:75627:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x261:0x0] 00000100:00100000:0.0:1787397915.109031:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701202944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397915.109107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397915.109311:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701203072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397915.109342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397915.109438:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701202944 00000100:00100000:2.0:1787397915.109446:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701202944 00000100:00100000:2.0:1787397915.109487:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203072 00000100:00100000:2.0:1787397915.109490:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203072 00000100:00100000:2.0:1787397915.109507:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787397915.109516:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701202944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397915.109589:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787397915.109652:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701202944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397915.109660:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787397915.109676:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787397915.109683:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701203072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397915.109716:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:1.0:1787397915.109941:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701203072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397915.110055:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701203072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 372us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397915.110062:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787397915.110159:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701202944:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397915.494233:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397916.518650:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397917.542668:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397917.668682:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397917.668708:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701203200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397917.668789:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397917.668843:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203200 00000100:00100000:3.0:1787397917.668851:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203200 00000100:00100000:3.0:1787397917.669048:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787397917.669058:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701203200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397917.669096:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:3.0:1787397917.669143:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701203200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397917.669150:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787397917.669170:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787397917.669199:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a704ee7800 x1874218701203200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397917.669217:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701203200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397917.672194:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397917.672218:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701203328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397917.672286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397917.672333:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203328 00000100:00100000:0.0:1787397917.672347:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203328 00000100:00100000:0.0:1787397917.672403:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787397917.672412:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701203328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397917.672432:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:0.0:1787397917.672472:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701203328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397917.672479:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787397917.672535:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787397917.672564:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfd180 x1874218701203328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397917.672583:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701203328:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787397917.678250:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:0.0:1787397917.678263:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787397917.678268:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787397918.181668:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701203456:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.181775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.181822:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701203968:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.181852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.181861:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203456 00000100:00100000:1.0:1787397918.181870:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203456 00000100:00100000:0.0:1787397918.181872:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701204480:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.181901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.181922:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701204992:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.181932:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787397918.181944:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701203456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.181952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.181977:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787397918.181985:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701203584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.182029:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701203456:12345-0@lo:400:kworker.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397918.182046:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787397918.182056:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701204096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.182104:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701204608:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.182109:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203584 00000100:00100000:1.0:1787397918.182114:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203584 00000100:00100000:0.0:1787397918.182134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.182146:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204096 00000100:00100000:1.0:1787397918.182151:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204096 00000100:00100000:1.0:1787397918.182167:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397918.182168:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701203456:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.182176:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701203584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182204:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.182225:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701203584:12345-0@lo:400:kworker.0 Request processed in 49us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397918.182233:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787397918.182239:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.182254:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397918.182263:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701204096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182265:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701204224:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.182311:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701204096:12345-0@lo:400:kworker.0 Request processed in 48us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182319:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701204736:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.182320:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787397918.182349:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.182377:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787397918.182383:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701203840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182403:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.182419:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701204352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397918.182472:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701204864:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397918.182515:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203968 00000100:00100000:1.0:1787397918.182540:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203968 00000100:00100000:0.0:1787397918.182554:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204480 00000100:00100000:0.0:1787397918.182560:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204480 00000100:00100000:1.0:1787397918.182567:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204992 00000100:00100000:1.0:1787397918.182572:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204992 00000100:00100000:0.0:1787397918.182586:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204608 00000100:00100000:0.0:1787397918.182591:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204608 00000100:00100000:1.0:1787397918.182605:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204736 00000100:00100000:1.0:1787397918.182611:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204736 00000100:00100000:0.0:1787397918.182616:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204864 00000100:00100000:0.0:1787397918.182621:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204864 00000100:00100000:1.0:1787397918.182638:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1787397918.182648:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701203968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182654:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1787397918.182664:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701204480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.182688:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701203968:12345-0@lo:400:kworker.0 Request processed in 41us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182712:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701204480:12345-0@lo:400:kworker.0 Request processed in 50us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182720:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1787397918.182735:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1787397918.182741:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701204992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182779:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701204992:12345-0@lo:400:kworker.0 Request processed in 38us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182785:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1787397918.182797:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1787397918.182803:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701204608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182828:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701204608:12345-0@lo:400:kworker.0 Request processed in 25us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182838:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1787397918.182850:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1787397918.182856:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701204736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182886:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701204736:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182892:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1787397918.182903:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1787397918.182908:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701204864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.182932:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701204864:12345-0@lo:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.182937:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1787397918.182969:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203712 00000100:00100000:0.0:1787397918.182973:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203712 00000100:00100000:0.0:1787397918.182996:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204224 00000100:00100000:0.0:1787397918.182999:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204224 00000100:00100000:0.0:1787397918.183009:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701203840 00000100:00100000:0.0:1787397918.183011:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701203840 00000100:00100000:0.0:1787397918.183020:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701204352 00000100:00100000:0.0:1787397918.183022:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701204352 00000100:00100000:0.0:1787397918.183034:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397918.183039:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701203712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183070:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701203712:12345-0@lo:400:kworker.0 Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.183076:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787397918.183087:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397918.183097:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701204224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183122:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701204224:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.183127:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787397918.183137:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787397918.183142:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701203840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183165:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701203840:12345-0@lo:400:kworker.0 Request processed in 23us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.183170:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787397918.183181:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787397918.183186:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701204352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183210:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701204352:12345-0@lo:400:kworker.0 Request processed in 24us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.183216:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787397918.183259:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfd500 x1874218701203840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397918.183278:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701203840:0@lo:400:kworker.0 00010000:00080000:0.0:1787397918.183291:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfc000 x1874218701204352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397918.183299:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701204352:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183311:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701204864:0@lo:400:kworker.0 00010000:00080000:0.0:1787397918.183320:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfdc00 x1874218701203712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397918.183329:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701203712:0@lo:400:kworker.0 00000100:00100000:1.0:1787397918.183342:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00010000:00080000:0.0:1787397918.183346:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfc700 x1874218701204224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397918.183355:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701204224:0@lo:400:kworker.0 00000100:00080000:1.0:1787397918.183365:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397918.183367:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701204736:0@lo:400:kworker.0 00000100:00080000:1.0:1787397918.183383:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397918.183387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397918.183414:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701203584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701204096:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183433:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701204608:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183443:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701203968:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183452:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701204480:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.183461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701204992:0@lo:400:kworker.0 00000100:00100000:0.0:1787397918.478546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397918.478605:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397918.478646:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397918.478672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397918.478756:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397918.478822:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293056 00000100:00100000:0.0:1787397918.478832:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293056 00000100:00100000:3.0:1787397918.479095:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293440 00000100:00100000:3.0:1787397918.479100:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293440 00000100:00100000:3.0:1787397918.479144:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293568 00000100:00100000:3.0:1787397918.479154:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293568 00000100:00100000:3.0:1787397918.479183:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787397918.479193:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681293440:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397918.479270:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681293440:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397918.479291:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:3.0:1787397918.479309:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787397918.479316:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681293568:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397918.479341:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681293568:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397918.479347:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00080000:3.0:1787397918.479373:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397918.479377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397918.479491:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293184 00000100:00100000:3.0:1787397918.479495:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293184 00000100:00100000:3.0:1787397918.479713:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293312 00000100:00100000:3.0:1787397918.479717:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293312 00000100:00100000:3.0:1787397918.479751:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1598 00000100:00100000:3.0:1787397918.479758:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681293184:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397918.479797:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681293184:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397918.479805:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1598 00000100:00100000:3.0:1787397918.479819:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1599 00000100:00100000:3.0:1787397918.479826:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681293312:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397918.479862:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681293312:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397918.479947:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1599 00000100:00080000:3.0:1787397918.480017:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397918.480020:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397918.480128:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 333 00000100:00100000:0.0:1787397918.480138:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681293056:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397918.480173:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681293056:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397918.480179:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 333 00010000:00010000:0.0:1787397918.566788:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787397918.697329:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787397918.697359:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787397918.697366:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:02000400:0.0:1787397919.462300:0:100808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787397919.589199:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397919.716665:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701205120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397919.716673:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397919.722780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397919.723019:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205120 00000100:00100000:2.0:1787397919.723085:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205120 00000100:00100000:2.0:1787397919.723147:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787397919.723160:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701205120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397919.723197:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397919.723251:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701205120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397919.723259:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787397919.723310:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a702136300 x1874218701205120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397919.723409:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701205120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397919.726908:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397919.728162:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205248 00000100:00100000:2.0:1787397919.728175:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205248 00000100:00100000:2.0:1787397919.728235:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787397919.728247:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701205248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787397919.728274:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397919.728425:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701205248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397919.728447:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787397919.728494:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a829b41500 x1874218701205248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397919.728513:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397920.236620:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701205376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397920.236700:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397920.236786:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205376 00000100:00100000:1.0:1787397920.236796:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205376 00000100:00100000:1.0:1787397920.236852:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397920.236861:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701205376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397920.236903:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1787397920.236953:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701205376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397920.236960:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397920.237015:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701205376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397920.237249:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397920.237260:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701205504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397920.237290:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397920.237351:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205504 00000100:00100000:3.0:1787397920.237356:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205504 00000100:00100000:3.0:1787397920.237388:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397920.237396:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701205504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397920.237416:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:3.0:1787397920.237454:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701205504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397920.237461:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397920.237492:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701205504:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787397920.621095:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397920.628021:0:100860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397920.628369:0:100860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397921.636740:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787397921.761760:0:100910:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397921.762212:0:100910:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787397922.661181:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397922.790442:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701205760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397922.791823:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701205632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397922.793692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397922.793839:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205632 00000100:00100000:2.0:1787397922.793850:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205632 00000100:00100000:2.0:1787397922.793928:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787397922.793939:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701205632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397922.793988:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:2.0:1787397922.794057:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701205632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397922.794066:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787397922.794117:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a704ee7800 x1874218701205632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397922.794135:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701205632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397922.794203:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397922.794514:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205760 00000100:00100000:2.0:1787397922.794546:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205760 00000100:00100000:2.0:1787397922.794584:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787397922.794592:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701205760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397922.794605:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:2.0:1787397922.794643:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701205760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397922.794672:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787397922.794767:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835bfce00 x1874218701205760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397922.794780:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701205760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787397922.796151:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397923.301059:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701205888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397923.301160:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701206016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301199:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701206400:0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.301220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397923.301253:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701206528:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301259:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701205888 00000100:00100000:3.0:1787397923.301269:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701205888 00000100:00100000:1.0:1787397923.301280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397923.301321:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701207040:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301344:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787397923.301356:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701205888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.301362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397923.301387:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787397923.301394:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701206144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301418:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70451bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701205888:12345-0@lo:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397923.301426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397923.301430:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787397923.301447:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701206656:0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.301473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397923.301487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397923.301512:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701207168:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301555:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701206912:0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.301577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397923.301599:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207040 00000100:00100000:3.0:1787397923.301603:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207040 00000100:00100000:0.0:1787397923.301651:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206656 00000100:00100000:3.0:1787397923.301655:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207168 00000100:00100000:0.0:1787397923.301657:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206656 00000100:00100000:3.0:1787397923.301660:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207168 00000100:00100000:0.0:1787397923.301692:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1787397923.301700:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:0.0:1787397923.301705:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701207040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.301712:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701206656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397923.301800:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:2.0:1787397923.301810:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701207168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304256:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701207040:12345-0@lo:400:kworker.0 Request processed in 2547us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.304285:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:0.0:1787397923.304368:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701206272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397923.304443:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701206784:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397923.304539:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206272 00000100:00100000:0.0:1787397923.304548:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206272 00000100:00100000:0.0:1787397923.304580:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206784 00000100:00100000:0.0:1787397923.304584:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206784 00000100:00100000:0.0:1787397923.304606:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1787397923.304613:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701206272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304674:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701206272:12345-0@lo:400:kworker.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.304680:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1787397923.304695:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1787397923.304702:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701206784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304733:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701206784:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.304739:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1787397923.304783:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701206272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304795:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701206784:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304852:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206528 00000100:00100000:0.0:1787397923.304856:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206528 00000100:00100000:0.0:1787397923.304885:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206144 00000100:00100000:0.0:1787397923.304889:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206144 00000100:00100000:0.0:1787397923.304922:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787397923.304929:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.304965:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701206528:12345-0@lo:400:kworker.0 Request processed in 37us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.304971:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787397923.304983:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787397923.304989:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701206144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305019:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701206144:12345-0@lo:400:kworker.0 Request processed in 30us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.305025:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787397923.305112:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206016 00000100:00100000:0.0:1787397923.305116:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206016 00000100:00100000:0.0:1787397923.305136:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206400 00000100:00100000:0.0:1787397923.305139:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206400 00000100:00100000:0.0:1787397923.305153:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787397923.305159:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701206016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305194:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701206016:12345-0@lo:400:kworker.0 Request processed in 35us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.305201:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787397923.305213:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397923.305219:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701206400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305249:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701206400:12345-0@lo:400:kworker.0 Request processed in 30us (3762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.305254:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397923.305338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397923.305373:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701205888:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305400:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701206400:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305427:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701206912 00000100:00100000:0.0:1787397923.305430:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701206912 00000100:00100000:0.0:1787397923.305456:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1787397923.305463:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701206912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.305498:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701206912:12345-0@lo:400:kworker.0 Request processed in 36us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.305505:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1787397923.305559:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701206912:0@lo:400:kworker.0 00000100:00080000:0.0:1787397923.305583:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397923.305589:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397923.305591:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397923.306238:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701206016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397923.306240:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701206656:12345-0@lo:400:kworker.0 Request processed in 4528us (4764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.306252:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00010000:00080000:1.0:1787397923.306260:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705984700 x1874218701206528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397923.306272:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701206528:0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.306288:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701207040:0@lo:400:kworker.0 00010000:00080000:1.0:1787397923.306309:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705985880 x1874218701206144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397923.306318:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701206144:0@lo:400:kworker.0 00000100:00100000:1.0:1787397923.306327:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701206656:0@lo:400:kworker.0 00000100:00100000:2.0:1787397923.306631:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701207168:12345-0@lo:400:kworker.0 Request processed in 4822us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.306640:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:1.0:1787397923.306763:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701207168:0@lo:400:kworker.0 00000100:00100000:0.0:1787397923.599413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397923.599570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397923.599606:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397923.599647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397923.599676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397923.599705:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293952 00000100:00100000:0.0:1787397923.599716:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293952 00000100:00100000:0.0:1787397923.599771:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293824 00000100:00100000:0.0:1787397923.599773:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293824 00000100:00100000:0.0:1787397923.599795:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1606 00000100:00100000:0.0:1787397923.599806:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681293952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397923.599888:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681293952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.599897:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1606 00000100:00100000:0.0:1787397923.599927:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1607 00000100:00100000:0.0:1787397923.599933:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681293824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397923.599960:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:2403:x1874218681293824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.599967:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1607 00000100:00100000:0.0:1787397923.599985:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294208 00000100:00100000:0.0:1787397923.599988:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294208 00000100:00100000:0.0:1787397923.600012:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294080 00000100:00100000:0.0:1787397923.600014:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294080 00000100:00100000:0.0:1787397923.600032:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787397923.600038:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681294208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397923.600061:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681294208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.600068:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787397923.600094:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:0.0:1787397923.600103:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681294080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397923.600127:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681294080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397923.600134:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00080000:3.0:1787397923.600139:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397923.600145:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397923.600148:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397923.600151:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397923.603427:0:94334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681293696 00000100:00100000:1.0:1787397923.603440:0:94334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681293696 00000100:00100000:1.0:1787397923.603605:0:94334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 335 00000100:00100000:1.0:1787397923.603616:0:94334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681293696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397923.603706:0:94334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681293696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (4303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397923.603715:0:94334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 335 00010000:00010000:0.0:1787397923.687614:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397923.730002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.730117:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294336 00000100:00100000:3.0:1787397923.730127:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294336 00000100:00100000:3.0:1787397923.730186:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1576 00000100:00100000:3.0:1787397923.730196:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:75222:x1874218681294336:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397923.730235:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1787397923.730304:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:75222:x1874218681294336:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.730312:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1576 00000100:00100000:0.0:1787397923.738312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.738412:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294464 00000100:00100000:2.0:1787397923.738422:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294464 00000100:00100000:2.0:1787397923.738488:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1577 00000100:00100000:2.0:1787397923.738499:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:75222:x1874218681294464:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397923.738571:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397923.738652:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:75222:x1874218681294464:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.738661:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1577 00000100:00100000:0.0:1787397923.748993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.749941:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294592 00000100:00100000:2.0:1787397923.749952:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294592 00000100:00100000:2.0:1787397923.750017:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787397923.750030:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:75222:x1874218681294592:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397923.750056:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:2.0:1787397923.750152:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:75222:x1874218681294592:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 125us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.750160:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787397923.755167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.755416:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294720 00000100:00100000:2.0:1787397923.755428:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294720 00000100:00100000:2.0:1787397923.755483:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787397923.755512:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:75222:x1874218681294720:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397923.755658:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397923.755746:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:75222:x1874218681294720:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 236us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.755754:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:0.0:1787397923.775988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.776091:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681294976 00000100:00100000:3.0:1787397923.776101:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681294976 00000100:00100000:3.0:1787397923.776161:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1578 00000100:00100000:3.0:1787397923.776171:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+51:73329:x1874218681294976:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787397923.776191:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.776226:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d1926c1 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d858c expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776367:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776383:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776397:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776414:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776420:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.776425:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787397923.776895:0:66177:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x776:0x0], index 0: 0 00010000:00010000:3.0:1787397923.777040:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d1926d6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777050:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d1926d6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777059:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d1926d6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777089:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777107:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777112:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777118:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777123:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.777128:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777135:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777147:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.777149:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.777153:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777159:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d1926c8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397923.777173:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4125743 reply state 00000000548e67f2 transno 120259084440 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777185:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777190:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8d93425 (ffff89a806066e00) 00010000:00010000:3.0:1787397923.777197:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397923.777199:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397923.777228:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d1926c1 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d858c expref: 54 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777242:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d1926d6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d858c expref: 53 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.777249:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x2f:0x0].0x0 (ffff89a806066b00) 00010000:00010000:3.0:1787397923.777251:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397923.777253:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582600, rc 0) 00000100:00100000:3.0:1787397923.777313:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+54:73329:x1874218681294976:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1144us (1341us total) trans 120259084440 rc 0/0 00000100:00100000:3.0:1787397923.777321:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1578 00000100:00100000:1.0:1787397923.789573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.789798:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681295104 00000100:00100000:3.0:1787397923.789809:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681295104 00000100:00100000:3.0:1787397923.789879:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787397923.789889:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:73329:x1874218681295104:12345-192.168.204.60@tcp:101:bash.0 00010000:00010000:3.0:1787397923.789908:0:99639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.790170:0:99639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8593 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397923.791024:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397923.791051:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=3803s v=(0 0) 00010000:00010000:3.0:1787397923.791055:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397923.791073:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 6 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.791109:0:99639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 6 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.791122:0:99639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582a00, rc 0) 00000100:00100000:3.0:1787397923.791286:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:73329:x1874218681295104:12345-192.168.204.60@tcp:101:bash.0 Request processed in 1398us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.791295:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787397923.796246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.796601:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681295360 00000100:00100000:2.0:1787397923.796611:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681295360 00000100:00100000:2.0:1787397923.796679:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 282 00000100:00100000:2.0:1787397923.796691:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+54:73329:x1874218681295360:12345-192.168.204.60@tcp:35:bash.0 00000100:00100000:2.0:1787397923.797012:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+55:73329:x1874218681295360:12345-192.168.204.60@tcp:35:bash.0 Request processed in 322us (776us total) trans 120259084441 rc 0/0 00000100:00100000:2.0:1787397923.797020:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 282 00000100:00100000:0.0:1787397923.829371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.829452:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681295488 00000100:00100000:3.0:1787397923.829463:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681295488 00000100:00100000:3.0:1787397923.829519:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1579 00000100:00100000:3.0:1787397923.829556:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+55:75239:x1874218681295488:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397923.829579:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.829602:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1926eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d859a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829678:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829691:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829703:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397923.829746:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1787397923.829749:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397923.829767:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829808:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1926eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d859a expref: 57 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829826:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d859a expref: 56 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.829835:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.829838:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397923.829841:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583a00, rc 0) 00000100:00100000:3.0:1787397923.829891:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+56:75239:x1874218681295488:12345-192.168.204.60@tcp:101:rm.0 Request processed in 337us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.829898:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1579 00000100:00100000:1.0:1787397923.840803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.840912:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681295744 00000100:00100000:2.0:1787397923.840923:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681295744 00000100:00100000:2.0:1787397923.840993:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1580 00000100:00100000:2.0:1787397923.841003:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+56:75239:x1874218681295744:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397923.841024:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397923.841045:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1926f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85a1 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397923.841159:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1787397923.841255:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1926f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85a1 expref: 58 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.841270:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397923.841274:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397923.841293:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1926f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85a1 expref: 58 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.841309:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808719c00, rc 0) 00000100:00100000:2.0:1787397923.841371:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:75239:x1874218681295744:12345-192.168.204.60@tcp:101:rm.0 Request processed in 369us (578us total) trans 120259084442 rc 301/301 00000100:00100000:2.0:1787397923.841379:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1580 00000100:00100000:0.0:1787397923.852048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.854810:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681295872 00000100:00100000:2.0:1787397923.854826:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681295872 00000100:00100000:2.0:1787397923.854896:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 283 00000100:00100000:2.0:1787397923.854906:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:75239:x1874218681295872:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:2.0:1787397923.863880:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:75239:x1874218681295872:12345-192.168.204.60@tcp:37:rm.0 Request processed in 8964us (11831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.863896:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 283 00000100:00100000:0.0:1787397923.877447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.877563:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681296128 00000100:00100000:3.0:1787397923.877573:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681296128 00000100:00100000:3.0:1787397923.877640:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 284 00000100:00100000:3.0:1787397923.877651:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+57:75239:x1874218681296128:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787397923.877899:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+58:75239:x1874218681296128:12345-192.168.204.60@tcp:35:rm.0 Request processed in 248us (461us total) trans 120259084443 rc 0/0 00000100:00100000:3.0:1787397923.877907:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 284 00000100:00100000:0.0:1787397923.896254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.896429:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681296384 00000100:00100000:2.0:1787397923.896440:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681296384 00000100:00100000:2.0:1787397923.896515:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1581 00000100:00100000:2.0:1787397923.896573:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+58:75239:x1874218681296384:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397923.896597:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397923.896617:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85a8 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.896737:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19270e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.896753:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19270e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.896786:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19270e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397923.896798:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1787397923.896908:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85a8 expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.896928:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19270e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85a8 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.896936:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.896939:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787397923.896942:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808719600, rc 0) 00000100:00100000:2.0:1787397923.897009:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681296384:12345-192.168.204.60@tcp:101:rm.0 Request processed in 486us (766us total) trans 120259084444 rc 0/0 00000100:00100000:2.0:1787397923.897017:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1581 00000100:00100000:0.0:1787397923.906224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.906362:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681296512 00000100:00100000:3.0:1787397923.906372:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681296512 00000100:00100000:3.0:1787397923.906441:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1582 00000100:00100000:3.0:1787397923.906451:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681296512:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397923.906475:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.906504:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d19271c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85af expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906616:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906642:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906655:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906669:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906677:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906683:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906751:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906760:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906768:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397923.906809:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 1024 00000004:00200000:3.0:1787397923.906813:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397923.906830:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906853:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906863:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906870:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906877:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906884:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906890:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.906895:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906902:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906914:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.906917:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.906922:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906928:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d192723 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906943:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906953:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906959:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906963:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.906965:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906971:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906978:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a806066700) 00010000:00010000:3.0:1787397923.906981:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.906984:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.906991:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d19272a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.907019:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d19271c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85af expref: 62 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.907034:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85af expref: 61 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.907041:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:3.0:1787397923.907043:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397923.907052:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22200, rc 0) 00000100:00100000:3.0:1787397923.908003:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681296512:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1540us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.908014:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1582 00000100:00100000:1.0:1787397923.924618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.926429:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681296768 00000100:00100000:2.0:1787397923.926445:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681296768 00000100:00100000:2.0:1787397923.926666:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1583 00000100:00100000:2.0:1787397923.926678:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681296768:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397923.926734:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787397923.926762:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192731 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85af expref: 61 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926787:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19221b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84f2 expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926826:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d191d28 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d836a expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926838:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:2.0:1787397923.926853:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1926f2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d859a expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926864:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.926867:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397923.926889:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926902:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926912:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926939:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926947:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.926954:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927045:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927063:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927071:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397923.927295:0:67264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].2, 64 off8320 00000004:00080000:2.0:1787397923.927306:0:67264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3803217782824ns, next at 3804217780301ns, rc = 0 00010000:00010000:2.0:1787397923.927354:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927362:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927370:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927377:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927383:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927388:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927414:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397923.927433:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927440:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927452:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927458:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.927462:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927470:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927479:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82df32900) 00010000:00010000:2.0:1787397923.927482:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397923.927485:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927490:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192746 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927507:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927513:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927518:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927791:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397923.927799:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927805:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397923.927809:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927815:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927825:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff89a82df32900) 00010000:00010000:1.0:1787397923.927827:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397923.927830:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927836:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d19274d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.927861:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.927863:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.927865:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397923.927905:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927911:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.927920:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927927:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927935:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.927938:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.927941:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927948:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192738 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397923.927957:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091053d69 reply state 00000000eb9ca823 transno 120259084445 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927969:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.927976:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a82df32100) 00010000:00010000:2.0:1787397923.927978:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397923.927981:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397923.928328:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681296768:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1648us (3717us total) trans 120259084445 rc 0/0 00000100:00100000:2.0:1787397923.928337:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1583 00000100:00100000:0.0:1787397923.934154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.934341:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681296896 00000100:00100000:2.0:1787397923.934351:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681296896 00000100:00100000:2.0:1787397923.934412:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1584 00000100:00100000:2.0:1787397923.934422:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681296896:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397923.934447:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397923.934482:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192754 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85b6 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934732:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934748:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934760:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934773:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934780:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934786:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934854:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934862:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934869:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397923.934910:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 1024 00000004:00200000:2.0:1787397923.934914:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397923.934932:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934948:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934957:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934964:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934969:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934975:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934980:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.934985:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.934991:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935002:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.935005:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.935009:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935015:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d19275b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935028:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935039:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935044:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935049:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.935052:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935057:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935064:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a82df32200) 00010000:00010000:2.0:1787397923.935067:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.935070:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935076:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d192762 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935103:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d192754 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85b6 expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935115:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85b6 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.935122:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397923.935124:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397923.935131:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808718800, rc 0) 00000100:00100000:2.0:1787397923.935208:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681296896:12345-192.168.204.60@tcp:101:rm.0 Request processed in 786us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.935216:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1584 00000100:00100000:1.0:1787397923.939010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.939282:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681297152 00000100:00100000:2.0:1787397923.939294:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681297152 00000100:00100000:2.0:1787397923.939358:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1585 00000100:00100000:2.0:1787397923.939369:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681297152:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397923.939420:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397923.939449:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d192769 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85b6 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939472:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d1920d9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8482 expref: 59 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939485:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d191c33 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8324 expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939497:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a817ea6f00) 00010000:00010000:2.0:1787397923.939508:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397923.939553:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939581:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939590:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939626:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939644:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939651:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939728:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939736:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939742:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397923.939939:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].3, 64 off8384 00010000:00010000:2.0:1787397923.939984:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.939993:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940000:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940008:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940014:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940026:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940291:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397923.940312:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940319:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940325:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940331:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.940336:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940343:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940353:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a82df32e00) 00010000:00010000:2.0:1787397923.940356:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397923.940359:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940364:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d19277e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940382:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940388:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940400:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940407:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940412:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.940415:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940421:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940430:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.940432:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.940435:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940441:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192770 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397923.940451:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e688148e reply state 0000000093d4fa26 transno 120259084446 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940462:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.940469:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a82df32600) 00010000:00010000:2.0:1787397923.940471:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397923.940474:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397923.940780:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681297152:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1409us (1775us total) trans 120259084446 rc 0/0 00000100:00100000:2.0:1787397923.940794:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1585 00010000:00010000:1.0:1787397923.941167:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397923.941175:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.941182:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397923.941198:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.941207:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.941217:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff89a82df32e00) 00010000:00010000:1.0:1787397923.941219:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397923.941222:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.941228:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d192785 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397923.941244:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.941246:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.941247:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397923.947135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.947407:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681297280 00000100:00100000:3.0:1787397923.947417:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681297280 00000100:00100000:3.0:1787397923.947508:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1586 00000100:00100000:3.0:1787397923.947554:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681297280:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397923.947582:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.947603:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d19278c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85bd expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947683:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947697:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947707:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947721:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947728:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947734:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947807:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947831:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947837:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397923.947883:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 1024 00000004:00200000:3.0:1787397923.947888:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397923.947906:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947916:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947924:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947929:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947935:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947940:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.947944:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947951:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947963:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.947971:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.947976:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947982:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192793 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.947995:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948000:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948004:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948008:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.948010:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948015:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948021:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a806066700) 00010000:00010000:3.0:1787397923.948023:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.948026:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948031:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d19279a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948056:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d19278c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85bd expref: 61 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948078:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85bd expref: 60 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.948085:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:3.0:1787397923.948087:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397923.948089:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22400, rc 0) 00000100:00100000:3.0:1787397923.948147:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681297280:12345-192.168.204.60@tcp:101:rm.0 Request processed in 630us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.948155:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1586 00000100:00100000:0.0:1787397923.952585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.952737:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681297536 00000100:00100000:3.0:1787397923.952746:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681297536 00000100:00100000:3.0:1787397923.952809:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1587 00000100:00100000:3.0:1787397923.952820:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681297536:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397923.952876:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397923.952902:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1927a1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85bd expref: 60 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.952924:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030000/0x274786fe0d192093 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d846d expref: 59 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.952945:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d191bd1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8308 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.952959:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a82e43e800) 00010000:00010000:3.0:1787397923.952969:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397923.953006:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953020:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953029:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953042:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953048:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953055:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953132:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953140:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953148:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397923.953464:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].4, 64 off8448 00010000:00010000:3.0:1787397923.953515:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953752:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953772:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953779:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953785:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953790:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953839:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397923.953857:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953863:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953869:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953873:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.953877:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953883:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953891:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a806066200) 00010000:00010000:3.0:1787397923.953894:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397923.953904:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953909:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d1927b6 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953929:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953935:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953940:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953945:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953949:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.953951:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953956:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953962:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.953964:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.953967:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953972:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1927a8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397923.953980:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045b95536 reply state 00000000ed8426df transno 120259084447 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.953996:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.954001:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a806066600) 00010000:00010000:3.0:1787397923.954003:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397923.954006:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397923.954089:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681297536:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1269us (1512us total) trans 120259084447 rc 0/0 00000100:00100000:3.0:1787397923.954097:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1587 00000100:00100000:1.0:1787397923.957152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397923.959607:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681297664 00000100:00100000:3.0:1787397923.959623:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681297664 00000100:00100000:3.0:1787397923.959702:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1588 00000100:00100000:3.0:1787397923.959713:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681297664:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397923.959738:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397923.959761:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1927c4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85c4 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959827:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959841:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959852:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959867:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959891:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959899:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959982:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959991:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.959998:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397923.960038:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 1024 00000004:00200000:3.0:1787397923.960042:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397923.960060:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960072:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960081:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960087:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960093:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960110:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960116:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.960120:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960127:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960139:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397923.960142:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.960146:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960153:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1927cb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960166:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960172:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960177:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960182:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397923.960192:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960208:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960217:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a806066000) 00010000:00010000:3.0:1787397923.960219:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397923.960222:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960228:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d1927d2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960704:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1927c4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85c4 expref: 61 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960720:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85c4 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397923.960727:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:3.0:1787397923.960730:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397923.960732:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582400, rc 0) 00000100:00100000:3.0:1787397923.960852:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681297664:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1141us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397923.960860:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1588 00010000:00010000:2.0:1787397923.963755:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397923.963769:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.963779:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397923.963784:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.963795:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.963814:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff89a806066200) 00010000:00010000:2.0:1787397923.963817:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787397923.963822:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.963828:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d1927bd lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.963848:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397923.963850:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397923.963853:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397923.978649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.978784:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681297920 00000100:00100000:2.0:1787397923.978795:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681297920 00000100:00100000:2.0:1787397923.978857:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1589 00000100:00100000:2.0:1787397923.978868:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681297920:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397923.978927:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397923.978955:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d1927d9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85c4 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.978996:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a1800/0x274786fe0d1922df lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8538 expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979010:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d191dbb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8394 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979022:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a818432300) 00010000:00010000:2.0:1787397923.979033:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397923.979056:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979068:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979077:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979091:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979098:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979105:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979196:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979204:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979219:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397923.979428:0:67264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].5, 64 off8512 00010000:00010000:2.0:1787397923.979475:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979484:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979492:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979499:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979505:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979510:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979619:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397923.979653:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979659:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979666:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979681:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.979686:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979693:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979702:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787397923.979705:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397923.979708:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979714:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d1927ee lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979731:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979738:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979744:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979749:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979754:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.979757:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979773:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979782:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.979784:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.979787:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979792:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d1927e0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397923.979801:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a9a4e8d reply state 00000000f0bfe766 transno 120259084448 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979812:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.979818:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a82df32200) 00010000:00010000:2.0:1787397923.979820:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397923.979822:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397923.979885:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681297920:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1018us (1256us total) trans 120259084448 rc 0/0 00000100:00100000:2.0:1787397923.979893:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1589 00000100:00100000:3.0:1787397923.982934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.983163:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681298048 00000100:00100000:2.0:1787397923.983174:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681298048 00000100:00100000:2.0:1787397923.983234:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1590 00000100:00100000:2.0:1787397923.983254:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681298048:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397923.983280:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397923.983301:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d1927fc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85cb expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983384:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983398:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983409:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983424:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983431:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983437:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983509:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983518:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.983691:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397923.983701:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.983709:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397923.983714:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.983723:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.983737:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:0.0:1787397923.983740:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397923.983745:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.983751:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719000/0x274786fe0d1927f5 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983802:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397923.983852:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 1024 00000004:00200000:2.0:1787397923.983857:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397923.983880:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983907:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983918:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983925:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983931:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983939:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983943:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.983947:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983952:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983961:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.983963:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.983966:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983971:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718000/0x274786fe0d192803 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983983:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.983995:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984000:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984005:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.984008:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984013:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984021:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a82df32000) 00010000:00010000:2.0:1787397923.984023:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.984025:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984031:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718a00/0x274786fe0d19280a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984062:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718c00/0x274786fe0d1927fc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85cb expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984075:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85cb expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.984083:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:2.0:1787397923.984086:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397923.984095:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a808719400, rc 0) 00010000:00010000:1.0:1787397923.984266:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.984274:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397923.984276:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397923.985391:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681298048:12345-192.168.204.60@tcp:101:rm.0 Request processed in 2139us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.985404:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1590 00000100:00100000:1.0:1787397923.989981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.990158:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681298304 00000100:00100000:2.0:1787397923.990170:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681298304 00000100:00100000:2.0:1787397923.990231:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1591 00000100:00100000:2.0:1787397923.990250:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681298304:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397923.990310:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397923.990339:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719400/0x274786fe0d192811 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85cb expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990364:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134600/0x274786fe0d191fd6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d843c expref: 59 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990380:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d191b6f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82ec expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990390:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a817ea6500) 00010000:00010000:2.0:1787397923.990400:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397923.990421:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990435:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990445:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990480:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990487:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990494:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990755:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990764:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.990771:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397923.990957:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].6, 64 off8576 00010000:00010000:2.0:1787397923.991006:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991015:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991023:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991030:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991037:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991049:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991073:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397923.991092:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991098:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991105:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991110:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.991115:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991122:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991131:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:2.0:1787397923.991134:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397923.991137:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991143:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719200/0x274786fe0d192826 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991168:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397923.991177:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991186:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397923.991196:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991204:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991214:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:0.0:1787397923.991217:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397923.991220:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991236:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719e00/0x274786fe0d19282d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397923.991248:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397923.991250:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397923.991252:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397923.991421:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991429:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991440:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991446:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991450:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.991452:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991458:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991467:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.991469:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.991472:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991477:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718400/0x274786fe0d192818 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397923.991487:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c37da2c2 reply state 00000000b50a2424 transno 120259084449 ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991498:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.991503:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a82df32a00) 00010000:00010000:2.0:1787397923.991505:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397923.991508:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397923.991791:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681298304:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1548us (1819us total) trans 120259084449 rc 0/0 00000100:00100000:2.0:1787397923.991805:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1591 00000100:00100000:1.0:1787397923.998033:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397923.998140:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681298432 00000100:00100000:2.0:1787397923.998151:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681298432 00000100:00100000:2.0:1787397923.998260:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1592 00000100:00100000:2.0:1787397923.998272:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681298432:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397923.998297:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397923.998317:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192834 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85d2 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998384:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998398:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998411:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998427:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998435:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998442:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998572:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998599:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998607:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397923.998664:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 1024 00000004:00200000:2.0:1787397923.998669:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397923.998687:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998700:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998709:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998715:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998721:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998728:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998734:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.998738:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998746:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998766:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397923.998768:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.998773:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998780:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718800/0x274786fe0d19283b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998794:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998800:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998805:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998810:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397923.998812:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998818:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998824:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a82df32c00) 00010000:00010000:2.0:1787397923.998826:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397923.998829:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998834:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192842 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998881:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719c00/0x274786fe0d192834 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d2 expref: 61 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998894:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d2 expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397923.998902:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:2.0:1787397923.998904:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397923.998907:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:2.0:1787397923.998973:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681298432:12345-192.168.204.60@tcp:101:rm.0 Request processed in 703us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397923.998981:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1592 00000100:00100000:3.0:1787397924.001975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397924.005514:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681298688 00000100:00100000:0.0:1787397924.005545:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681298688 00000100:00100000:0.0:1787397924.005604:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1593 00000100:00100000:0.0:1787397924.005614:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681298688:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397924.005678:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787397924.005707:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192849 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d2 expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005725:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d19234f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d855b expref: 59 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005739:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d191e1d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83b0 expref: 58 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005772:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a818432d00) 00010000:00010000:0.0:1787397924.005783:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397924.005817:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005830:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005840:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005854:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005861:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005868:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005962:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005969:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.005977:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397924.006190:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].7, 64 off8640 00010000:00010000:0.0:1787397924.006243:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006259:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006267:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006275:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006281:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006288:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006317:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397924.006340:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006346:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006352:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006358:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.006362:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006369:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006388:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a81ab0c700) 00010000:00010000:0.0:1787397924.006391:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.006394:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006399:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d19285e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006415:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006420:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006425:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006431:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006435:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.006437:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006443:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006450:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.006452:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.006454:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006469:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55400/0x274786fe0d192850 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397924.006478:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4d2c6e8 reply state 00000000669ca3f0 transno 120259084450 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006489:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.006496:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a81ab0cf00) 00010000:00010000:0.0:1787397924.006499:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397924.006501:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397924.006609:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681298688:12345-192.168.204.60@tcp:36:rm.0 Request processed in 994us (4643us total) trans 120259084450 rc 0/0 00000100:00100000:0.0:1787397924.006618:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1593 00010000:00010000:1.0:1787397924.007395:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397924.007403:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.007411:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397924.007415:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.007423:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.007435:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff89a81ab0c700) 00010000:00010000:1.0:1787397924.007437:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397924.007440:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.007446:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55c00/0x274786fe0d192865 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.007475:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.007477:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.007479:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.011704:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.011873:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681298816 00000100:00100000:3.0:1787397924.011883:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681298816 00000100:00100000:3.0:1787397924.011954:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1594 00000100:00100000:3.0:1787397924.011981:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681298816:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397924.012005:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397924.012026:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19286c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85d9 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012227:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012244:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012255:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012270:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012275:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012281:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012362:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012374:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012383:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397924.012445:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 1024 00000004:00200000:3.0:1787397924.012450:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397924.012483:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012497:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012506:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012512:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012640:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012649:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012655:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.012660:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012667:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012680:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.012684:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.012688:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012705:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192873 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012720:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012726:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012731:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012736:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.012739:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012746:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012754:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a806066000) 00010000:00010000:3.0:1787397924.012757:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.012760:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.012765:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d19287a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.013457:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d19286c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d9 expref: 61 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.013489:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d9 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.013496:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397924.013498:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397924.013501:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22c00, rc 0) 00000100:00100000:3.0:1787397924.013697:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681298816:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1717us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397924.013706:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1594 00000100:00100000:2.0:1787397924.033096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.034932:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299072 00000100:00100000:3.0:1787397924.034948:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299072 00000100:00100000:3.0:1787397924.035027:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1595 00000100:00100000:3.0:1787397924.035037:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299072:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.035094:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.035123:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192881 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85d9 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035143:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d191ee1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83e1 expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035158:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75a00/0x274786fe0d191adc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82c2 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035170:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a818432100) 00010000:00010000:3.0:1787397924.035182:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.035218:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035232:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035242:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035255:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035261:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035267:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035358:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035366:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035373:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.035718:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].8, 64 off8704 00010000:00010000:3.0:1787397924.035766:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.035774:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036068:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036078:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036085:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036090:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036105:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.036124:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036129:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036135:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036140:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.036144:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036151:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036160:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a806066700) 00010000:00010000:3.0:1787397924.036163:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.036174:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036180:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d192896 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036199:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036205:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036210:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036215:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.036218:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036224:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036232:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.036234:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.036237:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036242:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192888 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.036251:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6141620 reply state 0000000014af0c9e transno 120259084451 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036273:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.036278:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a806066000) 00010000:00010000:3.0:1787397924.036280:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.036283:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.036419:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299072:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1379us (3327us total) trans 120259084451 rc 0/0 00000100:00100000:3.0:1787397924.036427:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1595 00010000:00010000:1.0:1787397924.038031:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397924.038046:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.038057:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397924.038076:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.038085:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.038099:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff89a806066700) 00010000:00010000:1.0:1787397924.038102:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397924.038106:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.038111:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d19289d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.038134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.038136:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.038137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.042865:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.042960:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299200 00000100:00100000:2.0:1787397924.042970:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299200 00000100:00100000:2.0:1787397924.043039:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1596 00000100:00100000:2.0:1787397924.043051:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299200:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.043076:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.043096:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928a4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85e0 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043164:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043178:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043207:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043222:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043229:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043236:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043312:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043321:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043328:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.043381:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.043386:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.043407:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043419:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043429:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043446:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043452:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043458:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043463:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.043468:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043474:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043485:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.043488:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.043492:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043498:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043512:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043518:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043572:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043583:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.043586:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043592:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043601:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a82df32c00) 00010000:00010000:2.0:1787397924.043603:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.043606:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043613:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928b2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043654:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928a4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e0 expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043668:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e0 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.043676:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:2.0:1787397924.043682:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.043685:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00000100:00100000:2.0:1787397924.043752:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299200:12345-192.168.204.60@tcp:101:rm.0 Request processed in 703us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.043760:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1596 00000100:00100000:0.0:1787397924.064185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.064299:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299456 00000100:00100000:2.0:1787397924.064322:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299456 00000100:00100000:2.0:1787397924.064381:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1597 00000100:00100000:2.0:1787397924.064392:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299456:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397924.064451:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397924.064477:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928b9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e0 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064499:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192046 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8451 expref: 59 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064513:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d191c95 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8340 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064585:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82ebb1300) 00010000:00010000:2.0:1787397924.064598:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397924.064620:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064644:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064655:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064671:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064678:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064695:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064780:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064789:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.064796:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397924.065020:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].9, 64 off8768 00010000:00010000:2.0:1787397924.065071:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065080:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065087:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065094:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065099:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065105:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065120:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397924.065146:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065151:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065157:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065162:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.065167:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065173:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065182:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:2.0:1787397924.065185:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397924.065188:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065193:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928ce lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065210:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065216:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065222:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065227:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065237:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.065240:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065245:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065253:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.065256:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.065258:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065264:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928c0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397924.065272:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcca2f8d reply state 0000000085ddb141 transno 120259084452 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065282:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.065288:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a82df32c00) 00010000:00010000:2.0:1787397924.065290:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397924.065292:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397924.065364:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299456:12345-192.168.204.60@tcp:36:rm.0 Request processed in 973us (1187us total) trans 120259084452 rc 0/0 00000100:00100000:2.0:1787397924.065372:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1597 00010000:00010000:0.0:1787397924.065687:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.065695:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.065702:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.065705:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.065711:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.065721:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:0.0:1787397924.065723:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.065734:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.065740:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d1928d5 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.065755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.065757:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.065759:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.074317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.074415:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299584 00000100:00100000:2.0:1787397924.074426:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299584 00000100:00100000:2.0:1787397924.074490:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1598 00000100:00100000:2.0:1787397924.074514:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299584:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.074585:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.074868:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928dc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85e7 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.074944:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.074960:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.074973:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.074988:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.074996:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075003:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075076:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075085:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075092:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.075271:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.075276:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.075299:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075312:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075322:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075330:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075337:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075344:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075350:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.075354:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075363:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075374:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.075377:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.075381:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075398:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d1928e3 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075413:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075418:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075423:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075427:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.075430:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075436:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075444:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a82df32000) 00010000:00010000:2.0:1787397924.075446:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.075449:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075454:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ea lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075487:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928dc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e7 expref: 61 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075516:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e7 expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.075620:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397924.075623:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.075635:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00000100:00100000:2.0:1787397924.075701:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299584:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1190us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.075710:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1598 00000100:00100000:1.0:1787397924.086110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.086233:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299840 00000100:00100000:2.0:1787397924.086245:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299840 00000100:00100000:2.0:1787397924.086306:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1599 00000100:00100000:2.0:1787397924.086316:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299840:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397924.086373:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397924.086401:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d1928f1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85e7 expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086424:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192118 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d849e expref: 59 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086436:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d191c02 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8316 expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086444:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a817ea6d00) 00010000:00010000:2.0:1787397924.086456:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397924.086495:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086509:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086519:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086582:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086590:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086598:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086694:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086701:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086708:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397924.086909:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].10, 64 off8832 00010000:00010000:2.0:1787397924.086959:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086968:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086986:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.086994:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087000:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087005:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087029:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397924.087049:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087056:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087062:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087067:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.087071:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087078:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087087:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:2.0:1787397924.087090:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397924.087100:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087106:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192906 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087123:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087130:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087135:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087141:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087147:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.087150:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087155:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087164:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.087166:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.087169:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087175:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1928f8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397924.087186:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000011859a2 reply state 0000000070089f00 transno 120259084453 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.087190:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397924.087199:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087207:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.087209:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397924.087216:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087219:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a82df32000) 00010000:00010000:1.0:1787397924.087228:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.087232:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397924.087237:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397924.087253:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:1.0:1787397924.087263:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397924.087267:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.087273:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d19290d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.087289:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.087292:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.087294:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397924.087330:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299840:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1013us (1228us total) trans 120259084453 rc 0/0 00000100:00100000:2.0:1787397924.087339:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1599 00000100:00100000:0.0:1787397924.090258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.090750:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681299968 00000100:00100000:2.0:1787397924.090761:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681299968 00000100:00100000:2.0:1787397924.090819:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1600 00000100:00100000:2.0:1787397924.090829:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681299968:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.090859:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.090884:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192914 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85ee expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.090953:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.090968:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.090980:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.090995:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091020:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091026:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091098:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091107:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091113:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.091264:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.091270:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.091290:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091303:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091314:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091320:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091325:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091342:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091347:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.091351:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091359:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091370:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.091374:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.091378:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091384:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19291b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091399:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091405:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091410:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091416:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.091419:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091436:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091445:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.091447:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.091450:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091455:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192922 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091489:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192914 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85ee expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091504:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85ee expref: 60 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.091511:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:2.0:1787397924.091514:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.091516:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a400, rc 0) 00000100:00100000:2.0:1787397924.092185:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681299968:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1355us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.092194:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1600 00000100:00100000:1.0:1787397924.106308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.106364:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681300224 00000100:00100000:2.0:1787397924.106374:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681300224 00000100:00100000:2.0:1787397924.106435:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1601 00000100:00100000:2.0:1787397924.106446:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681300224:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397924.106557:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397924.106587:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192929 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85ee expref: 60 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106608:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192253 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8507 expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106621:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d191d8a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8386 expref: 58 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106645:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a818432700) 00010000:00010000:2.0:1787397924.106658:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397924.106681:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106696:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106706:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106722:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106728:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106735:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106845:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106853:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.106860:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397924.107770:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].11, 64 off8896 00010000:00010000:0.0:1787397924.107912:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.107925:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.107934:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.107942:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.107948:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.107955:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108022:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397924.108147:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108155:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108172:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108178:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.108183:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108320:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108333:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a82df32900) 00010000:00010000:0.0:1787397924.108336:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.108340:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108346:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d19293e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108365:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108372:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108377:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108382:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.108385:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108402:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108412:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.108415:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.108418:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108424:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d192930 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397924.108434:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a8b4841 reply state 00000000873fd9ea transno 120259084454 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108445:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.108652:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a82df32e00) 00010000:00010000:0.0:1787397924.108655:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397924.108658:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397924.108785:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681300224:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2336us (2482us total) trans 120259084454 rc 0/0 00000100:00100000:0.0:1787397924.108803:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1601 00010000:00010000:1.0:1787397924.108961:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397924.108969:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.108975:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397924.108979:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.108985:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.108994:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff89a82df32900) 00010000:00010000:1.0:1787397924.108996:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397924.108999:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.109016:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55800/0x274786fe0d192945 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.109127:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.109129:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.109131:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.118106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.118205:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681300352 00000100:00100000:2.0:1787397924.118216:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681300352 00000100:00100000:2.0:1787397924.118401:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1602 00000100:00100000:2.0:1787397924.118413:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681300352:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.118469:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.118494:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d19294c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85f5 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118686:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118700:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118712:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118727:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118734:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118754:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118912:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118922:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.118929:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.118971:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.118975:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.118993:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119005:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119014:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119020:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119026:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119033:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119116:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.119121:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119128:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119140:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.119143:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.119148:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119155:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192953 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119168:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119173:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119179:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119184:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.119187:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119193:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119212:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.119214:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.119217:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119223:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19295a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119316:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d19294c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85f5 expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119332:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85f5 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.119340:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:2.0:1787397924.119342:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.119345:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b000, rc 0) 00000100:00100000:2.0:1787397924.119463:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681300352:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1051us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.119473:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1602 00000100:00100000:0.0:1787397924.123474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.123795:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681300608 00000100:00100000:3.0:1787397924.123806:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681300608 00000100:00100000:3.0:1787397924.123899:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1603 00000100:00100000:3.0:1787397924.123910:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681300608:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.123964:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.123993:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192961 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85f5 expref: 60 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124015:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1921dc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84dd expref: 59 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124027:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d191cf7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d835c expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124037:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a82ebb1b00) 00010000:00010000:3.0:1787397924.124047:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.124072:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124100:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124110:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124127:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124135:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124141:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124224:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124232:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124251:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.124591:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].12, 64 off8960 00010000:00010000:3.0:1787397924.124656:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124665:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124672:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124686:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124692:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124697:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124723:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.124742:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124747:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124754:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124760:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.124763:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124771:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124779:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a806066900) 00010000:00010000:3.0:1787397924.124783:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.124786:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124802:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d192976 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124819:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124825:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124830:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124835:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124840:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.124843:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124850:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124858:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.124861:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.124864:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124870:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192968 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.124878:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002bf20ced reply state 00000000c83a3750 transno 120259084455 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124898:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.124904:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a806066500) 00010000:00010000:3.0:1787397924.124906:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.124909:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.124989:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681300608:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1079us (1522us total) trans 120259084455 rc 0/0 00000100:00100000:3.0:1787397924.124997:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1603 00010000:00010000:0.0:1787397924.125071:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.125078:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.125095:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.125098:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.125104:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.125114:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff89a806066900) 00010000:00010000:0.0:1787397924.125116:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.125119:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.125124:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d19297d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.125139:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.125140:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.125142:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.130516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.130778:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681300736 00000100:00100000:2.0:1787397924.130789:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681300736 00000100:00100000:2.0:1787397924.130853:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1604 00000100:00100000:2.0:1787397924.130865:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681300736:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.130893:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.130915:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192984 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d85fc expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.130992:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131008:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131020:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131035:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131042:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131049:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131180:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131190:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131197:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.131344:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.131349:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.131373:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131398:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131409:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131417:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131423:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131431:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131437:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.131441:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131449:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131462:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.131465:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.131469:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131474:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d19298b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131488:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131499:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131506:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131511:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.131514:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131611:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131622:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.131634:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.131638:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131644:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192992 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131678:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192984 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85fc expref: 61 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131692:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85fc expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.131698:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:2.0:1787397924.131700:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.131710:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a400, rc 0) 00000100:00100000:2.0:1787397924.131774:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681300736:12345-192.168.204.60@tcp:101:rm.0 Request processed in 912us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.131782:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1604 00000100:00100000:2.0:1787397924.135880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397924.135949:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681300992 00000100:00100000:0.0:1787397924.135960:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681300992 00000100:00100000:0.0:1787397924.136018:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1605 00000100:00100000:0.0:1787397924.136027:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681300992:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397924.136093:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787397924.136123:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a400/0x274786fe0d192999 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85fc expref: 60 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136147:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135800/0x274786fe0d191f5f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8404 expref: 59 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136181:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d191b3e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82de expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136192:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a82e43e700) 00010000:00010000:0.0:1787397924.136204:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397924.136225:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136249:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136260:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136275:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136283:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136290:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136370:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136378:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136384:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397924.136646:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].13, 64 off9024 00010000:00010000:0.0:1787397924.136703:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136712:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136720:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136727:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136733:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136739:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136752:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397924.136769:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136775:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136781:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136786:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.136790:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136806:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136815:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a81ab0c500) 00010000:00010000:0.0:1787397924.136817:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.136821:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136826:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929ae lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136842:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136847:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136853:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136858:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136863:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.136866:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136872:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136879:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.136887:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.136891:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136897:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929a0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397924.136908:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002fbc30ae reply state 00000000300df6d5 transno 120259084456 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136919:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.136925:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a81ab0ce00) 00010000:00010000:0.0:1787397924.136927:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397924.136930:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397924.139069:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681300992:12345-192.168.204.60@tcp:36:rm.0 Request processed in 3032us (3187us total) trans 120259084456 rc 0/0 00000100:00100000:0.0:1787397924.139083:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1605 00010000:00010000:1.0:1787397924.139428:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397924.139438:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.139447:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397924.139451:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.139461:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.139476:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff89a81ab0c500) 00010000:00010000:1.0:1787397924.139479:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787397924.139482:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.139488:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55200/0x274786fe0d1929b5 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.139507:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.139509:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397924.139511:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397924.144442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.144561:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681301120 00000100:00100000:2.0:1787397924.144571:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681301120 00000100:00100000:2.0:1787397924.144624:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1606 00000100:00100000:2.0:1787397924.144645:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681301120:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.144670:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.144691:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1929bc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8603 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144761:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144778:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144790:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144804:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144811:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144817:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144910:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144920:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.144927:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.144972:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.144976:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.144995:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145006:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145015:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145023:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145029:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145035:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145041:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.145045:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145059:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145072:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.145075:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.145093:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145100:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d1929c3 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145115:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145120:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145127:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145133:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.145136:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145143:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145151:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a82df32400) 00010000:00010000:2.0:1787397924.145153:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.145156:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145171:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d1929ca lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145203:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b200/0x274786fe0d1929bc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8603 expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145216:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8603 expref: 60 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.145223:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:2.0:1787397924.145225:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.145227:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b800, rc 0) 00000100:00100000:2.0:1787397924.145291:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681301120:12345-192.168.204.60@tcp:101:rm.0 Request processed in 647us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.145299:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1606 00000100:00100000:1.0:1787397924.150331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.150706:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681301376 00000100:00100000:3.0:1787397924.150717:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681301376 00000100:00100000:3.0:1787397924.150776:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1607 00000100:00100000:3.0:1787397924.150786:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681301376:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.150846:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.150876:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b800/0x274786fe0d1929d1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8603 expref: 60 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.150899:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d191f19 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83ef expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.150912:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d191aab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82b4 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.150923:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397924.150933:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.150972:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.150999:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151011:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151026:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151032:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151037:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151123:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151131:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151139:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.151344:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].14, 64 off9088 00010000:00010000:3.0:1787397924.151393:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151401:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151418:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151426:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151432:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151438:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151460:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.151478:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151485:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151491:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151496:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.151500:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151507:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151515:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a806066200) 00010000:00010000:3.0:1787397924.151517:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.151557:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151563:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1929e6 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151579:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151585:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151591:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151596:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.151599:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151605:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151613:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.151616:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.151618:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151624:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1929d8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.151645:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092f97ef3 reply state 000000000082b606 transno 120259084457 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151670:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.151676:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a806066700) 00010000:00010000:3.0:1787397924.151679:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.151681:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.151758:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681301376:12345-192.168.204.60@tcp:36:rm.0 Request processed in 973us (1437us total) trans 120259084457 rc 0/0 00000100:00100000:3.0:1787397924.151767:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1607 00010000:00010000:0.0:1787397924.152540:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.152549:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.152558:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.152563:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.152570:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.152582:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff89a806066200) 00010000:00010000:0.0:1787397924.152585:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.152597:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.152604:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1929ed lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.152620:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.152622:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.152634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.154569:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397924.155519:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681301504 00000100:00100000:0.0:1787397924.155544:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681301504 00000100:00100000:0.0:1787397924.155604:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1608 00000100:00100000:0.0:1787397924.155615:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681301504:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397924.155650:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397924.155671:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929f4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d860a expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155742:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155758:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155769:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155783:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155789:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155812:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155887:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155896:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155903:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397924.155944:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 1024 00000004:00200000:0.0:1787397924.155949:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397924.155969:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155981:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155991:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.155998:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156004:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156009:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156026:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.156030:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156037:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156048:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.156051:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.156055:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156062:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d1929fb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156080:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156088:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156094:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156099:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.156102:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156107:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156126:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a81ab0c000) 00010000:00010000:0.0:1787397924.156128:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.156131:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156137:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a02 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156417:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54800/0x274786fe0d1929f4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d860a expref: 61 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156431:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d860a expref: 60 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.156438:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:0.0:1787397924.156440:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787397924.156443:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55e00, rc 0) 00000100:00100000:0.0:1787397924.156720:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681301504:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1106us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397924.156729:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1608 00000100:00100000:1.0:1787397924.165484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.165976:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681301760 00000100:00100000:2.0:1787397924.165987:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681301760 00000100:00100000:2.0:1787397924.166056:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1609 00000100:00100000:2.0:1787397924.166066:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681301760:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397924.166123:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397924.166152:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55e00/0x274786fe0d192a09 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d860a expref: 60 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166261:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d191ed3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83d3 expref: 59 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166297:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d191a7a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82a6 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166309:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82e43e600) 00010000:00010000:2.0:1787397924.166320:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397924.166341:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166354:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166363:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166376:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166382:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166388:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166472:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166479:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166486:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397924.166755:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].15, 64 off9152 00010000:00010000:2.0:1787397924.166809:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166817:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166825:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166831:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166838:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.166843:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172831:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397924.172877:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172889:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172897:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172903:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.172908:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172934:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172951:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.172954:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397924.172959:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172966:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a1e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172993:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.172999:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173006:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173011:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173016:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.173019:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173025:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173031:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.173038:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.173042:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173048:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a10 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397924.173058:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e0a36c7 reply state 00000000cfb7b315 transno 120259084458 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173070:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.173077:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a82df32400) 00010000:00010000:2.0:1787397924.173079:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397924.173082:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397924.173176:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681301760:12345-192.168.204.60@tcp:36:rm.0 Request processed in 7105us (7702us total) trans 120259084458 rc 0/0 00000100:00100000:2.0:1787397924.173185:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1609 00010000:00010000:2.0:1787397924.176445:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397924.176462:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.176474:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397924.176479:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.176489:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.176507:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.176510:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787397924.176560:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.176566:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a25 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.176591:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397924.176592:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397924.176594:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397924.181077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.181950:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681301888 00000100:00100000:3.0:1787397924.181963:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681301888 00000100:00100000:3.0:1787397924.182038:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1610 00000100:00100000:3.0:1787397924.182049:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681301888:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397924.182076:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397924.182098:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192a2c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8611 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182182:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182197:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182218:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182235:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182258:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182265:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182352:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182361:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182367:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397924.182407:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 1024 00000004:00200000:3.0:1787397924.182411:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397924.182431:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182442:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182464:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182471:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182477:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182493:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.182498:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182506:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182518:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.182547:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.182553:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182560:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a33 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182574:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182580:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182587:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182591:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.182594:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182599:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182618:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a806066300) 00010000:00010000:3.0:1787397924.182620:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.182623:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182642:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a3a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182675:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192a2c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8611 expref: 61 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182689:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8611 expref: 60 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.182696:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:3.0:1787397924.182698:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397924.182701:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:3.0:1787397924.182776:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681301888:12345-192.168.204.60@tcp:101:rm.0 Request processed in 729us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397924.182784:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1610 00000100:00100000:0.0:1787397924.196059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.196161:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681302144 00000100:00100000:2.0:1787397924.196171:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681302144 00000100:00100000:2.0:1787397924.196229:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1611 00000100:00100000:2.0:1787397924.196249:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681302144:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397924.196304:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397924.196331:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a41 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8611 expref: 60 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196354:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192054 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d845f expref: 59 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196368:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a800030e00/0x274786fe0d191ba0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82fa expref: 58 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196378:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82e43ea00) 00010000:00010000:2.0:1787397924.196389:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397924.196411:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196423:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196449:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196464:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196472:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196478:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196621:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196640:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196647:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397924.196858:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].16, 64 off9216 00010000:00010000:2.0:1787397924.196909:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196918:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196926:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196934:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196946:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.196952:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197170:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397924.197190:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197196:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197202:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197208:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.197213:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197221:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197231:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82df32500) 00010000:00010000:2.0:1787397924.197234:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787397924.197237:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197244:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192a56 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197261:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197273:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197279:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197285:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197290:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.197293:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197299:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197309:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.197311:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.197314:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197320:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192a48 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397924.197330:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075b9190b reply state 00000000bb1db77d transno 120259084459 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197340:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.197345:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a82df32f00) 00010000:00010000:2.0:1787397924.197357:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397924.197361:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397924.197462:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681302144:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1221us (1409us total) trans 120259084459 rc 0/0 00000100:00100000:2.0:1787397924.197470:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1611 00010000:00010000:3.0:1787397924.200345:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397924.200359:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.200368:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397924.200373:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.200401:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.200418:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff89a82df32500) 00010000:00010000:3.0:1787397924.200421:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397924.200425:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.200430:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192a5d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.200453:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.200455:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.200457:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.203667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.203743:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681302272 00000100:00100000:3.0:1787397924.203755:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681302272 00000100:00100000:3.0:1787397924.203822:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1612 00000100:00100000:3.0:1787397924.203832:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681302272:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397924.203858:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397924.203880:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192a64 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8618 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.203946:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.203961:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.203973:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.203999:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204007:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204015:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204103:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204113:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204120:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397924.204171:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 1024 00000004:00200000:3.0:1787397924.204176:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397924.204194:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204214:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204224:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204232:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204248:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204256:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204262:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.204266:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204274:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204286:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.204289:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.204293:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204300:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d192a6b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204313:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204319:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204807:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204813:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.204825:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204833:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204843:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a806066300) 00010000:00010000:3.0:1787397924.204846:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.204849:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204855:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d192a72 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204892:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d192a64 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8618 expref: 61 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204904:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8618 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.204912:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:3.0:1787397924.204915:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397924.204918:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23800, rc 0) 00000100:00100000:0.0:1787397924.205053:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681302272:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1219us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397924.205062:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1612 00000100:00100000:1.0:1787397924.208781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.208924:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681302528 00000100:00100000:3.0:1787397924.208934:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681302528 00000100:00100000:3.0:1787397924.209000:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1613 00000100:00100000:3.0:1787397924.209011:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681302528:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.209068:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.209097:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d192a79 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8618 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209134:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8016a0400/0x274786fe0d192299 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d851c expref: 59 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209147:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d191d59 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8378 expref: 58 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209157:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a82ebb1a00) 00010000:00010000:3.0:1787397924.209169:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.209202:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209214:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209224:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209247:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209257:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209264:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209348:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209356:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209370:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.209790:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].17, 64 off9280 00010000:00010000:3.0:1787397924.209844:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209854:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209862:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209869:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209875:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209880:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209895:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.209912:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209918:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209923:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209943:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.209946:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209953:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209963:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a806066400) 00010000:00010000:3.0:1787397924.209965:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.209968:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209973:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d192a8e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209988:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209993:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.209998:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210002:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.210004:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210008:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210024:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.210026:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.210029:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210034:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d192a80 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.210042:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb42d627 reply state 0000000070dbea15 transno 120259084460 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210053:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.210059:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a806066800) 00010000:00010000:3.0:1787397924.210062:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.210064:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.210150:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681302528:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1139us (1378us total) trans 120259084460 rc 0/0 00000100:00100000:3.0:1787397924.210158:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1613 00010000:00010000:0.0:1787397924.210248:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.210255:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.210271:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.210275:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.210281:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.210291:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff89a806066400) 00010000:00010000:0.0:1787397924.210293:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.210296:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.210302:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583c00/0x274786fe0d192a95 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.210318:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.210320:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.210322:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.214901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397924.214986:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681302784 00000100:00100000:0.0:1787397924.214997:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681302784 00000100:00100000:0.0:1787397924.215061:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1614 00000100:00100000:0.0:1787397924.215072:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+59:75239:x1874218681302784:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397924.215130:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397924.215156:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d1926d6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d858c expref: 59 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215177:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x2f:0x0].0x0 (ffff89a806066b00) 00010000:00010000:0.0:1787397924.215187:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397924.215226:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215250:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215261:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215272:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215279:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215284:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215362:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215369:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215375:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397924.215605:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].18, 64 off9344 00010000:00010000:0.0:1787397924.215671:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215680:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215699:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215707:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215713:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215719:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215740:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397924.215760:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215766:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215772:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215778:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.215782:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215790:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215798:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x2f:0x0].0x0 (ffff89a81ab0c000) 00010000:00010000:0.0:1787397924.215802:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.215812:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215818:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192aaa lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215835:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215841:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215847:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215852:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215856:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.215859:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215864:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215872:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.215879:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.215882:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215890:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192a9c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397924.215900:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f922941a reply state 00000000bcd344c5 transno 120259084461 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215917:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.215924:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8d93425 (ffff89a806066e00) 00010000:00010000:0.0:1787397924.215927:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397924.215930:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397924.216010:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681302784:12345-192.168.204.60@tcp:36:rm.0 Request processed in 938us (1118us total) trans 120259084461 rc 0/0 00000100:00100000:0.0:1787397924.216019:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1614 00010000:00010000:3.0:1787397924.217103:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397924.217112:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.217119:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397924.217124:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.217131:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.217158:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x2f:0x0].0x0 (ffff89a81ab0c000) 00010000:00010000:3.0:1787397924.217160:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397924.217164:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.217168:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d192ab1 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.217198:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.217200:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.217202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.220694:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.221842:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681302912 00000100:00100000:2.0:1787397924.221857:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681302912 00000100:00100000:2.0:1787397924.221924:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1615 00000100:00100000:2.0:1787397924.221936:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681302912:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.221961:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.221981:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192ab8 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d861f expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222051:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222067:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222078:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222092:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222100:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222107:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222205:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222215:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222221:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.222262:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.222266:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.222283:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222293:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222302:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222308:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222313:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222318:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222323:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.222327:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222342:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222355:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.222357:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.222362:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222367:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192abf lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222382:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222387:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222393:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222398:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.222401:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222407:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222412:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a82df32b00) 00010000:00010000:2.0:1787397924.222415:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.222417:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222432:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192ac6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222464:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a600/0x274786fe0d192ab8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d861f expref: 62 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222477:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d861f expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.222483:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:2.0:1787397924.222486:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.222488:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00000100:00100000:2.0:1787397924.222574:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681302912:12345-192.168.204.60@tcp:101:rm.0 Request processed in 641us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.222583:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1615 00000100:00100000:2.0:1787397924.228014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.228068:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681303168 00000100:00100000:3.0:1787397924.228078:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681303168 00000100:00100000:3.0:1787397924.228131:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1616 00000100:00100000:3.0:1787397924.228140:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681303168:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.228190:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.228216:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a000/0x274786fe0d192acd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d861f expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228256:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192150 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84ac expref: 60 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228270:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d191c64 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8332 expref: 59 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228281:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a82ebb1e00) 00010000:00010000:3.0:1787397924.228291:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.228322:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228335:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228345:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228358:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228364:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228370:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228441:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228448:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228456:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.228780:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].19, 64 off9408 00010000:00010000:3.0:1787397924.228823:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228832:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228850:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228859:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228866:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228872:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228894:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.228911:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228916:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228922:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228928:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.228932:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228940:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.228947:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a806066b00) 00010000:00010000:0.0:1787397924.229159:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.229167:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229188:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.229197:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229204:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192ae2 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229220:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229241:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229248:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229253:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.229256:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229263:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229270:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.229273:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.229276:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229281:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192ad4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.229290:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031d0d2cc reply state 000000001299836b transno 120259084462 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229311:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.229317:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a806066300) 00010000:00010000:3.0:1787397924.229320:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.229322:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.229394:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681303168:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1253us (1389us total) trans 120259084462 rc 0/0 00000100:00100000:3.0:1787397924.229403:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1616 00000100:00100000:1.0:1787397924.232298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.233062:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681303296 00000100:00100000:3.0:1787397924.233074:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681303296 00000100:00100000:3.0:1787397924.233130:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1617 00000100:00100000:3.0:1787397924.233139:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681303296:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397924.233164:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397924.233185:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192af0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8626 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233264:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233278:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233288:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233303:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233326:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233332:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233404:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233412:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233419:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397924.233459:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 1024 00000004:00200000:3.0:1787397924.233463:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397924.233482:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233494:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233503:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233509:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233515:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233562:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233568:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.233573:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233581:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233593:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.233596:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.233601:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233607:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192af7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233632:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233639:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233645:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233651:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.233654:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233670:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233679:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a806066400) 00010000:00010000:3.0:1787397924.233681:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.233684:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233691:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192afe lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233724:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192af0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8626 expref: 62 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233737:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8626 expref: 61 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.233744:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397924.233746:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397924.233749:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582600, rc 0) 00000100:00100000:3.0:1787397924.233816:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681303296:12345-192.168.204.60@tcp:101:rm.0 Request processed in 678us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397924.233824:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1617 00010000:00010000:0.0:1787397924.235470:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.235481:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.235495:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.235512:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff89a806066b00) 00010000:00010000:0.0:1787397924.235515:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.235519:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.237844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192ae9 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.237874:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.237876:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.239712:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.240732:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397924.240865:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681303552 00000100:00100000:0.0:1787397924.240876:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681303552 00000100:00100000:0.0:1787397924.240939:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1618 00000100:00100000:0.0:1787397924.240950:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681303552:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397924.241008:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787397924.241036:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192b05 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8626 expref: 61 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241059:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d191f9e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8420 expref: 60 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241070:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d191b0d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d82d0 expref: 59 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241080:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:0.0:1787397924.241093:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397924.241114:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241126:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241135:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241159:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241167:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241180:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241265:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241274:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241281:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397924.241477:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].20, 64 off9472 00010000:00010000:0.0:1787397924.241555:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241565:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241573:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241580:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241585:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241590:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241615:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397924.241669:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397924.241679:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.241703:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397924.241708:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.241716:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.241727:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a81ab0c600) 00010000:00010000:2.0:1787397924.241736:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787397924.241740:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.241745:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d192b21 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.241754:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397924.241756:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397924.241758:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.241860:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241867:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241873:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241878:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.241882:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241887:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241895:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff89a81ab0c600) 00010000:00010000:0.0:1787397924.241897:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.241900:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241905:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d192b1a lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241924:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241931:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241936:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241941:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241953:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397924.241956:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241962:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241971:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:0.0:1787397924.241973:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397924.241976:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.241982:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d192b0c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397924.241991:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de2e6c2d reply state 00000000660b24a8 transno 120259084463 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.242001:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.242007:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a81ab0c300) 00010000:00010000:0.0:1787397924.242009:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397924.242012:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397924.242094:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681303552:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1143us (1367us total) trans 120259084463 rc 0/0 00000100:00100000:0.0:1787397924.242102:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1618 00000100:00100000:2.0:1787397924.245686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397924.245827:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681303680 00000100:00100000:1.0:1787397924.245837:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681303680 00000100:00100000:1.0:1787397924.245904:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1619 00000100:00100000:1.0:1787397924.245914:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681303680:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787397924.245940:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397924.245961:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192b28 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d862d expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246027:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246042:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246052:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246066:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246072:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246079:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246160:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246169:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246192:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397924.246234:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 1024 00000004:00200000:1.0:1787397924.246251:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397924.246274:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246286:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246295:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246301:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246308:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246314:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246320:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397924.246323:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246331:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246342:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397924.246350:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397924.246355:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246362:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b2f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246377:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246382:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246387:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246392:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397924.246394:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246400:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246407:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a70c7dc100) 00010000:00010000:1.0:1787397924.246409:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397924.246412:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246418:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192b36 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246448:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192b28 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d862d expref: 62 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246473:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d862d expref: 61 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.246480:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:1.0:1787397924.246482:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787397924.246484:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:1.0:1787397924.249782:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681303680:12345-192.168.204.60@tcp:101:rm.0 Request processed in 3856us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397924.249797:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1619 00000100:00100000:1.0:1787397924.254951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.255040:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681303936 00000100:00100000:3.0:1787397924.255051:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681303936 00000100:00100000:3.0:1787397924.255112:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1620 00000100:00100000:3.0:1787397924.255121:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681303936:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.257782:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.257824:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192b3d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d862d expref: 61 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257850:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582e00/0x274786fe0d1921a4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d84c8 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257865:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d191cc6 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d834e expref: 59 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257875:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a82e43e400) 00010000:00010000:3.0:1787397924.257887:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.257913:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257926:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257935:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257950:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257957:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.257964:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258065:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258074:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258080:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.258876:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].21, 64 off9536 00010000:00010000:3.0:1787397924.258934:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258945:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258953:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258960:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258965:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258971:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.258985:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.259004:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259022:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259028:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259034:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.259038:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259046:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259057:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a806066200) 00010000:00010000:0.0:1787397924.259057:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397924.259060:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397924.259063:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259064:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259070:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192b52 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259078:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.259081:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259087:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259088:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259094:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259095:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff89a806066200) 00010000:00010000:0.0:1787397924.259098:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787397924.259101:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259101:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259107:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259107:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192b59 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259116:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.259120:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.259121:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.259123:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.259125:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.259126:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259133:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.259136:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.259139:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259144:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b44 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.259154:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b4d371e reply state 0000000073401b8f transno 120259084464 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259164:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.259170:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a806066400) 00010000:00010000:3.0:1787397924.259172:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.259175:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787397924.259292:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681303936:12345-192.168.204.60@tcp:36:rm.0 Request processed in 4167us (4346us total) trans 120259084464 rc 0/0 00000100:00100000:3.0:1787397924.259302:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1620 00000100:00100000:3.0:1787397924.266251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.266375:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681304064 00000100:00100000:2.0:1787397924.266385:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681304064 00000100:00100000:2.0:1787397924.266476:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1621 00000100:00100000:2.0:1787397924.266487:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681304064:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397924.266510:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397924.266589:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192b60 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8634 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266672:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266687:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266700:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266717:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266723:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266745:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266833:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266843:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266850:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397924.266918:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 1024 00000004:00200000:2.0:1787397924.266922:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397924.266941:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266953:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266962:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266969:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266975:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266981:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.266996:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.267000:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267006:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267018:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:2.0:1787397924.267020:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.267024:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267030:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d192b67 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267042:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267048:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267054:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267058:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397924.267061:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267066:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267084:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a82df32b00) 00010000:00010000:2.0:1787397924.267087:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397924.267089:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267095:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d192b6e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267125:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192b60 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8634 expref: 62 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267137:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8634 expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397924.267144:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:2.0:1787397924.267146:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787397924.267149:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720bc00, rc 0) 00000100:00100000:2.0:1787397924.267209:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681304064:12345-192.168.204.60@tcp:101:rm.0 Request processed in 723us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397924.267217:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1621 00000100:00100000:1.0:1787397924.272760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397924.272936:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681304320 00000100:00100000:3.0:1787397924.272945:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681304320 00000100:00100000:3.0:1787397924.273013:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1622 00000100:00100000:3.0:1787397924.273022:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681304320:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787397924.273074:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787397924.273100:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192b75 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8634 expref: 61 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273122:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d192341 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d854d expref: 60 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273136:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a135600/0x274786fe0d191dec lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83a2 expref: 59 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273146:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a82ebb1d00) 00010000:00010000:3.0:1787397924.273156:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397924.273176:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273189:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273199:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273214:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273221:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273227:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273326:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273334:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.273341:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787397924.273512:0:74374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].22, 64 off9600 00010000:00010000:3.0:1787397924.274085:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274096:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274104:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274113:0:74374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274119:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274125:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274144:0:74374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397924.274161:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274177:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274183:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274189:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.274193:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274200:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274211:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a806066b00) 00010000:00010000:3.0:1787397924.274214:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787397924.274217:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274260:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397924.274267:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274273:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397924.274276:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274282:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274291:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff89a806066b00) 00010000:00010000:0.0:1787397924.274301:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397924.274304:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274310:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192b91 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397924.274321:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.274323:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397924.274325:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397924.274450:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582000/0x274786fe0d192b8a lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274475:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274480:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274485:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274490:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397924.274500:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274506:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274514:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:3.0:1787397924.274517:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397924.274705:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274713:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d192b7c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397924.274724:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd543890 reply state 00000000d811ce9a transno 120259084465 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274736:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397924.274742:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a806066900) 00010000:00010000:3.0:1787397924.274745:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397924.274747:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787397924.274906:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681304320:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1880us (2148us total) trans 120259084465 rc 0/0 00000100:00100000:2.0:1787397924.274917:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1622 00000100:00100000:1.0:1787397924.280934:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397924.281031:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681304576 00000100:00100000:2.0:1787397924.281041:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681304576 00000100:00100000:2.0:1787397924.281099:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 285 00000100:00100000:2.0:1787397924.281110:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8040bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681304576:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787397924.281372:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8040bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681304576:12345-192.168.204.60@tcp:35:rm.0 Request processed in 264us (448us total) trans 120259084466 rc 0/0 00000100:00100000:2.0:1787397924.281380:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 285 00000100:00100000:2.0:1787397924.286270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397924.286422:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681304832 00000100:00100000:1.0:1787397924.286432:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681304832 00000100:00100000:1.0:1787397924.286509:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1623 00000100:00100000:1.0:1787397924.286569:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+61:75239:x1874218681304832:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787397924.286643:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787397924.286678:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719600/0x274786fe0d19270e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d85a8 expref: 61 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286702:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d191a49 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8298 expref: 60 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286717:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a817ea6900) 00010000:00010000:1.0:1787397924.286735:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70a134000/0x274786fe0d191e7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d83c5 expref: 59 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286762:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397924.286766:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397924.286793:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286806:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286815:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286828:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286834:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286839:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286929:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286937:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.286944:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397924.287175:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1787397924.287190:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287202:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287209:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287215:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397924.287219:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287226:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287235:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff89a70c7dce00) 00010000:00010000:1.0:1787397924.287237:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787397924.287241:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287246:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192ba6 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287266:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287272:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287278:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287283:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287293:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397924.287296:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287302:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287310:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397924.287312:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397924.287315:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287321:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192b98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397924.287330:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095749060 reply state 000000000870cd96 transno 120259084467 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287340:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397924.287345:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a70c7dc100) 00010000:00010000:1.0:1787397924.287347:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397924.287350:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397924.287433:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:75239:x1874218681304832:12345-192.168.204.60@tcp:36:rm.0 Request processed in 914us (1171us total) trans 120259084467 rc 0/0 00000100:00100000:1.0:1787397924.287441:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1623 00010000:00010000:3.0:1787397924.708777:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397924.836957:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701207296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397924.837039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397924.837109:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397924.837116:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701207424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397924.837141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397924.837224:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207296 00000100:00100000:0.0:1787397924.837232:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207296 00000100:00100000:0.0:1787397924.837273:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207424 00000100:00100000:0.0:1787397924.837276:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207424 00000100:00100000:0.0:1787397924.837293:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397924.837302:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701207296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397924.837327:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397924.837391:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701207296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397924.837399:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787397924.837416:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787397924.837422:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701207424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397924.837432:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397924.837455:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701207424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397924.837461:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787397924.837580:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a828cf8700 x1874218701207424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397924.837601:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701207424:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787397924.837625:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705986d80 x1874218701207296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397924.837636:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701207296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397925.350870:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701207552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397925.350950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397925.351032:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207552 00000100:00100000:1.0:1787397925.351041:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207552 00000100:00100000:1.0:1787397925.351097:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787397925.351106:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701207552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787397925.351149:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:1.0:1787397925.351205:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701207552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397925.351212:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787397925.351295:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701207552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397925.352775:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701207680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397925.352831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397925.353001:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207680 00000100:00100000:2.0:1787397925.353008:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207680 00000100:00100000:2.0:1787397925.353050:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787397925.353058:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701207680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397925.353087:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:2.0:1787397925.353136:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701207680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397925.353144:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397925.360057:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701207680:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787397925.732770:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397926.761670:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397927.780994:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787397927.909198:0:94348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3807199672140ns, next at 3808199669345ns, rc = 0 00000100:00100000:3.0:1787397927.909292:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397927.909312:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397927.909382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397927.909870:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207808 00000100:00100000:0.0:1787397927.909879:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207808 00000100:00100000:0.0:1787397927.909944:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787397927.909956:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701207808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397927.909988:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:0.0:1787397927.910039:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701207808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397927.910047:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787397927.910069:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397927.910109:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787397927.910373:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701207936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397927.910424:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397927.910546:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701207936 00000100:00100000:2.0:1787397927.910561:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701207936 00000100:00100000:2.0:1787397927.910611:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397927.910619:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701207936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397927.910632:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923431424 avail 3691909120 00000100:00100000:2.0:1787397927.910671:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701207936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397927.910678:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787397927.910730:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701207936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787397927.910786:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397928.425165:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701208064:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425316:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701208576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701209088:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425450:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787397928.425456:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701208192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425507:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701208704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425610:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701209216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425668:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701208448:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425711:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701208960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425732:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425751:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787397928.425757:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701208320:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425796:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701208832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425854:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701209344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.425875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397928.425908:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208064 00000100:00100000:3.0:1787397928.425917:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208064 00000100:00100000:3.0:1787397928.425971:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787397928.425980:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701208064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426039:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701208064:12345-0@lo:400:kworker.0 Request processed in 59us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426055:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1787397928.426102:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208576 00000100:00100000:3.0:1787397928.426106:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208576 00000100:00100000:3.0:1787397928.426125:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208192 00000100:00100000:3.0:1787397928.426128:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208192 00000100:00100000:3.0:1787397928.426140:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397928.426146:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701208576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426182:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701208576:12345-0@lo:400:kworker.0 Request processed in 36us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426189:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397928.426202:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397928.426208:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701208192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426234:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701208192:12345-0@lo:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426240:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397928.426260:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208704 00000100:00100000:3.0:1787397928.426263:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208704 00000100:00100000:3.0:1787397928.426301:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208320 00000100:00100000:3.0:1787397928.426304:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208320 00000100:00100000:3.0:1787397928.426322:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397928.426328:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701208704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426358:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701208704:12345-0@lo:400:kworker.0 Request processed in 30us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426364:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397928.426375:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397928.426381:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701208320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426422:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701208320:12345-0@lo:400:kworker.0 Request processed in 41us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426428:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397928.426447:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209088 00000100:00100000:3.0:1787397928.426451:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209088 00000100:00100000:3.0:1787397928.426471:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209216 00000100:00100000:3.0:1787397928.426473:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209216 00000100:00100000:3.0:1787397928.426483:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208448 00000100:00100000:3.0:1787397928.426485:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208448 00000100:00100000:3.0:1787397928.426495:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208960 00000100:00100000:3.0:1787397928.426497:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208960 00000100:00100000:3.0:1787397928.426507:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701208832 00000100:00100000:3.0:1787397928.426509:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701208832 00000100:00100000:3.0:1787397928.426518:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209344 00000100:00100000:3.0:1787397928.426566:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209344 00000100:00100000:3.0:1787397928.426585:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1787397928.426590:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701209088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426620:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701209088:12345-0@lo:400:kworker.0 Request processed in 30us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426626:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1787397928.426638:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1787397928.426644:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701209216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426670:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701209216:12345-0@lo:400:kworker.0 Request processed in 27us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426676:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1787397928.426687:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1787397928.426693:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701208448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426718:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701208448:12345-0@lo:400:kworker.0 Request processed in 26us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426731:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1787397928.426744:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1787397928.426750:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701208960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426779:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701208960:12345-0@lo:400:kworker.0 Request processed in 30us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426785:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1787397928.426796:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1787397928.426802:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701208832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426828:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701208832:12345-0@lo:400:kworker.0 Request processed in 26us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426833:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1787397928.426844:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1787397928.426849:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701209344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.426877:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701209344:12345-0@lo:400:kworker.0 Request processed in 28us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397928.426883:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00080000:3.0:1787397928.426918:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397928.426922:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397928.426925:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787397928.426974:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70aa91f80 x1874218701208320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397928.426991:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701208320:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427005:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701208832:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427016:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701209344:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427037:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701208448:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427047:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701208960:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701208192:0@lo:400:kworker.0 00010000:00080000:3.0:1787397928.427102:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70aa91c00 x1874218701208704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397928.427111:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701208704:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427120:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701209216:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427128:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701208064:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427136:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701208576:0@lo:400:kworker.0 00000100:00100000:3.0:1787397928.427144:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701209088:0@lo:400:kworker.0 00000100:00100000:1.0:1787397928.714118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397928.714177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397928.714215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397928.714241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397928.714264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397928.714296:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305472 00000100:00100000:1.0:1787397928.714306:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305472 00000100:00100000:1.0:1787397928.714364:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305344 00000100:00100000:1.0:1787397928.714368:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305344 00000100:00100000:1.0:1787397928.714393:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:1.0:1787397928.714412:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681305472:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397928.714480:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681305472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397928.714488:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:1.0:1787397928.714508:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787397928.714514:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681305344:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397928.714580:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681305344:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 65us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397928.714587:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787397928.714608:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305216 00000100:00100000:1.0:1787397928.714612:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305216 00000100:00100000:1.0:1787397928.714703:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305088 00000100:00100000:1.0:1787397928.714707:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305088 00000100:00100000:1.0:1787397928.714732:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1614 00000100:00100000:1.0:1787397928.714738:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681305216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397928.714767:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681305216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397928.714773:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1614 00000100:00100000:1.0:1787397928.714786:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1615 00000100:00100000:1.0:1787397928.714792:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:2405:x1874218681305088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397928.714819:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+60:2405:x1874218681305088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397928.714825:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1615 00000100:00080000:1.0:1787397928.714844:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397928.714853:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397928.714856:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397928.714858:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397928.714985:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681304960 00000100:00100000:2.0:1787397928.714990:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681304960 00000100:00100000:2.0:1787397928.715033:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 337 00000100:00100000:2.0:1787397928.715040:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681304960:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397928.715065:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681304960:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397928.715071:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 337 00010000:00010000:1.0:1787397928.804782:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787397929.455178:0:94328:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787397929.455232:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084467 is committed 00000004:00080000:0.0:1787397929.455263:0:94328:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787397929.455296:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455308:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455316:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455346:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455351:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455359:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455378:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8d93425 (ffff89a806066e00) 00010000:00010000:0.0:1787397929.455381:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455386:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455393:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1926cf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455410:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455416:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455421:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455425:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455428:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455433:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455450:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff89a82df32100) 00010000:00010000:0.0:1787397929.455452:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455455:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455461:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719a00/0x274786fe0d19273f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455476:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455481:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455486:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455490:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455492:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455496:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455502:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff89a82df32600) 00010000:00010000:0.0:1787397929.455504:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455506:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455511:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718600/0x274786fe0d192777 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455554:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455561:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455566:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455571:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455574:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455579:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455587:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff89a806066600) 00010000:00010000:0.0:1787397929.455589:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455591:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455596:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1927af lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455606:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455612:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455618:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455629:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808718200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455632:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455638:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455645:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff89a82df32200) 00010000:00010000:0.0:1787397929.455647:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455650:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455655:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808718200/0x274786fe0d1927e7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455668:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455674:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455680:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455685:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a808719800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455688:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455693:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455710:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff89a82df32a00) 00010000:00010000:0.0:1787397929.455713:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455715:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455722:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a808719800/0x274786fe0d19281f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455735:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455741:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455747:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455753:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455755:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455761:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455768:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff89a81ab0cf00) 00010000:00010000:0.0:1787397929.455771:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455773:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455779:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d192857 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455800:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455806:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455811:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455816:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455819:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455825:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455833:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff89a806066000) 00010000:00010000:0.0:1787397929.455835:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455837:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455842:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19288f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455857:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455864:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455869:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455881:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455884:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455890:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455898:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff89a82df32c00) 00010000:00010000:0.0:1787397929.455901:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455903:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455909:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a800/0x274786fe0d1928c7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455923:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455929:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455935:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455940:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.455943:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455949:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455966:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff89a82df32000) 00010000:00010000:0.0:1787397929.455968:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.455972:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455977:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d1928ff lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455992:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.455998:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456004:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456009:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456011:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456017:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456024:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff89a82df32e00) 00010000:00010000:0.0:1787397929.456026:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456029:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456034:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ae00/0x274786fe0d192937 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456056:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456063:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456069:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456074:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456077:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456082:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456090:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff89a806066500) 00010000:00010000:0.0:1787397929.456092:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456095:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456101:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19296f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456114:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456120:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456126:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456138:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456141:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456148:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456156:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff89a81ab0ce00) 00010000:00010000:0.0:1787397929.456159:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456161:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456167:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d1929a7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456180:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456186:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456191:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456196:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456198:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456204:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456222:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff89a806066700) 00010000:00010000:0.0:1787397929.456224:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456227:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456233:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1929df lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456247:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456253:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456259:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456264:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456266:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456273:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456280:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff89a82df32400) 00010000:00010000:0.0:1787397929.456283:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456286:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456291:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b000/0x274786fe0d192a17 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456312:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456317:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456323:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456327:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456330:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456336:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456344:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff89a82df32f00) 00010000:00010000:0.0:1787397929.456346:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456348:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456353:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b400/0x274786fe0d192a4f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456365:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456370:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456375:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456385:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456387:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456394:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456401:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff89a806066800) 00010000:00010000:0.0:1787397929.456403:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456406:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456411:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d192a87 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456424:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456430:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456435:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456439:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456442:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456447:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456467:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8d93425 (ffff89a806066e00) 00010000:00010000:0.0:1787397929.456469:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456472:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456478:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54a00/0x274786fe0d192aa3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456491:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456496:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456501:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456506:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456508:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456513:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456556:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff89a806066300) 00010000:00010000:0.0:1787397929.456559:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456562:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456568:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192adb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456591:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456598:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456604:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456608:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456611:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456616:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456623:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff89a81ab0c300) 00010000:00010000:0.0:1787397929.456625:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456627:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456633:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55a00/0x274786fe0d192b13 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456645:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456651:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456656:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456667:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456670:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456675:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456683:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff89a806066400) 00010000:00010000:0.0:1787397929.456686:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456688:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456693:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192b4b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456708:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456713:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456718:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456723:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456725:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456731:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456749:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff89a806066900) 00010000:00010000:0.0:1787397929.456751:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456753:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456758:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192b83 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456773:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456779:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456784:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456789:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397929.456791:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456797:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456806:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff89a70c7dc100) 00010000:00010000:0.0:1787397929.456808:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397929.456811:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.456816:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192b9f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397929.457250:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457392:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457418:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457440:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787397929.457446:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457477:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457493:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457514:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701209600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457573:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701210112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457600:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397929.457604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701209728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457629:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701210240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.457645:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.457671:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209856 00000100:00100000:1.0:1787397929.457679:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209856 00000100:00100000:1.0:1787397929.457722:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210368 00000100:00100000:1.0:1787397929.457725:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210368 00000100:00100000:1.0:1787397929.457735:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209472 00000100:00100000:1.0:1787397929.457746:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209472 00000100:00100000:1.0:1787397929.457757:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209984 00000100:00100000:1.0:1787397929.457758:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209984 00000100:00100000:1.0:1787397929.457766:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209600 00000100:00100000:1.0:1787397929.457768:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209600 00000100:00100000:1.0:1787397929.457775:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210112 00000100:00100000:1.0:1787397929.457777:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210112 00000100:00100000:1.0:1787397929.457785:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701209728 00000100:00100000:1.0:1787397929.457787:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701209728 00000100:00100000:1.0:1787397929.457796:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210240 00000100:00100000:1.0:1787397929.457798:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210240 00000100:00100000:1.0:1787397929.457812:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787397929.457820:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3650:x1874218701209856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.457847:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1907 count 1 00000100:00100000:1.0:1787397929.458008:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787397929.458016:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3650:x1874218701210368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.458028:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1901 count 1 00000100:00080000:1.0:1787397929.458089:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787397929.458655:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.458665:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.458681:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.458686:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.458692:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.458708:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.458729:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.458736:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.458756:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787397929.458923:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3650:x1874218701210368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 906us (1502us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787397929.458931:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787397929.458955:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787397929.458963:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3650:x1874218701209472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.458977:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1904 count 1 00002000:00010000:1.0:1787397929.461411:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.461427:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.461444:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.461448:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.461454:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.461467:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.461488:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.461496:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.462951:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397929.462964:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.462978:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.462983:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.462995:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463017:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463033:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192bad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463058:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397929.463062:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463069:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.463072:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463080:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463089:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463097:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.463099:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.463101:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.463190:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.463198:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463207:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.463217:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.463222:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463233:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463242:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463250:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.463270:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.464195:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3650:x1874218701209856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6371us (6874us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787397929.464213:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787397929.464250:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397929.464263:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3650:x1874218701209984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.464294:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1895 count 1 00010000:00010000:1.0:1787397929.464420:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397929.464430:0:99640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397929.464571:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3650:x1874218701209472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5609us (7105us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1787397929.464578:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787397929.464594:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397929.464601:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701209600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.464612:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1899 count 1 00002000:00010000:1.0:1787397929.465691:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.465701:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.465715:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.465720:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.465726:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.465750:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.465760:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.465767:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.465790:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787397929.465911:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3648:x1874218701209600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1308us (8346us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787397929.465920:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787397929.465945:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787397929.465953:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701210112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.465972:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1909 count 1 00000004:00080000:1.0:1787397929.466080:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702188700/2, rc 0, transno 12884901891 00000100:00100000:1.0:1787397929.466104:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.466117:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702188000/2, rc 0, transno 12884901890 00000100:00100000:1.0:1787397929.466121:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209856:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.466129:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70218aa00/2, rc 0, transno 12884901889 00000100:00100000:1.0:1787397929.466132:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210368:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787397929.466207:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397929.466217:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.466228:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.466234:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397929.466239:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:0.0:1787397929.466245:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466248:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466266:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.466269:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.466274:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466290:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466298:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466305:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466320:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787397929.466415:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3650:x1874218701209984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2156us (8919us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787397929.466423:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397929.466438:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397929.466445:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701209728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.466459:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1897 count 1 00010000:00010000:3.0:1787397929.466519:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397929.466551:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466559:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.466562:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466571:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466590:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466597:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192bc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466617:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397929.466620:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466626:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.466629:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466637:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466647:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466654:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.466665:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.466667:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.466673:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.466822:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.466832:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb755b53/0x274786fe0d192bbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.466850:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.466852:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.466854:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.467285:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.467292:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467302:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.467306:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.467311:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467320:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467340:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467349:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467371:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.467471:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3648:x1874218701209728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1025us (9847us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787397929.467479:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787397929.467497:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787397929.467504:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701210240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.467548:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1892 count 1 00010000:00010000:0.0:1787397929.467694:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397929.467700:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.467710:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.467713:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.467729:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.467741:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.467748:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d192bd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.467762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.467764:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.467766:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.467858:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.467870:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467879:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.467882:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.467887:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467896:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467903:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467910:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.467919:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.467998:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3648:x1874218701210240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 493us (10350us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787397929.468005:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787397929.468133:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397929.468150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.468158:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397929.468162:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.468169:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.468181:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.468188:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192bd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.468203:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.468204:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.468206:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.468288:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787397929.468324:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70218b100/2, rc 0, transno 12884901893 00000100:00100000:1.0:1787397929.468484:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701209984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.468498:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397929.468507:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.468574:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.468631:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.468658:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.468698:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210496 00000100:00100000:1.0:1787397929.468705:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210496 00000100:00100000:1.0:1787397929.468735:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210880 00000100:00100000:1.0:1787397929.468738:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210880 00000100:00100000:1.0:1787397929.468751:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397929.468759:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3650:x1874218701210496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.468784:0:99639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1898 count 1 00002000:00010000:1.0:1787397929.469431:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.469440:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.469451:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.469454:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.469459:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.469469:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.469478:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.469486:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.469508:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787397929.469652:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3650:x1874218701210496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 892us (1076us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787397929.469668:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787397929.469687:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787397929.469694:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3650:x1874218701210880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.469708:0:99639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1894 count 1 00002000:00010000:0.0:1787397929.470193:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:0.0:1787397929.470201:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470210:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:0.0:1787397929.470212:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397929.470216:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470225:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470233:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470244:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470257:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1787397929.470609:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3648:x1874218701210112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4656us (13015us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787397929.470617:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787397929.470636:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397929.470641:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470648:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.470653:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470661:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470677:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470684:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ef7b6c/0x274786fe0d192bde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470700:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397929.470708:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470714:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.470717:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470723:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470731:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470737:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d192be5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.470746:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.470748:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.470749:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.471256:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397929.471617:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.471627:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.471639:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.471643:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.471648:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.471661:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.471669:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.471677:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.471758:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787397929.471901:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3650:x1874218701210880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2206us (3240us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1787397929.471910:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1787397929.472104:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd5880/2, rc 0, transno 12884901898 00000100:00100000:1.0:1787397929.472117:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210880:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.472130:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd6680/2, rc 0, transno 12884901896 00000100:00100000:1.0:1787397929.472143:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701210496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472216:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472247:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472290:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701210752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472312:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472346:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787397929.472352:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701210624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472383:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701211136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472419:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211008 00000100:00100000:1.0:1787397929.472425:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211008 00000100:00100000:1.0:1787397929.472452:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210752 00000100:00100000:1.0:1787397929.472455:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210752 00000100:00100000:1.0:1787397929.472464:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701210624 00000100:00100000:1.0:1787397929.472466:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701210624 00000100:00100000:1.0:1787397929.472474:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211136 00000100:00100000:1.0:1787397929.472476:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211136 00000100:00100000:1.0:1787397929.472487:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787397929.472493:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3651:x1874218701211008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.472518:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1891 count 1 00000004:00080000:2.0:1787397929.472591:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70218b480/2, rc 0, transno 12884901894 00000100:00100000:2.0:1787397929.472600:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701209728:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787397929.472611:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702189500/2, rc 0, transno 12884901895 00000100:00100000:2.0:1787397929.472614:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701210240:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787397929.472623:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702188a80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787397929.472626:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701209600:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787397929.472634:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702188380/2, rc 0, transno 12884901897 00000100:00100000:2.0:1787397929.472636:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701210112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472751:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472777:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472798:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397929.472804:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472839:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701211648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472865:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397929.472869:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701211264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.472884:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.472899:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211520 00000100:00100000:1.0:1787397929.472903:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211520 00000100:00100000:1.0:1787397929.472920:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211392 00000100:00100000:1.0:1787397929.472922:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211392 00000100:00100000:1.0:1787397929.472931:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211648 00000100:00100000:1.0:1787397929.472933:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211648 00000100:00100000:1.0:1787397929.472941:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211264 00000100:00100000:1.0:1787397929.472943:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211264 00000100:00100000:1.0:1787397929.472956:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397929.472961:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3649:x1874218701210752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.472974:0:99639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1903 count 1 00010000:00010000:3.0:1787397929.475283:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397929.475297:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.475313:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.475478:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.475492:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.475515:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.475895:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d192bec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397929.476230:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.476237:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.476249:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.476253:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.476259:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397929.476270:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.476271:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.476277:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.476280:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.476285:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.476288:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.476291:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.476301:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.476302:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.476313:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.476319:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397929.476320:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.476426:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1787397929.476513:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3651:x1874218701211008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4015us (4262us total) trans 12884901900 rc 0/0 00010000:00010000:2.0:1787397929.476556:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397929.476563:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476571:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397929.476574:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476583:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476605:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476611:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192bf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476627:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397929.476630:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476636:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397929.476638:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476645:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476653:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476659:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015cca1ab/0x274786fe0d192bfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.476670:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.476671:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.476680:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397929.477457:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3649:x1874218701210752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4490us (5139us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787397929.478822:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397929.479887:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787397929.480967:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787397929.480986:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3649:x1874218701210624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787397929.481021:0:99639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1906 count 1 00000100:00100000:1.0:1787397929.483232:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397929.483257:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3649:x1874218701211136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.483290:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1890 count 1 00002000:00010000:2.0:1787397929.483654:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:2.0:1787397929.483664:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483681:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:2.0:1787397929.483685:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397929.483692:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483706:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483716:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483724:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483742:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787397929.483895:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3649:x1874218701210624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2915us (11519us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787397929.483903:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787397929.483931:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787397929.483951:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3651:x1874218701211520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787397929.483964:0:99639:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1910 count 1 00010000:00010000:2.0:1787397929.483976:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483989:0:99639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 5 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.483996:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x776:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1787397929.483999:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787397929.484003:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.484032:0:99639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 5 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.484046:0:99639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 5 pid: 99639 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397929.484060:0:99639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:99639:1874218701211776:192.168.204.60@tcp:104: 00002000:00010000:1.0:1787397929.484844:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.484855:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.484866:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.484869:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.484874:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.484885:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.484905:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.484912:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.484934:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1787397929.485109:0:99639:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111840 going to sleep for 11 seconds 00000100:00100000:1.0:1787397929.486236:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3649:x1874218701211136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2986us (13830us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1787397929.486249:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787397929.486279:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397929.486289:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3651:x1874218701211392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.486311:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1905 count 1 00002000:00010000:1.0:1787397929.487017:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:1.0:1787397929.487028:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.487043:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:1.0:1787397929.487047:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397929.487054:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.487067:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.487088:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.487231:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.487294:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1787397929.487451:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3651:x1874218701211392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1162us (14624us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787397929.487459:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787397929.487482:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787397929.487489:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3648:x1874218701211648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397929.487506:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1900 count 1 00010000:00010000:2.0:1787397929.487874:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397929.487884:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487892:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397929.487903:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487914:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487931:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487939:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d192c01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487959:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397929.487963:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487969:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397929.487973:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487980:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487990:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.487996:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d192c0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488018:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397929.488022:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488028:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397929.488031:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488039:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488049:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488056:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d192c16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.488068:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.488069:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.488071:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.488423:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.488434:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787397929.488483:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd6d80/2, rc 0, transno 12884901901 00000100:00100000:1.0:1787397929.488498:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701210624:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.488512:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd7480/2, rc 0, transno 12884901902 00000100:00100000:1.0:1787397929.488516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701211136:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.488573:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd7b80/2, rc 0, transno 12884901899 00000100:00100000:1.0:1787397929.488577:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701210752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.488665:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701212032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.488713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.488749:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397929.488755:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701212160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.488774:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397929.488795:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701211904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397929.488816:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397929.488832:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787397929.488849:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd6a00/2, rc 0, transno 12884901903 00000100:00100000:1.0:1787397929.488854:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211392:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787397929.488864:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd5500/2, rc 0, transno 12884901900 00000100:00100000:1.0:1787397929.488867:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787397929.489322:0:99641:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00010000:3.0:1787397929.489633:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.489643:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.489656:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.489660:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.489666:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.489678:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.489687:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.489695:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397929.489992:0:99641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:3.0:1787397929.490097:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.490989:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3648:x1874218701211648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3495us (18125us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787397929.491001:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397929.491029:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212032 00000100:00100000:3.0:1787397929.491037:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212032 00000100:00100000:3.0:1787397929.491065:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212160 00000100:00100000:3.0:1787397929.491068:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212160 00000100:00100000:3.0:1787397929.491080:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701211904 00000100:00100000:3.0:1787397929.491082:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701211904 00000100:00100000:3.0:1787397929.491112:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787397929.491120:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3648:x1874218701211264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.491160:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1896 count 1 00010000:00010000:0.0:1787397929.491494:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397929.491503:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.491515:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.491542:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.491565:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.491584:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.491592:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d192c1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.491613:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.491615:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.491617:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.491840:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.491848:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492060:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.492064:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.492070:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492082:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492101:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492117:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492133:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.492276:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3648:x1874218701211264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1155us (19388us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1787397929.492283:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787397929.492303:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787397929.492310:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3650:x1874218701212032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.492561:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1902 count 1 00010000:00010000:3.0:1787397929.492676:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397929.492682:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492691:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397929.492695:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492704:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492717:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492723:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.492749:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.492751:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397929.492753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.493037:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.493044:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.493055:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.493058:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.493062:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.493072:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.493079:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.493207:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.493228:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.493382:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3650:x1874218701212032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1070us (4666us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787397929.493391:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397929.494227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397929.494265:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305600 00000100:00100000:0.0:1787397929.494275:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305600 00010000:00010000:0.0:1787397929.494314:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 6 pid: 99639 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397929.494347:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2659 00000100:00100000:0.0:1787397929.494356:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681305600:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397929.494369:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397929.494375:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 6 pid: 99639 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.494387:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 6 pid: 99639 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.494418:0:19657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787397929.494422:0:19657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x776:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787397929.494428:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.494436:0:19657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.494459:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397929.494512:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681305600:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 155us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397929.494547:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2659 00000100:00100000:3.0:1787397929.494627:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397929.494637:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3650:x1874218701212160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.494662:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1908 count 1 00010000:00010000:1.0:1787397929.495049:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397929.495057:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.495066:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397929.495072:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.495083:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.495109:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.495118:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d192c2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.495217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.495219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.495221:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397929.495454:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.495462:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.495473:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.495476:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.495480:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.495490:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.495498:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.495506:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.495562:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.495714:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3650:x1874218701212160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1077us (6936us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787397929.495722:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397929.495746:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397929.495757:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3649:x1874218701211904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397929.495783:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1893 count 1 00010000:00010000:1.0:1787397929.496252:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397929.496259:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.496268:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397929.496272:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.496281:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.496293:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.496300:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d192c32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.496318:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.496320:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.496321:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787397929.496486:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd7800/2, rc 0, transno 12884901904 00000100:00100000:2.0:1787397929.496495:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701211648:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787397929.496792:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d1926e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8593 expref: 5 pid: 99639 timeout: 3908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397929.496814:0:99639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:99639:1874218701211776:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787397929.496833:0:99639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.496843:0:99639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.496850:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.496859:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.496866:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.496885:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787397929.497036:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3651:x1874218701211520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13084us (24256us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1787397929.497045:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787397929.497081:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd5f80/2, rc 0, transno 12884901908 00010000:00010000:0.0:1787397929.497321:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397929.497329:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.497338:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397929.497341:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.497350:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.497364:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.497385:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d192c08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397929.497403:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.497405:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.497407:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397929.497617:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787397929.497647:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a81816ea00/2, rc 0, transno 12884901907 00000100:00100000:0.0:1787397929.497652:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701212160:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787397929.497664:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a81816df80/2, rc 0, transno 12884901906 00000100:00100000:0.0:1787397929.497668:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701212032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787397929.497761:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701211520:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787397929.497792:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a82ebd4700/2, rc 0, transno 12884901905 00000100:00100000:2.0:1787397929.497797:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701211264:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1787397929.497963:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 1024, mtime: 0x6a89869a, atime: 0x6a89868f, ctime: 0x6a89869a, blocks: 0x8 00010000:00010000:3.0:1787397929.497971:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.497983:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=3808s v=(0 0) 00010000:00010000:3.0:1787397929.497987:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397929.497993:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.498006:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.498014:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.498022:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397929.498082:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397929.498233:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3649:x1874218701211904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2478us (9415us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787397929.498242:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:2.0:1787397929.498443:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a81816c380/2, rc 0, transno 12884901909 00000100:00100000:2.0:1787397929.498449:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701211904:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787397929.498481:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397929.498489:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.498511:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397929.498515:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.498687:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.498704:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397929.498712:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d192c39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397929.498800:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.498803:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397929.498804:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397929.828851:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397929.957738:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701212288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397929.957818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397929.957912:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212288 00000100:00100000:0.0:1787397929.957920:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212288 00000100:00100000:0.0:1787397929.957989:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397929.957999:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701212288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787397929.958028:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397929.958074:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701212288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397929.958081:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787397929.958264:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397929.958305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397929.958444:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212416 00000100:00100000:0.0:1787397929.958449:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212416 00000100:00100000:0.0:1787397929.958467:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397929.958473:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701212416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397929.958484:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397929.958560:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701212416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397929.958580:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787397929.958674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a828cf8e00 x1874218701212288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397929.958693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701212288:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787397929.958821:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a705986d80 x1874218701212416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397929.958834:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397930.468969:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397930.468996:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701212544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397930.469195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397930.469292:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212544 00000100:00100000:0.0:1787397930.469301:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212544 00000100:00100000:0.0:1787397930.469375:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397930.469385:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701212544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397930.469423:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397930.469993:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701212544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 606us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397930.470002:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397930.470075:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701212544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397930.470631:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397930.470645:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701212672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397930.470691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397930.470800:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212672 00000100:00100000:0.0:1787397930.470807:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212672 00000100:00100000:0.0:1787397930.471398:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787397930.471409:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701212672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397930.471443:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1787397930.471549:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701212672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397930.471558:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787397930.471662:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701212672:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397930.854994:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397930.922801:0:101107:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 136: MDS to disconnect all OSPs first, then cleanup ldlm ========================================================== 07:25:28 (1787397928) 00010000:00010000:0.0:1787397931.889221:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397932.494788:0:101155:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_136 needs > 2 MDTs 00010000:00010000:0.0:1787397932.900803:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397933.029007:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701212800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397933.029108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397933.029925:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212800 00000100:00100000:0.0:1787397933.029942:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212800 00000100:00100000:2.0:1787397933.030115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397933.030129:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701212928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397933.030192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397933.030236:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701212928 00000100:00100000:2.0:1787397933.030239:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701212928 00000100:00100000:0.0:1787397933.031268:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787397933.031281:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701212800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397933.031317:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397933.031390:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701212800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397933.031412:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397933.034208:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701212800:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397933.039410:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397933.039970:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397933.039995:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3648:x1874218701212928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397933.040025:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397933.040134:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3648:x1874218701212928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (9942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397933.040156:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787397933.040390:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701212928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397933.540873:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701213312:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.540953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397933.540991:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701213824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397933.541037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701214336:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397933.541102:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787397933.541110:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701213440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397933.541147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701213952:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397933.541202:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213312 00000100:00100000:3.0:1787397933.541211:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213312 00000100:00100000:3.0:1787397933.541276:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397933.541286:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701213312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541350:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701213312:12345-0@lo:400:kworker.0 Request processed in 61us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.541359:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787397933.541388:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213824 00000100:00100000:3.0:1787397933.541391:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213824 00000100:00100000:3.0:1787397933.541414:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214336 00000100:00100000:3.0:1787397933.541416:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214336 00000100:00100000:3.0:1787397933.541436:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213440 00000100:00100000:3.0:1787397933.541438:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213440 00000100:00100000:3.0:1787397933.541466:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213952 00000100:00100000:3.0:1787397933.541469:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213952 00000100:00100000:3.0:1787397933.541484:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:3.0:1787397933.541499:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701213824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541559:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701213824:12345-0@lo:400:kworker.0 Request processed in 61us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.541566:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:3.0:1787397933.541581:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1787397933.541588:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701214336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541614:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701214336:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.541620:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1787397933.541631:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:3.0:1787397933.541636:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701213440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541660:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701213440:12345-0@lo:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.541665:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:3.0:1787397933.541675:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1787397933.541680:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701213952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541701:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701213952:12345-0@lo:400:kworker.0 Request processed in 21us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.541705:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1787397933.541746:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701213440:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541755:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701213952:0@lo:400:kworker.0 00010000:00080000:3.0:1787397933.541765:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835b59880 x1874218701213312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397933.541775:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701213312:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541791:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701213824:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.541799:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701214336:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.541990:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701213056:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542031:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542073:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542114:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701214080:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542149:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787397933.542154:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701213184:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542187:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701213696:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542219:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701214208:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397933.542257:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214080 00000100:00100000:1.0:1787397933.542261:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214080 00000100:00100000:1.0:1787397933.542286:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1787397933.542293:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701214080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542333:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701214080:12345-0@lo:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.542341:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1787397933.542354:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214208 00000100:00100000:1.0:1787397933.542357:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214208 00000100:00100000:1.0:1787397933.542373:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1787397933.542378:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701214208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542414:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701214208:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.542420:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1787397933.542464:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213568 00000100:00100000:1.0:1787397933.542467:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213568 00000100:00100000:1.0:1787397933.542485:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213184 00000100:00100000:1.0:1787397933.542487:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213184 00000100:00100000:1.0:1787397933.542499:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787397933.542504:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701213568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542563:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701213568:12345-0@lo:400:kworker.0 Request processed in 59us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.542568:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787397933.542579:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787397933.542584:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701213184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542608:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701213184:12345-0@lo:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.542613:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787397933.542634:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213696 00000100:00100000:1.0:1787397933.542637:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213696 00000100:00100000:1.0:1787397933.542663:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787397933.542668:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701213696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542696:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701213696:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.542701:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787397933.542722:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787397933.542726:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397933.542729:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397933.542761:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701213184:0@lo:400:kworker.0 00010000:00080000:1.0:1787397933.542772:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835b5b800 x1874218701213696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397933.542781:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701213696:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542790:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701214208:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542799:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701213568:0@lo:400:kworker.0 00000100:00100000:1.0:1787397933.542809:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701214080:0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.546034:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701213056 00000100:00100000:3.0:1787397933.546052:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701213056 00000100:00100000:3.0:1787397933.546155:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787397933.546168:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701213056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397933.546286:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701213056:12345-0@lo:400:kworker.0 Request processed in 121us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.546295:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787397933.546825:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701213056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397933.828347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397933.828445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397933.828513:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397933.829552:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305728 00000100:00100000:3.0:1787397933.829565:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305728 00000100:00100000:3.0:1787397933.829625:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 339 00000100:00100000:3.0:1787397933.829635:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681305728:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397933.829704:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681305728:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 70us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.829711:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 339 00000100:00100000:3.0:1787397933.829752:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306240 00000100:00100000:3.0:1787397933.829756:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306240 00000100:00100000:3.0:1787397933.829798:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:3.0:1787397933.829805:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681306240:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397933.829837:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681306240:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.829843:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:1.0:1787397933.830169:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305984 00000100:00100000:1.0:1787397933.830176:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305984 00000100:00100000:1.0:1787397933.830217:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1622 00000100:00100000:1.0:1787397933.830226:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681305984:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397933.830316:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681305984:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397933.830324:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1622 00000100:00080000:1.0:1787397933.830346:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397933.830351:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397933.831078:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397933.831122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397933.831151:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681305856 00000100:00100000:0.0:1787397933.831151:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306112 00000100:00100000:0.0:1787397933.831158:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306112 00000100:00100000:3.0:1787397933.831165:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681305856 00000100:00100000:0.0:1787397933.831214:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:0.0:1787397933.831235:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681306112:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397933.831284:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1623 00000100:00100000:3.0:1787397933.831293:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681305856:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397933.831336:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681305856:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397933.831343:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1623 00000100:00100000:0.0:1787397933.831544:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681306112:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 300us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397933.831552:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00080000:0.0:1787397933.831640:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397933.831644:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787397933.926532:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787397933.998852:0:101203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137a: DNE: create under striped dir, fail MDT1 ========================================================== 07:25:31 (1787397931) 00000100:00100000:0.0:1787397934.274994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397934.275113:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306368 00000100:00100000:1.0:1787397934.275124:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306368 00000100:00100000:1.0:1787397934.275323:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1624 00000100:00100000:1.0:1787397934.275338:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:76135:x1874218681306368:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397934.275359:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397934.275382:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d863b expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275485:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275512:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275569:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397934.275622:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397934.275626:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397934.275648:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275671:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275689:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.275699:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397934.275701:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397934.275705:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00000100:00100000:1.0:1787397934.275764:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:76135:x1874218681306368:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 430us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.275771:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1624 00000100:00100000:1.0:1787397934.278975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397934.279251:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306624 00000100:00100000:2.0:1787397934.279262:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306624 00000100:00100000:2.0:1787397934.279333:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1625 00000100:00100000:2.0:1787397934.279345:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76135:x1874218681306624:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787397934.279365:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397934.279446:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192c4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8642 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.279624:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214464:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.279683:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.279725:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397934.279868:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214464 00000100:00100000:3.0:1787397934.279874:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214464 00000100:00100000:3.0:1787397934.279917:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397934.279925:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701214464:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397934.280010:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701214464:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.280017:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787397934.280138:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214464:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.280185:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214592:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.280207:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.280226:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397934.280276:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214592 00000100:00100000:3.0:1787397934.280281:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214592 00000100:00100000:3.0:1787397934.280309:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787397934.280316:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701214592:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397934.280398:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701214592:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (190us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397934.280405:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397934.280503:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214592:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787397934.280576:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.280586:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.280598:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.280626:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214720:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787397934.280651:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.280672:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397934.280780:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214720 00000100:00100000:3.0:1787397934.280785:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214720 00000100:00100000:3.0:1787397934.280849:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397934.280856:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:77740:x1874218701214720:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787397934.280866:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397934.280880:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d192c55 expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.280917:0:66188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.280927:0:66188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.280953:0:66188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.280968:0:66188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 9 pid: 67264 timeout: 3913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397934.280980:0:66188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701214848:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397934.281056:0:66188:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec000 going to sleep for 11 seconds 00000100:00100000:0.0:1787397934.288661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397934.288761:0:66188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701214848:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397934.288798:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.288813:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397934.288817:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.288821:0:66188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.288833:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583000, rc 0) 00000100:00100000:3.0:1787397934.288901:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701214720:12345-0@lo:101:mdt00_005.0 Request processed in 8045us (8249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.288972:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787397934.289077:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306752 00000100:00100000:1.0:1787397934.289090:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306752 00010000:00010000:1.0:1787397934.289123:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 10 pid: 67264 timeout: 3913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397934.289164:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2660 00000100:00100000:1.0:1787397934.289172:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2404:x1874218681306752:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787397934.289202:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397934.289209:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 10 pid: 67264 timeout: 3913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289222:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 10 pid: 67264 timeout: 3913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289245:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d863b expref: 10 pid: 67264 timeout: 3913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289260:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397934.289265:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289274:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289283:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.289315:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397934.289338:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6507:1874218701214976:0@lo:105: 00000100:00100000:1.0:1787397934.289374:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397934.289414:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686780 going to sleep for 11 seconds 00000100:00100000:0.0:1787397934.289636:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701214976 00000100:00100000:0.0:1787397934.289641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701214976 00000100:00100000:0.0:1787397934.289677:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1787397934.289685:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1874218701214976:12345-0@lo:105: 00010000:00010000:0.0:1787397934.289697:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289706:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289728:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289736:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289742:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289749:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.289763:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a70720a000) 00000100:00100000:0.0:1787397934.289809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1874218701214976:12345-0@lo:105: Request processed in 125us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397934.289817:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787397934.289894:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6507:1874218701214976:0@lo:105: 00010000:00010000:3.0:1787397934.289911:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397934.289958:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681306752:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 785us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.289966:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2660 00000100:00100000:2.0:1787397934.290125:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701214720:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397934.290144:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397934.290168:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397934.290303:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.290313:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.290322:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.290339:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215104:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787397934.290373:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.290401:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.290509:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215104 00000100:00100000:1.0:1787397934.290514:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215104 00000100:00100000:1.0:1787397934.290580:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397934.290589:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701215104:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787397934.290605:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397934.290622:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d192c63 expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.290641:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192c63 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.290653:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c63 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.290662:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70a1c4300) 00010000:00010000:1.0:1787397934.290665:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397934.290668:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:1.0:1787397934.290698:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215104:12345-0@lo:101:mdt00_005.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.290705:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787397934.291748:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215104:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397934.291768:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.291780:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397934.291820:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787397934.291863:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215232:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.291903:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.291931:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.291990:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215232 00000100:00100000:1.0:1787397934.291995:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215232 00000100:00100000:1.0:1787397934.292033:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397934.292059:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215232:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.292141:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215232:12345-0@lo:1000:mdt00_005.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.292148:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787397934.292234:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215232:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.292273:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215360:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.292295:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.292315:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.292663:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215360 00000100:00100000:1.0:1787397934.292669:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215360 00000100:00100000:1.0:1787397934.292690:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787397934.292695:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215360:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.292775:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215360:12345-0@lo:1000:mdt00_005.0 Request processed in 79us (478us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397934.292782:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787397934.293031:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215360:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.293118:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215488:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.293146:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.293170:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.295714:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215488 00000100:00100000:1.0:1787397934.295732:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215488 00000100:00100000:1.0:1787397934.295790:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397934.295799:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215488:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.295966:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215488:12345-0@lo:1000:mdt00_005.0 Request processed in 166us (2817us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397934.295974:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787397934.296161:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215488:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.296270:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215616:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.296306:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397934.296489:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215616 00000100:00100000:1.0:1787397934.296494:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215616 00000100:00100000:1.0:1787397934.296516:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397934.296559:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215616:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.296615:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215616:12345-0@lo:1000:mdt00_005.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.296621:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787397934.296743:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1787397934.296760:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215616:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.296803:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215744:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.296826:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.296850:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.296904:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215744 00000100:00100000:1.0:1787397934.296909:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215744 00000100:00100000:1.0:1787397934.296942:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397934.296949:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215744:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.297015:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215744:12345-0@lo:1000:mdt00_005.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.297022:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787397934.297142:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215744:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.297252:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215872:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787397934.297285:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.297308:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.297435:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701215872 00000100:00100000:1.0:1787397934.297440:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701215872 00000100:00100000:1.0:1787397934.297461:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787397934.297466:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215872:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787397934.297587:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701215872:12345-0@lo:1000:mdt00_005.0 Request processed in 55us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.297594:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787397934.297653:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701215872:0@lo:1000:mdt00_005.0 00000040:00080000:2.0:1787397934.301143:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].6, 1000 off39288 00000040:00080000:2.0:1787397934.301436:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].6, 1152 off40176 00000004:00080000:2.0:1787397934.301447:0:77740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7027d3240 with version 17 00000004:00080000:1.0:1787397934.301600:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 17 rpc_version 17 00000020:00100000:1.0:1787397934.301664:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397934.301677:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835bfc000 x1874218701216128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397934.301702:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701216128:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397934.301777:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397934.301807:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397934.303140:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216128 00000100:00100000:0.0:1787397934.303151:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216128 00000100:00100000:0.0:1787397934.303224:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787397934.303233:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701216128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397934.304000:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:75622:x1874218701216128:12345-0@lo:1000:osp_up0-1.0 Request processed in 765us (2219us total) trans 120259084468 rc 0/0 00000100:00100000:0.0:1787397934.304011:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397934.305609:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701216128:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1787397934.305780:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1787397934.305813:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192c71 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305829:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192c71 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305841:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192c71 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397934.305857:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397934.305868:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305877:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305884:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305949:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787397934.305955:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397934.305961:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.305990:0:77740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.306055:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192c4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8642 expref: 14 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.306084:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192c71 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8642 expref: 13 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.306093:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:2.0:1787397934.306096:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397934.306100:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b200, rc 0) 00000100:00100000:2.0:1787397934.306179:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76135:x1874218681306624:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 26835us (27213us total) trans 81604378769 rc 0/0 00000100:00100000:2.0:1787397934.306189:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1625 00010000:00010000:1.0:1787397934.310038:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397934.310053:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.310066:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a000 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397934.310074:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397934.310100:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.310152:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.310159:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787397934.310244:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701216256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397934.310315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397934.310423:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.310441:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a000/0x274786fe0d192c55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d192c5c expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.310457:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397934.310459:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397934.310460:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397934.310908:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216256 00000100:00100000:2.0:1787397934.310918:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216256 00000100:00100000:2.0:1787397934.311017:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1787397934.311027:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3649:x1874218701216256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397934.311040:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397934.311061:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d192c5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192c55 expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.311080:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397934.311085:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397934.311407:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701216256:12345-0@lo:103:ldlm_bl.0 Request processed in 379us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397934.311415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1787397934.311495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701216256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397934.329124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397934.329218:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681306880 00000100:00100000:3.0:1787397934.329228:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681306880 00000100:00100000:3.0:1787397934.329283:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1626 00000100:00100000:3.0:1787397934.329294:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:76136:x1874218681306880:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397934.329314:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397934.329337:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8649 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329409:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329423:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329448:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397934.329497:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397934.329501:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397934.329566:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329592:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8649 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329614:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8649 expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.329623:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397934.329627:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397934.329631:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583400, rc 0) 00000100:00100000:3.0:1787397934.329689:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:76136:x1874218681306880:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 396us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.329696:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1626 00000100:00100000:0.0:1787397934.332993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397934.333339:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307008 00000100:00100000:1.0:1787397934.333351:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307008 00000100:00100000:1.0:1787397934.333423:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1627 00000100:00100000:1.0:1787397934.333444:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:76136:x1874218681307008:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397934.333468:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397934.333491:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8650 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333733:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333752:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333765:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333776:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333786:0:67264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192c63 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333795:0:67264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.333835:0:67264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d192c63 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.333853:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67264:1874218701216384:0@lo:104: 00000100:00100000:2.0:1787397934.333909:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.333955:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787397934.334018:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216384 00000100:00100000:0.0:1787397934.334038:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216384 00000100:00100000:0.0:1787397934.334083:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1787397934.334090:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:67264:x1874218701216384:12345-0@lo:104: 00010000:00010000:0.0:1787397934.334104:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.334173:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787397934.334545:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397934.334552:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.334566:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a600 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397934.334572:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397934.334579:0:15258:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.334607:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.334613:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397934.334637:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.334643:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a600/0x274786fe0d192c63 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192c6a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.334666:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397934.334668:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397934.334670:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397934.334684:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701216512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397934.334724:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397934.334765:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216512 00000100:00100000:1.0:1787397934.334770:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216512 00010000:00010000:1.0:1787397934.334789:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x274786fe0d192c63 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397934.334826:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1787397934.334833:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701216512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397934.334843:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787397934.335454:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:67264:x1874218701216384:12345-0@lo:104: Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397934.335467:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1787397934.336942:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67264:1874218701216384:0@lo:104: 00010000:00010000:2.0:1787397934.336971:0:67264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787397934.339335:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084468 is committed 00010000:00010000:0.0:1787397934.339481:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192c6a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d192c63 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.339502:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70a1c4300) 00010000:00010000:0.0:1787397934.339506:0:19660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.339515:0:19660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.339555:0:19660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397934.339590:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397934.339673:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701216512:12345-0@lo:103:ldlm_bl.0 Request processed in 4839us (4946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397934.339685:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00010000:00010000:2.0:1787397934.339757:0:67264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.339765:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.339914:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701216640:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787397934.339960:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.339997:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027d3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397934.340108:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701216512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397934.340281:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216640 00000100:00100000:3.0:1787397934.340290:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216640 00000100:00100000:3.0:1787397934.340338:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787397934.340347:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:67264:x1874218701216640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787397934.340449:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:67264:x1874218701216640:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.340456:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787397934.340561:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701216640:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787397934.340615:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340627:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340638:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397934.340669:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340684:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340690:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340696:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340721:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340726:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397934.340730:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340738:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340751:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:2.0:1787397934.340754:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397934.340758:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340765:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720b600/0x274786fe0d192c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340777:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340782:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340787:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340792:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397934.340795:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340810:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340819:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70a1c4300) 00010000:00010000:2.0:1787397934.340821:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397934.340824:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340829:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720bc00/0x274786fe0d192c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340871:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192c86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8650 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340886:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8650 expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.340893:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32800) 00010000:00010000:2.0:1787397934.340895:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397934.340897:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720be00, rc 0) 00000100:00100000:2.0:1787397934.340954:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76136:x1874218681307008:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 7513us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397934.340962:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1627 00000100:00100000:0.0:1787397934.344512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397934.344737:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307136 00000100:00100000:1.0:1787397934.344748:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307136 00000100:00100000:1.0:1787397934.344824:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1628 00000100:00100000:1.0:1787397934.344835:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76136:x1874218681307136:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397934.344863:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397934.344888:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63600/0x274786fe0d192ca2 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8657 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.345022:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d192ca9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.345038:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d192ca9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.345049:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d192ca9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397934.345103:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1787397934.345107:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787397934.345145:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63600/0x274786fe0d192ca2 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8657 expref: 15 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.345186:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d192ca9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8657 expref: 14 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397934.345246:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:1.0:1787397934.345250:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787397934.345255:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63800, rc 0) 00000100:00100000:1.0:1787397934.345326:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76136:x1874218681307136:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 492us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397934.345334:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1628 00000100:00100000:1.0:1787397934.353603:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397934.353656:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397934.353838:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307392 00000100:00100000:2.0:1787397934.353852:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307392 00000100:00100000:2.0:1787397934.353931:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 690 00000100:00100000:2.0:1787397934.353943:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2404:x1874218681307392:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397934.353987:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397934.354020:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d192ca9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8657 expref: 14 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.354055:0:19662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:2.0:1787397934.354062:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397934.354165:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681307392:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 223us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397934.354174:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 690 00000100:00100000:3.0:1787397934.355581:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307264 00000100:00100000:3.0:1787397934.355593:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307264 00000100:00100000:3.0:1787397934.355657:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1629 00000100:00100000:3.0:1787397934.355667:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76136:x1874218681307264:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397934.355690:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397934.355858:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583600/0x274786fe0d192cb0 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d865e expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.355947:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.355963:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.355974:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356064:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356073:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356080:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356331:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356411:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356419:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356439:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356445:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397934.356458:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356468:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356482:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:3.0:1787397934.356485:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.356490:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356496:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582400/0x274786fe0d192cb7 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356514:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356683:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356689:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356694:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397934.356697:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356783:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356794:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a82e43e100) 00010000:00010000:3.0:1787397934.356797:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.356806:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356813:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192cbe lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356856:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583600/0x274786fe0d192cb0 lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d865e expref: 14 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356866:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:3.0:1787397934.356869:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.356873:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583600/0x274786fe0d192cb0 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d865e expref: 14 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.356882:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00000100:00100000:3.0:1787397934.356993:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76136:x1874218681307264:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1327us (3404us total) trans 0 rc 301/301 00000100:00100000:3.0:1787397934.357002:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1629 00000100:00100000:1.0:1787397934.363975:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397934.364055:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307648 00000100:00100000:3.0:1787397934.364066:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307648 00000100:00100000:3.0:1787397934.364219:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1630 00000100:00100000:3.0:1787397934.364234:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76136:x1874218681307648:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397934.364257:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397934.364292:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8665 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397934.364435:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:3.0:1787397934.364598:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192cc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8665 expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.364636:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a82e43ee00) 00010000:00010000:3.0:1787397934.364639:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397934.364646:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8665 expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.364670:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583a00, rc 0) 00000100:00100000:3.0:1787397934.364743:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76136:x1874218681307648:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 512us (779us total) trans 81604378770 rc 301/301 00000100:00100000:3.0:1787397934.367713:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1630 00000100:00100000:0.0:1787397934.369284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397934.370076:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681307904 00000100:00100000:2.0:1787397934.370089:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681307904 00000100:00100000:2.0:1787397934.370167:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1631 00000100:00100000:2.0:1787397934.370178:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76136:x1874218681307904:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:2.0:1787397934.370241:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397934.370286:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192c71 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8642 expref: 14 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370308:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32700) 00010000:00010000:2.0:1787397934.370319:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397934.370392:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370408:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370422:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370469:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370477:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.370484:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397934.371489:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].7, 2152 off41440 00000040:00080000:2.0:1787397934.371625:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].7, 2352 off42528 00000004:00080000:2.0:1787397934.371632:0:77740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a829b5da80 with version 18 00000004:00080000:3.0:1787397934.371685:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 18 rpc_version 18 00000020:00100000:3.0:1787397934.371726:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397934.371736:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70aa91f80 x1874218701216896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397934.371766:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701216896:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397934.371849:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397934.371890:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1787397934.377605:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701216896 00000100:00100000:2.0:1787397934.377623:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701216896 00000100:00100000:2.0:1787397934.377694:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787397934.377705:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701216896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397934.382865:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084468 gen 3 00000004:00080000:3.0:1787397934.382879:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084468 committed transno 120259084468 00000100:00100000:3.0:1787397934.382914:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a70aa91f80 x1874218701216896/t120259084469(120259084469) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 1787397950 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397934.382966:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701216896:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397934.383197:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701216896:12345-0@lo:1000:osp_up0-1.0 Request processed in 5492us (11345us total) trans 120259084469 rc 0/0 00000100:00100000:2.0:1787397934.383215:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1787397934.383369:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383386:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383399:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383418:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383446:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383454:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383494:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383511:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.383542:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397934.383569:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701217024:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787397934.383631:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397934.383950:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836022900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397934.386325:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217024 00000100:00100000:3.0:1787397934.386342:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217024 00000100:00100000:3.0:1787397934.386422:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787397934.386443:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:77740:x1874218701217024:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787397934.386487:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397934.386699:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192cf6 lrc: 2/0,0 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d192cef expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.386732:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192cf6 lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192cef expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.386748:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192cf6 lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192cef expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.386828:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:3.0:1787397934.386831:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.386835:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582400, rc 0) 00000100:00100000:3.0:1787397934.387226:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701217024:12345-0@lo:101:mdt00_005.0 Request processed in 786us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397934.387234:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397934.387743:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701217024:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397934.387834:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.387847:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397934.387880:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b4bedd5 reply state 000000003532def4 transno 81604378771 ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.387893:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.387912:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a82df32400) 00010000:00010000:2.0:1787397934.387914:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397934.387917:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397934.387923:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397934.387931:0:77740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397934.387941:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000088d1:0x4:0x0] 00000004:00010000:3.0:1787397934.388215:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b4bedd5 reply state 000000003532def4 transno 81604378771 ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388226:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388233:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:3.0:1787397934.388235:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397934.388237:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787397934.388243:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1787397934.388254:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388260:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388272:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388279:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388284:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397934.388289:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388296:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388309:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32300) 00010000:00010000:3.0:1787397934.388311:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397934.388315:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388320:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720bc00/0x274786fe0d192cd3 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397934.388345:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b4bedd5 reply state 000000003532def4 transno 81604378771 ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388354:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397934.388360:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a82df32b00) 00010000:00010000:3.0:1787397934.388362:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397934.388364:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787397934.388646:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:76136:x1874218681307904:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 18322us (19222us total) trans 81604378771 rc 0/0 00000100:00100000:3.0:1787397934.388665:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1631 00000100:00100000:1.0:1787397934.398043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397934.398244:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308160 00000100:00100000:2.0:1787397934.398256:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308160 00000100:00100000:2.0:1787397934.398327:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 286 00000100:00100000:2.0:1787397934.398338:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:76136:x1874218681308160:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787397934.398638:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:76136:x1874218681308160:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 301us (602us total) trans 81604378772 rc 0/0 00000100:00100000:2.0:1787397934.398648:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 286 00010000:00010000:0.0:1787397934.948802:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397935.077883:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701217152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397935.077919:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701217280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397935.077959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397935.078021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397935.078027:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217152 00000100:00100000:1.0:1787397935.078036:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217152 00000100:00100000:1.0:1787397935.078100:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787397935.078111:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701217152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397935.078142:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397935.078197:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701217152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397935.078205:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787397935.078224:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217280 00000100:00100000:1.0:1787397935.078227:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217280 00000100:00100000:1.0:1787397935.078255:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787397935.078260:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701217280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397935.078271:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397935.078302:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701217280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397935.078309:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787397935.078324:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787397935.078354:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835b58380 x1874218701217280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397935.078373:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701217280:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787397935.078479:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835b59500 x1874218701217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397935.078496:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701217152:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1787397935.195092:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084469 is committed 00010000:00010000:2.0:1787397935.195902:0:75615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397935.195921:0:75615:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397935.195978:0:75615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 2/0,0 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397935.195985:0:75615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397935.196035:0:75615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a70720a200/0x274786fe0d192cef lrc: 0/0,0 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d192cf6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397935.196055:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378772 is committed 00000020:00080000:2.0:1787397935.196071:0:75615:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a7027d3600 refcount 2 committed 0 result 0 batchid 77309411390 00000020:00080000:2.0:1787397935.196075:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a8102ef000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a7027d3240 00000020:00080000:2.0:1787397935.196078:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].6 00000020:00080000:2.0:1787397935.196080:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a8102ef900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a704b69e00 00000020:00080000:2.0:1787397935.196083:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].6 00000100:00100000:2.0:1787397935.196104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787397935.196125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701217408:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787397935.196193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787397935.196234:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411390 committed batchid 77309411389 00000020:00080000:2.0:1787397935.196295:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000100:00100000:2.0:1787397935.196310:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217408 00000100:00100000:2.0:1787397935.196317:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217408 00000100:00100000:2.0:1787397935.196364:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1787397935.196372:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701217408:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787397935.196386:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397935.196404:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582400/0x274786fe0d192cf6 lrc: 0/0,0 mode: --/PW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192cef expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397935.196431:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a82e43e900) 00010000:00010000:2.0:1787397935.196442:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397935.196479:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701217408:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397935.196486:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1787397935.196570:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701217408:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787397935.196829:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196840:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196847:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196853:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397935.196857:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196865:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196876:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a82df32b00) 00010000:00010000:0.0:1787397935.196879:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397935.196882:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196889:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b600/0x274786fe0d192cda lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196905:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196911:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196917:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196944:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720aa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397935.196948:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196954:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196962:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:0.0:1787397935.196965:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397935.196968:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196974:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720aa00/0x274786fe0d192ce1 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196987:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196993:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.196999:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.197004:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397935.197006:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.197012:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.197690:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a82df32400) 00010000:00010000:0.0:1787397935.197692:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397935.197697:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.197703:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720ac00/0x274786fe0d192ce8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787397935.199133:0:99635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901909 is committed 00000020:00080000:0.0:1787397935.210886:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411390 batchid updated 00000020:00080000:2.0:1787397935.210923:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00000004:00080000:2.0:1787397935.210991:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a701b2be40 with version 19 00000020:00080000:2.0:1787397935.211011:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411390 cancel update log [0x2000088d1:0x2:0x0].6: rc = 0 00000020:00080000:2.0:1787397935.211093:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411390 cancel update log [0x2400090a0:0x2:0x0].6: rc = 0 00000020:00080000:2.0:1787397935.211103:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00000004:00080000:3.0:1787397935.211140:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 19 rpc_version 19 00000020:00100000:3.0:1787397935.211174:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397935.211188:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835b59500 x1874218701217664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397935.211211:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701217664:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397935.211289:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397935.211325:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec240 going to sleep for 11 seconds 00000100:00100000:2.0:1787397935.211436:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217664 00000100:00100000:2.0:1787397935.211444:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217664 00000100:00100000:2.0:1787397935.211498:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787397935.211507:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701217664:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397935.211777:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701217664:12345-0@lo:1000:osp_up0-1.0 Request processed in 269us (486us total) trans 120259084470 rc 0/0 00000100:00100000:2.0:1787397935.211785:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787397935.211851:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084469 gen 3 00000004:00080000:3.0:1787397935.211857:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084469 committed transno 120259084469 00000020:00080000:3.0:1787397935.211862:0:75622:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a829b5d600 refcount 2 committed 0 result 0 batchid 77309411391 00000020:00080000:3.0:1787397935.211866:0:75622:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a8102ef200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a829b5da80 00000020:00080000:3.0:1787397935.211869:0:75622:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].7 00000020:00080000:3.0:1787397935.211871:0:75622:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a8102ef500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a704b68000 00000020:00080000:3.0:1787397935.211873:0:75622:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].7 00000100:00100000:3.0:1787397935.213762:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a835b59500 x1874218701217664/t120259084470(120259084470) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397951 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397935.213793:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701217664:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1787397935.213918:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411391 committed batchid 77309411390 00000001:00080000:3.0:1787397935.215402:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084470 is committed 00000020:00080000:2.0:1787397935.215593:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411390 00000020:00080000:0.0:1787397935.225828:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411391 batchid updated 00000020:00080000:3.0:1787397935.225889:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411391 00000004:00080000:3.0:1787397935.225957:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8092ec240 with version 20 00000020:00080000:3.0:1787397935.225968:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411391 cancel update log [0x2000088d1:0x2:0x0].7: rc = 0 00000020:00080000:3.0:1787397935.226054:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411391 cancel update log [0x2400090a0:0x2:0x0].7: rc = 0 00000020:00080000:3.0:1787397935.226063:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411391 00000004:00080000:1.0:1787397935.226199:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 20 rpc_version 20 00000020:00100000:1.0:1787397935.226237:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397935.226250:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835bff800 x1874218701217920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397935.226278:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701217920:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397935.226360:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397935.226450:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835686780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397935.232343:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217920 00000100:00100000:3.0:1787397935.232356:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217920 00000100:00100000:3.0:1787397935.232434:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397935.232446:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701217920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397935.232703:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701217920:12345-0@lo:1000:osp_up0-1.0 Request processed in 259us (6343us total) trans 120259084471 rc 0/0 00000100:00100000:3.0:1787397935.232712:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397935.232768:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084470 gen 3 00000004:00080000:3.0:1787397935.232774:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084470 committed transno 120259084470 00000100:00100000:3.0:1787397935.232802:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a835bff800 x1874218701217920/t120259084471(120259084471) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397951 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397935.232823:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701217920:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397935.283973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397935.284059:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308288 00000100:00100000:0.0:1787397935.284069:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308288 00000100:00100000:0.0:1787397935.284140:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1632 00000100:00100000:0.0:1787397935.284151:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76145:x1874218681308288:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397935.284190:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:0.0:1787397935.284257:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76145:x1874218681308288:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397935.284265:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1632 00000100:00080000:3.0:1787397935.285370:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397935.286731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397935.286932:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308416 00000100:00100000:3.0:1787397935.286942:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308416 00000100:00100000:3.0:1787397935.287011:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1633 00000100:00100000:3.0:1787397935.287034:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76145:x1874218681308416:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397935.287076:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:3.0:1787397935.287151:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76145:x1874218681308416:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 131us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.287160:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1633 00000100:00080000:0.0:1787397935.287649:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397935.289780:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397935.289915:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308544 00000100:00100000:3.0:1787397935.289925:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308544 00000100:00100000:3.0:1787397935.289992:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:3.0:1787397935.290003:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:76145:x1874218681308544:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397935.290051:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397935.290112:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:76145:x1874218681308544:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.290119:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00080000:0.0:1787397935.290261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397935.295981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397935.297624:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308672 00000100:00100000:3.0:1787397935.297639:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308672 00000100:00100000:3.0:1787397935.297877:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787397935.297891:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:76145:x1874218681308672:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787397935.297916:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787397935.298003:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:76145:x1874218681308672:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 115us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.298011:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00080000:0.0:1787397935.300298:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397935.391325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397935.392645:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308928 00000100:00100000:0.0:1787397935.392660:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308928 00000100:00100000:0.0:1787397935.392720:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1634 00000100:00100000:0.0:1787397935.392732:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76152:x1874218681308928:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:0.0:1787397935.392803:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397935.392830:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583400/0x274786fe0d192c7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8649 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392850:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397935.392855:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397935.392915:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392929:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392956:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392972:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392979:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.392986:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393388:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393398:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393415:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393428:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393434:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397935.393439:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393448:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393614:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:0.0:1787397935.393619:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397935.393623:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393630:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d192cfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397935.393642:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea567f49 reply state 000000002b31c323 transno 120259084472 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393653:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.393659:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a7059b7500) 00010000:00010000:0.0:1787397935.393661:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397935.393664:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397935.393757:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76152:x1874218681308928:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 1025us (2441us total) trans 120259084472 rc 0/0 00000100:00100000:0.0:1787397935.393766:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1634 00000100:00100000:0.0:1787397935.410414:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397935.410588:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309056 00000100:00100000:3.0:1787397935.410598:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309056 00000100:00100000:3.0:1787397935.410654:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1635 00000100:00100000:3.0:1787397935.410663:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76155:x1874218681309056:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397935.410691:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397935.410712:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d866c expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410789:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410804:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410816:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397935.410868:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397935.410872:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397935.410892:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410919:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583a00/0x274786fe0d192d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d866c expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410937:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d866c expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.410946:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397935.410948:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397935.410952:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00000100:00100000:3.0:1787397935.411013:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76155:x1874218681309056:12345-192.168.204.60@tcp:101:rm.0 Request processed in 350us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.411150:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1635 00000100:00100000:0.0:1787397935.414737:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397935.414810:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309184 00000100:00100000:3.0:1787397935.414822:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309184 00000100:00100000:3.0:1787397935.414893:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1636 00000100:00100000:3.0:1787397935.414902:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76155:x1874218681309184:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397935.414921:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397935.414941:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8673 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415013:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415129:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415142:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415156:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415163:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415170:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415266:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415274:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415281:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397935.415341:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x30:0x0]: returning size 0 00000004:00200000:3.0:1787397935.415345:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397935.415367:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415381:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415391:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415398:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415414:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415421:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415428:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397935.415433:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415442:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415455:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:3.0:1787397935.415458:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397935.415462:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415480:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415494:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415499:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415505:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415509:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397935.415513:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415518:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415649:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a7059b7500) 00010000:00010000:3.0:1787397935.415652:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397935.415655:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415661:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192d27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415695:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8673 expref: 15 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415722:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8673 expref: 14 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397935.415728:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x30:0x0].0x0 (ffff89a817be7600) 00010000:00010000:3.0:1787397935.415731:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787397935.415733:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582800, rc 0) 00000100:00100000:3.0:1787397935.415844:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76155:x1874218681309184:12345-192.168.204.60@tcp:101:rm.0 Request processed in 942us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.415855:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1636 00000100:00100000:3.0:1787397935.418507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397935.418615:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309440 00000100:00100000:1.0:1787397935.418628:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309440 00000100:00100000:1.0:1787397935.418690:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1637 00000100:00100000:1.0:1787397935.418699:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76155:x1874218681309440:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787397935.418759:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787397935.418787:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582800/0x274786fe0d192d2e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8673 expref: 14 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418807:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x30:0x0].0x0 (ffff89a817be7600) 00010000:00010000:1.0:1787397935.418839:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192d12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d866c expref: 13 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418849:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397935.418853:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397935.418873:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418886:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418896:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418914:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418921:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.418928:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419037:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419049:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419056:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419270:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419286:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419293:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419301:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419307:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419313:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419338:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397935.419357:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419364:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419370:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419375:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397935.419380:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419387:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419416:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x30:0x0].0x0 (ffff89a81a867100) 00010000:00010000:1.0:1787397935.419419:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787397935.419424:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419431:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d43 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419448:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419455:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419460:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419462:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397935.419466:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419469:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419470:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397935.419474:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419475:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397935.419479:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419480:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419486:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419487:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397935.419490:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397935.419493:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419494:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x30:0x0].0x0 (ffff89a81a867100) 00010000:00010000:0.0:1787397935.419497:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787397935.419500:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419506:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d4a lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419508:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d35 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397935.419518:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4e4a52e reply state 00000000c2fcfed2 transno 120259084473 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397935.419548:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397935.419551:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397935.419552:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397935.419608:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397935.419615:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a7059b7500) 00010000:00010000:1.0:1787397935.419617:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397935.419621:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787397935.419704:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76155:x1874218681309440:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1004us (1206us total) trans 120259084473 rc 0/0 00000100:00100000:1.0:1787397935.419712:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1637 00000100:00100000:2.0:1787397935.589011:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397935.589050:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397935.589135:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397935.589375:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218048 00000100:00100000:3.0:1787397935.589385:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218048 00000100:00100000:3.0:1787397935.589460:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787397935.589472:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701218048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397935.589517:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1787397935.589600:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701218048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397935.589607:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397935.589790:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397935.605704:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397935.605733:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701218176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397935.605811:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397935.605864:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218176 00000100:00100000:1.0:1787397935.605871:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218176 00000100:00100000:1.0:1787397935.605928:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397935.605938:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701218176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787397935.605971:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:1.0:1787397935.606019:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701218176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397935.606027:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397935.606094:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701218176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397935.978838:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397936.257481:0:101302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe2c5ddd70 00000020:00000080:3.0:1787397936.257502:0:101302:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1787397936.257512:0:101302:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:1.0:1787397937.001544:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397938.022235:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397938.151594:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397938.151622:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701218304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397938.151705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397938.151765:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218304 00000100:00100000:3.0:1787397938.151776:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218304 00000100:00100000:3.0:1787397938.151860:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397938.151871:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701218304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397938.151903:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397938.151948:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701218304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397938.151956:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787397938.152051:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397938.152098:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701218304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397938.156506:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701218432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397938.156614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397938.156683:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218432 00000100:00100000:3.0:1787397938.156691:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218432 00000100:00100000:3.0:1787397938.156754:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397938.156763:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701218432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397938.156789:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397938.156841:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701218432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397938.156849:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787397938.156874:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397938.156905:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 3 00000004:00080000:3.0:1787397938.156911:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70218aa00, transno 12884901889 00000004:00080000:3.0:1787397938.156924:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702188000, transno 12884901890 00000004:00080000:3.0:1787397938.156927:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702188700, transno 12884901891 00000004:00080000:3.0:1787397938.156930:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702188a80, transno 12884901892 00000004:00080000:3.0:1787397938.156934:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70218b100, transno 12884901893 00000004:00080000:3.0:1787397938.156937:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70218b480, transno 12884901894 00000004:00080000:3.0:1787397938.156940:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702189500, transno 12884901895 00000004:00080000:3.0:1787397938.156955:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd6680, transno 12884901896 00000004:00080000:3.0:1787397938.156957:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702188380, transno 12884901897 00000004:00080000:3.0:1787397938.156960:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd5880, transno 12884901898 00000004:00080000:3.0:1787397938.156962:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd7b80, transno 12884901899 00000004:00080000:3.0:1787397938.159384:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd5500, transno 12884901900 00000004:00080000:3.0:1787397938.159389:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd6d80, transno 12884901901 00000004:00080000:3.0:1787397938.159392:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd7480, transno 12884901902 00000004:00080000:3.0:1787397938.159394:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd6a00, transno 12884901903 00000004:00080000:3.0:1787397938.159397:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd7800, transno 12884901904 00000004:00080000:3.0:1787397938.159399:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd4700, transno 12884901905 00000004:00080000:3.0:1787397938.159402:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a81816df80, transno 12884901906 00000004:00080000:3.0:1787397938.159405:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a81816ea00, transno 12884901907 00000004:00080000:3.0:1787397938.159408:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a82ebd5f80, transno 12884901908 00000004:00080000:3.0:1787397938.159410:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a81816c380, transno 12884901909 00000100:00100000:3.0:1787397938.159432:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701218432:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787397938.159648:0:94347:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 21 done 00000100:00100000:2.0:1787397938.660771:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701218816:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.660842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397938.660872:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701219328:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.660898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397938.660914:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701219840:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.660951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397938.660977:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787397938.660983:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701218944:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397938.661022:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701219456:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661042:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397938.661075:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218816 00000100:00100000:2.0:1787397938.661083:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218816 00000100:00100000:2.0:1787397938.661137:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397938.661147:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701218816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661209:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701218816:12345-0@lo:400:kworker.0 Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.661216:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397938.661241:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219328 00000100:00100000:2.0:1787397938.661245:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219328 00000100:00100000:2.0:1787397938.661275:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219840 00000100:00100000:2.0:1787397938.661278:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219840 00000100:00100000:2.0:1787397938.661298:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218944 00000100:00100000:2.0:1787397938.661301:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218944 00000100:00100000:2.0:1787397938.661312:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219456 00000100:00100000:2.0:1787397938.661314:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219456 00000100:00100000:2.0:1787397938.661349:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1787397938.661357:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701219328:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397938.661373:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876f800 x1874218701219328/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397938.661402:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701219328:12345-0@lo:400:kworker.0 Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.661409:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1787397938.661429:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1787397938.661435:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701219840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661466:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701219840:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.661472:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1787397938.661483:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:2.0:1787397938.661489:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701218944:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397938.661498:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876d500 x1874218701218944/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397938.661555:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701218944:12345-0@lo:400:kworker.0 Request processed in 65us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.661561:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:2.0:1787397938.661573:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:2.0:1787397938.661578:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701219456:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397938.661589:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83876f100 x1874218701219456/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397938.661612:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701219456:12345-0@lo:400:kworker.0 Request processed in 35us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.661617:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00080000:2.0:1787397938.661641:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397938.661645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397938.661647:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397938.661688:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701218944:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661699:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701219456:0@lo:400:kworker.0 00010000:00080000:2.0:1787397938.661708:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83fa11f80 x1874218701218816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397938.661725:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701218816:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661738:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701219328:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.661746:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701219840:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.661898:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701218688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.661933:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.661965:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701219200:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.661985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.662002:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701219712:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.662053:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787397938.662060:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701218560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662088:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.662116:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701219072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.662152:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701219584:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662171:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397938.662196:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219712 00000100:00100000:0.0:1787397938.662200:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219712 00000100:00100000:0.0:1787397938.662229:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219584 00000100:00100000:0.0:1787397938.662232:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219584 00000100:00100000:0.0:1787397938.662251:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:0.0:1787397938.662257:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701219712:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787397938.662271:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829849c00 x1874218701219712/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397938.662302:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701219712:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397938.662310:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:0.0:1787397938.662333:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1787397938.662348:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701219584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662376:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701219584:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397938.662382:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1787397938.662399:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219200 00000100:00100000:0.0:1787397938.662402:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219200 00000100:00100000:0.0:1787397938.662435:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787397938.662441:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701219200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662471:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701219200:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397938.662477:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787397938.662495:0:94340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218560 00000100:00100000:0.0:1787397938.662499:0:94340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218560 00000100:00100000:0.0:1787397938.662543:0:94340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787397938.662549:0:94340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662578:0:94340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83823c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701218560:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397938.662583:0:94340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787397938.662624:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701218560:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662636:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701219584:0@lo:400:kworker.0 00010000:00080000:0.0:1787397938.662645:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83fa11880 x1874218701219200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397938.662654:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701219200:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.662664:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701219712:0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.662990:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701218688 00000100:00100000:2.0:1787397938.662996:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701218688 00000100:00100000:2.0:1787397938.663020:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219072 00000100:00100000:2.0:1787397938.663023:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219072 00000100:00100000:2.0:1787397938.663036:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787397938.663042:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701218688:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787397938.663058:0:66189:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829848e00 x1874218701218688/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397938.663102:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701218688:12345-0@lo:400:kworker.0 Request processed in 60us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.663108:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787397938.663122:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787397938.663128:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701219072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397938.663156:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701219072:12345-0@lo:400:kworker.0 Request processed in 28us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.663162:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787397938.663195:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397938.663199:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397938.663201:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397938.663428:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701219072:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.663441:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701218688:0@lo:400:kworker.0 00000100:00100000:0.0:1787397938.955819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397938.955882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397938.955924:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309824 00000100:00100000:0.0:1787397938.955924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397938.955942:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309824 00000100:00100000:0.0:1787397938.955985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397938.956026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397938.956045:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309696 00000100:00100000:2.0:1787397938.956083:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309696 00000100:00100000:0.0:1787397938.956084:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310080 00000100:00100000:0.0:1787397938.956100:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310080 00000100:00100000:2.0:1787397938.956141:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1630 00000100:00100000:2.0:1787397938.956157:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681309824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397938.956169:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309952 00000100:00100000:0.0:1787397938.956176:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309952 00000100:00100000:0.0:1787397938.956206:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787397938.956218:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681310080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397938.956287:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2402:x1874218681309824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 132us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.956297:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1630 00000100:00100000:2.0:1787397938.956322:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1631 00000100:00100000:2.0:1787397938.956329:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681309696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397938.956372:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681310080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 152us (443us total) trans 0 rc 0/0 00010000:00000080:2.0:1787397938.956378:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82984b100 x1874218681309696/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:379/0 lens 224/224 e 0 to 0 dl 1787397949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397938.956394:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:2.0:1787397938.956426:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681309696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397938.956438:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1631 00000100:00100000:0.0:1787397938.956449:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:0.0:1787397938.956463:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681309952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:2.0:1787397938.956477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787397938.956484:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397938.956489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397938.956492:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397938.956509:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681309952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 48us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397938.956518:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:3.0:1787397938.957118:0:94335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309568 00000100:00100000:3.0:1787397938.957129:0:94335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309568 00000100:00100000:3.0:1787397938.957195:0:94335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 341 00000100:00100000:3.0:1787397938.957220:0:94335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681309568:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397938.957284:0:94335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8278fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681309568:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 80us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397938.957293:0:94335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 341 00010000:00010000:0.0:1787397939.045987:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397940.068972:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397940.197461:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701220096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397940.197613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397940.197812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701219968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397940.198306:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220096 00000100:00100000:1.0:1787397940.198327:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220096 00000100:00100000:3.0:1787397940.198372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397940.198421:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701219968 00000100:00100000:1.0:1787397940.198425:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701219968 00000100:00100000:1.0:1787397940.198451:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397940.198462:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701220096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397940.198516:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397940.198653:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701220096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397940.198668:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787397940.198702:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787397940.198711:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701219968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397940.198725:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00010000:00080000:2.0:1787397940.198729:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a702189880 x1874218701220096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397940.198767:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701219968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397940.198774:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787397940.198929:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835b59880 x1874218701219968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397940.198934:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701220096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397940.198990:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701219968:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787397940.199174:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787397940.708958:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084473 is committed 00000001:00080000:3.0:1787397940.708975:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084471 is committed 00010000:00010000:0.0:1787397940.709055:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709071:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709078:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709084:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397940.709097:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709106:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709124:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a7059b7500) 00010000:00010000:0.0:1787397940.709127:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397940.709131:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709138:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d192d04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709157:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709163:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709170:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709174:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397940.709177:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709183:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709191:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a7059b7500) 00010000:00010000:0.0:1787397940.709193:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397940.709202:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397940.709209:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d3c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397940.709930:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397940.710002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397940.710183:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220224 00000100:00100000:3.0:1787397940.710192:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220224 00000100:00100000:3.0:1787397940.710241:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397940.710251:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701220224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787397940.710284:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000080:3.0:1787397940.710313:0:66189:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82984a680 x1874218701220224/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:381/0 lens 224/368 e 0 to 0 dl 1787397951 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397940.710369:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701220224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397940.710377:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787397940.710506:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701220224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397940.712098:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397940.712117:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701220352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397940.712169:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397940.712277:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220352 00000100:00100000:3.0:1787397940.712285:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220352 00000100:00100000:3.0:1787397940.712337:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787397940.712346:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701220352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397940.712376:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:3.0:1787397940.712429:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701220352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397940.712436:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787397940.713054:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701220352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787397941.101893:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787397941.474960:0:101598:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1787397941.551489:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.551672:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310208 00000100:00100000:1.0:1787397941.551696:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310208 00000100:00100000:1.0:1787397941.551777:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1638 00000100:00100000:1.0:1787397941.551790:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:76222:x1874218681310208:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397941.551813:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397941.551835:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d867a expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.551918:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.551932:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.551944:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397941.551990:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397941.551994:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397941.552017:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.552044:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d192d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d867a expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.552061:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d867a expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.552071:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397941.552074:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397941.552078:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00010000:00000080:1.0:1787397941.552093:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf8e00 x1874218681310208/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:382/0 lens 576/688 e 0 to 0 dl 1787397952 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397941.552156:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76222:x1874218681310208:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 370us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397941.552164:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1638 00000100:00080000:0.0:1787397941.552910:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397941.557149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.559555:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310336 00000100:00100000:1.0:1787397941.559570:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310336 00000100:00100000:1.0:1787397941.559629:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1639 00000100:00100000:1.0:1787397941.559638:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76222:x1874218681310336:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397941.559662:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397941.559684:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8681 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559764:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559779:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559791:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559805:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559812:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559818:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559890:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559910:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559917:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397941.559938:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559954:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559960:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559966:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559973:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559979:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397941.559983:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.559992:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560004:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a8098c4300) 00010000:00010000:1.0:1787397941.560013:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397941.560018:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560025:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d192d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560039:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560046:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560052:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560058:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397941.560061:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560066:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560074:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a81a867c00) 00010000:00010000:1.0:1787397941.560076:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397941.560078:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560083:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d192d6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560116:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d192d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8681 expref: 13 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560140:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8681 expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.560147:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32800) 00010000:00010000:1.0:1787397941.560150:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397941.560152:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31e00, rc 0) 00010000:00000080:1.0:1787397941.560159:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf8000 x1874218681310336/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:382/0 lens 592/584 e 0 to 0 dl 1787397952 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397941.560229:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76222:x1874218681310336:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 591us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397941.560238:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1639 00000100:00100000:1.0:1787397941.566700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.566997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397941.567608:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310592 00000100:00100000:0.0:1787397941.567621:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310592 00000100:00100000:0.0:1787397941.567691:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 692 00000100:00100000:0.0:1787397941.567701:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2403:x1874218681310592:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787397941.567727:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397941.567754:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31e00/0x274786fe0d192d74 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8681 expref: 12 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397941.567773:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a82df32800) 00010000:00010000:0.0:1787397941.567778:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787397941.567838:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681310592:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 138us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397941.567846:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 692 00000100:00100000:3.0:1787397941.570146:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310464 00000100:00100000:3.0:1787397941.570163:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310464 00000100:00080000:0.0:1787397941.570590:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397941.570688:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1640 00000100:00100000:2.0:1787397941.570700:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76222:x1874218681310464:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787397941.570838:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397941.570862:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192d7b lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8688 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397941.571021:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a800/0x274786fe0d192d82 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397941.571036:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a800/0x274786fe0d192d82 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397941.571047:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a800/0x274786fe0d192d82 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397941.571092:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1787397941.571096:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787397941.571132:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720b200/0x274786fe0d192d7b lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8688 expref: 13 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397941.571147:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a800/0x274786fe0d192d82 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8688 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397941.571156:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70242d600) 00010000:00010000:2.0:1787397941.571159:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787397941.571162:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a800, rc 0) 00000100:00100000:2.0:1787397941.571421:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76222:x1874218681310464:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 722us (4731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397941.571430:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1640 00000100:00100000:1.0:1787397941.585254:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397941.585495:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310720 00000100:00100000:3.0:1787397941.585506:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310720 00000100:00100000:3.0:1787397941.585596:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1641 00000100:00100000:3.0:1787397941.585607:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76222:x1874218681310720:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787397941.585631:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397941.585655:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192d89 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d868f expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585767:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585782:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585795:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585813:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585820:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585828:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585917:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585926:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.585934:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397941.586015:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787397941.586021:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787397941.586041:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586063:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586070:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586077:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586083:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397941.586088:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586095:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586107:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70242d600) 00010000:00010000:3.0:1787397941.586110:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397941.586113:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586119:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836582600/0x274786fe0d192d90 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586131:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586137:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586142:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586153:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397941.586157:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586163:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586171:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a817be7d00) 00010000:00010000:3.0:1787397941.586174:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397941.586176:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586182:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583800/0x274786fe0d192d97 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586218:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583e00/0x274786fe0d192d89 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d868f expref: 14 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586230:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d868f expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.586237:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a817be7700) 00010000:00010000:3.0:1787397941.586239:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787397941.586241:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583a00, rc 0) 00000100:00100000:3.0:1787397941.586315:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76222:x1874218681310720:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 710us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397941.586323:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1641 00000100:00100000:3.0:1787397941.589866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.590101:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310848 00000100:00100000:1.0:1787397941.590111:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310848 00000100:00100000:1.0:1787397941.590173:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1642 00000100:00100000:1.0:1787397941.590185:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:76222:x1874218681310848:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397941.590207:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397941.590229:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d192da5 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8696 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.590300:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31a00/0x274786fe0d192dac lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.590313:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31a00/0x274786fe0d192dac lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.590333:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31a00/0x274786fe0d192dac lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397941.590385:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1787397941.590391:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787397941.590425:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d192da5 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8696 expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.590442:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31a00/0x274786fe0d192dac lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8696 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.590451:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:1.0:1787397941.590454:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787397941.590457:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31a00, rc 0) 00000100:00100000:1.0:1787397941.590511:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76222:x1874218681310848:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 328us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397941.590519:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1642 00000100:00100000:3.0:1787397941.592453:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.592555:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681310976 00000100:00100000:1.0:1787397941.592564:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681310976 00000100:00100000:1.0:1787397941.592613:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1643 00000100:00100000:1.0:1787397941.592622:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:76222:x1874218681310976:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397941.592640:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397941.592660:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d192db3 lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d869d expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.592716:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d192dba lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.592740:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d192dba lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.592752:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d192dba lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397941.592800:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000088d1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1787397941.592805:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787397941.592839:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d192db3 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d869d expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.592856:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d192dba lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d869d expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.592864:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a81a867400) 00010000:00010000:1.0:1787397941.592866:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787397941.592869:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31400, rc 0) 00010000:00000080:1.0:1787397941.592877:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b58380 x1874218681310976/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:382/0 lens 576/640 e 0 to 0 dl 1787397952 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787397941.592933:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76222:x1874218681310976:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 312us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397941.592941:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1643 00000100:00100000:1.0:1787397941.604948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397941.605034:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681311232 00000100:00100000:3.0:1787397941.605048:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681311232 00000100:00100000:3.0:1787397941.605108:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1644 00000100:00100000:3.0:1787397941.605118:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:76222:x1874218681311232:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787397941.605140:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397941.605143:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787397941.605170:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d192dba lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d869d expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605187:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a81a867400) 00010000:00010000:3.0:1787397941.605200:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787397941.605217:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192dc1 lrc: 2/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86a4 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605360:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,1 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605372:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605382:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605394:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605401:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.605407:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397941.606112:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1787397941.606132:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192dd6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606143:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192dd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606154:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192dd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606165:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606172:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 2/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606178:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606183:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397941.606188:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606196:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606205:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a817be7d00) 00010000:00010000:3.0:1787397941.606208:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397941.606211:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 2/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606228:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d192dc8 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397941.606240:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001123219f reply state 00000000cc68a68d transno 120259084474 ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606251:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606257:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a817be7000) 00010000:00010000:3.0:1787397941.606259:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787397941.606262:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787397941.606318:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d192dc1 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 14 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606338:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192dd6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397941.606345:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a817be7f00) 00010000:00010000:3.0:1787397941.606347:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397941.606349:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00010000:00000080:3.0:1787397941.606358:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70218a680 x1874218681311232/t120259084474(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:382/0 lens 520/584 e 0 to 0 dl 1787397952 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787397941.606479:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76222:x1874218681311232:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1361us (1540us total) trans 120259084474 rc 0/0 00000100:00100000:3.0:1787397941.606488:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1644 00000100:00100000:0.0:1787397941.646968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397941.649061:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681311488 00000100:00100000:1.0:1787397941.649077:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681311488 00000100:00100000:1.0:1787397941.649157:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1645 00000100:00100000:1.0:1787397941.649891:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76223:x1874218681311488:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787397941.649935:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397941.649938:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787397941.649966:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31a00/0x274786fe0d192dac lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8696 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.649984:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:1.0:1787397941.649995:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397941.650010:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d192ddd lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86ab expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650153:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650166:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650176:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650190:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650197:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650203:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397941.650750:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00010000:00010000:1.0:1787397941.650769:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30800/0x274786fe0d192df2 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650784:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30800/0x274786fe0d192df2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650792:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30800/0x274786fe0d192df2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650806:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650814:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650820:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650827:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650834:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397941.650838:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650846:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 5/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650855:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a81a867a00) 00010000:00010000:1.0:1787397941.650858:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397941.650862:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 3/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650868:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee31c00/0x274786fe0d192de4 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397941.650887:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000808f913 reply state 000000007dcf8c4b transno 81604378773 ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650899:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650906:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0xf0209d98 (ffff89a81a867000) 00010000:00010000:1.0:1787397941.650908:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397941.650911:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787397941.650951:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30400/0x274786fe0d192ddd lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ab expref: 16 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650969:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30800/0x274786fe0d192df2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ab expref: 15 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397941.650976:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a81a867e00) 00010000:00010000:1.0:1787397941.650979:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397941.650981:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30800, rc 0) 00000100:00100000:1.0:1787397941.651068:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:76223:x1874218681311488:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1181us (4110us total) trans 81604378773 rc 0/0 00000100:00100000:1.0:1787397941.655671:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1645 00010000:00010000:1.0:1787397942.117715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397943.142977:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787397943.163779:0:101695:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787397943.163839:0:101695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163856:0:101695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163863:0:101695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163870:0:101695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163889:0:101695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787397943.163895:0:101695:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787397943.163924:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397943.163929:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163937:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787397943.163941:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.163951:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787397943.163971:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397943.163977:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787397943.163979:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787397943.163982:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787397943.164014:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.164020:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787397943.164046:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.164053:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d191946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19194d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.164063:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397943.164064:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397943.164066:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397943.164082:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701220480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397943.164158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787397943.164213:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397943.164216:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787397943.164221:0:101695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787397943.164232:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787397943.164690:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701220608:0@lo:39:umount.0 00000100:00100000:3.0:1787397943.164733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397943.165288:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220608 00000100:00100000:0.0:1787397943.165297:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220608 00000100:00100000:0.0:1787397943.165339:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1787397943.165347:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701220608:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787397943.165381:0:66177:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1915db 00000100:00080000:0.0:1787397943.165390:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a835595800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1787397943.165418:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd6680 x1874218701220608/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:384/0 lens 224/224 e 0 to 0 dl 1787397954 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397943.165467:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218701220608:12345-0@lo:39:umount.0 Request processed in 121us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397943.165474:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000020:00000080:0.0:1787397943.165486:0:66177:0:(genops.c:906:class_export_put()) final put ffff89a835592000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1787397943.165681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220480 00000100:00100000:1.0:1787397943.165686:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220480 00000100:00100000:1.0:1787397943.165721:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1787397943.165729:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701220480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397943.165739:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397943.165763:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa800/0x274786fe0d19194d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191946 expref: 24 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.165778:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397943.165814:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701220480:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397943.165820:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00010000:00010000:1.0:1787397943.165838:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397943.165869:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701220480:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787397943.166312:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787397943.166331:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701220608:0@lo:39:umount.0 00000020:00000080:3.0:1787397943.166354:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835592000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397943.166419:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835595800 for lustre-MDT0000 00000100:00080000:0.0:1787397943.166802:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787397943.166806:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787397943.166811:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787397943.168427:0:101695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168445:0:101695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168454:0:101695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168461:0:101695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168548:0:101695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397943.168556:0:101695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168563:0:101695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168589:0:101695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.168595:0:101695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168698:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397943.168707:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168714:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397943.168723:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168733:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397943.168740:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397943.168746:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397943.168748:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787397943.168783:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168790:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397943.168826:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168833:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63a00/0x274786fe0d191954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19195b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168845:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397943.168848:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168852:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397943.168855:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168860:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397943.168874:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397943.168878:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787397943.168880:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787397943.168896:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168901:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397943.168906:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397943.168913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397943.168914:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397943.168916:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397943.168964:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701220864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397943.169032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.169086:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397943.169092:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701220736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397943.169129:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.169161:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220864 00000100:00100000:3.0:1787397943.169168:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220864 00000100:00100000:3.0:1787397943.169210:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220736 00000100:00100000:3.0:1787397943.169213:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220736 00000100:00100000:3.0:1787397943.169235:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1787397943.169242:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701220864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397943.169264:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397943.169278:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74800/0x274786fe0d19269e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192697 expref: 24 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.169292:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397943.169328:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701220864:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.169335:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1787397943.169354:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1787397943.169360:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701220736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397943.169376:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397943.169385:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75400/0x274786fe0d19195b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191954 expref: 22 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.169395:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397943.169417:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701220736:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.169423:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1787397943.169456:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701220736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397943.169465:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701220864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787397943.169749:0:101695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787397943.169755:0:101695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050abc00/0x274786fe0d192697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19269e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397943.169766:0:101695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787397943.169774:0:101695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.169781:0:101695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.169788:0:101695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.169795:0:101695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.169824:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397943.169830:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.169837:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787397943.169840:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.169847:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787397943.169852:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397943.169857:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787397943.169859:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787397943.169875:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.169880:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397943.169908:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.169923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397943.169924:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397943.169926:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397943.169966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701220992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397943.169997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397943.170094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701220992 00000100:00100000:1.0:1787397943.170098:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701220992 00000100:00100000:1.0:1787397943.170146:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1787397943.170155:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701220992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397943.170163:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397943.170172:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74200/0x274786fe0d1914d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1914ca expref: 21 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.170182:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397943.170263:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701220992:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397943.170270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00010000:00010000:0.0:1787397943.170398:0:101695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787397943.170402:0:101695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0a00/0x274786fe0d1914ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1914d1 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397943.170412:0:101695:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787397943.170426:0:101695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.170432:0:101695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.170439:0:101695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.170444:0:101695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.170496:0:101695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787397943.170500:0:101695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787397943.170503:0:101695:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787397943.170565:0:101695:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787397943.170570:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787397943.170575:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787397943.170581:0:101695:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1787397943.171298:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701220992:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1787397943.172423:0:101695:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1787397943.173132:0:94328:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084474 is committed 00010000:00010000:0.0:1787397943.173247:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173268:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 2/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173275:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173281:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397943.173286:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173305:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 4/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173321:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a817be7000) 00010000:00010000:0.0:1787397943.173324:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397943.173328:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 2/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397943.173334:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582600/0x274786fe0d192dcf lrc: 0/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787397943.173404:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1787397943.173412:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a702021800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397943.173418:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a8364ef000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397943.173422:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a828a5a000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787397943.173429:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b19800 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 11 (0 0 6) 0 0 0 0: 0000000000000000 120259084474 stale:0 00000020:00080000:0.0:1787397943.173433:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a829b1e800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084471 stale:0 00000020:00080000:0.0:1787397943.173437:0:101695:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a703c88000) has exports, disconnecting them 00000020:00080000:0.0:1787397943.173442:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a702021800), last request at 1787397938 00000020:00000080:0.0:1787397943.173448:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19265f 00000100:00080000:0.0:1787397943.173456:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a702027000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787397943.173748:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397943.173755:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.173764:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787397943.173768:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.173776:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397943.173783:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397943.173788:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787397943.173791:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787397943.173794:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787397943.173826:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.173840:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397943.173870:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.173876:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0000/0x274786fe0d1913f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1913f8 expref: -99 pid: 94327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.173886:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.173888:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.173889:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397943.174053:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397943.174069:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701221120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397943.174225:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787397943.174635:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397943.174655:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701221120 00000100:00100000:1.0:1787397943.174662:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701221120 00000100:00100000:1.0:1787397943.174718:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1787397943.174728:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701221120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397943.174741:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397943.174756:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030600/0x274786fe0d1913f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1913f1 expref: 20 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.174769:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397943.174819:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701221120:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397943.174838:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1787397943.174976:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701221120:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787397943.175089:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a702021800): rc 0 00000020:00000080:0.0:1787397943.175092:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a702021800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787397943.175110:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a8364ef000), last request at 1787397938 00000020:00000080:2.0:1787397943.175215:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702021800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397943.175271:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702027000 for lustre-MDT0000 00000020:00000080:0.0:1787397943.175323:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1925b7 00000100:00080000:0.0:1787397943.175333:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a8364e9800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787397943.175365:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787397943.175427:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8364ef000): rc 0 00000020:00000080:0.0:1787397943.175429:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a8364ef000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787397943.175442:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a828a5a000), last request at 1787397746 00000020:00000080:0.0:1787397943.175445:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1915d4 00000100:00080000:0.0:1787397943.175449:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a828a59800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787397943.175475:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364ef000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787397943.175511:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8364e9800 for lustre-MDT0000 00010000:00010000:2.0:1787397943.178756:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787397943.178947:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a828a5a000): rc 0 00000020:00000080:0.0:1787397943.178952:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828a5a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787397943.178975:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a829b19800), last request at 1787397941 00000020:00000080:0.0:1787397943.178990:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19144c 00000020:00010000:0.0:1787397943.179017:0:101695:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a829b19800: total 1 00000100:00080000:0.0:1787397943.179022:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a81912e000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787397943.179056:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787397943.179107:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a59800 for lustre-MDT0000 00000020:00010000:1.0:1787397943.179207:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a829b19800: total 0 00010000:00010000:1.0:1787397943.179296:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a829b19800, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1787397943.179338:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d191819 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8228 expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179371:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720be00/0x274786fe0d192c9b lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8650 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179391:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d191866 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8244 expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179409:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62800/0x274786fe0d1917fd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8221 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179425:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62000/0x274786fe0d192d58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d867a expref: 6 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179441:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583600/0x274786fe0d192dd6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 5 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397943.179455:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a829b19800, canceled 6 locks, left on hash table 0. 00000020:00080000:2.0:1787397943.181233:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a829b19800): rc 0 00000020:00080000:2.0:1787397943.181241:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a829b1e800), last request at 1787397740 00000020:00000080:2.0:1787397943.181249:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191445 00000020:00010000:2.0:1787397943.181291:0:101695:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a829b1e800: total 0 00000100:00080000:2.0:1787397943.181296:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a7054c6800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787397943.182764:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a829b1e800: total 0 00010000:00010000:3.0:1787397943.182842:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a829b1e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787397943.182879:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d191605 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 5 pid: 94362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.182902:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a829b1e800, canceled 1 locks, left on hash table 0. 00000020:00080000:2.0:1787397943.184712:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a829b1e800): rc 0 00000004:00000080:2.0:1787397943.184724:0:101695:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41bafae0 00000100:00080000:2.0:1787397943.184749:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397943.184754:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787397943.187678:0:101695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787397943.187716:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a810dbd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787397943.187865:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397943.188016:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221248:0@lo:39:umount.0 00000100:00100000:2.0:1787397943.188096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397943.188271:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701221248 00000100:00100000:0.0:1787397943.188280:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701221248 00000100:00100000:0.0:1787397943.190638:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787397943.190660:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701221248:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787397943.190698:0:66189:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19148b 00000100:00080000:0.0:1787397943.190706:0:66189:0:(import.c:65:import_set_state_nolock()) ffff89a836491800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397943.190734:0:66189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378773 00000100:00100000:0.0:1787397943.190898:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3647:x1874218701221248:12345-0@lo:39:umount.0 Request processed in 248us (2801us total) trans 81604378774 rc 0/0 00000100:00100000:0.0:1787397943.190905:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1787397943.200020:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397943.200080:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a810dbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787397943.200093:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221248:0@lo:39:umount.0 00000100:00080000:2.0:1787397943.205214:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787397943.205224:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 4 00000004:00080000:2.0:1787397943.205246:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787397943.205318:0:101695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787397943.206110:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787397943.206130:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787397943.206137:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968731 gen 4 00000004:00080000:2.0:1787397943.206150:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787397943.206212:0:101695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787397943.206225:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787397943.206263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221376:0@lo:9:umount.0 00000020:00080000:2.0:1787397943.206286:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c88000) has no exports 00000100:00100000:0.0:1787397943.206341:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397943.206401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221504:0@lo:9:umount.0 00000100:00100000:2.0:1787397943.206402:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701221376 00000100:00100000:0.0:1787397943.206428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397943.206466:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701221504 00000100:00100000:0.0:1787397943.206472:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701221504 00000100:00100000:2.0:1787397943.206519:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701221376 00000100:00100000:0.0:1787397943.206553:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397943.206565:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701221504:12345-0@lo:9:umount.0 00000100:00100000:2.0:1787397943.206578:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787397943.206587:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701221376:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787397943.206596:0:99639:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1926ac 00000020:00000080:2.0:1787397943.206605:0:99641:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192604 00000100:00080000:0.0:1787397943.206615:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a70378a000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787397943.206623:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a836570800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787397943.206673:0:99639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00000004:2.0:1787397943.206674:0:99641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901909 00000100:00100000:0.0:1787397943.206825:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701221504:12345-0@lo:9:umount.0 Request processed in 263us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397943.206833:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787397943.206853:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397943.206857:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787397943.206917:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a83876ce00 x1874218701221504/t0(0) o9->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787397943.206930:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a830a0f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397943.206934:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397943.206937:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397943.206940:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221504:0@lo:9:umount.0 00010000:00010000:0.0:1787397943.206962:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397943.206969:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397943.207052:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701221376:12345-0@lo:9:umount.0 Request processed in 466us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397943.207059:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787397943.208261:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787397943.208280:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787397943.208282:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787397943.208288:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701221376:0@lo:9:umount.0 00000100:00100000:0.0:1787397943.208568:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1787397943.208581:0:3651:0:(client.c:1381:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff89a83876ea00 x1874218701221632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397943.208623:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1874218701221632:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1787397943.220876:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a703c88000) has no exports 00000020:00000080:1.0:1787397943.221296:0:6510:0:(genops.c:906:class_export_put()) final put ffff89a829b19800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397943.221380:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b19800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0000 00000020:00000080:1.0:1787397943.221458:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a81912e000 for lustre-MDT0000 00010000:00010000:1.0:1787397943.221472:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397943.221489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397943.221492:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397943.226096:0:56852:0:(genops.c:906:class_export_put()) final put ffff89a829b1e800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1787397943.226654:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.226658:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.226662:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787397943.227882:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787397943.227953:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7054c6800 for lustre-MDT0000 00000100:00100000:1.0:1787397943.269760:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701221760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397943.269841:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.269948:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701221760 00000100:00100000:3.0:1787397943.269970:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701221760 00000100:00100000:3.0:1787397943.270032:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787397943.270042:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701221760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397943.270071:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397943.270114:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701221760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.270121:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787397943.270184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397943.270222:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701221760:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1787397943.295621:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191461 00000020:00000080:2.0:1787397943.295639:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828787000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787397943.295661:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787397943.297150:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828787000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787397943.297269:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397943.297283:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787397943.297288:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a83b9d3380) has no exports 00000020:00000080:3.0:1787397943.297826:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19145a 00000020:00000080:3.0:1787397943.297835:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a838798800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397943.297885:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397943.297893:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397943.297896:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a827b39000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787397943.297899:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b39000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787397943.297904:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787397943.298074:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838798800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787397943.298131:0:101695:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a811418480 - data ffff89a83fc440d8/ffff89a703e3d000 00000020:01000000:3.0:1787397943.298269:0:101695:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70582e060 - data ffff89a827cf4798/ffff89a810b64400 00000100:00080000:1.0:1787397943.355691:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787397943.355701:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787397943.355716:0:101695:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a83876ca80 x1874218701221248/t81604378774(81604378774) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397953 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397943.355744:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787397943.361239:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397943.361260:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 5 00000004:00080000:1.0:1787397943.361283:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397943.361286:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787397943.361622:0:94347:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787397943.361628:0:94347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 22 count 1 00000040:00080000:3.0:1787397943.361642:0:94347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:1.0:1787397943.362794:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397943.362799:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968731 gen 5 00000004:00080000:1.0:1787397943.362814:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397943.362817:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787397943.363159:0:94349:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787397943.363165:0:94349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:2.0:1787397943.363176:0:94349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:1.0:1787397943.372234:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191414 00000020:00000080:1.0:1787397943.372257:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a837bc0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397943.372368:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397943.374671:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191430 00000020:00000080:1.0:1787397943.374684:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a836715000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787397943.374746:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787397943.374754:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397943.374765:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787397943.374779:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a703c899c0) has no exports 00000004:01000000:1.0:1787397943.375177:0:101695:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787397943.375187:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1914ae 00000020:00000080:1.0:1787397943.375191:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a7054c0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397943.375226:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836715000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787397943.375394:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787397943.375395:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787397943.375400:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397943.375408:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787397943.375411:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a703f599c0) has no exports 00000020:00000080:1.0:1787397943.375418:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1914a0 00000020:00000080:1.0:1787397943.375423:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a830a0e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397943.375438:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787397943.375932:0:101695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787397943.375937:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787397943.375942:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968731 gen 6 00000004:00080000:1.0:1787397943.375947:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397943.375949:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397943.376042:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397943.376052:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397943.376059:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191492 00000020:00000080:1.0:1787397943.376064:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828785000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397943.376102:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a830a0f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787397943.376109:0:8:0:(genops.c:906:class_export_put()) final put ffff89a828781000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397943.376120:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828781000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787397943.376124:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397943.376547:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787397943.376554:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397943.376562:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787397943.376565:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a702478000) has no exports 00000020:00000080:1.0:1787397943.376571:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191484 00000020:00000080:1.0:1787397943.376576:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a817efa800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397943.376637:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828785000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787397943.377488:0:101695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787397943.377493:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787397943.377497:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 6 00000004:00080000:1.0:1787397943.377502:0:101695:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787397943.377504:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397943.377837:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397943.377982:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397943.377995:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787397943.378030:0:101695:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787397943.378039:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191476 00000020:00000080:1.0:1787397943.378048:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828784800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397943.378076:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efe800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787397943.378083:0:8:0:(genops.c:906:class_export_put()) final put ffff89a828786800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397943.378086:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828786800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787397943.378091:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397943.378373:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787397943.378379:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787397943.378386:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787397943.378389:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a703f5b380) has no exports 00000020:00000080:1.0:1787397943.378395:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19146f 00000020:00000080:1.0:1787397943.378399:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a83879e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787397943.378427:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828784800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787397943.379228:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83879e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787397943.385890:0:101695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787397943.386157:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787397943.386162:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397943.386170:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787397943.386222:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a810dbd800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787397943.386235:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397943.386263:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397943.386288:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828856800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397943.386293:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828856800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787397943.386494:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397943.386890:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397943.386897:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397943.386901:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a828855800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787397943.386904:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828855800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787397943.386909:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787397943.386967:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d191437 00000020:00000080:2.0:1787397943.386973:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a836712000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787397943.386990:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787397943.386994:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397943.387000:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397943.387004:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a703c8b380) has no exports 00000020:00000080:2.0:1787397943.387033:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397943.387038:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787397943.387042:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19143e 00000020:00000080:2.0:1787397943.387047:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a836715800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787397943.387056:0:101695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a901000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787397943.387059:0:101695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 3 00000020:01000004:2.0:1787397943.387062:0:101695:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70a901000 from lustre-MDT0000 00000020:00000080:2.0:1787397943.387081:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397943.387085:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787397943.387087:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a837bc4800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787397943.387090:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787397943.387098:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1787397943.387106:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836712000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787397943.387113:0:8:0:(genops.c:906:class_export_put()) final put ffff89a836716000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787397943.387115:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836716000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787397943.387127:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787397943.387136:0:101695:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787397943.387140:0:101695:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787397943.387143:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787397943.387147:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397943.387150:0:101695:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787397943.387156:0:101695:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a83670d800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397943.387164:0:101695:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a83670f000 e5696550-1ffc-466d-b13d-359d59b5fc5f 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787397943.387169:0:101695:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a703f58000) has exports, disconnecting them 00000020:00080000:2.0:1787397943.387175:0:101695:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a83670d800), last request at 1787397740 00000020:00000080:3.0:1787397943.387196:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836715800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787397943.387196:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1913e3 00000020:00010000:2.0:1787397943.387206:0:101695:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83670d800: total 0 00000100:00080000:2.0:1787397943.387212:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a709123800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787397943.387236:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83670d800): rc 0 00000020:00080000:2.0:1787397943.387240:0:101695:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a83670f000), last request at 1787397737 00000020:00010000:3.0:1787397943.387264:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83670d800: total 0 00010000:00010000:3.0:1787397943.387300:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83670d800, canceled 0 locks, left on hash table 13. 00000020:00000080:2.0:1787397943.387311:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1913c0 00000020:00010000:2.0:1787397943.387316:0:101695:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83670f000: total 0 00000100:00080000:2.0:1787397943.387320:0:101695:0:(import.c:65:import_set_state_nolock()) ffff89a83670e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787397943.387333:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63e00/0x274786fe0d191977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191970 expref: 14 pid: 94340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787397943.387348:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a83670f000): rc 0 00010000:00010000:3.0:1787397943.387356:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63000/0x274786fe0d192578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192571 expref: 13 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787397943.387358:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a703f58000) has no exports 00010000:00010000:3.0:1787397943.387382:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75000/0x274786fe0d192594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19258d expref: 12 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387397:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74600/0x274786fe0d1925a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19259b expref: 11 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387421:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aba00/0x274786fe0d192620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192619 expref: 10 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387435:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345f1a00/0x274786fe0d1915b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1915aa expref: 9 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397943.387450:0:94335:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a8187abc00:94335] 2 exiting: rc = 0 00010000:00010000:3.0:1787397943.387455:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62400/0x274786fe0d1926b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1926a5 expref: 8 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387467:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75c00/0x274786fe0d1919bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1919b6 expref: 7 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387479:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62c00/0x274786fe0d19264a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192643 expref: 6 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387489:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22a00/0x274786fe0d191541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19153a expref: 5 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387501:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22600/0x274786fe0d19154f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191548 expref: 4 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387513:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab600/0x274786fe0d19263c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192635 expref: 3 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387541:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75800/0x274786fe0d191969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d191962 expref: 2 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387551:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83670d800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787397943.387568:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a83670d800/99b57a74-e5dc-42df-b087-b10fad741506 00000020:00010000:3.0:1787397943.387577:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83670f000: total 1 00010000:00010000:3.0:1787397943.387585:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.387606:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83670f000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1787397943.387623:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a800030200/0x274786fe0d1913d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8205 expref: 5 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387637:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75a00/0x274786fe0d19193f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8275 expref: 4 pid: 94333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387647:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74600/0x274786fe0d191938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d826e expref: 3 pid: 94334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387659:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a74400/0x274786fe0d192690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8585 expref: 2 pid: 94335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397943.387669:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83670f000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1787397943.387682:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a83670f000/e5696550-1ffc-466d-b13d-359d59b5fc5f 00010000:00010000:3.0:1787397943.387688:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.387690:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397943.387694:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397943.387694:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787397943.387704:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670d800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000100:00100000:0.0:1787397943.387735:0:94340:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a818250000:94340] 3 exiting: rc = 0 00000020:00000080:3.0:1787397943.387740:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670f000/e5696550-1ffc-466d-b13d-359d59b5fc5f for MGS 00000020:00000080:3.0:1787397943.387757:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a709123800 for MGS 00000020:00000080:3.0:1787397943.387763:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83670e800 for MGS 00000100:00100000:2.0:1787397943.389786:0:94334:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a8187ab600:94334] 1 exiting: rc = 0 00000100:00100000:2.0:1787397943.390584:0:94333:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a8187aba00:94333] 0 exiting: rc = 1 00000100:00100000:3.0:1787397943.390632:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390643:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390651:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390657:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390663:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390669:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390676:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390681:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390699:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390705:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390712:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390720:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390727:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390735:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390742:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390750:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390757:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390765:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390773:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390781:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390790:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390796:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390803:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390810:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390816:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390821:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390826:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390832:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390837:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390842:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390848:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390853:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390860:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390865:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390870:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390875:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390882:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390889:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390896:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390903:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390910:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390916:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390922:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390938:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390946:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390955:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390962:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390969:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390977:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390986:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.390994:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391004:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391027:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391037:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391044:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391050:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391056:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391061:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391068:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391074:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391079:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391091:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391107:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787397943.391116:0:101695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787397943.393122:0:101695:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a811418840 - data ffff89a827fce510/ffff89a835668800 00000020:01000000:3.0:1787397943.393256:0:101695:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a811418b40 - data ffff89a827dfb000/ffff89a82880d800 00000020:00000080:3.0:1787397943.393752:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1913b9 00000020:00000080:3.0:1787397943.393760:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a70a901800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787397943.393776:0:101695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a70a901000 from MGS, refs=2 00000020:01000004:3.0:1787397943.393780:0:101695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 2 00000020:01000004:3.0:1787397943.393782:0:101695:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a70a901000 from MGS 00000020:00000080:3.0:1787397943.393800:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787397943.393808:0:101695:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787397943.393811:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a709125000/MGS 00000020:00000080:3.0:1787397943.393814:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709125000/MGS for MGS 00000020:01000000:3.0:1787397943.393820:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1787397943.393886:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70a901800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787397943.393888:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787397943.393900:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787397943.393909:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787397943.393916:0:101695:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a83fa41000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787397943.393922:0:101695:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a7020799c0) has exports, disconnecting them 00000020:00080000:3.0:1787397943.393926:0:101695:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a83fa41000), last request at 1787397740 00000020:00000080:3.0:1787397943.393930:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1914ed 00000020:00080000:3.0:1787397943.393938:0:101695:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83fa41000): rc 0 00000020:00000080:3.0:1787397943.393942:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a83fa41000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787397943.394717:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa41000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787397943.395572:0:101695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787397943.395580:0:101695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787397943.395584:0:101695:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787397943.395590:0:101695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787397943.395638:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a58000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787397943.398657:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787397943.398678:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787397943.398686:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a817ecf000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787397943.398691:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ecf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787397943.398700:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787397943.398791:0:101695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a70a901000 1 00000020:00000080:2.0:1787397943.398798:0:101695:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1913ab 00000020:00000080:2.0:1787397943.398804:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a709126800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787397943.398828:0:101695:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787397943.398832:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787397943.398838:0:101695:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787397943.398842:0:101695:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a703c8cd40) has no exports 00000020:00000080:1.0:1787397943.398909:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709126800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787397943.418695:0:101695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787397943.418710:0:101695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787397943.418716:0:101695:0:(genops.c:906:class_export_put()) final put ffff89a70a906000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787397943.418721:0:101695:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70a906000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787397943.418727:0:101695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787397943.418849:0:101695:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a70a900000 00000020:02000400:1.0:1787397943.418925:0:101695:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787397943.785946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701222016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786093:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701222528:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786145:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787397943.786150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701221888:0@lo:400:kworker.0 00000400:00000100:3.0:1787397943.786168:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701221888 offset 0 length 224: 4 00000100:00100000:3.0:1787397943.786192:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701222400:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786231:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701222912:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786264:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786302:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701222144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786354:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701222656:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786395:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397943.786400:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701222272:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786468:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701222784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.786562:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222016 00000100:00100000:3.0:1787397943.786573:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222016 00000100:00100000:3.0:1787397943.786627:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787397943.786636:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1874218701222016:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397943.786646:0:66188:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397943.786697:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1874218701222016:12345-0@lo:400:kworker.0 Request processed in 59us (647us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397943.786705:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787397943.786737:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222528 00000100:00100000:3.0:1787397943.786741:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222528 00000100:00100000:3.0:1787397943.786763:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222400 00000100:00100000:3.0:1787397943.786766:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222400 00000100:00100000:3.0:1787397943.786775:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222912 00000100:00100000:3.0:1787397943.786777:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222912 00000100:00100000:3.0:1787397943.786807:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222656 00000100:00100000:3.0:1787397943.786810:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222656 00000100:00100000:3.0:1787397943.786826:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222784 00000100:00100000:3.0:1787397943.786829:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222784 00000100:00100000:3.0:1787397943.786840:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:3.0:1787397943.786846:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701222912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786895:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701222912:12345-0@lo:400:kworker.0 Request processed in 49us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.786903:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:3.0:1787397943.786917:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1787397943.786922:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701222656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.786964:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701222656:12345-0@lo:400:kworker.0 Request processed in 42us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.786971:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1787397943.786982:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1787397943.786986:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701222528:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397943.786991:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397943.787012:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701222528:12345-0@lo:400:kworker.0 Request processed in 24us (892us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397943.787018:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1787397943.787028:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1787397943.787032:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701222400:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397943.787036:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397943.787056:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701222400:12345-0@lo:400:kworker.0 Request processed in 23us (842us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397943.787061:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:3.0:1787397943.787072:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1787397943.787076:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701222784:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787397943.787080:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787397943.787099:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701222784:12345-0@lo:400:kworker.0 Request processed in 21us (607us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787397943.787105:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1787397943.787124:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222144 00000100:00100000:3.0:1787397943.787128:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222144 00000100:00100000:3.0:1787397943.787152:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701222272 00000100:00100000:3.0:1787397943.787154:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701222272 00000100:00100000:3.0:1787397943.787174:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397943.787181:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701222144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787220:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701222144:12345-0@lo:400:kworker.0 Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.787227:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397943.787254:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787397943.787261:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701222272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787290:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701222272:12345-0@lo:400:kworker.0 Request processed in 30us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397943.787297:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787397943.787348:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397943.787354:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397943.787359:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397943.787365:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397943.787370:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3625 00000100:00080000:3.0:1787397943.787377:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397943.787408:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915c00 x1874218701223040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397943.787435:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701222400:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787457:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701222912:0@lo:400:kworker.0 00000100:00080000:3.0:1787397943.787467:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397943.787471:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397943.787474:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397943.787479:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397943.787484:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3625 00000100:00080000:3.0:1787397943.787496:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397943.787513:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806914e00 x1874218701223168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397943.787551:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701222016:0@lo:400:kworker.0 00000100:00080000:3.0:1787397943.787564:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397943.787568:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397943.787570:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397943.787573:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397943.787577:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3776 00000100:00080000:3.0:1787397943.787581:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397943.787595:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915500 x1874218701223296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397943.787605:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701222528:0@lo:400:kworker.0 00010000:00080000:3.0:1787397943.787652:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a82ebd7800 x1874218701222272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397943.787663:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701222272:0@lo:400:kworker.0 00000100:00080000:3.0:1787397943.787672:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787397943.787675:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787397943.787678:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787397943.787681:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397943.787683:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3792 00000100:00080000:3.0:1787397943.787687:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397943.787708:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806917b80 x1874218701223424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397943.787719:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701222784:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787733:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701222144:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787742:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701222656:0@lo:400:kworker.0 00000100:00100000:3.0:1787397943.787774:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701223040:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787397943.787806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.787827:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701223168:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787397943.787849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.787865:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701223296:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787397943.787883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.787896:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701223424:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787397943.787914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397943.787939:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223040 00000100:00100000:3.0:1787397943.787943:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223040 00000100:00100000:3.0:1787397943.787959:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223296 00000100:00100000:3.0:1787397943.787962:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223296 00000100:00100000:3.0:1787397943.787968:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223424 00000100:00100000:3.0:1787397943.787970:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223424 00000100:00100000:3.0:1787397943.787979:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1787397943.787985:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223040:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1787397943.788010:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397943.788042:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223040:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (234us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397943.788056:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1787397943.788070:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1787397943.788073:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223296:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1787397943.788083:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397943.788108:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223296:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (224us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397943.788113:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1787397943.788123:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1787397943.788129:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223424:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1787397943.788137:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397943.788161:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701223424:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (246us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397943.788167:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1787397943.788184:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223168 00000100:00100000:3.0:1787397943.788188:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223168 00000100:00100000:3.0:1787397943.788204:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787397943.788208:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701223168:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1787397943.788217:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397943.788253:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701223168:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (391us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397943.788258:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787397943.788289:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397943.788295:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397943.788298:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701223040:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787397943.788319:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397943.788323:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397943.788326:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701223168:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787397943.788333:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397943.788336:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397943.788339:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701223296:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787397943.788345:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397943.788348:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397943.788351:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701223424:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1787397943.788532:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397943.788539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1787397944.070858:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681311616 offset 0 length 224: 4 00000100:00100000:2.0:1787397944.093022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397944.093132:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397944.093154:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312000 00000100:00100000:2.0:1787397944.093163:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312000 00000100:00100000:2.0:1787397944.093226:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:2.0:1787397944.093245:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681312000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397944.093320:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681312000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397944.093341:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:2.0:1787397944.093378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:1.0:1787397944.098405:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397944.098476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397944.098553:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681311744 00000100:00100000:0.0:1787397944.098563:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681311744 00000100:00100000:0.0:1787397944.098611:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681311872 00000100:00100000:1.0:1787397944.098706:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1653 00000100:00100000:1.0:1787397944.098715:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1874218681311744:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:1.0:1787397944.098725:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:1.0:1787397944.098776:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1874218681311744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 62us (5767us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787397944.098784:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1653 00000100:00100000:0.0:1787397944.098820:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681311872 00000100:00080000:1.0:1787397944.098906:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397944.098971:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1634 00000100:00100000:0.0:1787397944.098979:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2405:x1874218681311872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397944.099022:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:2405:x1874218681311872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 45us (5643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397944.099028:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1634 00000100:00100000:3.0:1787397944.099094:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312128 00000100:00100000:3.0:1787397944.099098:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312128 00000100:00100000:3.0:1787397944.099132:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:3.0:1787397944.099138:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681312128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397944.099163:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681312128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397944.099168:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00080000:1.0:1787397944.099404:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397944.105801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397944.107599:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312256 00000100:00100000:1.0:1787397944.107626:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312256 00000100:00100000:1.0:1787397944.107683:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1654 00000100:00100000:1.0:1787397944.107692:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681312256:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1787397944.107721:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397944.107806:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681312256:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 Request processed in 114us (2018us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397944.107814:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1654 00010000:00010000:0.0:1787397944.168376:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397945.191682:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397945.323056:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701223552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397945.323152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397945.325391:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223552 00000100:00100000:2.0:1787397945.325403:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223552 00000100:00100000:2.0:1787397945.325543:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787397945.325554:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701223552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397945.325605:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397945.325689:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701223552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397945.325696:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787397945.328800:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787397945.331555:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a806917b80 x1874218701223552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397945.331602:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701223552:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397946.212742:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397947.238005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787397947.880096:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397947.880112:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378774 is committed 00000020:00000080:0.0:1787397947.880117:0:75615:0:(genops.c:906:class_export_put()) final put ffff89a835449000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787397947.880213:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378773 is committed 00010000:00010000:1.0:1787397947.882676:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882694:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882702:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882708:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397947.882713:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882722:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882744:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0xf0209d98 (ffff89a81a867000) 00010000:00010000:1.0:1787397947.882748:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397947.882753:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397947.882795:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30000/0x274786fe0d192deb lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787397947.883740:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835449000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787397947.883835:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836491800 for lustre-MDT0001 00010000:00010000:3.0:1787397948.260751:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397948.388910:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701223680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397948.388999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397948.390978:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223680 00000100:00100000:2.0:1787397948.390993:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223680 00000100:00080000:3.0:1787397948.391083:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397948.391232:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787397948.391246:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701223680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397948.391280:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397948.391361:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701223680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397948.391469:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701223680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397948.393633:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000001:00100000:0.0:1787397948.902576:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397948.902587:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a70378f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787397948.902946:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70378f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000100:00080000:1.0:1787397948.903052:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397948.903057:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397948.903060:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397948.903070:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3823 00000100:00080000:1.0:1787397948.903076:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397948.903082:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397948.903116:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70218aa00 x1874218701223936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397948.903166:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397948.903170:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397948.903172:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397948.903176:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3823 00000100:00080000:1.0:1787397948.903179:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397948.903182:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397948.903194:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702188a80 x1874218701224320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397948.903202:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397948.903206:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397948.903207:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787397948.903209:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701223808:0@lo:400:kworker.0 00000100:00080000:1.0:1787397948.903210:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3823 00000100:00080000:1.0:1787397948.903223:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397948.903227:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397948.903238:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70218b100 x1874218701224448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787397948.903250:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787397948.903253:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787397948.903254:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787397948.903257:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3823 00000400:00000100:2.0:1787397948.903260:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701223808 offset 0 length 224: 4 00000100:00080000:1.0:1787397948.903260:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787397948.903263:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397948.903271:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702189500 x1874218701224704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:1.0:1787397948.903300:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70378a000 for lustre-OST0001 00000100:00100000:2.0:1787397948.903303:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701224832:0@lo:400:kworker.0 00000100:00100000:1.0:1787397948.903315:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701223936:0@lo:38:kworker.0 00000100:00100000:2.0:1787397948.903334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397948.903356:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397948.903357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397948.903361:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701224576:0@lo:400:kworker.0 00000100:00100000:1.0:1787397948.903377:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701224320:0@lo:38:kworker.0 00000100:00100000:2.0:1787397948.903390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397948.903405:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224832 00000100:00100000:1.0:1787397948.903413:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224832 00000100:00100000:1.0:1787397948.903467:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224576 00000100:00100000:1.0:1787397948.903470:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224576 00000100:00100000:1.0:1787397948.903493:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:1.0:1787397948.903501:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701224832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397948.903552:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1787397948.903561:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701224576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397948.903628:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701224576:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397948.903638:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1787397948.903702:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701224576:0@lo:400:kworker.0 00000100:00100000:2.0:1787397948.903775:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701223936 00000100:00100000:2.0:1787397948.903779:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701223936 00000100:00100000:2.0:1787397948.903803:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397948.903808:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701223936:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787397948.904157:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701224832:12345-0@lo:400:kworker.0 Request processed in 585us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397948.904167:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00080000:1.0:1787397948.904204:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397948.904217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397948.904241:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701224448:0@lo:38:kworker.0 00000100:00100000:1.0:1787397948.904269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397948.904284:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701224704:0@lo:38:kworker.0 00000100:00100000:1.0:1787397948.904304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397948.904336:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224320 00000100:00100000:1.0:1787397948.904340:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224320 00000100:00100000:1.0:1787397948.904359:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224448 00000100:00100000:1.0:1787397948.904362:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224448 00000100:00100000:1.0:1787397948.904372:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224704 00000100:00100000:1.0:1787397948.904374:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224704 00000100:00100000:1.0:1787397948.904387:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:1.0:1787397948.904392:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224320:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397948.904414:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397948.904450:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224320:12345-0@lo:38:kworker.0 Request processed in 57us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397948.904457:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:1.0:1787397948.904468:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1787397948.904472:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224448:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397948.904480:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397948.904503:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224448:12345-0@lo:38:kworker.0 Request processed in 30us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397948.904508:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1787397948.904519:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1787397948.904543:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397948.904552:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397948.904584:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701224704:12345-0@lo:38:kworker.0 Request processed in 40us (279us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397948.904590:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1787397948.904880:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224192:0@lo:400:kworker.0 00000100:00100000:3.0:1787397948.904922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397948.904949:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397948.904956:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224064:0@lo:400:kworker.0 00000100:00100000:3.0:1787397948.904991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397948.905020:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224192 00000100:00100000:3.0:1787397948.905025:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224192 00000100:00100000:3.0:1787397948.905066:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224064 00000100:00100000:3.0:1787397948.905069:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224064 00000100:00100000:3.0:1787397948.905086:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787397948.905106:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397948.905163:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224192:12345-0@lo:400:kworker.0 Request processed in 58us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397948.905170:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787397948.905189:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397948.905194:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397948.905220:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224064:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397948.905226:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787397948.905249:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397948.905274:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224064:0@lo:400:kworker.0 00010000:00080000:3.0:1787397948.905287:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a702188700 x1874218701224192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397948.905297:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397948.905644:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701224832:0@lo:400:kworker.0 00000100:00080000:1.0:1787397948.906222:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397948.906231:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397948.906237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701224320:0@lo:38:kworker.0 00000100:00080000:1.0:1787397948.906259:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:2.0:1787397948.906261:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1787397948.906262:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397948.906265:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701224448:0@lo:38:kworker.0 00000100:00080000:1.0:1787397948.906275:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397948.906278:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397948.906280:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701224704:0@lo:38:kworker.0 00000100:00100000:2.0:1787397948.906323:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701223936:12345-0@lo:38:kworker.0 Request processed in 2511us (2962us total) trans 0 rc -19/-19 00000100:00080000:1.0:1787397948.906324:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397948.906327:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397948.906330:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701223936:0@lo:38:kworker.0 00000100:00100000:2.0:1787397948.906332:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000001:00100000:0.0:1787397948.909365:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787397948.909377:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a817ec9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787397948.909636:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ec9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787397948.909696:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836570800 for lustre-OST0000 00000400:00000100:1.0:1787397949.198248:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681312384 offset 0 length 224: 4 00000100:00100000:1.0:1787397949.198298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397949.198344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397949.198427:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312512 00000100:00100000:2.0:1787397949.198437:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312512 00000100:00100000:2.0:1787397949.198479:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312640 00000100:00100000:2.0:1787397949.198483:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312640 00000100:00100000:2.0:1787397949.198569:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1637 00000100:00100000:2.0:1787397949.198581:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681312640:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397949.198669:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681312640:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397949.198678:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1637 00000100:00100000:2.0:1787397949.198699:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1658 00000100:00100000:2.0:1787397949.198706:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681312512:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397949.198744:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397949.198774:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681312512:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 68us (477us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397949.198781:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1658 00000100:00080000:0.0:1787397949.199068:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397949.203626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397949.207788:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312768 00000100:00100000:3.0:1787397949.207803:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312768 00000100:00100000:3.0:1787397949.207890:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:3.0:1787397949.207902:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681312768:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:0.0:1787397949.208027:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397949.220370:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681312768:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 12454us (16737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397949.220389:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:2.0:1787397949.221830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397949.222354:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681312896 00000100:00100000:3.0:1787397949.222364:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681312896 00000100:00080000:0.0:1787397949.222498:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397949.222717:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:0.0:1787397949.222730:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681312896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397949.222815:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681312896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397949.222823:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00010000:00010000:0.0:1787397949.285407:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397950.309456:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397950.437961:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787397950.437983:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397950.438063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397950.438173:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701224960 00000100:00100000:2.0:1787397950.438181:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701224960 00000100:00100000:2.0:1787397950.438255:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787397950.438265:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397950.438296:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397950.438337:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701224960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397950.438344:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787397950.438406:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787397950.438879:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a806914e00 x1874218701224960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397950.438917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701224960:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397951.332832:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397952.356775:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397953.380697:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397953.509553:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397953.509576:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701225088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397953.509647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397953.510084:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225088 00000100:00100000:3.0:1787397953.510093:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225088 00000100:00100000:3.0:1787397953.510169:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787397953.510179:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701225088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397953.510212:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397953.510269:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701225088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397953.510276:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787397953.510379:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397953.510418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701225088:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787397954.021270:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397954.021277:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397954.021280:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397954.021289:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3828 00000100:00080000:2.0:1787397954.021294:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397954.021302:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397954.021325:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876df80 x1874218701225344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397954.021361:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397954.021365:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397954.021366:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397954.021387:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3828 00000100:00080000:2.0:1787397954.021390:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397954.021395:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397954.021410:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70218aa00 x1874218701225728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397954.021420:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397954.021422:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397954.021424:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397954.021428:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3828 00000100:00080000:2.0:1787397954.021431:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397954.021435:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397954.021446:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702189500 x1874218701225856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787397954.021470:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397954.021473:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787397954.021475:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397954.021478:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3828 00000100:00080000:2.0:1787397954.021480:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397954.021483:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397954.021494:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702188a80 x1874218701226112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397954.021581:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701225472:0@lo:400:kworker.0 00000100:00100000:1.0:1787397954.021655:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.021730:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701225216:0@lo:400:kworker.0 00000400:00000100:0.0:1787397954.021756:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701225216 offset 0 length 224: 4 00000100:00100000:0.0:1787397954.021782:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701226240:0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.021809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.021850:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226240 00000100:00100000:0.0:1787397954.021858:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226240 00000100:00100000:0.0:1787397954.021916:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1787397954.021925:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701226240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.021983:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701226240:12345-0@lo:400:kworker.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397954.021990:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00080000:0.0:1787397954.022018:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397954.022058:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701226240:0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022081:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701225600:0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022126:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397954.022131:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701225984:0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022172:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225984 00000100:00100000:0.0:1787397954.022176:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225984 00000100:00100000:0.0:1787397954.022206:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1787397954.022213:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701225984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022246:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701225984:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397954.022252:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00080000:0.0:1787397954.022266:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397954.022282:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701225984:0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022315:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701225344:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.022362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022383:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701225728:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.022404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022418:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701225856:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.022447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701226112:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.022477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397954.022506:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225728 00000100:00100000:0.0:1787397954.022509:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225728 00000100:00100000:0.0:1787397954.022544:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225856 00000100:00100000:0.0:1787397954.022547:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225856 00000100:00100000:0.0:1787397954.022559:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226112 00000100:00100000:0.0:1787397954.022561:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226112 00000100:00100000:0.0:1787397954.022571:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1787397954.022575:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701225728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397954.022592:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397954.022622:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701225728:12345-0@lo:38:kworker.0 Request processed in 45us (216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397954.022628:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1787397954.022639:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1787397954.022642:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701225856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397954.022650:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397954.022669:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701225856:12345-0@lo:38:kworker.0 Request processed in 26us (221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397954.022674:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1787397954.022683:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1787397954.022686:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701226112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397954.022694:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397954.022716:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701226112:12345-0@lo:38:kworker.0 Request processed in 27us (237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397954.022730:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00080000:0.0:1787397954.022763:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397954.022768:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397954.022770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70218aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701225728:0@lo:38:kworker.0 00000100:00080000:0.0:1787397954.022779:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397954.022782:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397954.022784:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701225856:0@lo:38:kworker.0 00000100:00080000:0.0:1787397954.022791:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397954.022794:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397954.022797:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701226112:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.022834:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225472 00000100:00100000:0.0:1787397954.022838:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225472 00000100:00100000:0.0:1787397954.022865:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225600 00000100:00100000:0.0:1787397954.022868:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225600 00000100:00100000:0.0:1787397954.022893:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397954.022899:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701225472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022933:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701225472:12345-0@lo:400:kworker.0 Request processed in 34us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397954.022939:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397954.022950:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397954.022955:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701225600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397954.022986:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701225600:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397954.022992:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787397954.023007:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787397954.023034:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a83876fb80 x1874218701225600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397954.023149:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701225472:0@lo:400:kworker.0 00000100:00100000:1.0:1787397954.023192:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701225344 00000100:00100000:1.0:1787397954.023196:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701225344 00000100:00100000:1.0:1787397954.023218:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787397954.023223:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e49d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701225344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787397954.023233:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787397954.023266:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e49d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701225344:12345-0@lo:38:kworker.0 Request processed in 42us (904us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787397954.023273:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787397954.023501:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397954.023506:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397954.023508:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701225344:0@lo:38:kworker.0 00000100:00100000:0.0:1787397954.023687:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701225600:0@lo:400:kworker.0 00000400:00000100:2.0:1787397954.318478:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681313024 offset 0 length 224: 4 00000100:00100000:2.0:1787397954.318518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397954.318575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397954.318623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397954.318626:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313408 00000100:00100000:0.0:1787397954.318638:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313408 00000100:00100000:2.0:1787397954.318699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397954.318720:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313536 00000100:00100000:0.0:1787397954.318725:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313536 00000100:00080000:2.0:1787397954.318739:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397954.318745:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397954.318755:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:0.0:1787397954.318766:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681313408:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397954.318768:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313280 00000100:00100000:2.0:1787397954.318775:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313280 00000100:00100000:2.0:1787397954.318829:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313152 00000100:00100000:2.0:1787397954.318833:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313152 00000100:00100000:2.0:1787397954.318855:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1640 00000100:00100000:0.0:1787397954.318861:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681313408:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397954.318870:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681313280:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397954.318875:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:0.0:1787397954.318898:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:0.0:1787397954.318906:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681313536:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397954.318932:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2402:x1874218681313280:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 59us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397954.318939:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681313536:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397954.318945:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1640 00000100:00100000:0.0:1787397954.318951:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:2.0:1787397954.318967:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1662 00000100:00100000:2.0:1787397954.318974:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681313152:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397954.318994:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397954.319026:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681313152:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 50us (327us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397954.319044:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1662 00000100:00080000:2.0:1787397954.319063:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787397954.404803:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397955.428774:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397955.557059:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701226368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397955.557131:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397955.557214:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226368 00000100:00100000:2.0:1787397955.557221:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226368 00000100:00100000:2.0:1787397955.557278:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787397955.557287:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701226368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397955.557315:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397955.557433:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701226368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397955.557440:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787397955.557440:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a806915880 x1874218701226368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397955.557455:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701226368:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787397956.454699:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397957.476789:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397958.501002:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397958.639695:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701226496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397958.639813:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397958.639879:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226496 00000100:00100000:3.0:1787397958.639888:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226496 00000100:00100000:3.0:1787397958.639965:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787397958.639974:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701226496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397958.640001:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397958.640045:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701226496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397958.640052:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787397958.640072:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397958.640106:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701226496:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787397959.140767:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397959.140774:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397959.140778:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397959.140788:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3833 00000100:00080000:0.0:1787397959.140799:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397959.140809:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397959.140851:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8047c9500 x1874218701226752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397959.140897:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397959.140900:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397959.140902:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397959.140905:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3833 00000100:00080000:0.0:1787397959.140908:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397959.140912:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397959.140923:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8047c8000 x1874218701227136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397959.140932:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397959.140936:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397959.140953:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397959.140956:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3833 00000100:00080000:0.0:1787397959.140959:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397959.140963:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397959.140991:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705478a80 x1874218701227264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397959.141009:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397959.141012:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397959.141014:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397959.141017:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3833 00000100:00080000:0.0:1787397959.141020:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787397959.141024:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397959.141055:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705478700 x1874218701227520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397959.141092:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701226752:0@lo:38:kworker.0 00000100:00100000:0.0:1787397959.141233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141280:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701227136:0@lo:38:kworker.0 00000100:00100000:0.0:1787397959.141307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141325:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701227264:0@lo:38:kworker.0 00000100:00100000:0.0:1787397959.141344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701227520:0@lo:38:kworker.0 00000100:00100000:0.0:1787397959.141381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141420:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701226880:0@lo:400:kworker.0 00000100:00100000:0.0:1787397959.141446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141483:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397959.141490:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701227008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397959.141511:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397959.141585:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226752 00000100:00100000:0.0:1787397959.141593:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226752 00000100:00100000:0.0:1787397959.141635:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787397959.141644:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701226752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397959.141668:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397959.141713:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701226752:12345-0@lo:38:kworker.0 Request processed in 68us (479us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397959.141721:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787397959.141748:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227136 00000100:00100000:0.0:1787397959.141752:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227136 00000100:00100000:0.0:1787397959.141780:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227264 00000100:00100000:0.0:1787397959.141784:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227264 00000100:00100000:0.0:1787397959.141799:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227520 00000100:00100000:0.0:1787397959.141801:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227520 00000100:00100000:0.0:1787397959.141817:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:0.0:1787397959.141822:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227136:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397959.141832:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397959.141862:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227136:12345-0@lo:38:kworker.0 Request processed in 38us (554us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397959.141868:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:0.0:1787397959.141881:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:0.0:1787397959.141885:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397959.141894:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397959.141916:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227264:12345-0@lo:38:kworker.0 Request processed in 30us (571us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397959.141922:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:0.0:1787397959.141932:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1787397959.141947:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787397959.141956:0:66177:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397959.141980:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701227520:12345-0@lo:38:kworker.0 Request processed in 42us (598us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397959.141986:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1787397959.142010:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701226880 00000100:00100000:0.0:1787397959.142014:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701226880 00000100:00100000:0.0:1787397959.142045:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227008 00000100:00100000:0.0:1787397959.142048:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227008 00000100:00100000:0.0:1787397959.142074:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397959.142089:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701226880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397959.142131:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701226880:12345-0@lo:400:kworker.0 Request processed in 44us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397959.142137:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397959.142150:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787397959.142156:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701227008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397959.142184:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701227008:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397959.142189:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787397959.142225:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787397959.142254:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a8047cbb80 x1874218701227008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397959.142268:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701227008:0@lo:400:kworker.0 00000100:00100000:0.0:1787397959.142279:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701226880:0@lo:400:kworker.0 00000100:00080000:0.0:1787397959.142308:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397959.142313:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397959.142315:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701226752:0@lo:38:kworker.0 00000100:00080000:0.0:1787397959.142323:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397959.142326:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397959.142328:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701227136:0@lo:38:kworker.0 00000100:00080000:0.0:1787397959.142335:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397959.142339:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397959.142341:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701227264:0@lo:38:kworker.0 00000100:00080000:0.0:1787397959.142349:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787397959.142358:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787397959.142361:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701227520:0@lo:38:kworker.0 00000100:00100000:1.0:1787397959.142575:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701227392:0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.142617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397959.142648:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787397959.142654:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701226624:0@lo:400:kworker.0 00000400:00000100:1.0:1787397959.142674:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701226624 offset 0 length 224: 4 00000100:00100000:1.0:1787397959.142695:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701227648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.142715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397959.142740:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227392 00000100:00100000:1.0:1787397959.142744:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227392 00000100:00100000:1.0:1787397959.142777:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227648 00000100:00100000:1.0:1787397959.142780:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227648 00000100:00100000:1.0:1787397959.142799:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:1.0:1787397959.142805:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701227392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.142839:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701227392:12345-0@lo:400:kworker.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397959.142846:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:1.0:1787397959.142860:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:1.0:1787397959.142866:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.142891:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701227648:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397959.142897:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00080000:1.0:1787397959.142917:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397959.142946:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701227648:0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.142960:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701227392:0@lo:400:kworker.0 00000100:00100000:2.0:1787397959.428695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000400:00000100:2.0:1787397959.428721:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681313664 offset 0 length 224: 4 00000100:00100000:2.0:1787397959.428741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397959.428772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397959.428803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397959.428832:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313920 00000100:00100000:2.0:1787397959.428833:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314048 00000100:00100000:3.0:1787397959.428843:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313920 00000100:00100000:2.0:1787397959.428844:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314048 00000100:00100000:3.0:1787397959.428919:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681313792 00000100:00100000:3.0:1787397959.428923:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681313792 00000100:00100000:3.0:1787397959.428954:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1643 00000100:00100000:3.0:1787397959.428964:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681313920:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397959.429038:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681313920:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397959.429046:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1643 00000100:00100000:3.0:1787397959.429077:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1666 00000100:00100000:3.0:1787397959.429081:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681313792:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397959.429098:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397959.429120:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681313792:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 38us (380us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397959.429126:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1666 00000100:00100000:2.0:1787397959.431692:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314176 00000100:00100000:2.0:1787397959.431704:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314176 00000100:00100000:2.0:1787397959.431827:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:2.0:1787397959.431838:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681314048:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787397959.431950:0:99639:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192682 00000100:00080000:2.0:1787397959.431962:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a702026000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397959.432009:0:99639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901909 00000100:00100000:2.0:1787397959.432161:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681314048:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 325us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397959.432169:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:2.0:1787397959.432185:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:2.0:1787397959.432192:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681314176:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:2.0:1787397959.432486:0:99639:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192689 00000100:00080000:2.0:1787397959.432493:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a702022800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787397959.432550:0:99639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787397959.432629:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681314176:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 436us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397959.432637:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00010000:00010000:2.0:1787397959.433113:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397959.433133:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397959.436242:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397959.436321:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397959.436325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787397959.526849:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787397959.572701:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397943/real 1787397943] req@ffff89a82ebd6d80 x1874218701221888/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397959 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397959.572735:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a82ebd6d80 x1874218701221888/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397959.572744:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787397959.572747:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787397959.572750:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787397959.572753:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787397959.572757:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a82ebd6d80 x1874218701221888/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787397959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397959.572766:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a702189880 x1874218701223808/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397959.572792:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a83876ce00 x1874218701225216/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397970 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397959.572815:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a8047c9880 x1874218701226624/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787397975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787397959.572835:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787397959.572838:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787397959.572839:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787397959.572841:0:3649:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1787397959.572871:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701221888:0@lo:400:kworker.0 00000100:00080000:3.0:1787397959.572908:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397959.572913:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787397959.572915:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397959.572920:0:65702:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3619 00000100:00080000:3.0:1787397959.572939:0:65702:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397959.572971:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915f80 x1874218701227776/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397959.573036:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701227776:0@lo:250:kworker.0 00000400:00000100:3.0:1787397959.573084:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701227776 offset 0 length 520: 4 00000100:00100000:0.0:1787397959.573198:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701223808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397959.573280:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701226624:0@lo:400:kworker.0 00000100:00100000:1.0:1787397959.573360:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701225216:0@lo:400:kworker.0 00000100:00100000:0.0:1787397960.468229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397960.468367:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314560 00000100:00100000:1.0:1787397960.468390:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314560 00000100:00100000:0.0:1787397960.468696:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1644 00000100:00100000:0.0:1787397960.468709:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681314560:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397960.468803:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681314560:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397960.468811:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1644 00000400:00000100:2.0:1787397960.485239:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681314304 offset 0 length 520: 4 00000100:00100000:2.0:1787397960.485301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397960.485403:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314432 00000100:00100000:3.0:1787397960.485422:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314432 00000100:00100000:3.0:1787397960.485499:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1667 00000100:00100000:3.0:1787397960.485511:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681314432:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787397960.485598:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397960.485860:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681314432:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 344us (552us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397960.485875:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1667 00010000:00010000:0.0:1787397960.549120:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397960.676967:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397960.676989:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701227904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397960.677054:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397960.677101:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701227904 00000100:00100000:3.0:1787397960.677108:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701227904 00000100:00100000:3.0:1787397960.677154:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397960.677163:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701227904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397960.677208:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787397960.677255:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701227904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397960.677263:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787397960.677308:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a806914380 x1874218701227904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397960.677326:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701227904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787397961.573144:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397962.598536:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397963.620847:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397963.750458:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701228032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397963.750579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397963.750913:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228032 00000100:00100000:3.0:1787397963.750924:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228032 00000100:00100000:3.0:1787397963.751016:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787397963.751028:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701228032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397963.751068:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397963.751127:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701228032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397963.751135:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787397963.752326:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397963.752390:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701228032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397964.489984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397964.490304:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397964.490388:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314816 00000100:00100000:2.0:1787397964.490403:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314816 00000100:00100000:2.0:1787397964.490500:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314688 00000100:00100000:2.0:1787397964.490504:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314688 00000100:00100000:2.0:1787397964.490562:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1645 00000100:00100000:2.0:1787397964.490576:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681314816:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397964.490688:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681314816:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 116us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397964.490698:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1645 00000100:00100000:2.0:1787397964.490724:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1668 00000100:00100000:2.0:1787397964.490730:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681314688:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787397964.490757:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397964.490786:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681314688:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 54us (483us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397964.490793:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1668 00000100:00080000:1.0:1787397964.491319:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787397964.646028:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397964.777942:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397964.777952:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787397964.777956:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397964.777960:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397964.777966:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397964.777977:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3838 00000100:00080000:0.0:1787397964.777983:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397964.777992:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397964.778041:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705478a80 x1874218701228160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397964.778106:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397964.778109:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397964.778124:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397964.778128:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3838 00000100:00080000:0.0:1787397964.778130:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397964.778135:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397964.778149:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705479180 x1874218701228544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397964.778159:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397964.778162:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397964.778163:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397964.778167:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3838 00000100:00080000:0.0:1787397964.778169:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397964.778173:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397964.778184:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547b800 x1874218701228672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397964.778214:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397964.778218:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397964.778219:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397964.778223:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3838 00000100:00080000:0.0:1787397964.778226:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397964.778230:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397964.778242:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547bb80 x1874218701228928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397964.778282:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701228288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.778371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397964.778423:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787397964.778429:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701228416:0@lo:400:kworker.0 00000100:00100000:3.0:1787397964.778599:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701228160:0@lo:38:kworker.0 00000100:00100000:3.0:1787397964.778634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397964.778670:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701228544:0@lo:38:kworker.0 00000100:00100000:3.0:1787397964.778699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397964.778716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701228672:0@lo:38:kworker.0 00000100:00100000:3.0:1787397964.778735:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397964.778750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701228928:0@lo:38:kworker.0 00000100:00100000:3.0:1787397964.778768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397964.778808:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228160 00000100:00100000:3.0:1787397964.778818:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228160 00000100:00100000:3.0:1787397964.778872:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787397964.778890:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701228160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397964.778916:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397964.778966:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701228160:12345-0@lo:38:kworker.0 Request processed in 76us (330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397964.778974:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787397964.779004:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228544 00000100:00100000:3.0:1787397964.779008:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228544 00000100:00100000:3.0:1787397964.779032:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228672 00000100:00100000:3.0:1787397964.779035:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228672 00000100:00100000:3.0:1787397964.779062:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228928 00000100:00100000:3.0:1787397964.779065:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228928 00000100:00100000:3.0:1787397964.779079:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1787397964.779083:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397964.779094:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397964.779121:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228544:12345-0@lo:38:kworker.0 Request processed in 36us (421us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397964.779129:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1787397964.779142:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1787397964.779146:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397964.779154:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397964.779175:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228672:12345-0@lo:38:kworker.0 Request processed in 28us (439us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397964.779181:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1787397964.779191:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1787397964.779195:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397964.779203:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397964.779226:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701228928:12345-0@lo:38:kworker.0 Request processed in 29us (457us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397964.779231:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00080000:3.0:1787397964.779287:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397964.779293:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397964.779296:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701228160:0@lo:38:kworker.0 00000100:00080000:3.0:1787397964.779305:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397964.779308:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397964.779318:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701228544:0@lo:38:kworker.0 00000100:00080000:3.0:1787397964.779329:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397964.779333:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397964.779335:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701228672:0@lo:38:kworker.0 00000100:00080000:3.0:1787397964.779342:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397964.779345:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787397964.779348:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701228928:0@lo:38:kworker.0 00000100:00100000:0.0:1787397964.779681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397964.779721:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701228800:0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.779751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397964.779772:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397964.779779:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701229056:0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.779800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397964.779842:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228288 00000100:00100000:0.0:1787397964.779847:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228288 00000100:00100000:0.0:1787397964.779903:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228416 00000100:00100000:0.0:1787397964.779906:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228416 00000100:00100000:0.0:1787397964.779943:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787397964.779951:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701228288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.780006:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701228288:12345-0@lo:400:kworker.0 Request processed in 55us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397964.780014:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787397964.780032:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787397964.780038:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701228416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.780066:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701228416:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397964.780073:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787397964.780096:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787397964.780127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a70547a300 x1874218701228416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397964.780141:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701228416:0@lo:400:kworker.0 00000100:00100000:0.0:1787397964.780154:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701228288:0@lo:400:kworker.0 00000100:00100000:3.0:1787397964.780647:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701228800 00000100:00100000:3.0:1787397964.780656:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701228800 00000100:00100000:3.0:1787397964.780766:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229056 00000100:00100000:3.0:1787397964.780769:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229056 00000100:00100000:3.0:1787397964.780792:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1787397964.780800:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701228800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397964.780872:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701228800:12345-0@lo:400:kworker.0 Request processed in 72us (1119us total) trans 0 rc 0/0 00000100:00080000:0.0:1787397964.781215:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787397964.781248:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1787397964.781271:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1787397964.781280:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701229056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397964.781319:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701229056:12345-0@lo:400:kworker.0 Request processed in 42us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397964.781326:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:3.0:1787397964.781380:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701229056:0@lo:400:kworker.0 00000100:00100000:3.0:1787397964.781396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701228800:0@lo:400:kworker.0 00000100:00100000:0.0:1787397965.514201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397965.514382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397965.519696:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315072 00000100:00100000:1.0:1787397965.519718:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315072 00000100:00100000:0.0:1787397965.524198:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681314944 00000100:00100000:0.0:1787397965.524220:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681314944 00000100:00100000:0.0:1787397965.524306:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1672 00000100:00100000:0.0:1787397965.524316:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681314944:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:0.0:1787397965.524349:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787397965.524472:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681314944:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 155us (10089us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787397965.524480:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1672 00000100:00100000:1.0:1787397965.525608:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1648 00000100:00100000:1.0:1787397965.525628:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681315072:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397965.525716:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681315072:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 98us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397965.525724:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1648 00010000:00010000:1.0:1787397965.669678:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397965.801582:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397965.801608:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701229184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397965.801838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1787397965.802768:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397965.802778:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a702025800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787397965.802910:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702025800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000001:00100000:1.0:1787397965.802971:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787397965.802976:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a702024800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787397965.803040:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702022800 for lustre-OST0001 00000020:00000080:2.0:1787397965.803049:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702024800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:2.0:1787397965.803076:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702026000 for lustre-OST0000 00000100:00100000:3.0:1787397965.804708:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229184 00000100:00100000:3.0:1787397965.804733:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229184 00000100:00100000:3.0:1787397965.804815:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787397965.804829:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701229184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397965.804875:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787397965.804992:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701229184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397965.805001:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787397965.805072:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89a702188380 x1874218701229184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397965.805102:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701229184:0@lo:13:osp-pre-1-1.0 00000020:01000004:3.0:1787397966.241592:0:102315:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787397966.241598:0:102315:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787397966.241600:0:102315:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787397966.241716:0:102315:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a7024bf000 00000020:01000004:3.0:1787397966.241731:0:102315:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787397966.241817:0:102315:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787397966.241832:0:102315:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a838783380) 00000020:00000080:3.0:1787397966.241850:0:102315:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787397966.401177:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787397966.401573:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.408465:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.408839:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.409176:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.409460:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.409828:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.410023:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.410219:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.411009:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.411226:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.411638:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.411901:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.412149:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787397966.413455:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787397966.414695:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.415048:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.415309:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.415550:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.415852:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.416084:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.416360:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.416645:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.416980:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.418457:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.419228:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.419569:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.419861:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.420109:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.420374:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.420877:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.421066:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.421393:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.421677:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.421992:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787397966.422227:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.422635:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.422895:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.423117:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787397966.423399:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787397966.423905:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787397966.424158:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787397966.424632:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787397966.425115:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787397966.425395:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787397966.425710:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787397966.426038:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787397966.426900:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397966.427314:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787397966.427548:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787397966.428039:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787397966.428500:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787397966.428890:0:102315:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787397966.429771:0:102315:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787397966.430011:0:102315:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787397966.430020:0:102315:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787397966.430032:0:102315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192e00 00000020:01000004:3.0:1787397966.430039:0:102315:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787397966.430050:0:102315:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787397966.430055:0:102315:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a7024bf000 from MGS 00000020:01000004:3.0:1787397966.430059:0:102315:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787397966.430068:0:102315:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a838780000) 00000020:00000080:3.0:1787397966.430080:0:102315:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1787397966.430140:0:102315:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a7024bf000 from MGS, refs=2 00080000:01000000:3.0:1787397966.430145:0:102315:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787397966.430149:0:102315:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192e0e 00010000:00010000:3.0:1787397966.430366:0:102315:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1787397966.435466:0:102315:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787397966.441976:0:102319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787397966.442074:0:102315:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787397966.442129:0:102315:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787397966.442901:0:102315:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787397966.443153:0:102315:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787397966.443291:0:102315:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787397966.443297:0:102315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787397966.445030:0:102315:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787397966.445043:0:102315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787397966.445598:0:102315:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787397966.445605:0:102315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787397966.446689:0:102315:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787397966.446716:0:102315:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1787397966.446718:0:102315:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1787397966.446722:0:102315:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1787397966.446727:0:102315:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 71, was 0): CONNECTING 00000100:00100000:2.0:1787397966.447377:0:102315:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1787397966.693031:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397967.717375:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397968.740795:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397968.869028:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701229312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397968.869114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397968.869283:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229312 00000100:00100000:3.0:1787397968.869292:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229312 00000100:00100000:3.0:1787397968.869368:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397968.869377:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701229312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397968.869412:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397968.869479:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701229312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397968.869486:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787397968.869552:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701229312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787397968.869861:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787397969.767365:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787397969.892696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.892722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787397969.892742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.892747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397969.892750:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397969.892759:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3844 00000100:00100000:1.0:1787397969.892761:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787397959/real 1787397959] req@ffff89a806915f80 x1874218701227776/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397969 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787397969.892764:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397969.892771:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397969.892790:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a806915f80 x1874218701227776/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787397969 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787397969.892811:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.892832:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787397969.892851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701227776:0@lo:250:kworker.0 00000100:00100000:3.0:1787397969.892952:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915c00 x1874218701229440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1787397969.892990:0:102315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1787397969.893009:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787397969.893014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.893018:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397969.893019:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:00010000:0.0:1787397969.893021:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787397969.893023:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3844 00000100:00080000:3.0:1787397969.893025:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 10000000:01000000:0.0:1787397969.893027:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:3.0:1787397969.893029:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397969.893040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd6d80 x1874218701229824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397969.893046:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701229696:0@lo:400:kworker.0 00000100:00080000:3.0:1787397969.893048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.893051:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397969.893052:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397969.893055:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3844 00000100:00080000:3.0:1787397969.893057:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787397969.893061:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397969.893071:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5500 x1874218701229952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787397969.893098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.893101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787397969.893103:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787397969.893106:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3844 00000100:00080000:3.0:1787397969.893108:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1787397969.893108:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397969.893112:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397969.893121:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5880 x1874218701230208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397969.893138:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1787397969.893139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787397969.893142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787397969.893143:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787397969.893143:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701229568:0@lo:400:kworker.0 00000100:00080000:3.0:1787397969.893146:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3838 00000100:00080000:3.0:1787397969.893149:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787397969.893152:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787397969.893160:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5f80 x1874218701230464/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787397969.893164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893187:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701230336:0@lo:400:kworker.0 00000100:00100000:0.0:1787397969.893187:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701230080:0@lo:400:kworker.0 00000100:00100000:0.0:1787397969.893217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893246:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229696 00000100:00100000:3.0:1787397969.893252:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229696 00010000:00010000:0.0:1787397969.893258:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787397969.893269:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1915aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1915b1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397969.893304:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229568 00000100:00100000:3.0:1787397969.893307:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229568 00000100:00100000:0.0:1787397969.893313:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787397969.893321:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701229696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397969.893326:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787397969.893331:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701229568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397969.893366:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701229568:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.893379:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787397969.893401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701229440:0@lo:38:kworker.0 00000100:00100000:3.0:1787397969.893406:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230080 00000100:00100000:3.0:1787397969.893410:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230080 00000100:00100000:1.0:1787397969.893430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893437:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1787397969.893443:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701230080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397969.893446:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701229824:0@lo:38:kworker.0 00000100:00100000:1.0:1787397969.893466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893474:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701230080:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397969.893479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701229952:0@lo:38:kworker.0 00000100:00100000:3.0:1787397969.893481:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1787397969.893491:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229824 00000100:00100000:3.0:1787397969.893494:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229824 00000100:00100000:1.0:1787397969.893496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893509:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229952 00000100:00100000:1.0:1787397969.893510:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701230208:0@lo:38:kworker.0 00000100:00100000:3.0:1787397969.893512:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229952 00000100:00100000:1.0:1787397969.893549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.893556:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:3.0:1787397969.893561:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701229824:12345-0@lo:38:kworker.0 00000100:00020000:1.0:1787397969.893568:0:3647:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff89a82ebd5f80 x1874218701230464/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:3.0:1787397969.893580:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397969.893605:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701229824:12345-0@lo:38:kworker.0 Request processed in 43us (138us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787397969.893610:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:3.0:1787397969.893620:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230208 00000100:00100000:3.0:1787397969.893623:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230208 00000100:00100000:3.0:1787397969.893634:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:3.0:1787397969.893638:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701229952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787397969.893647:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787397969.893670:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701229952:12345-0@lo:38:kworker.0 Request processed in 31us (173us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397969.893787:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:2.0:1787397969.893793:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701230208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397969.893804:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397969.893834:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701230208:12345-0@lo:38:kworker.0 Request processed in 41us (285us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397969.893847:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00080000:2.0:1787397969.893864:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397969.893869:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787397969.893878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397969.893905:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230336 00000100:00100000:2.0:1787397969.893908:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230336 00000100:00100000:2.0:1787397969.893931:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:2.0:1787397969.893937:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397969.893970:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701230336:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397969.893976:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00080000:2.0:1787397969.893990:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397969.894014:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701230336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397969.894047:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701229440 00000100:00100000:2.0:1787397969.894051:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701229440 00000100:00100000:2.0:1787397969.894067:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787397969.894071:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701229440:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787397969.894080:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787397969.894103:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701229440:12345-0@lo:38:kworker.0 Request processed in 31us (673us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787397969.894108:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787397969.894162:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701230080:0@lo:400:kworker.0 00000100:00100000:3.0:1787397969.894761:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00010000:00010000:3.0:1787397969.894892:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.894904:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.894910:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.894923:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.894931:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62e00/0x274786fe0d191962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d191969 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.894943:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.894950:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.894956:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.894959:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.894963:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe74800/0x274786fe0d191970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d191977 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.894972:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.894978:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.894983:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.894986:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.894990:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d1919b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1919bd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895007:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895013:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895019:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895022:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895026:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192578 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895037:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895043:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895049:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895052:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895056:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a808718e00/0x274786fe0d19259b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1925a2 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895065:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895071:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895077:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895086:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895090:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74a00/0x274786fe0d192619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192620 expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895099:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895106:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895111:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895114:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895118:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d192643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19264a expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895132:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895139:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895144:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895147:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895150:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d1926a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d1926b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895163:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895170:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895185:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1787397969.895189:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895194:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a800031400/0x274786fe0d19153a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d191541 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895206:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895212:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895217:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787397969.895220:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895224:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a8016a0800/0x274786fe0d191548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19154f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895232:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895239:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895244:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787397969.895247:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895250:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74000/0x274786fe0d19258d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192594 expref: -99 pid: 99634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.895259:0:102315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787397969.895276:0:102315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.895281:0:102315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787397969.895285:0:102315:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787397969.895289:0:102315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d192635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d19263c expref: -99 pid: 100451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397969.896186:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701229696:12345-0@lo:400:kworker.0 Request processed in 2860us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397969.896197:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787397969.898977:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701229568:0@lo:400:kworker.0 00010000:00080000:2.0:1787397969.899010:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a806915f80 x1874218701229696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397969.899044:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701229696:0@lo:400:kworker.0 00000100:00080000:3.0:1787397969.933870:0:102315:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 72, was 0): CONNECTING 00000100:00080000:3.0:1787397969.933884:0:102315:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1787397969.935094:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.935176:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1787397969.935193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:0:1874218701230464:0@lo:250:kworker.0 00000100:00080000:1.0:1787397969.935256:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.935260:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397969.935263:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701229440:0@lo:38:kworker.0 00000100:00080000:1.0:1787397969.935275:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.936272:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397969.936278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701229824:0@lo:38:kworker.0 00000100:00080000:1.0:1787397969.936305:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.936309:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397969.936312:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701229952:0@lo:38:kworker.0 00000100:00080000:1.0:1787397969.936325:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787397969.936328:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787397969.936331:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701230208:0@lo:38:kworker.0 00000100:00080000:2.0:1787397969.936503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787397969.936509:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787397969.936513:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787397969.936517:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3849 00000100:00080000:2.0:1787397969.936769:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787397969.936777:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787397969.936907:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a806915c00 x1874218701230592/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397969.936961:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701230592:0@lo:250:kworker.0 00000100:00100000:1.0:1787397969.937026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.937802:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230592 00000100:00100000:3.0:1787397969.937812:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230592 00000100:00100000:3.0:1787397969.937859:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787397969.937867:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1874218701230592:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1787397969.937896:0:102321:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3849 last 0 00000020:00000080:3.0:1787397969.937924:0:102321:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d192e15 00000100:00080000:3.0:1787397969.938053:0:102321:0:(import.c:65:import_set_state_nolock()) ffff89a83ae95800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397969.938123:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218701230592:12345-0@lo:250:kworker.0 Request processed in 255us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.938131:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787397969.938480:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 29 00000100:00080000:1.0:1787397969.938491:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:1.0:1787397969.938499:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787397969.938503:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787397969.938507:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787397969.938509:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787397969.938585:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787397969.938601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701230592:0@lo:250:kworker.0 00000020:01000000:2.0:1787397969.938651:0:8:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:2.0:1787397969.938667:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1787397969.938670:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787397969.938682:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787397969.938684:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397969.938685:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397969.938686:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397969.938688:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397969.938689:0:8:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787397969.938691:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397969.938693:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787397969.938738:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1787397969.938746:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1787397969.938748:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787397969.938749:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787397969.938750:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397969.938752:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397969.938753:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397969.938754:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397969.938755:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397969.938757:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397969.938758:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787397969.938771:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1787397969.938783:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1787397969.938907:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1787397969.938909:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787397969.938910:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787397969.938911:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787397969.938912:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787397969.938913:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787397969.938914:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787397969.938915:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787397969.938916:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1787397969.938948:0:8:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1787397969.938971:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701230976:0@lo:253:kworker.0 00000100:00100000:2.0:1787397969.938974:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701230720:0@lo:253:kworker.0 00000100:00080000:3.0:1787397969.940462:0:102315:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1787397969.940479:0:102315:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787397969.940559:0:102315:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787397969.940565:0:102315:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787397969.940700:0:102315:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787397969.940748:0:102315:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787397969.940753:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787397969.940761:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397969.940762:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397969.940763:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397969.940764:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397969.940765:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397969.940767:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397969.940768:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397969.940769:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397969.940770:0:102315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397969.940772:0:102315:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787397969.940774:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787397969.940775:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397969.940776:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397969.940777:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397969.940778:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397969.940779:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397969.940780:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397969.940780:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397969.940781:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397969.940782:0:102315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787397969.940815:0:102315:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787397969.940832:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787397969.944868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397969.944946:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397969.944960:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701230848:0@lo:253:kworker.0 00000100:00100000:2.0:1787397969.945017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397969.945072:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230720 00000100:00100000:2.0:1787397969.945081:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230720 00000100:00100000:2.0:1787397969.945123:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230848 00000100:00100000:2.0:1787397969.945126:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230848 00000100:00100000:2.0:1787397969.945143:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787397969.945151:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+6:3650:x1874218701230720:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787397969.945182:0:102321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1787397969.945330:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787397969.945338:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+6:3650:x1874218701230848:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787397969.945355:0:102322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1787397969.945391:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787397969.945496:0:102321:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 128 00000100:00100000:1.0:1787397969.953930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397969.954429:0:102323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787397969.954442:0:102323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:0.0:1787397969.955815:0:102325:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787397969.955823:0:102325:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787397969.955826:0:102325:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787397969.955829:0:102325:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787397969.955859:0:102325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000100:00100000:0.0:1787397969.956086:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397969.956116:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397969.956406:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701230976 00000100:00100000:0.0:1787397969.956417:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701230976 00000100:00100000:0.0:1787397969.956456:0:102323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1787397969.956464:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231104 00000100:00100000:0.0:1787397969.956467:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231104 00000100:00100000:3.0:1787397969.956771:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787397969.956782:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218701230976:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1787397969.956942:0:102326:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787397969.957499:0:102321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787397969.957545:0:102321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787397969.976481:0:102321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787397969.976499:0:102321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787397969.976701:0:102322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787397969.977087:0:102324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397969.977095:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397969.977123:0:102324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977142:0:102324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397969.977169:0:102324:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000076630s 00010000:00010000:0.0:1787397969.977175:0:102324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977184:0:102324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977190:0:102324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977198:0:102324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977205:0:102324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397969.977209:0:102324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977217:0:102324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977231:0:102324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977239:0:102324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.977245:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54400/0x274786fe0d192e1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397969.977461:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:3650:x1874218701230720:12345-0@lo:253:kworker.0 Request processed in 32305us (32594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397969.977476:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787397969.977518:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787397969.977552:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:102315:x1874218701231104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397969.977597:0:102321:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787397969.977599:0:102321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787397969.977602:0:102321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1787397969.977607:0:102321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1787397969.977827:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787397969.977830:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787397969.977832:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397969.977833:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397969.977834:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397969.977836:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397969.977837:0:3650:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397969.977839:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397969.977840:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787397969.977844:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701230720:0@lo:253:kworker.0 20000000:01000000:3.0:1787397969.988342:0:102322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397969.988369:0:102322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787397969.988680:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:102315:x1874218701231104:12345-0@lo:253:mount.lustre.0 Request processed in 11120us (32585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397969.988697:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1787397969.988746:0:102324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787397969.988750:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787397969.988771:0:102324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988798:0:102324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787397969.988808:0:102324:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000076630s 00010000:00010000:0.0:1787397969.988813:0:102324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988821:0:102324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988828:0:102324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988835:0:102324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988841:0:102324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397969.988846:0:102324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988853:0:102324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988866:0:102324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988884:0:102324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397969.988891:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54800/0x274786fe0d192e23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397969.989166:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787397969.989180:0:102315:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787397969.989183:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787397969.989184:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787397969.989186:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787397969.989187:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787397969.989188:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787397969.989190:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787397969.989191:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787397969.989193:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787397969.989194:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787397969.989196:0:102315:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787397969.989214:0:102315:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a7024bf000 from lustre-MDT0000 10000000:01000000:3.0:1787397969.989243:0:102315:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787397969.989246:0:102315:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787397969.989254:0:102315:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a7024bf000 10000000:01000000:3.0:1787397969.989257:0:102315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787397969.989261:0:102315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a7024bf000 10000000:01000000:3.0:1787397969.989264:0:102315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787397969.989267:0:102315:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a7024bf000 from 1 10000000:01000000:3.0:1787397969.989270:0:102315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787397969.989297:0:102315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989306:0:102315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989314:0:102315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397969.989334:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397969.989382:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.989419:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397969.989435:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231232 00000100:00100000:3.0:1787397969.989441:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231232 00000100:00100000:3.0:1787397969.989473:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787397969.989480:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+7:102315:x1874218701231232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397969.989491:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397969.989503:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583800/0x274786fe0d192e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192e2a expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989541:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583800/0x274786fe0d192e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192e2a expref: 8 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989550:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583800/0x274786fe0d192e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192e2a expref: 8 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989558:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583800, rc 0) 00000100:00100000:3.0:1787397969.989583:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:102315:x1874218701231232:12345-0@lo:101:mount.lustre.0 Request processed in 103us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.989590:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787397969.989632:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397969.989642:0:102315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989650:0:102315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.989660:0:102315:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787397969.989679:0:102315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989696:0:102315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397969.989703:0:102315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787397969.989717:0:102315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787397969.989721:0:102315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a7024bf000 10000000:01000000:3.0:1787397969.989733:0:102315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787397969.989736:0:102315:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787397969.989738:0:102315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397969.989751:0:102315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989758:0:102315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.989766:0:102315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397969.989776:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787397969.989999:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.990018:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231360 00000100:00100000:3.0:1787397969.990022:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231360 00000100:00100000:3.0:1787397969.990043:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787397969.990048:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:102315:x1874218701231360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397969.990054:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397969.990062:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582800/0x274786fe0d192e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192e38 expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.990083:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582800/0x274786fe0d192e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192e38 expref: 9 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.990091:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582800/0x274786fe0d192e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192e38 expref: 9 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.990098:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582800, rc 0) 00000100:00100000:3.0:1787397969.990118:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701231360:12345-0@lo:101:mount.lustre.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.990124:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787397969.990144:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397969.990154:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397969.990162:0:102315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397969.990169:0:102315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397969.990207:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397969.990226:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.990240:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231488 00000100:00100000:3.0:1787397969.990243:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231488 00000100:00100000:3.0:1787397969.990258:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397969.990263:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701231488:12345-0@lo:501:mount.lustre.0 20000000:01000000:1.0:1787397969.990485:0:102326:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787397969.990953:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:3650:x1874218701230848:12345-0@lo:253:kworker.0 Request processed in 45614us (45933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397969.990962:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787397969.991068:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701231488:12345-0@lo:501:mount.lustre.0 Request processed in 804us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.991083:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787397969.991113:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397969.991125:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787397969.991152:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787397969.991187:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397969.991208:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397969.991961:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231616 00000100:00100000:0.0:1787397969.991970:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231616 00000100:00100000:0.0:1787397969.992006:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787397969.992013:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701231616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397969.992121:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701231616:12345-0@lo:503:mount.lustre.0 Request processed in 107us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397969.992127:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000004:1.0:1787397969.992269:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397969.992272:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787397969.992274:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397969.992275:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397969.992277:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397969.992278:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397969.992280:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397969.992282:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397969.992283:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397969.992286:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701230848:0@lo:253:kworker.0 00000100:00100000:3.0:1787397969.992739:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701231616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397969.993190:0:102327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701231744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397969.993238:0:102327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397969.993269:0:102327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397969.993314:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231744 00000100:00100000:3.0:1787397969.993318:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231744 00000100:00100000:3.0:1787397969.993355:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787397969.993362:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:102327:x1874218701231744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397969.994580:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:102327:x1874218701231744:12345-0@lo:502:llog_process_th.0 Request processed in 1212us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397969.994593:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787397969.995050:0:102327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702136d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701231744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397969.995087:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397969.995098:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397969.995100:0:102327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787397969.995105:0:102327:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787397969.995108:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397969.995122:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a7033a4d40) 00000020:00000080:1.0:1787397969.995143:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1787397969.995147:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787397969.995227:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787397969.995232:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192e4d 00000020:00000080:1.0:1787397969.996919:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787397969.996931:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397969.996938:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397969.996940:0:102327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787397969.996943:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397969.996949:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397969.996951:0:102327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787397969.996954:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397969.996967:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a702478000) 00000020:00000080:1.0:1787397969.996994:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1787397969.996999:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787397969.997001:0:102327:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787397969.997004:0:102327:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787397969.997011:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787397969.997078:0:102327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a7024bf000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787397969.997092:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a70247b380) 00000020:00000080:1.0:1787397969.997101:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1787397969.997152:0:102327:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787397969.997158:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192e62 00000020:00000080:1.0:1787397969.997255:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787397969.997261:0:102327:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787397969.997279:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d192e69 00080000:01000000:1.0:1787397969.997285:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787397969.997289:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192e70 20000000:01000000:3.0:1787397970.005244:0:102326:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787397970.005268:0:102326:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787397970.005396:0:102324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397970.005401:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397970.005427:0:102324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005444:0:102324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787397970.005454:0:102324:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000076630s 00010000:00010000:1.0:1787397970.005459:0:102324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005466:0:102324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005473:0:102324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005480:0:102324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005486:0:102324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397970.005490:0:102324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005497:0:102324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005509:0:102324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005551:0:102324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.005557:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192e77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397970.006975:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218701230976:12345-0@lo:253:kworker.0 Request processed in 50188us (53044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.006988:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1787397970.007098:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1787397970.007101:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787397970.007102:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787397970.007103:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787397970.007105:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787397970.007106:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787397970.007108:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787397970.007110:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787397970.007111:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787397970.007114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701230976:0@lo:253:kworker.0 00010000:00010000:2.0:1787397970.099236:0:102327:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1787397970.099378:0:102327:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964117000 srv lr: 120259084288 lx: 0 gen 21 00000001:00080000:2.0:1787397970.099419:0:102327:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 115964117002 srv lr: 120259084288 lx: 0 gen 23 00000001:00000004:2.0:1787397970.099449:0:102327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:2.0:1787397970.100237:0:102327:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1787397970.100311:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80aa01cc0: xid 1874218701217664, transno 120259084470, client gen 21, slot idx 0 00000001:00080000:2.0:1787397970.100324:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80aa01900: xid 1874218681304832, transno 120259084467, client gen 23, slot idx 1 00000001:00080000:2.0:1787397970.100329:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80aa01d80: xid 1874218701216896, transno 120259084469, client gen 21, slot idx 2 00000001:00080000:2.0:1787397970.100334:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80aa01000: xid 1874218701100544, transno 120259084290, client gen 21, slot idx 3 00000001:00080000:2.0:1787397970.100339:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a80aa01780: xid 1874218681266944, transno 120259084436, client gen 23, slot idx 4 00000001:00080000:2.0:1787397970.100345:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a706daa840: xid 1874218681263744, transno 120259084425, client gen 23, slot idx 5 00000001:00080000:2.0:1787397970.100350:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a7046fc0c0: xid 1874218681259008, transno 120259084409, client gen 23, slot idx 6 00000001:00080000:2.0:1787397970.100354:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a7046fce40: xid 1874218681260160, transno 120259084412, client gen 23, slot idx 7 00000001:00080000:2.0:1787397970.100358:0:102327:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a7046fccc0: xid 1874218681254912, transno 120259084393, client gen 23, slot idx 8 00000020:00000080:2.0:1787397970.101228:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a83b9d4d40) 00000020:00000080:2.0:1787397970.101253:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1787397970.101327:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787397970.101333:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192e93 00000020:00000080:2.0:1787397970.108160:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787397970.122933:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d192e9a 00000020:00000080:1.0:1787397970.127018:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787397970.127032:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.127040:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.127042:0:102327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787397970.127045:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397970.127048:0:102327:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787397970.127050:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397970.127051:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397970.127053:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397970.127056:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.127057:0:102327:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787397970.127060:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.127064:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.127065:0:102327:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787397970.127070:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787397970.127126:0:102327:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787397970.127144:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.127161:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.127162:0:102327:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787397970.127165:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.127169:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.127170:0:102327:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787397970.127173:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787397970.127177:0:102327:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:1.0:1787397970.127201:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787397970.127219:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a829b919c0) 00000020:00000080:1.0:1787397970.127239:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787397970.127244:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787397970.127302:0:102327:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787397970.127309:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787397970.127315:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192ea8 00010000:00080000:1.0:1787397970.127344:0:102327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a819129800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787397970.135471:0:102327:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787397970.137311:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397970.137327:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787397970.137365:0:102327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787397970.137388:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192eaf 00000100:00080000:0.0:1787397970.137398:0:102327:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397970.137404:0:102327:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397970.137441:0:102327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547ad80 x1874218701231872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397970.137469:0:102327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787397970.137552:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397970.137564:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.137566:0:102327:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787397970.137569:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397970.137572:0:102327:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787397970.137574:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397970.137575:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397970.137577:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397970.137579:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.137580:0:102327:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397970.137583:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397970.137588:0:102327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787397970.137591:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.137593:0:102327:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787397970.137596:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397970.137600:0:102327:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787397970.137631:0:102327:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787397970.137634:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397970.137647:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a7020799c0) 00000020:00000080:0.0:1787397970.137661:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787397970.137665:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397970.137808:0:102327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787397970.137816:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787397970.137822:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192ebd 00010000:00080000:0.0:1787397970.137856:0:102327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a702184000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397970.138031:0:102327:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1787397970.138549:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701231872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397970.138617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.138831:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701231872 00000100:00100000:2.0:1787397970.138839:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701231872 00000100:00100000:2.0:1787397970.138871:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787397970.138879:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701231872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787397970.138903:0:66188:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3849 last 0 00000020:00000080:2.0:1787397970.138936:0:66188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192ec4 00000004:00100000:2.0:1787397970.138950:0:66188:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397970.139040:0:66188:0:(import.c:65:import_set_state_nolock()) ffff89a837bc3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397970.139121:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701231872:12345-0@lo:38:llog_process_th.0 Request processed in 240us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.139128:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787397970.139469:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787397970.139479:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1787397970.139488:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787397970.139494:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787397970.139496:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787397970.139518:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701231872:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787397970.139854:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397970.139865:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701232000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397970.139901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1787397970.140086:0:102327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787397970.140119:0:102327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787397970.140272:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232000 00000100:00100000:3.0:1787397970.140278:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232000 00000100:00100000:3.0:1787397970.140319:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787397970.140327:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701232000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787397970.140354:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:3.0:1787397970.140409:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701232000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.140416:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787397970.140487:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701232000:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787397970.140956:0:102327:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:0.0:1787397970.149993:0:102327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787397970.150028:0:102327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:0.0:1787397970.150198:0:102327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:0.0:1787397970.160436:0:102333:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:0.0:1787397970.160447:0:102333:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787397970.162081:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787397970.162105:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787397970.162152:0:102327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787397970.162177:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192ecb 00000100:00080000:0.0:1787397970.162188:0:102327:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397970.162195:0:102327:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a702184000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397970.162234:0:102327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547b480 x1874218701232128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397970.162308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701232128:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787397970.162395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.163560:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232128 00000100:00100000:3.0:1787397970.163572:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232128 00000100:00100000:3.0:1787397970.163645:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397970.163653:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1874218701232128:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787397970.163691:0:99639:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3849 last 0 00000020:00000080:3.0:1787397970.163718:0:99639:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192ed2 00002000:00100000:3.0:1787397970.163740:0:99639:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a827b3e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787397970.163744:0:99639:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787397970.163747:0:99639:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787397970.163819:0:99639:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397970.163843:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a827b38000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787397970.163924:0:102327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787397970.163997:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397970.164003:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.164006:0:102327:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787397970.164009:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787397970.164012:0:102327:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787397970.164014:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397970.164016:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787397970.164017:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787397970.164093:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.164095:0:102327:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787397970.164099:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787397970.164104:0:102327:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787397970.164107:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.164109:0:102327:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787397970.164112:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787397970.164116:0:102327:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787397970.164135:0:102327:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787397970.164138:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787397970.164152:0:102327:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a83549cd40) 00000020:00000080:0.0:1787397970.164168:0:102327:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1787397970.164172:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787397970.164247:0:102327:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787397970.164254:0:102327:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787397970.164272:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d192ee0 00010000:00080000:0.0:1787397970.164302:0:102327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a70378a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397970.165012:0:102327:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1787397970.165089:0:102327:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787397970.165104:0:102327:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787397970.167053:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787397970.167055:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701232128:12345-0@lo:8:llog_process_th.0 Request processed in 3391us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.167071:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787397970.167071:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1787397970.167087:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787397970.167095:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787397970.167100:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702184000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787397970.167182:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787397970.167189:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701232128:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787397970.169084:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397970.169106:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701232512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.169176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.169235:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701232640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.169257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.169348:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397970.169356:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701233024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.169379:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.169407:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232512 00000100:00100000:0.0:1787397970.169413:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232512 00000100:00100000:0.0:1787397970.169673:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232640 00000100:00100000:0.0:1787397970.169677:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232640 00000100:00100000:0.0:1787397970.169694:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233024 00000100:00100000:0.0:1787397970.169697:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233024 00000100:00100000:0.0:1787397970.169711:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787397970.169719:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701232512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.169754:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1897 count 1 00000100:00100000:0.0:1787397970.169841:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701232512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 122us (664us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.169848:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787397970.169866:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787397970.169872:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1874218701232640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.169883:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1907 count 1 00000100:00100000:0.0:1787397970.169937:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1874218701232640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (678us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.169943:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787397970.169955:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787397970.169960:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701233024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.169970:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1892 count 1 00000100:00100000:0.0:1787397970.170010:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701233024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (630us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.170016:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1787397970.170049:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e55880, transno 0 00000004:00080000:0.0:1787397970.170055:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e55880/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.170060:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701233024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787397970.170071:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a8047c9500, transno 0 00000004:00080000:0.0:1787397970.170073:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a8047c9500/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.170075:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701232640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787397970.170081:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a8047c9880, transno 0 00000004:00080000:0.0:1787397970.170083:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a8047c9880/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.170085:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701232512:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787397970.170187:0:102333:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 4 in flight, 3 done 00000100:00100000:0.0:1787397970.170220:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701233152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.170248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.170272:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233152 00000100:00100000:0.0:1787397970.170276:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233152 00000100:00100000:0.0:1787397970.170296:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787397970.170301:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701233152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.170312:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1901 count 1 00000100:00100000:0.0:1787397970.170363:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701233152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.170369:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:1.0:1787397970.171067:0:102327:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000100:00100000:1.0:1787397970.171287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701233536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.171329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171572:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171618:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171646:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701233280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171661:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171672:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787397970.171678:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171696:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171717:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171759:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701233408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.171775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.171802:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233536 00000100:00100000:3.0:1787397970.171807:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233536 00000100:00100000:3.0:1787397970.171833:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232256 00000100:00100000:3.0:1787397970.171836:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232256 00000100:00100000:3.0:1787397970.171845:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232768 00000100:00100000:3.0:1787397970.171847:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232768 00000100:00100000:3.0:1787397970.171856:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233280 00000100:00100000:3.0:1787397970.171858:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233280 00000100:00100000:3.0:1787397970.171868:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232384 00000100:00100000:3.0:1787397970.171870:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232384 00000100:00100000:3.0:1787397970.171880:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701232896 00000100:00100000:3.0:1787397970.171882:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701232896 00000100:00100000:3.0:1787397970.171890:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233408 00000100:00100000:3.0:1787397970.171892:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233408 00000100:00100000:3.0:1787397970.171906:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397970.171912:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701233536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.171934:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1903 count 1 00000100:00100000:3.0:1787397970.171996:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3648:x1874218701233536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 83us (667us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172004:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397970.172022:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787397970.172028:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3650:x1874218701232256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172038:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1904 count 1 00000100:00100000:3.0:1787397970.172080:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3650:x1874218701232256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (475us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172094:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787397970.172108:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397970.172113:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3650:x1874218701232768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172124:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1895 count 1 00000100:00100000:3.0:1787397970.172163:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3650:x1874218701232768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (526us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172169:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397970.172180:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397970.172186:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1874218701233280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172195:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1898 count 1 00000100:00100000:3.0:1787397970.172225:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1874218701233280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40us (563us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172231:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397970.172241:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397970.172246:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1874218701232384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172254:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1899 count 1 00000100:00100000:3.0:1787397970.172287:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1874218701232384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40us (589us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172292:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397970.172303:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787397970.172308:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701232896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172318:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1909 count 1 00000100:00100000:3.0:1787397970.172371:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701232896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (620us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.172377:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787397970.172397:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787397970.172403:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701233408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787397970.172414:0:99640:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1906 count 1 00000004:00080000:1.0:1787397970.172719:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702137800, transno 0 00000004:00080000:1.0:1787397970.172734:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702137800/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.172741:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701233536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.172852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397970.172860:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701233664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.172891:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787397970.173076:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e55880, transno 0 00000004:00080000:1.0:1787397970.173081:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e55880/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.173089:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701233152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.173284:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233664 00000100:00100000:0.0:1787397970.173290:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233664 00000100:00100000:0.0:1787397970.173313:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397970.173320:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874218701233664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.173348:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1894 count 1 00000100:00100000:0.0:1787397970.173399:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874218701233664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 79us (507us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.173406:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787397970.173866:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397970.173878:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701233792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787397970.173916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.173945:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233792 00000100:00100000:2.0:1787397970.173950:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233792 00000100:00100000:2.0:1787397970.173970:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787397970.173977:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701233792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787397970.173991:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1891 count 1 00000100:00100000:2.0:1787397970.174041:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701233792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 64us (124us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397970.174048:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787397970.174066:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787397970.174086:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70698df80, transno 0 00000004:00080000:2.0:1787397970.174091:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70698df80/1, rc -2, transno 0 00000100:00100000:2.0:1787397970.174101:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701233792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787397970.174179:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701233920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787397970.174201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.174225:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701233920 00000100:00100000:2.0:1787397970.174228:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701233920 00000100:00100000:2.0:1787397970.174247:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787397970.174253:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701233920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787397970.174263:0:99641:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1890 count 1 00000100:00100000:2.0:1787397970.174318:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1874218701233920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397970.174324:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787397970.174568:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a806914a80, transno 0 00000004:00080000:0.0:1787397970.174573:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a806914a80/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.174577:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701233920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.174639:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787397970.174647:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701234048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.174674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.174695:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234048 00000100:00100000:0.0:1787397970.174698:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234048 00000100:00100000:0.0:1787397970.174738:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787397970.174745:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701234048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.174757:0:101069:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1896 count 1 00000100:00100000:0.0:1787397970.174805:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701234048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.174812:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1787397970.174833:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e54a80, transno 0 00000004:00080000:0.0:1787397970.174837:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e54a80/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.174841:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701234048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.174907:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701234176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.174931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.174952:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234176 00000100:00100000:0.0:1787397970.174956:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234176 00000100:00100000:0.0:1787397970.174976:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787397970.174982:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701234176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.174992:0:101069:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1905 count 1 00000100:00100000:0.0:1787397970.175037:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3649:x1874218701234176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (104us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.175043:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:0.0:1787397970.175063:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e54a80, transno 0 00000004:00080000:0.0:1787397970.175066:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e54a80/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.175070:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701234176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.175122:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397970.175128:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.175150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.175166:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234304 00000100:00100000:0.0:1787397970.175170:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234304 00000100:00100000:0.0:1787397970.175187:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787397970.175191:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1874218701234304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.175201:0:101069:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1910 count 1 00000100:00100000:0.0:1787397970.175237:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1874218701234304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45us (86us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.175243:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000004:00080000:0.0:1787397970.175259:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e54a80, transno 0 00000004:00080000:0.0:1787397970.175262:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e54a80/1, rc -2, transno 0 00000100:00100000:0.0:1787397970.175274:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.175322:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.175357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.175377:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234432 00000100:00100000:0.0:1787397970.175381:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234432 00000100:00100000:0.0:1787397970.175396:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787397970.175401:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1874218701234432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787397970.175410:0:101069:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1900 count 1 00000004:00080000:1.0:1787397970.175558:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702137800, transno 0 00000004:00080000:1.0:1787397970.175561:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702137800/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.175565:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701233664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.175649:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701234560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.175681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.175733:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397970.175739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701234688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397970.175763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.175808:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234560 00000100:00100000:1.0:1787397970.175812:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234560 00000100:00100000:1.0:1787397970.175830:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397970.175836:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3648:x1874218701234560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397970.175848:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1893 count 1 00000100:00100000:1.0:1787397970.175898:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3648:x1874218701234560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (216us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397970.175904:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000004:00080000:1.0:1787397970.175926:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70698fb80, transno 0 00000004:00080000:1.0:1787397970.175930:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70698fb80/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.175938:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701234560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.176011:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397970.176018:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.176041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.176061:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234816 00000100:00100000:1.0:1787397970.176064:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234816 00000100:00100000:1.0:1787397970.176078:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787397970.176084:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1874218701234816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397970.176094:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1902 count 1 00000100:00100000:1.0:1787397970.176131:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1874218701234816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (90us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397970.176137:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000004:00080000:1.0:1787397970.176153:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70698fb80, transno 0 00000004:00080000:1.0:1787397970.176163:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70698fb80/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.176170:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.176233:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787397970.176254:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.176276:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234944 00000100:00100000:1.0:1787397970.176279:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234944 00000100:00100000:1.0:1787397970.176295:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787397970.176300:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1874218701234944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787397970.176311:0:100418:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:1908 count 1 00000100:00100000:1.0:1787397970.176353:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3651:x1874218701234944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (97us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397970.176358:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:1.0:1787397970.176377:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70698fb80, transno 0 00000004:00080000:1.0:1787397970.176380:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70698fb80/1, rc -2, transno 0 00000100:00100000:1.0:1787397970.176384:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234944:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1787397970.176421:0:102333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 23 count 8 00000040:00080000:1.0:1787397970.176456:0:102333:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:1.0:1787397970.176460:0:102333:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1787397970.176478:0:102333:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787397970.176501:0:102333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3849466977997ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787397970.176507:0:102333:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787397970.176989:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701234688 00000100:00100000:3.0:1787397970.176995:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701234688 00000100:00100000:3.0:1787397970.177027:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397970.177034:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3648:x1874218701234688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787397970.177047:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397970.177096:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3648:x1874218701234688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.177103:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:3.0:1787397970.177133:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70547ad80, transno 0 00000004:00080000:3.0:1787397970.177137:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70547ad80/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177147:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232384:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787397970.177157:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e57480, transno 0 00000004:00080000:3.0:1787397970.177160:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e57480/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177163:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232896:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787397970.177171:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a70547b480, transno 0 00000004:00080000:3.0:1787397970.177174:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a70547b480/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177177:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232256:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787397970.177185:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a8047cbb80, transno 0 00000004:00080000:3.0:1787397970.177187:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a8047cbb80/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177190:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701232768:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787397970.177197:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702134a80, transno 0 00000004:00080000:3.0:1787397970.177199:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702134a80/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177202:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701233280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787397970.177265:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1874218701233408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4861us (5488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397970.177271:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:3.0:1787397970.177292:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a702134e00, transno 0 00000004:00080000:3.0:1787397970.177296:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a702134e00/1, rc -2, transno 0 00000100:00100000:3.0:1787397970.177300:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701233408:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1787397970.179835:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89a706e54a80, transno 0 00000004:00080000:2.0:1787397970.179849:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89a706e54a80/1, rc -2, transno 0 00000100:00100000:2.0:1787397970.179859:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701234432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787397970.179912:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701234432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4508us (4552us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397970.179922:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787397970.180277:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701234688:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787397970.180740:0:102333:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 6 done 00000040:00080000:3.0:1787397970.180823:0:102333:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1787397970.180827:0:102327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787397970.180841:0:102333:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787397970.180856:0:102327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1787397970.181095:0:102327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000040:00080000:2.0:1787397970.181699:0:102335:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:2.0:1787397970.181705:0:102335:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787397970.181841:0:102335:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1787397970.181857:0:102335:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1787397970.181945:0:102335:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:2.0:1787397970.181949:0:102335:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1787397970.185771:0:102316:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1787397970.186209:0:102327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787397970.186223:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787397970.186265:0:102327:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787397970.186291:0:102327:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192ee7 00000100:00080000:1.0:1787397970.186300:0:102327:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787397970.186314:0:102327:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a70378a000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787397970.186504:0:102327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bff480 x1874218701235072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397970.186631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701235072:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787397970.186703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.186804:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235072 00000100:00100000:0.0:1787397970.186811:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235072 00000100:00100000:0.0:1787397970.186853:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787397970.186861:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701235072:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787397970.186891:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3849 last 0 00000020:00000080:0.0:1787397970.186920:0:100418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d192eee 00002000:00100000:0.0:1787397970.186933:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a703789000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787397970.186937:0:100418:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787397970.186940:0:100418:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787397970.187012:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787397970.187036:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a70378a800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787397970.187114:0:102327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787397970.187170:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.187175:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.187177:0:102327:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787397970.187180:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.187184:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.187185:0:102327:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787397970.187188:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787397970.187191:0:102327:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787397970.187193:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.187195:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.187196:0:102327:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787397970.187198:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.187201:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.187202:0:102327:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787397970.187206:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787397970.187211:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.187214:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.187215:0:102327:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1787397970.187217:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397970.187220:0:102327:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #41 00000020:01000000:1.0:1787397970.187222:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397970.187223:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1787397970.187247:0:102327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701235200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397970.187299:0:102327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.187317:0:102327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397970.194168:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701235072:12345-0@lo:8:llog_process_th.0 Request processed in 7295us (7453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397970.194184:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787397970.194357:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a835bff480 x1874218701235072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787397980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397970.194370:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397970.194382:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787397970.194393:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787397970.194399:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787397970.194403:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a70378a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787397970.194518:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235200 00000100:00100000:0.0:1787397970.194563:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235200 00000100:00100000:0.0:1787397970.194615:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787397970.194624:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:102327:x1874218701235200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.194787:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:102327:x1874218701235200:12345-0@lo:502:llog_process_th.0 Request processed in 164us (7487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397970.194794:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:3.0:1787397970.194892:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787397970.194901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701235072:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787397970.195148:0:102335:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787397970.195213:0:102335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3849485690363ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787397970.195220:0:102335:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787397970.195877:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701235328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397970.195933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397970.196016:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235328 00000100:00100000:3.0:1787397970.196087:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235328 00000100:00100000:3.0:1787397970.196139:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397970.196147:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701235328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397970.196172:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00080000:2.0:1787397970.196308:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397970.196369:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701235328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.196386:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787397970.196699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89a806915500 x1874218701235328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397970.196861:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701235328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397970.197211:0:102327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701235200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397970.197246:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397970.197260:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.197263:0:102327:0:(obd_config.c:1561:class_process_config()) marker 41 (0x6) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:1.0:1787397970.197267:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787397970.197272:0:102327:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:1.0:1787397970.197273:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397970.197274:0:102327:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787397970.197276:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787397970.197278:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.197280:0:102327:0:(obd_config.c:1561:class_process_config()) marker 44 (0x6) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1787397970.197282:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.197286:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.197287:0:102327:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1787397970.197291:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:1.0:1787397970.197303:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.197306:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.197307:0:102327:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1787397970.197309:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787397970.197311:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.197313:0:102327:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:1.0:1787397970.197317:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1787397970.197359:0:102327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701235456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787397970.197421:0:102327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787397970.197479:0:102316:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787397970.199733:0:102327:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397970.202598:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235456 00000100:00100000:2.0:1787397970.202617:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235456 00000100:00100000:2.0:1787397970.202688:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787397970.202700:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:102327:x1874218701235456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.202949:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:102327:x1874218701235456:12345-0@lo:502:llog_process_th.0 Request processed in 251us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.202958:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787397970.203580:0:102327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102327:1874218701235456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787397970.203621:0:102327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787397970.203629:0:102327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787397970.203632:0:102327:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:1.0:1787397970.203636:0:102327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1787397970.203842:0:102315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:2.0:1787397970.203863:0:102315:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787397970.203882:0:102315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.203907:0:102315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397970.203916:0:102315:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a7024bf000 from 1 10000000:01000000:2.0:1787397970.203918:0:102315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787397970.203954:0:102315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.203961:0:102315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.203970:0:102315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.203990:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397970.204036:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.204075:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.204151:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235584 00000100:00100000:3.0:1787397970.204157:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235584 00000100:00100000:3.0:1787397970.204192:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787397970.204199:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+8:102315:x1874218701235584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787397970.204209:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397970.204222:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192ef5 expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397970.204243:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 9 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397970.204252:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 9 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397970.204261:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583400, rc 0) 00000100:00100000:3.0:1787397970.204301:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701235584:12345-0@lo:101:mount.lustre.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.204306:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787397970.204371:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397970.204381:0:102315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.204389:0:102315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.205011:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235712:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787397970.205053:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.205080:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.205236:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235712 00000100:00100000:3.0:1787397970.205241:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235712 00000100:00100000:3.0:1787397970.205277:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787397970.205285:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701235712:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787397970.205300:0:102323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787397970.205319:0:102323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787397970.205323:0:102323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787397970.205327:0:102323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787397970.205334:0:102323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 131 00000100:00100000:3.0:1787397970.205412:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701235712:12345-0@lo:256:mount.lustre.0 Request processed in 128us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.205432:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787397970.206056:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235712:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787397970.206697:0:102315:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397970.206728:0:102315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.206740:0:102315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397970.206748:0:102315:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a7024bf000 from 1 10000000:01000000:2.0:1787397970.206750:0:102315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787397970.206778:0:102315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.206786:0:102315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.206805:0:102315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.206822:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787397970.206866:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.206896:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397970.207318:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235840 00000100:00100000:1.0:1787397970.207325:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235840 00000100:00100000:1.0:1787397970.207360:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787397970.207368:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:102315:x1874218701235840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787397970.207387:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397970.207399:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192f0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f03 expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.207419:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f03 expref: 10 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.207438:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192f0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f03 expref: 10 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.207446:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31e00, rc 0) 00000100:00100000:1.0:1787397970.207480:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701235840:12345-0@lo:101:mount.lustre.0 Request processed in 113us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397970.207487:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787397970.207901:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397970.207916:0:102315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.207924:0:102315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.207993:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397970.208023:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.208053:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787397970.208156:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701235968 00000100:00100000:1.0:1787397970.208160:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701235968 00000100:00100000:1.0:1787397970.208192:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787397970.208200:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701235968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787397970.208394:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701235968:12345-0@lo:501:mount.lustre.0 Request processed in 194us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397970.208401:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787397970.213021:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701235968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397970.216101:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397970.216198:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.216287:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397970.222608:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236096 00000100:00100000:1.0:1787397970.222626:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236096 00000100:00100000:1.0:1787397970.222759:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787397970.222770:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701236096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787397970.222981:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701236096:12345-0@lo:503:mount.lustre.0 Request processed in 213us (6782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397970.222999:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787397970.223131:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397970.223392:0:102337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102337:1874218701236224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.223448:0:102337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.225300:0:102337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.225355:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236224 00000100:00100000:3.0:1787397970.225366:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236224 00000100:00100000:2.0:1787397970.225480:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787397970.225491:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:102337:x1874218701236224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.226832:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:102337:x1874218701236224:12345-0@lo:502:llog_process_th.0 Request processed in 1339us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.226845:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787397970.226975:0:102337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102337:1874218701236224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397970.227012:0:102337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397970.227025:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.227028:0:102337:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787397970.227035:0:102337:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a7024bf000 00000020:00000080:0.0:1787397970.227038:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787397970.227047:0:102337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397970.227049:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.227060:0:102337:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787397970.227063:0:102337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787397970.227067:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.227068:0:102337:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787397970.227071:0:102337:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a7024bf000 00000020:00000080:0.0:1787397970.227073:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787397970.227169:0:102337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102337:1874218701236352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.227213:0:102337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.227248:0:102337:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.227301:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236352 00000100:00100000:3.0:1787397970.227308:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236352 00000100:00100000:3.0:1787397970.227354:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787397970.227363:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:102337:x1874218701236352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787397970.227461:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:102337:x1874218701236352:12345-0@lo:502:llog_process_th.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.227468:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787397970.228465:0:102337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102337:1874218701236352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787397970.228496:0:102337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787397970.228502:0:102337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787397970.228504:0:102337:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787397970.228508:0:102337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787397970.228629:0:102315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787397970.228655:0:102315:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397970.228669:0:102315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397970.228765:0:102315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397970.228817:0:102315:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787397970.228820:0:102315:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a7024bf000 10000000:01000000:0.0:1787397970.228823:0:102315:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a7024bf000 10000000:01000000:0.0:1787397970.228828:0:102315:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787397970.228833:0:102315:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a7024bf000 from 1 10000000:01000000:0.0:1787397970.228836:0:102315:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397970.228866:0:102315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397970.228887:0:102315:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397970.228897:0:102315:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397970.228917:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787397970.228969:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.229004:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787397970.230467:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236480 00000100:00100000:2.0:1787397970.230481:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236480 00000100:00100000:2.0:1787397970.230564:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397970.230574:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:102315:x1874218701236480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397970.230591:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397970.230611:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b200/0x274786fe0d192f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f11 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.230639:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b200/0x274786fe0d192f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f11 expref: 11 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.230650:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b200/0x274786fe0d192f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f11 expref: 11 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.230658:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b200, rc 0) 00000100:00100000:2.0:1787397970.231032:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701236480:12345-0@lo:101:mount.lustre.0 Request processed in 458us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.231039:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787397970.231093:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787397970.231113:0:102315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.231122:0:102315:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.231205:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397970.231240:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.231260:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397970.231276:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236608 00000100:00100000:2.0:1787397970.231280:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236608 00000100:00100000:2.0:1787397970.231306:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397970.231313:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701236608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397970.231439:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701236608:12345-0@lo:501:mount.lustre.0 Request processed in 126us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.231446:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787397970.231477:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787397970.231502:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397970.231560:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.231575:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397970.231588:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236736 00000100:00100000:2.0:1787397970.231591:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236736 00000100:00100000:2.0:1787397970.231623:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787397970.231629:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701236736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787397970.231928:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701236736:12345-0@lo:503:mount.lustre.0 Request processed in 298us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.231935:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787397970.232086:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701236736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787397970.232289:0:102339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701236864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.232328:0:102339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.232364:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236864 00000100:00100000:0.0:1787397970.232369:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236864 00000100:00100000:0.0:1787397970.232400:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787397970.232406:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701236864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.232489:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701236864:12345-0@lo:502:llog_process_th.0 Request processed in 82us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397970.232496:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787397970.232559:0:102339:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397970.232573:0:102339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701236864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787397970.232623:0:102339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787397970.232638:0:102339:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a82e4fcd40) 00000020:00000080:0.0:1787397970.232666:0:102339:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787397970.232978:0:102339:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a7024bf000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787397970.232988:0:102339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7024bf000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787397970.232991:0:102339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7024bf000 4 00010000:00080000:0.0:1787397970.233024:0:102339:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a817efb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787397970.241583:0:102339:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1787397970.241785:0:102339:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787397970.241836:0:102339:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787397970.241851:0:102339:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d192f26 00000100:00080000:0.0:1787397970.241862:0:102339:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787397970.241869:0:102339:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a817efb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397970.241910:0:102339:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e54380 x1874218701236992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397970.241943:0:102339:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787397970.242181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701236992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397970.242256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.242584:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701236992 00000100:00100000:0.0:1787397970.242592:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701236992 00000100:00100000:0.0:1787397970.242626:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1787397970.242633:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701236992:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787397970.242702:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701236992:12345-0@lo:38:llog_process_th.0 Request processed in 67us (445us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787397970.242710:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1787397970.242823:0:102339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701237120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787397970.242872:0:102339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.242894:0:102339:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.245768:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787397970.245784:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787397970.245791:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787397970.245795:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701236992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787397970.246135:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237120 00000100:00100000:2.0:1787397970.246143:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237120 00000100:00100000:2.0:1787397970.246192:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787397970.246201:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701237120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.246421:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701237120:12345-0@lo:502:llog_process_th.0 Request processed in 219us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.246429:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787397970.246590:0:102339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701237120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.246646:0:102339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701237248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.246803:0:102339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.246828:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237248 00000100:00100000:2.0:1787397970.246833:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237248 00000100:00100000:2.0:1787397970.246897:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787397970.246904:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701237248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787397970.246972:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:102339:x1874218701237248:12345-0@lo:502:llog_process_th.0 Request processed in 69us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.246979:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787397970.248601:0:102339:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.248635:0:102339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:102339:1874218701237248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787397970.248672:0:102339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1787397970.248953:0:102315:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1787397970.248981:0:102315:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397970.249040:0:102315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397970.249052:0:102315:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787397970.249109:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787397970.249111:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397970.249113:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397970.249114:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397970.249116:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397970.249118:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397970.249119:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397970.249121:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397970.249123:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397970.249125:0:102315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397970.249128:0:102315:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787397970.249131:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787397970.249133:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397970.249134:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397970.249135:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397970.249136:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397970.249137:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397970.249138:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397970.249139:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397970.249140:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397970.249141:0:102315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787397970.249162:0:102315:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787397970.249177:0:102315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701237376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787397970.249244:0:102315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397970.249506:0:102315:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546900 going to sleep for 11 seconds 00000100:00100000:1.0:1787397970.251543:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237376 00000100:00100000:1.0:1787397970.251559:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237376 00000100:00100000:1.0:1787397970.251623:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787397970.251633:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701237376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787397970.251665:0:102322:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787397970.251787:0:102322:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787397970.262552:0:102322:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787397970.262577:0:102322:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787397970.262902:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:102315:x1874218701237376:12345-0@lo:253:mount.lustre.0 Request processed in 11265us (13652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.262915:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787397970.263187:0:102315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:102315:1874218701237376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787397970.263201:0:102315:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787397970.263205:0:102315:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787397970.263207:0:102315:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787397970.263208:0:102315:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787397970.263210:0:102315:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787397970.263211:0:102315:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787397970.263212:0:102315:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787397970.263214:0:102315:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787397970.263215:0:102315:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787397970.263224:0:102315:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787397970.263225:0:102315:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787397970.263241:0:102315:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787397970.263439:0:102324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787397970.263443:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787397970.263464:0:102324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.263480:0:102324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 10 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.263489:0:102324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.263581:0:102324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 10 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.263596:0:102324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 10 pid: 102326 timeout: 3949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397970.263611:0:102324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701237504:0@lo:104: 00000100:00100000:1.0:1787397970.263652:0:102324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.263805:0:102324:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397970.267093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237504 00000100:00100000:2.0:1787397970.267106:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237504 00000100:00100000:2.0:1787397970.267162:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1787397970.267172:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:102324:x1874218701237504:12345-0@lo:104: 00010000:00010000:2.0:1787397970.267191:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267292:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787397970.267300:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:102324:x1874218701237504:12345-0@lo:104: Request processed in 130us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.267307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00010000:00010000:2.0:1787397970.267340:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397970.267347:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267355:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787397970.267359:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267367:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787397970.267374:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397970.267379:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787397970.267430:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267437:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397970.267456:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267463:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720ba00/0x274786fe0d192ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192efc expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267478:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397970.267480:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397970.267481:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397970.267502:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701237632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397970.267562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.267610:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237632 00000100:00100000:2.0:1787397970.267613:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237632 00010000:00010000:2.0:1787397970.267630:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 11 pid: 102326 timeout: 3949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397970.267648:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1787397970.267654:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+11:3649:x1874218701237632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397970.267664:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397970.267669:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 11 pid: 102326 timeout: 3949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267864:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 11 pid: 102326 timeout: 3949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267885:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267901:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787397970.267919:0:19657:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004474962s 00010000:00010000:2.0:1787397970.267924:0:19657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267931:0:19657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267938:0:19657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267944:0:19657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267950:0:19657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397970.267954:0:19657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267962:0:19657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267970:0:19657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397970.267982:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397970.268057:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+11:3649:x1874218701237632:12345-0@lo:103:ldlm_bl.0 Request processed in 402us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.268065:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00010000:00010000:1.0:1787397970.268166:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836583400/0x274786fe0d192efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d192ef5 expref: 10 pid: 102326 timeout: 3949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397970.268192:0:102324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701237504:0@lo:104: 00010000:00010000:1.0:1787397970.268211:0:102324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.268220:0:102324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.268228:0:102324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397970.268234:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31800/0x274786fe0d192f2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397970.269197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701237632:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787397970.277090:0:102315:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:2.0:1787397970.277367:0:102315:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787397970.278566:0:102345:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:0.0:1787397970.278573:0:102345:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:01000000:2.0:1787397970.278715:0:102346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787397970.278886:0:102315:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787397970.279666:0:102346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787397970.279896:0:102347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701237760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397970.279970:0:102347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.280014:0:102347:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.280457:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237760 00000100:00100000:3.0:1787397970.280465:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237760 00000100:00100000:3.0:1787397970.280550:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787397970.280569:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701237760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397970.280652:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701237760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.280659:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000040:01000000:2.0:1787397970.281143:0:102315:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787397970.281180:0:102315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787397970.281932:0:102315:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787397970.282260:0:102315:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787397970.282316:0:102315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787397970.284212:0:102347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701237760:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787397970.284264:0:102347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787397970.284316:0:102347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701237888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397970.284399:0:102347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.284424:0:102347:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787397970.284489:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701237888 00000100:00100000:3.0:1787397970.284496:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701237888 00000100:00100000:3.0:1787397970.284557:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787397970.284566:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701237888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397970.284711:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701237888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.284730:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000040:00080000:2.0:1787397970.285635:0:102315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787397970.285878:0:102347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701237888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397970.285961:0:102347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701238016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787397970.286026:0:102347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397970.286044:0:102347:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcde40 going to sleep for 11 seconds 00000040:00080000:2.0:1787397970.286133:0:102315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787397970.286162:0:102315:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:3.0:1787397970.287458:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238016 00000100:00100000:3.0:1787397970.287469:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238016 00000100:00100000:3.0:1787397970.287551:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787397970.287561:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701238016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787397970.287673:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102347:x1874218701238016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397970.287681:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787397970.287776:0:102347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102347:1874218701238016:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787397970.287837:0:102347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787397970.287883:0:102315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787397970.288430:0:102315:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00000040:00080000:0.0:1787397970.292907:0:102346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1787397970.293555:0:102347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787397970.293621:0:102347:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787397970.294433:0:102346:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787397970.294440:0:102346:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1787397970.295166:0:102315:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084470 00010000:00080000:2.0:1787397970.298054:0:102348:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 102348 00010000:02000000:2.0:1787397970.298076:0:102348:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1787397970.298079:0:102348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787397970.298083:0:102348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1787397970.298280:0:102315:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787397970.298298:0:102315:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787397970.298317:0:102315:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787397970.298354:0:102315:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787397970.299236:0:102315:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787397970.299475:0:102315:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787397970.634039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397970.634091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397970.634113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397970.634152:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315456 00000100:00100000:0.0:1787397970.634161:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315456 00000100:00100000:0.0:1787397970.634216:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315328 00000100:00100000:0.0:1787397970.634219:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315328 00000100:00100000:0.0:1787397970.634238:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1651 00000100:00100000:0.0:1787397970.634248:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681315456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397970.634328:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681315456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397970.634336:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1651 00000100:00100000:0.0:1787397970.634355:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1677 00000100:00100000:0.0:1787397970.634360:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681315328:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:0.0:1787397970.634389:0:66176:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a7090fd000, cookie 0x274786fe0d192e85 00010000:00080000:0.0:1787397970.634394:0:66176:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t120259084472 exp ffff89a7090fd000 cur 3849 last 1787397970 00010000:02000400:0.0:1787397970.634403:0:66176:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787397970.634409:0:66176:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1787397970.634443:0:66176:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787397970.634694:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315200 00000100:00100000:2.0:1787397970.634699:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315200 00000100:00100000:2.0:1787397970.634738:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:2.0:1787397970.634745:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874218681315200:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:2.0:1787397970.634758:0:102321:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp t0 exp 0000000000000000 cur 3849 last 0 00000020:00000080:2.0:1787397970.634786:0:102321:0:(genops.c:1406:class_connect()) connect: client e5696550-1ffc-466d-b13d-359d59b5fc5f, cookie 0x274786fe0d192f34 00000100:00080000:2.0:1787397970.634893:0:102321:0:(import.c:65:import_set_state_nolock()) ffff89a7025d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397970.634927:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:2401:x1874218681315200:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 181us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.634933:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00080000:2.0:1787397970.635100:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397970.635379:0:66176:0:(import.c:65:import_set_state_nolock()) ffff89a706d32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787397970.635432:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681315328:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 1070us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397970.635442:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1677 00000100:00100000:0.0:1787397970.664113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397970.664196:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681308928 00000100:00100000:2.0:1787397970.664206:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681308928 00000100:00100000:2.0:1787397970.664269:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1678 00000100:00100000:2.0:1787397970.664280:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681308928:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:2.0:1787397970.664302:0:67264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084471, current: 120259084472, replaying 00000100:00100000:2.0:1787397970.664325:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681308928:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 49us (224us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397970.664332:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1678 00010000:00080000:0.0:1787397970.664405:0:102348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1787397970.790018:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397970.923190:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787397970.923227:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701238144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397970.923303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397970.923370:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238144 00000100:00100000:2.0:1787397970.923377:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238144 00000100:00100000:2.0:1787397970.924099:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787397970.924113:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701238144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787397970.924141:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00010000:00080000:3.0:1787397970.924672:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a806914a80 x1874218701238144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787397986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397970.924693:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701238144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397970.925002:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701238144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 891us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397970.925011:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 10000000:01000000:3.0:1787397971.173858:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787397971.173867:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a7024bf000 from 132 10000000:01000000:3.0:1787397971.173873:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397971.173925:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.173938:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.173949:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.173977:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.174048:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.174091:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.174150:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238272 00000100:00100000:2.0:1787397971.174159:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238272 00000100:00100000:2.0:1787397971.174212:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787397971.174221:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+10:6519:x1874218701238272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397971.174234:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397971.174249:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f3b expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.174288:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f3b expref: 11 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.174298:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f3b expref: 11 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.174308:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b800, rc 0) 00000100:00100000:2.0:1787397971.174399:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701238272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.174406:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787397971.180926:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.180961:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.180976:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397971.184172:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.184254:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397971.184302:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.184358:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238400 00000100:00100000:0.0:1787397971.184365:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238400 00000100:00100000:0.0:1787397971.184414:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787397971.184423:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701238400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787397971.184444:0:102321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787397971.184460:0:102321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787397971.184463:0:102321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 132 00000100:00100000:1.0:1787397971.186449:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701238400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2017us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397971.186463:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787397971.186583:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787397971.186646:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787397971.186657:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.186669:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397971.186685:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397971.186687:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a83ae93000 from 64 10000000:01000000:3.0:1787397971.186690:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397971.186732:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.186740:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.186748:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.186766:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.186800:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.186835:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397971.186968:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238528 00000100:00100000:1.0:1787397971.186975:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238528 00000100:00100000:1.0:1787397971.187026:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787397971.187034:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+11:6519:x1874218701238528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.187047:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397971.187060:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee30400/0x274786fe0d192f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f49 expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.187085:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee30400/0x274786fe0d192f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f49 expref: 12 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.187095:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee30400/0x274786fe0d192f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f49 expref: 12 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.187106:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee30400, rc 0) 00000100:00100000:1.0:1787397971.187185:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397971.187192:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787397971.187809:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.187829:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.187839:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.187911:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.187952:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.188023:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.188058:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238656 00000100:00100000:2.0:1787397971.188064:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238656 00000100:00100000:2.0:1787397971.188140:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787397971.188150:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.188300:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.188306:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787397971.188369:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.188400:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.188450:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.191803:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238784 00000100:00100000:3.0:1787397971.191818:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238784 00000100:00100000:3.0:1787397971.191879:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787397971.191888:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.192036:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.192045:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787397971.195225:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.195274:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397971.195945:0:102391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1787397971.196011:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1787397971.196038:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787397971.196050:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.196062:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397971.196082:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787397971.196085:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1787397971.196088:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787397971.196123:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.196132:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.196140:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.196162:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.196224:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.196262:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.196686:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701238912 00000100:00100000:3.0:1787397971.196696:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701238912 00000100:00100000:2.0:1787397971.196839:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787397971.196854:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:6519:x1874218701238912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397971.196871:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397971.196886:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a600/0x274786fe0d192f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f57 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.196926:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a600/0x274786fe0d192f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f57 expref: 13 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.196937:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a600/0x274786fe0d192f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f57 expref: 13 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.196947:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a600, rc 0) 00000100:00100000:2.0:1787397971.197000:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701238912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.197007:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787397971.197151:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701238912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397971.197166:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.197175:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.197242:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.197336:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.197359:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.197372:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239040 00000100:00100000:0.0:1787397971.197376:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239040 00000100:00100000:0.0:1787397971.197406:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397971.197413:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701239040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.197597:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701239040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.197604:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787397971.197636:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.197666:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.197717:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.197735:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.197745:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239168 00000100:00100000:0.0:1787397971.197749:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239168 00000100:00100000:0.0:1787397971.197767:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397971.197772:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701239168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.201272:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701239168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3489us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.201286:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787397971.201372:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397971.201973:0:102392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1787397971.202037:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1787397971.202060:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787397971.202072:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.202082:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397971.202105:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787397971.202108:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a83ae93000 from 7 10000000:01000000:0.0:1787397971.202110:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787397971.202147:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.202154:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.202162:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.202183:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.202233:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.202266:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.204509:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239296 00000100:00100000:3.0:1787397971.204540:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239296 00000100:00100000:3.0:1787397971.204605:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787397971.204615:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:6519:x1874218701239296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.204632:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.204650:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583c00/0x274786fe0d192f6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f65 expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.204676:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583c00/0x274786fe0d192f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f65 expref: 14 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.204687:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583c00/0x274786fe0d192f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f65 expref: 14 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.204697:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583c00, rc 0) 00000100:00100000:3.0:1787397971.204778:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.204785:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787397971.206645:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397971.206673:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.206685:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.206782:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.206839:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.206883:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.206904:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239424 00000100:00100000:0.0:1787397971.206909:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239424 00000100:00100000:0.0:1787397971.206960:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397971.206969:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.207108:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.207116:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787397971.207157:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.207185:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.207223:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.207234:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.207244:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239552 00000100:00100000:0.0:1787397971.207247:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239552 00000100:00100000:0.0:1787397971.207264:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787397971.207268:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.207352:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.207359:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787397971.207395:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787397971.208362:0:102393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787397971.208419:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787397971.208439:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787397971.208448:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208459:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787397971.208481:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787397971.208483:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a8364e2000 from 64 10000000:01000000:0.0:1787397971.208486:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787397971.208562:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208570:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208579:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.208598:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.208645:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.208677:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.208694:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239680 00000100:00100000:0.0:1787397971.208711:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239680 00000100:00100000:0.0:1787397971.208747:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787397971.208756:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701239680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397971.208767:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397971.208781:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55200/0x274786fe0d192f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f73 expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208806:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55200/0x274786fe0d192f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f73 expref: 15 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208818:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55200/0x274786fe0d192f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f73 expref: 15 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208838:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55200, rc 0) 00000100:00100000:0.0:1787397971.208873:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701239680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.208880:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787397971.208926:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397971.208938:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.208946:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397971.208992:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397971.209015:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397971.209037:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83649d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.209460:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239808 00000100:00100000:3.0:1787397971.209466:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239808 00000100:00100000:3.0:1787397971.209514:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397971.209542:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701239808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.209694:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701239808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.209712:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787397971.209744:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.209778:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.209821:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.209837:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.209851:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701239936 00000100:00100000:3.0:1787397971.209855:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701239936 00000100:00100000:3.0:1787397971.209873:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397971.209879:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701239936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.209952:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701239936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.209958:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787397971.209999:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701239936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397971.210991:0:102394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1787397971.211066:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1787397971.211087:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397971.211096:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211106:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397971.211114:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787397971.211128:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787397971.211131:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787397971.211161:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211169:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211178:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.211196:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.211242:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.211261:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.211278:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240064 00000100:00100000:3.0:1787397971.211282:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240064 00000100:00100000:3.0:1787397971.211312:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787397971.211394:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701240064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.211405:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.211417:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582000/0x274786fe0d192f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f81 expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211438:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582000/0x274786fe0d192f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f81 expref: 16 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211448:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582000/0x274786fe0d192f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f81 expref: 16 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211457:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582000, rc 0) 00000100:00100000:3.0:1787397971.211491:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.211628:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787397971.211671:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.211685:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.211693:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.211748:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.211773:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.211786:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.211797:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240192 00000100:00100000:3.0:1787397971.211801:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240192 00000100:00100000:3.0:1787397971.211821:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397971.211827:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.211948:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.211955:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397971.211985:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.212010:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.212046:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.212061:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.212072:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240320 00000100:00100000:3.0:1787397971.212075:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240320 00000100:00100000:3.0:1787397971.212096:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397971.212108:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.215067:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2950us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.215083:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787397971.217065:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397971.224254:0:102395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1787397971.229720:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787397971.229773:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787397971.229787:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.229801:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397971.231073:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787397971.231079:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a8364e2000 from 7 10000000:01000000:3.0:1787397971.231084:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787397971.231132:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231144:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231155:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.231183:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.231255:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.231298:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.231332:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240448 00000100:00100000:3.0:1787397971.231339:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240448 00000100:00100000:3.0:1787397971.231387:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787397971.231396:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701240448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.231410:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.231422:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836582e00/0x274786fe0d192f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f8f expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231443:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836582e00/0x274786fe0d192f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f8f expref: 17 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231467:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836582e00/0x274786fe0d192f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f8f expref: 17 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231476:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582e00, rc 0) 00000100:00100000:3.0:1787397971.231515:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.231542:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787397971.231596:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.231610:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.231619:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.231678:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.231723:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.231739:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.231753:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240576 00000100:00100000:3.0:1787397971.231756:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240576 00000100:00100000:3.0:1787397971.231780:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397971.231787:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.231895:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.231902:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397971.231934:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.231974:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.232014:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.232028:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90300 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.232039:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240704 00000100:00100000:3.0:1787397971.232043:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240704 00000100:00100000:3.0:1787397971.232064:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787397971.232071:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.232147:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.232154:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787397971.232195:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397971.232817:0:102399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787397971.232882:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787397971.232899:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787397971.232907:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.232918:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397971.232928:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787397971.232930:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a835594800 from 64 10000000:01000000:3.0:1787397971.232933:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787397971.232959:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.232965:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.232982:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.232998:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233037:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.233057:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.233075:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240832 00000100:00100000:3.0:1787397971.233080:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240832 00000100:00100000:3.0:1787397971.233114:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397971.233122:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701240832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.233132:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.233143:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583600/0x274786fe0d192fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192f9d expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.233161:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583600/0x274786fe0d192fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192f9d expref: 18 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.233171:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583600/0x274786fe0d192fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f9d expref: 18 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.233179:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583600, rc 0) 00000100:00100000:3.0:1787397971.233213:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701240832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.233219:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787397971.233257:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.233267:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.233281:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.233326:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233351:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.233365:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.233377:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701240960 00000100:00100000:3.0:1787397971.233380:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701240960 00000100:00100000:3.0:1787397971.233400:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397971.233405:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701240960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233493:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701240960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.233500:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787397971.233558:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701240960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233582:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233618:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.233632:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.233642:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241088 00000100:00100000:3.0:1787397971.233646:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241088 00000100:00100000:3.0:1787397971.233666:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397971.233672:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701241088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.233753:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701241088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.233759:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787397971.233805:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397971.247428:0:102401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1787397971.250767:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1787397971.250813:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787397971.250826:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.250840:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787397971.250849:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787397971.250852:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a835594800 from 129 10000000:01000000:3.0:1787397971.250855:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787397971.250893:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.250901:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.250910:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397971.250934:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.251086:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397971.251141:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.251330:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241216 00000100:00100000:2.0:1787397971.251338:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241216 00000100:00100000:2.0:1787397971.251402:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787397971.251414:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701241216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397971.251430:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397971.251445:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720a000/0x274786fe0d192fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192fab expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.251940:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720a000/0x274786fe0d192fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192fab expref: 19 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.251954:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720a000/0x274786fe0d192fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192fab expref: 19 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.251964:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720a000, rc 0) 00000100:00100000:2.0:1787397971.252029:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701241216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 617us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.252037:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397971.252122:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.252145:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.252155:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.252214:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.252253:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.252332:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703fcd600 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.252414:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241344 00000100:00100000:3.0:1787397971.252420:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241344 00000100:00100000:3.0:1787397971.252490:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787397971.252511:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701241344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397971.252553:0:102322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787397971.252574:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397971.252578:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1787397971.252580:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1787397971.252583:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1787397971.252585:0:102322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 132 00000100:00100000:3.0:1787397971.252665:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701241344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.252672:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787397971.252747:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787397971.252825:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787397971.252832:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.252841:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787397971.252850:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787397971.252853:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:2.0:1787397971.252855:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787397971.252877:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.252884:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.252894:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397971.252913:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.252938:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397971.253169:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787397971.253204:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241472 00000100:00100000:1.0:1787397971.253209:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241472 00000100:00100000:1.0:1787397971.253240:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397971.253247:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701241472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.253256:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397971.253273:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82ee31c00/0x274786fe0d192fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192fb9 expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.253291:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82ee31c00/0x274786fe0d192fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192fb9 expref: 20 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.253301:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82ee31c00/0x274786fe0d192fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192fb9 expref: 20 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.253309:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31c00, rc 0) 00000100:00100000:1.0:1787397971.253350:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397971.253357:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787397971.253408:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.253425:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.253434:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.253492:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.253926:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.253949:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.256450:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241600 00000100:00100000:3.0:1787397971.256467:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241600 00000100:00100000:3.0:1787397971.256760:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787397971.256772:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.256967:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (3039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.256975:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397971.259787:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.259860:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.259944:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.260034:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.260081:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241728 00000100:00100000:3.0:1787397971.260088:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241728 00000100:00100000:3.0:1787397971.260149:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787397971.260160:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397971.260294:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.260302:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397971.260416:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787397971.261227:0:102404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:1.0:1787397971.261288:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:1.0:1787397971.261772:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787397971.261785:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.261797:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.261807:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1787397971.261810:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a835594800 from 1 10000000:01000000:1.0:1787397971.261813:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787397971.261846:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.261861:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.261871:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.261892:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.261942:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.263490:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.267357:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241856 00000100:00100000:3.0:1787397971.267371:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241856 00000100:00100000:3.0:1787397971.267487:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397971.267499:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701241856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.267518:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.267554:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23600/0x274786fe0d192fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192fc7 expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.267594:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23600/0x274786fe0d192fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192fc7 expref: 21 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.267606:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23600/0x274786fe0d192fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192fc7 expref: 21 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.267759:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23600, rc 0) 00000100:00100000:3.0:1787397971.267836:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701241856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 339us (5893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.267843:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397971.268847:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.268874:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.268887:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.268911:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787397971.268917:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.268924:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.268933:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787397971.268935:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a835594800 from 7 10000000:01000000:1.0:1787397971.268938:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787397971.269126:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.269149:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.269159:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.269181:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.269239:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.269279:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.270457:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701241984 00000100:00100000:3.0:1787397971.284898:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701241984 00000100:00100000:2.0:1787397971.286226:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787397971.286242:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701241984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787397971.286264:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397971.286285:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a70720b600/0x274786fe0d192fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192fd5 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.286333:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a70720b600/0x274786fe0d192fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192fd5 expref: 22 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.286345:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a70720b600/0x274786fe0d192fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192fd5 expref: 22 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397971.286356:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720b600, rc 0) 00000100:00100000:2.0:1787397971.286458:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701241984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (17218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.286466:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787397971.286564:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701241984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.286585:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.286595:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.286676:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.286721:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.290814:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.292940:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242112 00000100:00100000:2.0:1787397971.292963:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242112 00000100:00100000:2.0:1787397971.293028:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787397971.293038:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701242112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.293219:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701242112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (6496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.293227:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787397971.293841:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.293901:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.293957:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.299360:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.299810:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242240 00000100:00100000:2.0:1787397971.299820:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242240 00000100:00100000:2.0:1787397971.299886:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787397971.299895:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a842070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701242240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.300175:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a842070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701242240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397971.300183:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787397971.300342:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787397971.305949:0:102407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787397971.306140:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787397971.306172:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787397971.306183:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.306197:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.306206:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1787397971.306208:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787397971.306211:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787397971.306250:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.306259:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.306269:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.306298:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.306364:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.306407:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83662dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787397971.306440:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242368 00000100:00100000:0.0:1787397971.306515:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242368 00000100:00100000:0.0:1787397971.306585:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397971.306595:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701242368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397971.306608:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397971.306622:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54a00/0x274786fe0d192fea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192fe3 expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.306649:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54a00/0x274786fe0d192fea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192fe3 expref: 23 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.306659:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54a00/0x274786fe0d192fea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192fe3 expref: 23 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.306676:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54a00, rc 0) 00000100:00100000:0.0:1787397971.306727:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701242368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397971.306735:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397971.307007:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.307022:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.307032:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.307050:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787397971.307062:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.307069:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787397971.307077:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787397971.307079:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787397971.307081:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787397971.307099:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.307107:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.307114:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.307129:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.307157:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.307190:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83662dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397971.307243:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242496 00000100:00100000:3.0:1787397971.307247:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242496 00000100:00100000:3.0:1787397971.307284:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397971.307292:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701242496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397971.307300:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397971.307310:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22600/0x274786fe0d192ff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d192ff1 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.307325:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22600/0x274786fe0d192ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d192ff1 expref: 24 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.307333:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22600/0x274786fe0d192ff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192ff1 expref: 24 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397971.307340:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22600, rc 0) 00000100:00100000:3.0:1787397971.307389:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701242496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397971.307396:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787397971.307463:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787397971.307473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.307481:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397971.308146:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787397971.308189:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397971.308228:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83662dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397971.308296:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242624 00000100:00100000:2.0:1787397971.308301:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242624 00000100:00100000:2.0:1787397971.308350:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787397971.308359:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701242624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787397971.308450:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701242624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787397971.308457:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787397971.308835:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701242624:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787397971.308871:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787397971.308879:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397971.308890:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397971.816116:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397972.484826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397972.485157:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315584 00000100:00100000:0.0:1787397972.485168:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315584 00000100:00100000:0.0:1787397972.485238:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787397972.485249:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:70888:x1874218681315584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397972.485265:0:102321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397972.485284:0:102321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86b2 expref: -99 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.485739:0:102321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 6 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.485751:0:102321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 6 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.485760:0:102321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55a00, rc 0) 00000100:00100000:0.0:1787397972.485831:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681315584:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 584us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397972.485839:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:0.0:1787397972.496984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.497244:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315712 00000100:00100000:3.0:1787397972.497255:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315712 00000100:00100000:3.0:1787397972.497331:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:3.0:1787397972.497343:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681315712:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787397972.497477:0:102322:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1787397972.497504:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787397972.497508:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1787397972.497511:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1787397972.497514:0:102322:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1787397972.497516:0:102322:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 132 00000100:00100000:0.0:1787397972.500628:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681315712:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 3272us (3642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397972.500655:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:1.0:1787397972.507908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.508086:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315840 00000100:00100000:3.0:1787397972.508098:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315840 00000100:00100000:3.0:1787397972.508160:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:3.0:1787397972.508172:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681315840:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397972.508192:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397972.508211:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23a00/0x274786fe0d193006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86b9 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.508255:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23a00/0x274786fe0d193006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b9 expref: 7 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.508267:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23a00/0x274786fe0d193006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b9 expref: 7 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.508277:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23a00, rc 0) 00000100:00100000:3.0:1787397972.509594:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681315840:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 1418us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397972.509604:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 64 00000100:00100000:1.0:1787397972.518217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397972.518669:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681315968 00000100:00100000:0.0:1787397972.518690:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681315968 00000100:00100000:0.0:1787397972.518752:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:0.0:1787397972.518762:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681315968:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787397972.518923:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681315968:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 162us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397972.518931:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:1.0:1787397972.521867:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.521963:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316096 00000100:00100000:3.0:1787397972.521972:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316096 00000100:00100000:3.0:1787397972.522033:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:3.0:1787397972.522044:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681316096:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787397972.522192:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681316096:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 149us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397972.522200:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 66 00000100:00100000:1.0:1787397972.530324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397972.530455:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316224 00000100:00100000:0.0:1787397972.530466:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316224 00000100:00100000:0.0:1787397972.530547:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:0.0:1787397972.530557:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681316224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787397972.530573:0:102326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397972.530591:0:102326:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19300d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86c0 expref: -99 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.530621:0:102326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19300d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c0 expref: 9 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.530632:0:102326:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19300d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c0 expref: 9 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397972.530641:0:102326:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55e00, rc 0) 00000100:00100000:0.0:1787397972.530707:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316224:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 151us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397972.530714:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:1.0:1787397972.534577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.534856:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316352 00000100:00100000:3.0:1787397972.534865:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316352 00000100:00100000:3.0:1787397972.534926:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787397972.534935:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397972.535124:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316352:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 190us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397972.535132:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:1.0:1787397972.540868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397972.540978:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316480 00000100:00100000:2.0:1787397972.540991:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316480 00000100:00100000:2.0:1787397972.541055:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:2.0:1787397972.541067:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316480:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787397972.541225:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316480:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 160us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397972.541234:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:2.0:1787397972.546632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.546737:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316608 00000100:00100000:3.0:1787397972.546748:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316608 00000100:00100000:3.0:1787397972.546810:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:3.0:1787397972.546821:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681316608:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787397972.546839:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397972.546860:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22a00/0x274786fe0d193014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86c7 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.546891:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22a00/0x274786fe0d193014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c7 expref: 10 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.546911:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22a00/0x274786fe0d193014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c7 expref: 10 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397972.546921:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22a00, rc 0) 00000100:00100000:3.0:1787397972.547067:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681316608:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 247us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397972.547074:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 70 00000100:00100000:0.0:1787397972.550349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397972.550544:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316736 00000100:00100000:3.0:1787397972.550555:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316736 00000100:00100000:3.0:1787397972.550615:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787397972.550625:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681316736:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787397972.550769:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681316736:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 145us (433us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787397972.550777:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00010000:00010000:3.0:1787397972.841566:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397973.864408:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397973.989542:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701242752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787397973.989618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397973.989692:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242752 00000100:00100000:2.0:1787397973.989706:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242752 00000100:00100000:2.0:1787397973.989761:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787397973.989773:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701242752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787397973.989813:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397973.989856:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701242752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397973.989864:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787397973.989885:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397973.989920:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701242752:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787397974.678915:0:102599:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787397974.886863:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787397975.526138:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397975.526148:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397975.526153:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397975.526163:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787397975.526169:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397975.526176:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a83563e800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397975.526200:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e56d80 x1874218701243008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397975.526249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397975.526253:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397975.526255:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397975.526259:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787397975.526261:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397975.526265:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7054c2800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397975.526280:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e55500 x1874218701243392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397975.526290:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397975.526293:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397975.526295:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397975.526298:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787397975.526300:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397975.526303:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397975.526316:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e54380 x1874218701243520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397975.526350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787397975.526353:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397975.526355:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397975.526358:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787397975.526360:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787397975.526364:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397975.526376:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e54a80 x1874218701243776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787397975.526406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787397975.526409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787397975.526410:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817efb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787397975.526415:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a817efb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787397975.526428:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8360b4700 x1874218701244416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787397975.526765:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701242880:0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.526838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.526880:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701243904:0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.526907:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.526936:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787397975.526942:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701243136:0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.526966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.526982:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701244032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.527010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.527048:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243904 00000100:00100000:2.0:1787397975.527056:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243904 00000100:00100000:2.0:1787397975.527113:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1787397975.527124:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701243904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.527178:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701243904:12345-0@lo:400:kworker.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.527185:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1787397975.527212:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244032 00000100:00100000:2.0:1787397975.527224:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244032 00000100:00100000:2.0:1787397975.527249:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787397975.527255:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.527289:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701244032:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.527295:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787397975.527311:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397975.527349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701244032:0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.527362:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701243904:0@lo:400:kworker.0 00000100:00100000:3.0:1787397975.527871:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701243008:0@lo:38:kworker.0 00000100:00100000:3.0:1787397975.527908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.527935:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701243392:0@lo:38:kworker.0 00000100:00100000:3.0:1787397975.527961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.527981:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701243520:0@lo:38:kworker.0 00000100:00100000:3.0:1787397975.527998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.528031:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701243776:0@lo:38:kworker.0 00000100:00100000:3.0:1787397975.528054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.528070:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701244416:0@lo:38:kworker.0 00000100:00100000:3.0:1787397975.528101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.528135:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701242880 00000100:00100000:3.0:1787397975.528140:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701242880 00000100:00100000:3.0:1787397975.528178:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787397975.528186:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701242880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397975.528225:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701242880:12345-0@lo:400:kworker.0 Request processed in 40us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397975.528232:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787397975.528263:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243136 00000100:00100000:3.0:1787397975.528266:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243136 00000100:00100000:3.0:1787397975.528303:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397975.528310:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701243136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397975.528341:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701243136:12345-0@lo:400:kworker.0 Request processed in 31us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397975.528346:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787397975.528364:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243008 00000100:00100000:3.0:1787397975.528367:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243008 00000100:00100000:3.0:1787397975.528382:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787397975.528387:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701243008:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787397975.528415:0:66188:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a7090fb000, cookie 0x274786fe0d192e7e 00010000:00080000:3.0:1787397975.528420:0:66188:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084471 exp ffff89a7090fb000 cur 3854 last 1787397970 00000004:00100000:3.0:1787397975.528445:0:66188:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787397975.529415:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243392 00000100:00100000:2.0:1787397975.529427:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243392 00000100:00100000:2.0:1787397975.529452:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243520 00000100:00100000:2.0:1787397975.529455:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243520 00000100:00100000:2.0:1787397975.529467:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243776 00000100:00100000:2.0:1787397975.529469:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243776 00000100:00100000:2.0:1787397975.529476:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244416 00000100:00100000:2.0:1787397975.529479:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244416 00000100:00100000:2.0:1787397975.529493:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787397975.529500:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701243392:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.529636:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:2.0:1787397975.529680:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d19301b 00000004:00100000:2.0:1787397975.529695:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397975.529729:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a83670c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397975.529811:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701243392:12345-0@lo:38:kworker.0 Request processed in 310us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.529817:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787397975.529838:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1787397975.529853:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701243520:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.529867:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:2.0:1787397975.529888:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d193022 00000004:00100000:2.0:1787397975.529896:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397975.529913:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a83670a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397975.529942:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701243520:12345-0@lo:38:kworker.0 Request processed in 89us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.529948:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1787397975.529960:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1787397975.529964:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701243776:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.529976:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:2.0:1787397975.530000:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d193029 00000004:00100000:2.0:1787397975.530005:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397975.530019:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a7025d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397975.530047:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701243776:12345-0@lo:38:kworker.0 Request processed in 81us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.530055:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:2.0:1787397975.530066:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1787397975.530070:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701244416:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.530084:0:66178:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3854 last 0 00000020:00000080:2.0:1787397975.530109:0:66178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d193030 00000004:00100000:2.0:1787397975.530115:0:66178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787397975.530127:0:66178:0:(import.c:65:import_set_state_nolock()) ffff89a828a5a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787397975.530156:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701244416:12345-0@lo:38:kworker.0 Request processed in 84us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.530170:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787397975.530941:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701243264:0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.530989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.531015:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701244160:0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.531057:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787397975.531064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701243648:0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.531102:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701244288:0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.531242:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243264 00000100:00100000:0.0:1787397975.531250:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243264 00000100:00100000:0.0:1787397975.531299:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244160 00000100:00100000:0.0:1787397975.531302:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244160 00000100:00100000:0.0:1787397975.531317:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244288 00000100:00100000:0.0:1787397975.531320:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244288 00000100:00100000:0.0:1787397975.531338:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787397975.531345:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701243264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531401:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701243264:12345-0@lo:400:kworker.0 Request processed in 55us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397975.531408:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787397975.531427:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787397975.531432:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701244160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531464:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701244160:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397975.531469:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787397975.531480:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787397975.531485:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701244288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397975.531507:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701244288:12345-0@lo:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397975.531512:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787397975.531814:0:66188:0:(import.c:65:import_set_state_nolock()) ffff89a70378c000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1787397975.532979:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e55500 x1874218701243392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.533004:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:2.0:1787397975.535212:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff89a706e55500 x1874218701243392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.535226:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787397975.535245:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397975.535249:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397975.535255:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701243392:0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.535293:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e54380 x1874218701243520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.535307:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00100000:3.0:1787397975.542660:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701243008:12345-0@lo:38:kworker.0 Request processed in 14265us (14745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397975.542675:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787397975.542815:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397975.542831:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701244544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397975.542881:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787397975.542936:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397975.542942:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787397975.543103:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701243136:0@lo:400:kworker.0 00000100:00100000:3.0:1787397975.543116:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701242880:0@lo:400:kworker.0 00000100:00080000:2.0:1787397975.543974:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a706e54380 x1874218701243520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.543998:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787397975.544004:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397975.544009:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397975.544015:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701243520:0@lo:38:kworker.0 00000100:00100000:2.0:1787397975.544037:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244544 00000100:00100000:2.0:1787397975.544044:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244544 00000100:00100000:2.0:1787397975.544103:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787397975.544112:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701244544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787397975.544147:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:2.0:1787397975.544220:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701244544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.544227:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787397975.544286:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701244544:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1787397975.544319:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e54a80 x1874218701243776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.544330:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:2.0:1787397975.545317:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a706e54a80 x1874218701243776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.545327:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787397975.545330:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787397975.545334:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397975.545339:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701243776:0@lo:38:kworker.0 00010000:00080000:2.0:1787397975.545365:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a8360b4700 x1874218701244416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787397985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.545378:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:2.0:1787397975.545385:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787397975.545388:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787397975.545391:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787397975.545395:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701244416:0@lo:38:kworker.0 00000100:00080000:2.0:1787397975.545427:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:2.0:1787397975.545435:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787397975.545439:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1787397975.545442:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084470 gen 3 00000100:00100000:2.0:1787397975.545459:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a835bff800 x1874218701217920/t120259084471(120259084471) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397951 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.545467:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 120259084470 last 0 00000100:00080000:2.0:1787397975.545473:0:3647:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff89a835bff800 x1874218701217920/t120259084471(120259084471) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397951 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787397975.545483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701243008:0@lo:38:kworker.0 00000100:00100000:2.0:1787397975.545503:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701217920:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397975.545581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.545629:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701217920 00000100:00100000:2.0:1787397975.545636:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701217920 00000100:00100000:2.0:1787397975.545664:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787397975.545671:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701217920:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1787397975.545687:0:66189:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084471, current: 120259084471, replaying 00000100:00100000:2.0:1787397975.545695:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701217920:12345-0@lo:1000:osp_up0-1.0 Request processed in 24us (115us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397975.545701:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000001:00100000:3.0:1787397975.547570:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787397975.547791:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787397975.550608:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701243648 00000100:00100000:2.0:1787397975.550634:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701243648 00000100:00100000:2.0:1787397975.550712:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1787397975.550721:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701243648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397975.550808:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701243648:12345-0@lo:400:kworker.0 Request processed in 88us (19720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.550815:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00080000:3.0:1787397975.551340:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397975.552239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701243648:0@lo:400:kworker.0 00010000:00080000:1.0:1787397975.552264:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a828cfad80 x1874218701244288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397975.552275:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701244288:0@lo:400:kworker.0 00010000:00080000:1.0:1787397975.552288:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e55180 x1874218701243264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787397991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397975.552296:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701243264:0@lo:400:kworker.0 00000100:00100000:1.0:1787397975.552319:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701244160:0@lo:400:kworker.0 00010000:00080000:1.0:1787397975.552371:0:102348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787397975.552378:0:102348:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 120259084471 00000020:00080000:1.0:1787397975.552383:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.552387:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 120259084471, next_transno: 120259084471 00010000:00080000:1.0:1787397975.552392:0:102348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084471) 00000020:00080000:1.0:1787397975.552394:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.552402:0:102348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218701217920 t120259084471 from 0@lo req@ffff89a829b40380 x1874218701217920/t0(120259084471) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:416/0 lens 488/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787397975.552709:0:102348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1787397975.552728:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.552731:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084472, next_transno: 120259084472 00010000:00080000:1.0:1787397975.552734:0:102348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084472) 00000020:00080000:1.0:1787397975.552737:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.552745:0:102348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681308928 t120259084472 from 192.168.204.60@tcp req@ffff89a706e56300 x1874218681308928/t0(120259084472) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:411/0 lens 528/0 e 0 to 0 dl 1787397981 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787397975.553267:0:102348:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 469us 00000100:00080000:2.0:1787397975.557900:0:3647:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff89a835bff800 x1874218701217920/t120259084471(120259084471) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397991 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.557923:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1787397975.557941:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084470 gen 3 00000100:00100000:2.0:1787397975.557947:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a835bff800 x1874218701217920/t120259084471(120259084471) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787397991 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787397975.558006:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a83563e800 from lustre-MDT0000_UUID committed 120259084470 last 120259084471 00000100:00080000:2.0:1787397975.558011:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00100000:2.0:1787397975.561696:0:75615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787397975.574086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701217920:0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1787397975.574702:0:102633:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1787397975.574708:0:102633:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1787397975.574713:0:102633:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:3.0:1787397975.576804:0:102633:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d191605 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787397975.576847:0:102633:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1787397975.577136:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701244672:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1787397975.577215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.577644:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244672 00000100:00100000:0.0:1787397975.577652:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244672 00000100:00100000:0.0:1787397975.577705:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787397975.577716:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874218701244672:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1787397975.577740:0:66189:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff89a70aa92d80 x1874218701244672/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:416/0 lens 328/0 e 0 to 0 dl 1787397986 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787397975.577785:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3647:x1874218701244672:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 72us (570us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787397975.577792:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1787397975.597148:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597168:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597184:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597207:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597215:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597222:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597942:0:102348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597970:0:102348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597977:0:102348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597984:0:102348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397975.597989:0:102348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.597997:0:102348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.598011:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397975.598014:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397975.598018:0:102348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.598023:0:102348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31400/0x274786fe0d193037 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397975.598053:0:102348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089af06bd reply state 0000000050e59763 transno 120259084472 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.598065:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.598072:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a70c7dc100) 00010000:00010000:1.0:1787397975.598074:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787397975.598077:0:102348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1787397975.598189:0:102348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1787397975.598210:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.598214:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084473 00000020:00080000:1.0:1787397975.598218:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.598220:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084473 00000100:00100000:0.0:1787397975.601999:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397975.602077:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681309440 00000100:00100000:2.0:1787397975.602089:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681309440 00000100:00100000:2.0:1787397975.602161:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1683 00000100:00100000:2.0:1787397975.602171:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681309440:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:2.0:1787397975.602192:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084473, current: 120259084473, replaying 00000100:00100000:2.0:1787397975.602217:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681309440:12345-192.168.204.60@tcp:36:rm.0 Request processed in 47us (233us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787397975.602224:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1683 00000020:00080000:0.0:1787397975.602296:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.602301:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084473, next_transno: 120259084473 00010000:00080000:0.0:1787397975.602306:0:102348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084473) 00000020:00080000:0.0:1787397975.602309:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.602321:0:102348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681309440 t120259084473 from 192.168.204.60@tcp req@ffff89a70218aa00 x1874218681309440/t0(120259084473) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:416/0 lens 512/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787397975.602413:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602429:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602441:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602452:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602460:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602466:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602612:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602644:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602652:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602858:0:102348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602867:0:102348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602874:0:102348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602880:0:102348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397975.602884:0:102348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602892:0:102348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602903:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x30:0x0].0x0 (ffff89a81ab0c200) 00010000:00010000:0.0:1787397975.602906:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397975.602911:0:102348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602916:0:102348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d193053 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602936:0:102348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602948:0:102348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602954:0:102348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602958:0:102348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397975.602961:0:102348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602966:0:102348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602973:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81ab0cb00) 00010000:00010000:0.0:1787397975.602975:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397975.602977:0:102348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.602982:0:102348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55000/0x274786fe0d193045 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397975.602993:0:102348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc97fc3b reply state 0000000009b9afe2 transno 120259084473 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.603004:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.603009:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a70c7dc100) 00010000:00010000:0.0:1787397975.603011:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397975.603014:0:102348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787397975.603094:0:102348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787397975.603110:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.603113:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084474 00000020:00080000:0.0:1787397975.603116:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.603118:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084474 00000100:00100000:2.0:1787397975.620181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397975.620283:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681311232 00000100:00100000:3.0:1787397975.620293:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681311232 00000100:00100000:3.0:1787397975.620355:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1684 00000100:00100000:3.0:1787397975.620365:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681311232:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00080000:3.0:1787397975.620383:0:77740:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084474, current: 120259084474, replaying 00000100:00100000:3.0:1787397975.620399:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681311232:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 37us (229us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397975.620405:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1684 00000020:00080000:0.0:1787397975.620510:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.620514:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 120259084474, next_transno: 120259084474 00010000:00080000:0.0:1787397975.620518:0:102348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084474) 00000020:00080000:0.0:1787397975.620609:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787397975.620631:0:102348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681311232 t120259084474 from 192.168.204.60@tcp req@ffff89a829b40a80 x1874218681311232/t0(120259084474) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:416/0 lens 520/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787397975.620699:0:102348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397975.620729:0:102348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d19305a lrc: 2/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86a4 expref: -99 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.620967:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,1 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.620982:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621236:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621264:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621272:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621279:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397975.621853:0:102348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00010000:00010000:2.0:1787397975.621872:0:102348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621882:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.621889:0:102348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622300:0:102348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622311:0:102348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 2/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622317:0:102348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622324:0:102348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397975.622328:0:102348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622346:0:102348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622360:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a70242d300) 00010000:00010000:2.0:1787397975.622363:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397975.622368:0:102348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 2/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622373:0:102348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720a200/0x274786fe0d193061 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397975.622386:0:102348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eef8aebd reply state 00000000275bebc1 transno 120259084474 ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622398:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622404:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a70242df00) 00010000:00010000:2.0:1787397975.622406:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397975.622410:0:102348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397975.622465:0:102348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ba00/0x274786fe0d19305a lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622486:0:102348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 12 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.622494:0:102348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:2.0:1787397975.622497:0:102348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397975.622499:0:102348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a70720aa00, rc 0) 00010000:00080000:2.0:1787397975.622966:0:102348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787397975.623069:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397975.623073:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084475 00000020:00080000:2.0:1787397975.623077:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787397975.623079:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084475 00000100:00100000:1.0:1787397975.630663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397975.632006:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316864 00000100:00100000:3.0:1787397975.632030:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316864 00000100:00100000:3.0:1787397975.632098:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1654 00000100:00100000:3.0:1787397975.632108:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2401:x1874218681316864:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787397975.632132:0:66178:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70aa93b80 x1874218681316864/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:416/0 lens 224/0 e 0 to 0 dl 1787397986 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397975.632155:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2401:x1874218681316864:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 49us (1503us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787397975.632162:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1654 00000020:00080000:1.0:1787397975.632581:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.632587:0:102348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084475 00010000:00080000:1.0:1787397975.632590:0:102348:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1787397975.632592:0:102348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787397975.632598:0:102348:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787397975.632601:0:102348:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1787397975.632608:0:102348:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff89a70aa92d80 x1874218701244672/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:416/0 lens 328/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397975.632637:0:102348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397975.632667:0:102348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31200/0x274786fe0d193076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d190de6 expref: -99 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.632692:0:102348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31200/0x274786fe0d193076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 8 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.632714:0:102348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31200/0x274786fe0d193076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 8 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.632722:0:102348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82ee31200, rc 0) 00010000:00080000:1.0:1787397975.632802:0:102348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1787397975.632815:0:102348:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1787397975.633175:0:3647:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193076 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787397975.633187:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1787397975.633211:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701244672:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1787397975.633247:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701244800:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1787397975.633284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397975.633515:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244800 00000100:00100000:1.0:1787397975.633666:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244800 00000100:00100000:1.0:1787397975.633749:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787397975.633758:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3647:x1874218701244800:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787397975.633771:0:66188:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a82ebd4380 x1874218701244800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:416/0 lens 224/0 e 0 to 0 dl 1787397986 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787397975.633795:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3647:x1874218701244800:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 39us (510us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787397975.633802:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1787397975.633849:0:102348:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787397975.633958:0:102348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:0.0:1787397975.640170:0:102316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787397975.640181:0:102316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:0.0:1787397975.640250:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084474 is committed 00000001:00080000:0.0:1787397975.640262:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084471 is committed 00000001:00080000:3.0:1787397975.640686:0:102348:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787397975.640729:0:102348:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1787397975.640745:0:102348:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a70aa93b80 x1874218681316864/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:416/0 lens 224/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787397975.640852:0:102348:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a82ebd4380 x1874218701244800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:416/0 lens 224/0 e 0 to 0 dl 1787397986 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1787397975.640923:0:102348:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:1.0:1787397975.642323:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642336:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642345:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642352:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397975.642356:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397975.642374:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084471 gen 3 00000004:00080000:2.0:1787397975.642383:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084471 committed transno 120259084471 00010000:00010000:1.0:1787397975.642385:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642403:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a70c7dc100) 00010000:00010000:1.0:1787397975.642406:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397975.642410:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642417:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee30e00/0x274786fe0d19303e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642436:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642443:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.642449:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397975.642453:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00010000:00010000:1.0:1787397975.642455:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397975.642460:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397975.642465:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a82ebd4a80 x1874218701244800/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397991 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397975.642468:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397975.642487:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a82ebd4a80 x1874218701244800/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787397991 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787397975.642487:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a70c7dc100) 00010000:00010000:1.0:1787397975.642493:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397975.642498:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787397975.642501:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:00010000:1.0:1787397975.642512:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19304c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:02000000:2.0:1787397975.642647:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787397975.642655:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701244800:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1787397975.642728:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701244928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397975.642787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.642837:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701244928 00000100:00100000:2.0:1787397975.642844:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701244928 00000100:00100000:2.0:1787397975.642886:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787397975.642896:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701244928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787397975.642930:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:2.0:1787397975.642972:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701244928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.642979:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787397975.644736:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701244928:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787397975.646107:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646123:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 2/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646131:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646138:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397975.646143:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646151:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 4/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646167:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a70242df00) 00010000:00010000:1.0:1787397975.646170:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397975.646174:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 2/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.646181:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720ac00/0x274786fe0d193068 lrc: 0/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:3.0:1787397975.687775:0:102348:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe485cbe10 00100000:10000000:3.0:1787397975.687806:0:102348:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1787397975.694413:0:102336:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:1.0:1787397975.694464:0:102336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102336:1874218701245056:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397975.694506:0:102334:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x776:0x0] 00000100:00100000:1.0:1787397975.694568:0:102336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.694573:0:102334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102334:1874218701245184:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787397975.694599:0:102336:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83662dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787397975.694610:0:102334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397975.694643:0:102334:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397975.694646:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245056 00000100:00100000:1.0:1787397975.694654:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245056 00000100:00100000:2.0:1787397975.694669:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245184 00000100:00100000:2.0:1787397975.694674:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245184 00000100:00100000:1.0:1787397975.694707:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787397975.694715:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787397975.694720:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:102336:x1874218701245056:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787397975.694729:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:102334:x1874218701245184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787397975.694751:0:99641:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1953 -> diff = -43 00002000:00080000:1.0:1787397975.694751:0:101069:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1921 -> diff = -127 00002000:02000040:2.0:1787397975.694760:0:99641:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1911 to 0x280000401:1953) 00002000:02000040:1.0:1787397975.694760:0:101069:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1921) 00002000:00010000:3.0:1787397975.696742:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.696754:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.696773:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a1:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:3.0:1787397975.696778:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.696785:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.696800:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.696811:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.696819:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.696838:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.696933:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.696941:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.696967:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.696971:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.696980:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.697007:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.697016:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d19307d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.697040:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.697042:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.697044:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.698269:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.698280:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698291:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a0:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.698294:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.698298:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698309:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698329:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698336:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698361:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.698394:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.698402:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.698411:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.698417:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.698439:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.698453:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.698461:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d193084 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.698478:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.698480:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.698481:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.698890:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.698897:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698906:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79f:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.698909:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.698913:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698922:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698930:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698937:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.698979:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397975.699744:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.699751:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.699760:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79e:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.699763:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.699768:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.699777:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.699785:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.699793:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.699817:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397975.699941:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.699949:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.699957:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.699962:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.699970:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.699997:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700004:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d19308b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700021:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.700024:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700031:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.700043:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700051:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700061:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700068:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193092 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.700079:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.700081:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.700083:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.700438:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.700444:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700453:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79d:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.700462:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.700466:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700476:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700485:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700492:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700542:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787397975.700932:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.700938:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700947:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79c:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.700950:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.700954:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700962:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700970:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.700995:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701013:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397975.701107:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397975.701114:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701122:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.701126:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701134:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701146:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701152:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d193099 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701167:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.701170:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701187:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.701191:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701198:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701208:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701214:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1930a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701223:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.701225:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.701232:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.701507:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.701657:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701668:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79b:0x0].0x0 since=3854s v=(0 0) 00010000:00010000:0.0:1787397975.701670:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.701675:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701683:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701698:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701704:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.701718:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.702369:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.702376:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.702385:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.702389:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.702398:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.702411:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.702429:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1930a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.702446:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.702448:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.702450:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.705119:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.705224:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.718420:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x79a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.718435:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718452:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79a:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.718457:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x79a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.718464:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718479:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718490:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718497:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718565:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.718782:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.718788:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718796:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.718800:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718809:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718825:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718832:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1930ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.718850:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.718852:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.718854:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.719416:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x799:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.719423:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.719432:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x799:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.719442:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.719448:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.719457:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.719466:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.719473:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.719487:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.721086:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.721097:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.721109:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.721114:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.721125:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.721144:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.721164:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1930b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.721187:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.721189:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.721191:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.725449:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x798:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.725477:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725496:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x798:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.725501:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.725508:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725539:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725549:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725557:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725576:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.725807:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.725813:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725821:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.725826:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725836:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725852:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725860:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d1930bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.725880:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.725882:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.725884:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.730111:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x797:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.730126:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730142:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x797:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.730146:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x797:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.730153:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730182:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730193:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730200:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730227:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397975.730351:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x796:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.730357:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730365:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x796:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.730367:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.730371:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730379:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730386:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730404:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730424:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397975.730493:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x795:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.730498:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730506:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.730509:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.730513:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730539:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730548:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730555:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730567:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787397975.730647:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x794:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.730652:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730665:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.730668:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.730672:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730681:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730689:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730696:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730708:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787397975.730737:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787397975.730746:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730757:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.730762:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730772:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730788:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730797:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1930c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.730814:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x793:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.730819:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397975.730821:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730824:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730832:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.730840:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.730845:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.730847:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730851:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730863:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730866:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730886:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730907:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730914:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1930ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730924:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730935:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397975.730940:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.730943:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787397975.730952:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.730956:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730964:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.730976:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731004:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d1930d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.731010:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x792:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.731018:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731021:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397975.731027:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731032:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.731040:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.731041:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.731046:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731048:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731066:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731070:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731087:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731087:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731111:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1930d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731112:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731137:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.731143:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731154:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.731154:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.731165:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731175:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731187:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731196:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1930df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731210:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.731214:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.731220:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x791:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.731222:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.731228:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731230:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731247:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731249:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.731257:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.731265:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731266:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731285:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1930e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731286:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731301:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.731311:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.731312:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.731315:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.731318:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.734052:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.734067:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.734083:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.734087:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.734093:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.734296:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.734308:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.734316:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.735300:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787397975.737153:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x790:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.737169:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.737187:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.737206:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.737213:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.737228:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.737239:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.737247:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740323:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787397975.740338:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740355:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.740360:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740371:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740393:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740400:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1930ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740443:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787397975.740450:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740457:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.740477:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740485:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740500:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740508:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.740512:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.740537:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.740542:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.742785:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.742812:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.742827:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742829:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742832:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742846:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742887:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742889:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.742891:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.746258:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397975.746273:0:99641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1930fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.746324:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.746332:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.746696:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.746898:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.746906:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.746920:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.746924:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.746929:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.746958:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.746967:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.746974:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.747055:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397975.747136:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.747142:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.747150:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.747154:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.747158:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.747166:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.747173:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747767:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.747777:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747786:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.747791:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747801:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747835:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747843:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d193102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.747866:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.747867:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.747869:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.747954:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397975.747968:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1930f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.748115:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.749624:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749661:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397975.749829:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.749836:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749850:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.749854:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.749859:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749872:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749881:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749889:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749908:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397975.749917:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397975.749922:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749937:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.749942:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749953:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749971:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.749979:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750000:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.750004:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750010:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.750014:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750022:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750031:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750056:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dba5f126/0x274786fe0d193110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750071:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.750073:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.750075:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.750146:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.750151:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750159:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.750162:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.750166:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750178:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750184:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750190:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750203:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.750216:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.750220:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750228:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.750230:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750238:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750248:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750253:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d193117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750265:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.750267:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.750268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.750329:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.750334:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750342:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.750345:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.750349:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750369:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750378:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750385:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750398:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397975.750837:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x78a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.750844:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750854:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.750857:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.750861:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750870:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750878:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750896:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.750918:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397975.750930:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397975.750939:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.750948:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.750953:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.750961:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.750975:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.750983:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19311e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.750992:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x789:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.750999:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751000:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.751007:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751014:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.751017:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.751019:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.751022:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751026:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751051:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751052:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751074:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751078:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751091:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751094:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d193125 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751121:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.751121:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.751128:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751134:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.751139:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.751142:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751150:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751162:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751171:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d19312c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.751199:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.751201:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.751204:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.751211:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x788:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.751222:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751230:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.751232:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.751236:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751244:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751252:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751259:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751273:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.751280:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.751284:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751290:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.751293:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751300:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751317:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751324:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d193133 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751338:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.751340:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.751342:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.751408:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x787:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.751414:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751422:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.751426:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.751431:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751440:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.751447:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.751452:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.751455:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.751460:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.751762:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.751770:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751779:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.751782:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.751787:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751797:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751806:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751813:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751827:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.751834:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.751839:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751847:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.751850:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751866:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751878:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751885:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d193141 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.751899:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.751901:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.751903:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.753466:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.753478:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.753491:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.753495:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.753500:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.753514:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.753543:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.753569:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.753594:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.753742:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787397975.753753:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397975.753760:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753769:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.753774:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753783:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753801:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753809:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c1316bb/0x274786fe0d193148 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753826:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.753829:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753836:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.753839:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753858:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753869:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753876:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19313a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753891:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.753893:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.753894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.753975:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x786:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.753980:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.753988:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.754308:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.754708:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.754715:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.754725:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.754728:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.754734:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.754742:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.754750:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.754758:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.754778:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.754800:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.754808:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.754820:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.754830:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755102:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.755110:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755118:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.755123:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755131:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755147:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755154:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be243241/0x274786fe0d193156 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755177:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.755179:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.755180:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.755360:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.755367:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755382:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.755385:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.755389:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755399:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755407:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755414:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755435:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.755545:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755565:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787397975.755640:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.755646:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755654:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00002000:00010000:3.0:1787397975.755656:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x785:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.755659:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755664:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755671:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755678:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.755683:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.755686:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755689:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755703:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82e8b21/0x274786fe0d19315d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755709:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755718:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.755720:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755723:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755738:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755740:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.755752:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755757:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.755762:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755776:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.755777:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755780:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.755784:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755790:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d19314f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755815:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.755819:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787397975.755820:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.755824:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.755829:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.755831:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.755834:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.755835:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755851:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.755855:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.755858:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755861:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755878:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d193164 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755883:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755897:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.755900:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.755900:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.755903:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.755910:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.755931:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787397975.755986:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x784:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.755992:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756112:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.756118:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756126:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.756130:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756137:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756148:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756156:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77ffe02/0x274786fe0d19316b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.756170:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.756172:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.756174:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.759771:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.759776:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.759785:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.759807:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.759837:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.759844:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760556:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397975.760742:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x783:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.760757:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760769:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.760773:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.760778:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760790:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760798:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760805:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760827:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787397975.760897:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x782:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.760919:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760928:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.760931:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.760935:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760951:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760966:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.760974:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761148:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397975.761157:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761166:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.761170:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761179:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761197:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761203:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d193172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761226:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.761232:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.761235:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761256:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.761259:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761266:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761277:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761284:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d193179 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761298:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.761302:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397975.761308:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x781:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.761309:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.761316:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761318:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761336:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761337:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.761345:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x781:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.761354:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761359:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761365:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761387:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d193180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761388:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761409:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761416:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.761418:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.761420:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.761454:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.761577:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.761583:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761591:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.761594:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761601:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761622:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761629:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d193187 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x781:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.761644:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.761647:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.761650:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x780:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.761656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.761659:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761668:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.761672:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x780:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.761676:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761685:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761693:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761701:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761724:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397975.761786:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.761792:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761800:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.761809:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.761812:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761822:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761829:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761835:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761851:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787397975.761860:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397975.761864:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761870:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.761873:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761880:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.761890:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762352:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.762358:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762366:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.762370:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762379:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762390:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762397:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d193195 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.762413:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.762415:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.762417:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.762456:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.762463:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397975.762827:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.762834:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.762843:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.762847:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.762852:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.762863:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.762885:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.762893:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.762925:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397975.763002:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.763008:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763016:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.763019:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.763023:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763032:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763039:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763045:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763068:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397975.763128:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.763133:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763143:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.763145:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.763149:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763158:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763165:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763171:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763185:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787397975.763191:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397975.763196:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763202:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.763210:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763218:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763228:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763234:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c66c88e/0x274786fe0d19319c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763250:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.763253:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763259:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.763262:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763267:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763274:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763282:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f99557f/0x274786fe0d1931a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763299:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.763302:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763307:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.763310:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763315:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763322:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763328:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23695d6/0x274786fe0d1931aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763336:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.763337:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.763338:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397975.763394:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.763399:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763407:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.763414:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.763419:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763429:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763437:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763443:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763456:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.763464:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.763468:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763474:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.763478:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763484:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763494:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.763511:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ed2f41/0x274786fe0d1931b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763609:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.763624:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.763687:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.763695:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.763705:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.763708:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.763713:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.763725:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.763733:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.763740:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.763778:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787397975.763866:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.763872:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763879:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.763891:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763901:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763914:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763922:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf713eb/0x274786fe0d1931b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.763944:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.763947:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.763949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.763962:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d19318e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x780:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764037:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.764040:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.764042:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397975.764114:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.764120:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764129:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.764132:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.764136:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764145:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764152:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764160:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764179:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397975.764247:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.764252:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764259:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.764261:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.764266:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764274:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764280:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764287:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764298:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397975.764359:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.764364:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764371:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.764375:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.764378:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764399:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764406:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764412:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764424:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787397975.764486:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.764491:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764498:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.764501:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.764505:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.764543:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764568:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787397975.764574:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764583:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.764587:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764595:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764607:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764632:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceaaa818/0x274786fe0d1931bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764651:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787397975.764655:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764661:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.764664:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764671:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764683:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764691:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3903041/0x274786fe0d1931c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764708:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.764711:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764717:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.764729:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764737:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.764746:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764750:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.764750:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.764754:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764761:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1931cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.764778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764781:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764783:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764791:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.764797:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.766221:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766248:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766706:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.766721:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.766726:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766736:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.766741:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766750:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766766:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766774:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d1931d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.766795:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.766797:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.766799:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.766803:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x77a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.766814:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.766828:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.766832:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x77a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.766837:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.766850:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.766858:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787397975.766859:0:99641:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1910 00010000:00010000:0.0:1787397975.766866:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.766892:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.767230:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.767235:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.767244:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.767247:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.767256:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.767268:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.767276:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3141683/0x274786fe0d1931db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.767289:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.767290:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.767299:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397975.767734:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:102334:x1874218701245184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73004us (73120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.767745:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00010000:0.0:1787397975.768474:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x779:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.768484:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.768495:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.768506:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x779:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.768511:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.768545:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.768554:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.768561:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.768584:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787397975.768595:0:102334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102334:1874218701245184:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787397975.768621:0:102334:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x7a1:0x0] from OST, last_created [0x280000401:0x7a1:0x0]last_used is [0x280000401:0x776:0x0] 00000100:00100000:1.0:1787397975.768689:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701245312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397975.768698:0:102334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102334:1874218701245440:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787397975.768748:0:102334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397975.768751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397975.768782:0:102334:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80533c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397975.768805:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245312 00000100:00100000:1.0:1787397975.768813:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245312 00000100:00100000:0.0:1787397975.769217:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245440 00000100:00100000:0.0:1787397975.769221:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245440 00000100:00100000:0.0:1787397975.770380:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787397975.770391:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:102334:x1874218701245440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787397975.770434:0:99639:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1954 00010000:00010000:2.0:1787397975.771823:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.771834:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.771847:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.771855:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.771865:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.771884:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.771891:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d1931e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x779:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.771926:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.771928:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.771930:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397975.772103:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787397975.772118:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701245312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397975.772139:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787397975.772223:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701245312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397975.772231:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787397975.772280:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701245312:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1787397975.772773:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x778:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.772781:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772793:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.772797:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x778:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.772803:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772814:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772823:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772831:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772858:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.772871:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.772876:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772884:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.772888:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772896:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772922:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772930:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1931e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x778:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.772959:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.772962:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.772965:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.774459:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x777:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.774471:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.774483:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.774494:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x777:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.774500:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.774706:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.774719:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.774728:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.774786:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397975.775330:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x776:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.775337:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.775346:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.775350:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x776:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.775354:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.775365:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.775374:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.775387:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397975.779362:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:102334:x1874218701245440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8963us (10607us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1787397975.779375:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787397975.779442:0:102334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102334:1874218701245440:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787397975.779457:0:102334:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x7a1:0x0]-[0x280000401:0x7c1:0x0] 00010000:00010000:2.0:1787397975.782026:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.782041:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782055:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.782067:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782081:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782106:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782115:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1931f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x777:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782138:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.782144:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782151:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.782155:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782164:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782174:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.782183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.782192:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.782194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.784572:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397975.784586:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1931f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x776:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397975.785293:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x775:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.785301:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.785314:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.785318:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.785324:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.785337:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.785345:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.785352:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.786212:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.786221:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.786298:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.786303:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.786314:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.786332:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.786342:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.786344:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.786346:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.788463:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.788501:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397975.788520:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1931fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397975.789144:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x774:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.789152:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789166:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.789170:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.789176:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789189:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789199:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789207:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789284:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.789294:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.789300:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789316:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.789321:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789330:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789346:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789360:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d193205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789374:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.789376:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.789378:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.789729:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x773:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.789736:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789744:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.789747:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.789751:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789760:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789775:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789782:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.789800:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.789837:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.789862:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.789872:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.789876:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.789885:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.789898:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.789905:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d19320c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.789926:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.789928:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.789930:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.790381:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x772:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.790388:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790396:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.790399:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.790403:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790412:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790419:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790426:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790461:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.790508:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.790514:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.790544:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.790549:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.790571:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.790585:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.790592:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d05b121/0x274786fe0d193213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.790626:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.790629:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.790631:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787397975.790765:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x771:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.790771:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790779:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.790782:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.790786:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790795:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790803:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790811:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.790836:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.792886:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.792896:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.792920:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.792926:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.792936:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.793131:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.793157:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19321a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.793182:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.793183:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.793185:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.795418:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x770:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.795432:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.795448:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.795453:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.795459:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.795473:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.795482:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.795490:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.798739:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.799279:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.799287:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.799300:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.799305:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.799316:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.799344:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.799352:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8e7fe3/0x274786fe0d193221 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.799372:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.799374:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.799376:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787397975.800875:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.800887:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.800901:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.802486:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787397975.802495:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.802513:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.802680:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.802688:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.802768:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787397975.808341:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.808356:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.808373:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.808386:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.808392:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.808406:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.808416:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.808424:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.808636:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.808644:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.808653:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.808658:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.808667:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.808684:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.808691:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.809079:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397975.809086:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.809107:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787397975.809111:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.809120:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.809132:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.809141:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.809142:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.809144:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.812256:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397975.812272:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d19322f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787397975.813372:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787397975.813383:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.813396:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:1.0:1787397975.813400:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787397975.813406:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.813419:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.813436:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.813443:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397975.813571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397975.813621:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00010000:00010000:2.0:1787397975.813631:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.813640:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.813648:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00000100:00100000:0.0:1787397975.813650:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317120 00010000:00010000:2.0:1787397975.813655:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397975.813659:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317120 00010000:00010000:2.0:1787397975.813669:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.813688:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397975.813716:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1655 00000100:00100000:0.0:1787397975.813725:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681317120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397975.813796:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681317120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397975.813814:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1655 00000100:00100000:0.0:1787397975.813836:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681316992 00000100:00100000:0.0:1787397975.813840:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681316992 00000100:00100000:0.0:1787397975.813859:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:0.0:1787397975.813865:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681316992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397975.813887:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681316992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397975.813893:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00080000:0.0:1787397975.813913:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787397975.813976:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.813979:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.813981:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.817387:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787397975.817401:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d193236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.818497:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.818507:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.818576:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.818580:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.818586:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.818599:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.818628:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.818635:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.818867:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.818875:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.818883:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.818887:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.818896:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.818925:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.818935:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.818936:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.818938:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.819152:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397975.819158:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dab264b/0x274786fe0d19323d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.821366:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.821377:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.821391:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.821396:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.821402:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.821414:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.821423:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.821449:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.822901:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.822914:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.822925:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.822930:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.822941:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.822973:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.823661:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397975.823672:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.824131:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.824405:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x76a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.824412:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.824425:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.824429:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.824435:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.824449:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.824457:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.824464:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.825090:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.826725:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.826735:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.826748:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.826753:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.826763:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.826783:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.826791:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb589abd/0x274786fe0d19324b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.826826:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.826828:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.827795:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x769:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.827804:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.827817:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.827821:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.827827:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.827839:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.827849:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.827856:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.835409:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.835425:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.835440:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.835465:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.835475:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.835497:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.835508:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.835510:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.835512:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.836822:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.838231:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787397975.838243:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537f5f65/0x274786fe0d193252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.838910:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x768:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.838919:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.838940:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.838961:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.838968:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.838987:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.838997:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.839005:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.839023:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787397975.839671:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397975.839679:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.839688:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787397975.839693:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.839704:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.839721:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.839728:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056711f6c/0x274786fe0d193259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397975.839749:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.839752:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.839754:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787397975.841496:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x767:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787397975.841511:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.841543:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:3.0:1787397975.841548:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.841554:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.841568:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.841587:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.841594:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.841624:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787397975.842123:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397975.842132:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.842141:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787397975.842146:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787397975.842156:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x766:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787397975.842158:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842168:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842178:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:0.0:1787397975.842180:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842181:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x766:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787397975.842191:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.842194:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d193260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842211:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842241:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397975.842243:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.842247:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.842251:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397975.842252:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397975.842287:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.842438:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.842445:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.842451:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.842454:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.842461:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.842472:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.842478:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebe575da/0x274786fe0d193267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.842500:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.842501:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.842503:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787397975.843221:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397975.851625:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x765:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.851639:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.851656:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.851661:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.851667:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.851682:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.851693:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.851702:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.851726:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787397975.853442:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x764:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.853456:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.853481:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.853486:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.853491:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.853505:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.853515:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.853549:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.853567:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787397975.854014:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x763:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.854024:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854034:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.854037:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.854041:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854050:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854064:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854070:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854088:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787397975.854098:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787397975.854103:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854110:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.854114:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854122:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854137:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854144:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c690d69e/0x274786fe0d19326e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854160:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787397975.854170:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854176:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.854179:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854187:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854197:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854203:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015e66a0c/0x274786fe0d193275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854221:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.854237:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854243:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.854246:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854254:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854275:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854282:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c075ba29/0x274786fe0d19327c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854296:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.854298:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.854300:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787397975.854788:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x762:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787397975.854795:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854803:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=3855s v=(0 0) 00010000:00010000:2.0:1787397975.854806:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787397975.854810:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854819:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854826:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854834:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854857:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787397975.854865:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787397975.854869:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854876:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787397975.854880:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854886:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854897:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854904:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010e9c323/0x274786fe0d193283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397975.854916:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.854918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397975.854919:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787397975.855876:0:101069:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00010000:00010000:3.0:1787397975.856292:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397975.856434:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397975.857211:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:102336:x1874218701245056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 162488us (162637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397975.857284:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787397975.857392:0:102336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102336:1874218701245056:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787397975.857410:0:102336:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x781:0x0] from OST, last_created [0x2c0000401:0x781:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:0.0:1787397975.857492:0:102336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102336:1874218701245696:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787397975.857634:0:102336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397975.857661:0:102336:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83662dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397975.857689:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245696 00000100:00100000:0.0:1787397975.857694:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245696 00000100:00100000:0.0:1787397975.857733:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787397975.857742:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:102336:x1874218701245696:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787397975.857780:0:100418:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1922 00000100:00100000:3.0:1787397975.858564:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397975.858580:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701245568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397975.858637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397975.860079:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245568 00000100:00100000:1.0:1787397975.860089:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245568 00000100:00100000:1.0:1787397975.860146:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787397975.860155:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701245568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397975.860182:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397975.860755:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701245568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 600us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397975.860764:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787397975.860879:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701245568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397975.863305:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:102336:x1874218701245696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5557us (5665us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787397975.863319:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787397975.863418:0:102336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102336:1874218701245696:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787397975.863442:0:102336:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x781:0x0]-[0x2c0000401:0x7a1:0x0] 00000020:00000004:1.0:1787397975.904804:0:102654:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787397975.906807:0:102654:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787397975.909073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397976.038566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701245824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397976.038655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397976.039020:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245824 00000100:00100000:0.0:1787397976.039029:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245824 00000100:00100000:0.0:1787397976.039097:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787397976.039107:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701245824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397976.039131:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397976.039196:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701245824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397976.039216:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787397976.039580:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701245824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787397976.942361:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787397977.081454:0:102704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787397977.082035:0:102704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787397977.956832:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397978.981426:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397979.037566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397979.037669:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317248 00000100:00100000:3.0:1787397979.037679:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317248 00000100:00100000:3.0:1787397979.037780:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1685 00000100:00100000:3.0:1787397979.037793:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:76546:x1874218681317248:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397979.037813:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397979.037843:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19328a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86ce expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.037913:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.037927:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.037940:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397979.038004:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397979.038024:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:0.0:1787397979.038707:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1787397979.038762:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.038800:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19328a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ce expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.038821:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ce expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397979.038830:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:3.0:1787397979.038833:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397979.038837:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:3.0:1787397979.039165:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:76546:x1874218681317248:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1373us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397979.039173:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1685 00000100:00100000:2.0:1787397979.058513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397979.058698:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317376 00000100:00100000:3.0:1787397979.058710:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317376 00000100:00100000:3.0:1787397979.058773:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1686 00000100:00100000:3.0:1787397979.058783:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:76546:x1874218681317376:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787397979.058824:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:3.0:1787397979.058903:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:76546:x1874218681317376:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 121us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397979.058910:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1686 00000100:00100000:0.0:1787397979.065439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397979.065621:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317504 00000100:00100000:2.0:1787397979.065632:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317504 00000100:00100000:2.0:1787397979.065708:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1687 00000100:00100000:2.0:1787397979.065720:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76546:x1874218681317504:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397979.065758:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:2.0:1787397979.065831:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:76546:x1874218681317504:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 114us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397979.065839:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1687 00000100:00080000:0.0:1787397979.065894:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397979.087676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397979.087939:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317632 00000100:00100000:3.0:1787397979.087948:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317632 00000100:00100000:3.0:1787397979.087997:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:3.0:1787397979.088005:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874218681317632:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:3.0:1787397979.088051:0:99640:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t8589934593 exp 0000000000000000 cur 3858 last 0 00000020:00000080:3.0:1787397979.088089:0:99640:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d193298 00002000:00100000:3.0:1787397979.088101:0:99640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a817eff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397979.088119:0:99640:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397979.088196:0:99640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787397979.088226:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a817efb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397979.088303:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681317632:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 297us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397979.088311:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:1.0:1787397979.101275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397979.101475:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317760 00000100:00100000:0.0:1787397979.101486:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317760 00000100:00100000:0.0:1787397979.101610:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:0.0:1787397979.101620:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:76546:x1874218681317760:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397979.101646:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397979.101723:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:76546:x1874218681317760:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 104us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397979.101731:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00080000:3.0:1787397979.101974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397979.105779:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397979.105941:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681317888 00000100:00100000:3.0:1787397979.105953:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681317888 00000100:00100000:3.0:1787397979.106005:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787397979.106015:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681317888:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:3.0:1787397979.106058:0:101069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3858 last 0 00000020:00000080:3.0:1787397979.106103:0:101069:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d19329f 00002000:00100000:3.0:1787397979.106115:0:101069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a817ef9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787397979.106134:0:101069:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787397979.106211:0:101069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787397979.106242:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787397979.106312:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681317888:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 296us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397979.106319:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:3.0:1787397979.108775:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787397979.108798:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701245952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397979.108875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397979.108961:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701245952 00000100:00100000:0.0:1787397979.108969:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701245952 00000100:00100000:0.0:1787397979.109035:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787397979.109045:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701245952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397979.109080:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397979.109126:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701245952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397979.109133:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787397979.109346:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701245952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397979.109457:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397979.110758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397979.110877:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318016 00000100:00100000:0.0:1787397979.110885:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318016 00000100:00100000:0.0:1787397979.110945:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787397979.110955:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:76546:x1874218681318016:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787397979.110988:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397979.111056:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:76546:x1874218681318016:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397979.111064:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00080000:3.0:1787397979.112397:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787397980.004718:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397980.649007:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701246080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787397980.649087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397980.649436:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397980.649445:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701246208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397980.649473:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397980.649718:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246080 00000100:00100000:0.0:1787397980.649726:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246080 00000100:00100000:0.0:1787397980.649762:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246208 00000100:00100000:0.0:1787397980.649765:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246208 00000100:00100000:0.0:1787397980.649782:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787397980.649790:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701246080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397980.649825:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:0.0:1787397980.650055:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701246080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 264us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397980.650063:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787397980.650082:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787397980.650088:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701246208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397980.650107:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:2.0:1787397980.650330:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701246080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397980.650431:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701246208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 341us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397980.650438:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787397980.650487:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701246208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397980.650937:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701246336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397980.650978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.650981:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701246464:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.651009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397980.651013:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701246848:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.651028:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701246976:0@lo:400:kworker.0 00000100:00100000:2.0:1787397980.651037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.651052:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246464 00000100:00100000:2.0:1787397980.651056:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701247360:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.651056:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246464 00000100:00100000:2.0:1787397980.651075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397980.651108:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246336 00000100:00100000:3.0:1787397980.651112:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246336 00000100:00100000:3.0:1787397980.651215:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787397980.651224:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701246336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397980.651264:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701246336:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397980.651270:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787397980.651824:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701246336:0@lo:400:kworker.0 00000100:00100000:2.0:1787397980.652508:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246848 00000100:00100000:2.0:1787397980.652542:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246848 00000100:00100000:2.0:1787397980.652923:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:2.0:1787397980.652935:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701246848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397980.653003:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701246848:12345-0@lo:400:kworker.0 Request processed in 72us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397980.653009:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1787397980.658594:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247360 00000100:00100000:1.0:1787397980.658609:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247360 00000100:00100000:1.0:1787397980.658684:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397980.658695:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701246464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.658781:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701246464:12345-0@lo:400:kworker.0 Request processed in 88us (7770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.658787:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787397980.658804:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397980.658811:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701247360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.658926:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701247360:12345-0@lo:400:kworker.0 Request processed in 115us (7849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.658953:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787397980.658981:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659019:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701247488:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659053:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659105:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701246464:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659132:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701246720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659180:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701247232:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659219:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787397980.659225:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701246592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659246:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659260:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701247104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659294:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701247616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397980.659344:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246976 00000100:00100000:1.0:1787397980.659348:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246976 00000100:00100000:1.0:1787397980.659386:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246720 00000100:00100000:1.0:1787397980.659388:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246720 00000100:00100000:1.0:1787397980.659399:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247232 00000100:00100000:1.0:1787397980.659401:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247232 00000100:00100000:1.0:1787397980.659414:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247104 00000100:00100000:1.0:1787397980.659416:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247104 00000100:00100000:1.0:1787397980.659428:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247616 00000100:00100000:1.0:1787397980.659431:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247616 00000100:00100000:1.0:1787397980.659452:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1787397980.659458:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701246976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659683:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701246976:12345-0@lo:400:kworker.0 Request processed in 224us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.659691:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1787397980.659705:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1787397980.659711:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701246720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659746:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701246720:12345-0@lo:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.659752:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1787397980.659763:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1787397980.659768:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701247232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659793:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701247232:12345-0@lo:400:kworker.0 Request processed in 25us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.659799:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1787397980.659809:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:1.0:1787397980.659814:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701247104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.659952:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701247104:12345-0@lo:400:kworker.0 Request processed in 137us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.659959:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:1.0:1787397980.659973:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1787397980.659980:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701247616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660006:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701247616:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.660011:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1787397980.660041:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247488 00000100:00100000:1.0:1787397980.660045:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247488 00000100:00100000:1.0:1787397980.660064:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701246592 00000100:00100000:1.0:1787397980.660067:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701246592 00000100:00100000:1.0:1787397980.660081:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397980.660087:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701247488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660117:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701247488:12345-0@lo:400:kworker.0 Request processed in 30us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.660123:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787397980.660134:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787397980.660140:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701246592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660166:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701246592:12345-0@lo:400:kworker.0 Request processed in 27us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397980.660172:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787397980.660201:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701246976:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660213:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701247488:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660242:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701246592:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660252:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701247104:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660262:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701247616:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660271:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701246720:0@lo:400:kworker.0 00000100:00100000:1.0:1787397980.660280:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701247232:0@lo:400:kworker.0 00000100:00080000:1.0:1787397980.660626:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787397980.660632:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787397980.660635:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787397980.660645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787397980.663243:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701246848:0@lo:400:kworker.0 00000100:00100000:2.0:1787397980.663264:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701247360:0@lo:400:kworker.0 00000100:00100000:3.0:1787397980.932917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397980.932976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397980.933023:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318272 00000100:00100000:0.0:1787397980.933043:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318272 00000100:00100000:3.0:1787397980.933109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397980.933138:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1662 00000100:00100000:0.0:1787397980.933153:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2403:x1874218681318272:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397980.933167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397980.933208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397980.933268:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2403:x1874218681318272:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397980.933290:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1662 00000100:00100000:0.0:1787397980.933309:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318400 00000100:00100000:0.0:1787397980.933313:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318400 00000100:00100000:0.0:1787397980.933337:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1663 00000100:00100000:0.0:1787397980.933343:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681318400:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397980.933373:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2403:x1874218681318400:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397980.933379:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1663 00000100:00100000:0.0:1787397980.933405:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318144 00000100:00100000:0.0:1787397980.933409:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318144 00000100:00100000:0.0:1787397980.933436:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:0.0:1787397980.933442:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681318144:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397980.933467:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681318144:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397980.933473:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787397980.941429:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318528 00000100:00100000:2.0:1787397980.941451:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318528 00000100:00100000:2.0:1787397980.941603:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318656 00000100:00100000:2.0:1787397980.941607:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318656 00000100:00100000:2.0:1787397980.941643:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787397980.941655:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681318528:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397980.941793:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681318528:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 136us (8811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397980.941820:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787397980.941841:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:2.0:1787397980.941847:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681318656:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397980.941878:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681318656:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (8671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397980.941884:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00010000:00010000:2.0:1787397981.028735:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397981.158035:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701247744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787397981.158110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397981.158169:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247744 00000100:00100000:0.0:1787397981.158176:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247744 00000100:00100000:0.0:1787397981.158238:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397981.158247:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701247744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787397981.158280:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397981.158326:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701247744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397981.158333:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787397981.158391:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701247744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397981.158618:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701247872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397981.158650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397981.158800:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701247872 00000100:00100000:0.0:1787397981.158802:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701248000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397981.158817:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701247872 00000100:00100000:0.0:1787397981.158837:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397981.159315:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248000 00000100:00100000:1.0:1787397981.159320:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248000 00000100:00100000:1.0:1787397981.159347:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397981.159356:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701247872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397981.159378:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787397981.159428:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701247872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397981.159435:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787397981.159460:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787397981.159467:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701248000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397981.159477:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787397981.159549:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701247872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787397981.159794:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701248000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397981.159801:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787397981.160113:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701248000:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787397981.678937:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:3.0:1787397981.678955:0:100452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787397981.685173:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:3.0:1787397981.685193:0:99635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901910 is committed 00010000:00010000:2.0:1787397982.054688:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787397983.077229:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397984.100630:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397984.229024:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787397984.229052:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701248128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397984.229127:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397984.229174:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248128 00000100:00100000:0.0:1787397984.229182:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248128 00000100:00100000:0.0:1787397984.229246:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397984.229256:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701248128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397984.229298:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397984.229342:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701248128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397984.229351:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787397984.229404:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701248128:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787397984.229416:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787397985.127175:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787397985.555902:0:102897:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:0.0:1787397985.765025:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701248384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397985.765105:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397985.765167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701248256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787397985.765195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397985.765238:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248384 00000100:00100000:0.0:1787397985.765246:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248384 00000100:00100000:0.0:1787397985.765294:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248256 00000100:00100000:0.0:1787397985.765298:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248256 00000100:00100000:0.0:1787397985.765321:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787397985.765330:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701248384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397985.765366:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:0.0:1787397985.765422:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701248384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.765430:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787397985.765464:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787397985.765473:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701248256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397985.765491:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:0.0:1787397985.765563:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701248256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.765571:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787397985.765625:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701248384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787397985.765667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701248256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397985.772749:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701248640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.772827:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397985.775072:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701248512:0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.775213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397985.775354:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248512 00000100:00100000:0.0:1787397985.775361:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248512 00000100:00100000:0.0:1787397985.775407:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397985.775430:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701248512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.775647:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701248512:12345-0@lo:400:kworker.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.775656:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787397985.775907:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701248512:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.785640:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248640 00000100:00100000:3.0:1787397985.785656:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248640 00000100:00100000:3.0:1787397985.785717:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787397985.785739:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701248640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.785827:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701248640:12345-0@lo:400:kworker.0 Request processed in 89us (13001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397985.785834:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787397985.786123:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701248640:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.786185:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701248768:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.786217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397985.798853:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701249024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.798936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397985.798965:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701249536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.798996:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701248896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.799016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397985.800533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701249408:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.800580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397985.800631:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249024 00000100:00100000:0.0:1787397985.800641:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249024 00000100:00100000:1.0:1787397985.802176:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248896 00000100:00100000:1.0:1787397985.802185:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248896 00000100:00100000:1.0:1787397985.802218:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:1.0:1787397985.802432:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701249024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.802506:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701249024:12345-0@lo:400:kworker.0 Request processed in 78us (3569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397985.802514:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00080000:3.0:1787397985.802659:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397985.802676:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701249152:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.802707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397985.802724:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701249664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.802746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397985.802764:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787397985.802770:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701249280:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.802787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397985.802795:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701249792:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.802812:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397985.802828:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249408 00000100:00100000:3.0:1787397985.802831:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249408 00000100:00100000:3.0:1787397985.802855:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249152 00000100:00100000:3.0:1787397985.802857:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249152 00000100:00100000:3.0:1787397985.802869:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249280 00000100:00100000:3.0:1787397985.802871:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249280 00000100:00100000:3.0:1787397985.802882:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249792 00000100:00100000:3.0:1787397985.802884:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249792 00000100:00100000:3.0:1787397985.804736:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1787397985.804756:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701248896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.804856:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701248896:12345-0@lo:400:kworker.0 Request processed in 107us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.809383:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:0.0:1787397985.809424:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701249408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.809880:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701249408:12345-0@lo:400:kworker.0 Request processed in 482us (9297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.809889:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:0.0:1787397985.809926:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1787397985.809934:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701249152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.809983:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701249152:12345-0@lo:400:kworker.0 Request processed in 50us (7275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.809989:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1787397985.810006:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1787397985.810013:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701249280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.810045:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701249280:12345-0@lo:400:kworker.0 Request processed in 33us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.810051:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1787397985.810062:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1787397985.810069:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701249792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.810096:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701249792:12345-0@lo:400:kworker.0 Request processed in 27us (7283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397985.810102:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1787397985.810939:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701249280:0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.810961:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701249792:0@lo:400:kworker.0 00000100:00100000:0.0:1787397985.810990:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701249152:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.811827:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397985.811879:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701249024:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.811917:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701248768 00000100:00100000:1.0:1787397985.811924:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701248768 00000100:00100000:1.0:1787397985.811974:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249664 00000100:00100000:1.0:1787397985.811977:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249664 00000100:00100000:1.0:1787397985.811994:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249536 00000100:00100000:1.0:1787397985.811996:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249536 00000100:00100000:1.0:1787397985.812009:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397985.812017:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701248768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.812429:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00080000:3.0:1787397985.812534:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397985.812539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787397985.812541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397985.812544:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397985.814887:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701248768:12345-0@lo:400:kworker.0 Request processed in 2863us (28661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397985.814909:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397985.814940:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397985.814951:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701249664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.814988:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701249664:12345-0@lo:400:kworker.0 Request processed in 41us (12241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397985.814994:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397985.815004:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397985.815011:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701249536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.815043:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701249536:12345-0@lo:400:kworker.0 Request processed in 33us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397985.815061:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787397985.815326:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 2 00000100:00100000:1.0:1787397985.815344:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701249536:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.815370:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701248896:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.815381:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701249408:0@lo:400:kworker.0 00000100:00100000:3.0:1787397985.815602:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701248768:0@lo:400:kworker.0 00000100:00100000:1.0:1787397985.816547:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787397985.816562:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701249664:0@lo:400:kworker.0 00000100:00100000:3.0:1787397986.059594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397986.059636:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397986.059670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397986.059694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397986.059721:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397986.059732:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318912 00000100:00100000:3.0:1787397986.059742:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319040 00000100:00100000:2.0:1787397986.059743:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318912 00000100:00100000:3.0:1787397986.059744:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319040 00000100:00100000:2.0:1787397986.059813:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1670 00000100:00100000:2.0:1787397986.059823:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681318912:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397986.059879:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681318784 00000100:00100000:1.0:1787397986.059884:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681318784 00000100:00100000:2.0:1787397986.059899:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2405:x1874218681318912:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397986.059906:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1670 00000100:00100000:1.0:1787397986.059930:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:1.0:1787397986.059937:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681318784:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397986.059977:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681318784:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397986.059984:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 77 00000100:00100000:1.0:1787397986.060033:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319168 00000100:00100000:1.0:1787397986.060037:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319168 00000100:00100000:2.0:1787397986.060086:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1671 00000100:00100000:2.0:1787397986.060099:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2405:x1874218681319040:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397986.060126:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2405:x1874218681319040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397986.060132:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1671 00000100:00100000:2.0:1787397986.060190:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319296 00000100:00100000:2.0:1787397986.060207:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319296 00000100:00100000:2.0:1787397986.060251:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:2.0:1787397986.060258:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681319296:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397986.060293:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681319296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397986.060300:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00080000:0.0:1787397986.063567:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787397986.063578:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787397986.063583:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787397986.063585:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787397986.064615:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:1.0:1787397986.064632:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681319168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397986.064718:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681319168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 93us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397986.064727:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00010000:00010000:2.0:1787397986.148843:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397986.276876:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701249920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787397986.276970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397986.277039:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397986.277046:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701250048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397986.277075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397986.277116:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701249920 00000100:00100000:1.0:1787397986.277124:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701249920 00000100:00100000:1.0:1787397986.277165:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250048 00000100:00100000:1.0:1787397986.277169:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250048 00000100:00100000:1.0:1787397986.277185:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397986.277193:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701249920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397986.277222:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397986.277265:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701249920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397986.277272:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787397986.277290:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397986.277296:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701250048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397986.277304:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397986.277326:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701250048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397986.277332:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787397986.277369:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701250048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397986.277380:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701249920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397986.277924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397986.277936:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701250176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787397986.277971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397986.278050:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250176 00000100:00100000:0.0:1787397986.278055:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250176 00000100:00100000:0.0:1787397986.278094:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787397986.278102:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701250176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787397986.278120:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397986.278167:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701250176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397986.278174:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787397986.278335:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701250176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787397987.173822:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787397987.920745:0:102946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1787397988.199042:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397989.220752:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397989.350488:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787397989.350513:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701250304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787397989.350620:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397989.350938:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250304 00000100:00100000:0.0:1787397989.350946:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250304 00000100:00080000:3.0:1787397989.351004:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397989.351014:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787397989.351023:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701250304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787397989.351051:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787397989.351098:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701250304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397989.351105:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787397989.351329:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701250304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397989.872731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397989.872842:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319424 00000100:00100000:2.0:1787397989.872854:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319424 00000100:00100000:2.0:1787397989.872939:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1688 00000100:00100000:2.0:1787397989.872949:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77014:x1874218681319424:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787397989.873003:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:2.0:1787397989.873079:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77014:x1874218681319424:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397989.873087:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1688 00000100:00080000:3.0:1787397989.873594:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787397989.876762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397989.876865:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319552 00000100:00100000:0.0:1787397989.876874:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319552 00000100:00100000:0.0:1787397989.876945:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1689 00000100:00100000:0.0:1787397989.876964:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77014:x1874218681319552:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787397989.877019:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445498880 avail 1299259392 00000100:00100000:0.0:1787397989.877097:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77014:x1874218681319552:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 136us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397989.877104:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1689 00000100:00080000:3.0:1787397989.877555:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787397989.882138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397989.882370:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319680 00000100:00100000:2.0:1787397989.882382:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319680 00000100:00100000:2.0:1787397989.882456:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:2.0:1787397989.882466:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77014:x1874218681319680:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397989.882492:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397989.882604:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77014:x1874218681319680:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 140us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397989.882612:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00080000:3.0:1787397989.882837:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397989.885050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397989.885185:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319808 00000100:00100000:2.0:1787397989.885195:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319808 00000100:00100000:2.0:1787397989.885286:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:2.0:1787397989.885295:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77014:x1874218681319808:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787397989.885326:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787397989.885393:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77014:x1874218681319808:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397989.885401:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00080000:3.0:1787397989.885575:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397989.943161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397989.943468:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681319936 00000100:00100000:2.0:1787397989.943478:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681319936 00000100:00100000:2.0:1787397989.943565:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 698 00000100:00100000:2.0:1787397989.943576:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70886:x1874218681319936:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397989.943592:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397989.943617:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193291 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ce expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397989.943636:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787397989.943641:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397989.943698:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70886:x1874218681319936:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 124us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397989.943705:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 698 00000100:00100000:1.0:1787397989.957652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397989.957919:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320064 00000100:00100000:3.0:1787397989.957942:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320064 00000100:00100000:3.0:1787397989.958018:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 699 00000100:00100000:3.0:1787397989.958028:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:70885:x1874218681320064:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397989.958043:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:3.0:1787397989.958070:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82ee30800/0x274786fe0d192df2 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ab expref: 14 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958090:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a81a867e00) 00010000:00010000:3.0:1787397989.958109:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a836583a00/0x274786fe0d192d9e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d868f expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958121:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a817be7700) 00010000:00010000:3.0:1787397989.958132:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a70720a800/0x274786fe0d192d82 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8688 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958141:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70242d600) 00010000:00010000:3.0:1787397989.958150:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d191890 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8252 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958159:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:3.0:1787397989.958167:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345f0c00/0x274786fe0d19136c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81e2 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958175:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff89a82ebb1c00) 00010000:00010000:3.0:1787397989.958196:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62600/0x274786fe0d191843 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8236 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958218:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:3.0:1787397989.958228:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a800031c00/0x274786fe0d191311 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81c6 expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958236:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff89a82ebb1500) 00010000:00010000:3.0:1787397989.958420:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75600/0x274786fe0d19139d lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81f0 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958434:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff89a81ab06b00) 00010000:00010000:3.0:1787397989.958445:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8016a1e00/0x274786fe0d191342 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d81d4 expref: 6 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397989.958457:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff89a82ebb1200) 00010000:00010000:3.0:1787397989.958462:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397989.958744:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:70885:x1874218681320064:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 495us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397989.958755:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 699 00000100:00100000:3.0:1787397990.007783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.007899:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320192 00000100:00100000:2.0:1787397990.007909:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320192 00000100:00100000:2.0:1787397990.007978:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1690 00000100:00100000:2.0:1787397990.007989:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77038:x1874218681320192:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787397990.008009:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.008030:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1932a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86d5 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008109:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008123:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008134:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397990.008183:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787397990.008198:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787397990.008234:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008270:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1932a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008289:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.008298:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787397990.008301:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397990.008305:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23000, rc 0) 00000100:00100000:2.0:1787397990.008378:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77038:x1874218681320192:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 392us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.008386:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1690 00000100:00100000:1.0:1787397990.011472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.011724:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320320 00000100:00100000:2.0:1787397990.011735:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320320 00000100:00100000:2.0:1787397990.011802:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1691 00000100:00100000:2.0:1787397990.011812:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77038:x1874218681320320:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787397990.011832:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.011851:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d1932b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86dc expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011920:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011934:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011957:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011973:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011979:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.011985:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.012101:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66178:1874218701250432:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787397990.012154:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397990.012486:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250432 00000100:00100000:1.0:1787397990.012492:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250432 00000100:00100000:1.0:1787397990.012562:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787397990.012571:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:66178:x1874218701250432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787397990.012677:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397990.015653:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:66178:x1874218701250432:12345-0@lo:1000:mdt00_002.0 Request processed in 3073us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.015669:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787397990.024843:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66178:1874218701250432:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787397990.025036:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025054:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025066:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397990.025112:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025128:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025135:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025141:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025148:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025153:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397990.025157:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025165:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025178:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:3.0:1787397990.025181:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397990.025199:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025206:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1932bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025222:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025234:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025251:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025257:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787397990.025260:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025266:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025275:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70242de00) 00010000:00010000:3.0:1787397990.025278:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397990.025281:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025287:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1932c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025326:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23800/0x274786fe0d1932b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86dc expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025350:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86dc expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.025356:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70526e400) 00010000:00010000:3.0:1787397990.025359:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397990.025367:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab000, rc 0) 00000100:00100000:3.0:1787397990.025431:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77038:x1874218681320320:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 13619us (13968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.025440:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1691 00000100:00100000:1.0:1787397990.044355:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.044555:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320448 00000100:00100000:0.0:1787397990.044575:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320448 00000100:00100000:0.0:1787397990.044644:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1692 00000100:00100000:0.0:1787397990.044654:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77038:x1874218681320448:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787397990.044675:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.044700:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1932d0 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86e3 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.044767:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1932d7 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.044783:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1932d7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.044795:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1932d7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.044841:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1787397990.044845:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787397990.044897:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1932d0 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86e3 expref: 7 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.044916:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1932d7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86e3 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.044956:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:0.0:1787397990.044960:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787397990.044964:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55000, rc 0) 00000100:00100000:0.0:1787397990.045033:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77038:x1874218681320448:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 379us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.045041:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1692 00000100:00100000:1.0:1787397990.054143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.054255:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320576 00000100:00100000:2.0:1787397990.054265:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320576 00000100:00100000:2.0:1787397990.054343:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1693 00000100:00100000:2.0:1787397990.054352:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77038:x1874218681320576:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787397990.054371:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.054391:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d1932de lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86ea expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054456:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054470:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054482:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054497:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054504:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054511:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054642:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054651:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054658:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397990.054744:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1787397990.054749:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787397990.054769:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054781:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054788:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054793:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054800:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054806:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397990.054810:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054817:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054829:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:2.0:1787397990.054832:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397990.054836:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054843:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d1932e5 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054866:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054873:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054878:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054883:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397990.054886:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054892:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054901:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a70242dc00) 00010000:00010000:2.0:1787397990.054903:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397990.054905:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054911:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23c00/0x274786fe0d1932ec lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054942:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d1932de lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ea expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054955:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ea expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.054972:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a70242d400) 00010000:00010000:2.0:1787397990.054975:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397990.054977:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22800, rc 0) 00000100:00100000:0.0:1787397990.058020:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77038:x1874218681320576:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 3657us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.058035:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1693 00000100:00100000:1.0:1787397990.060479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.060635:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320704 00000100:00100000:0.0:1787397990.060645:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320704 00000100:00100000:0.0:1787397990.060700:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1694 00000100:00100000:0.0:1787397990.060710:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77038:x1874218681320704:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787397990.060729:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.060751:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d1932fa lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86f1 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060819:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 3/1,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060833:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 3/1,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060844:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 3/1,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060857:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060875:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060882:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060976:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060986:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.060993:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.061033:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00000004:00200000:0.0:1787397990.061038:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397990.061059:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061072:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 4/1,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061079:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 4/1,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061086:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 3/0,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061093:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 4/0,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061110:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.061115:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 4/0,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061123:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 5/0,0 mode: CR/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061138:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397990.061141:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.061146:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 3/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061152:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193301 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061169:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061176:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 2/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061182:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061187:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.061190:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061196:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 4/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061215:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a806066800) 00010000:00010000:0.0:1787397990.061217:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.061220:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 2/0,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061225:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d193308 lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061325:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d1932fa lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86f1 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061354:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86f1 expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.061363:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:0.0:1787397990.061365:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397990.061368:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54200, rc 0) 00000100:00100000:0.0:1787397990.061431:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77038:x1874218681320704:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 722us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.061440:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1694 00000100:00100000:1.0:1787397990.099475:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.099580:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681320960 00000100:00100000:0.0:1787397990.099590:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681320960 00000100:00100000:0.0:1787397990.099653:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1695 00000100:00100000:0.0:1787397990.099664:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77043:x1874218681320960:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397990.099684:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.099705:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d193316 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86f8 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.099831:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.100098:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d193316 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86f8 expref: 12 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.100114:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:0.0:1787397990.100118:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397990.100123:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d193316 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86f8 expref: 12 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.100138:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54c00, rc 0) 00000100:00100000:0.0:1787397990.100209:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77043:x1874218681320960:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 547us (743us total) trans 124554051585 rc 301/301 00000100:00100000:0.0:1787397990.100217:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1695 00000100:00100000:1.0:1787397990.109833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.109927:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681321088 00000100:00100000:2.0:1787397990.109936:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681321088 00000100:00100000:2.0:1787397990.109992:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 287 00000100:00100000:2.0:1787397990.110001:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77043:x1874218681321088:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:2.0:1787397990.110092:0:80567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00000004:00200000:2.0:1787397990.110096:0:80567:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787397990.110179:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77043:x1874218681321088:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 178us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.110188:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 287 00000100:00100000:1.0:1787397990.122152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.122310:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681321344 00000100:00100000:0.0:1787397990.122320:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681321344 00000100:00100000:0.0:1787397990.122383:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 288 00000100:00100000:0.0:1787397990.122393:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77043:x1874218681321344:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787397990.122644:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77043:x1874218681321344:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 252us (502us total) trans 124554051586 rc 0/0 00000100:00100000:0.0:1787397990.122652:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 288 00000100:00100000:1.0:1787397990.164631:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.164718:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681321600 00000100:00100000:3.0:1787397990.164728:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681321600 00000100:00100000:3.0:1787397990.164792:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1696 00000100:00100000:3.0:1787397990.164803:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77048:x1874218681321600:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397990.164828:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.164849:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193324 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d86ff expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.164975:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d19332b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.164991:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d19332b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.165003:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d19332b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397990.165013:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1787397990.165110:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193324 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ff expref: 15 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.165128:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d19332b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ff expref: 14 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.165137:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:3.0:1787397990.165153:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787397990.165157:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abe00, rc 0) 00000100:00100000:3.0:1787397990.165220:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77048:x1874218681321600:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 418us (600us total) trans 124554051587 rc 0/0 00000100:00100000:3.0:1787397990.165228:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1696 00000100:00100000:1.0:1787397990.178610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.178717:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681321728 00000100:00100000:3.0:1787397990.178728:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681321728 00000100:00100000:3.0:1787397990.178773:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 289 00000100:00100000:3.0:1787397990.178783:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77048:x1874218681321728:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:3.0:1787397990.178872:0:66180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00000004:00200000:3.0:1787397990.178876:0:66180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787397990.178962:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77048:x1874218681321728:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 179us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.178970:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 289 00000100:00100000:1.0:1787397990.206377:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.206492:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681321856 00000100:00100000:0.0:1787397990.206506:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681321856 00000100:00100000:0.0:1787397990.206632:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1697 00000100:00100000:0.0:1787397990.206646:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77049:x1874218681321856:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787397990.206673:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.206719:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d193339 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8706 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206809:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 3/1,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206826:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206841:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206853:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206861:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206868:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206969:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206978:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.206986:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.207031:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1787397990.207035:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397990.207056:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207077:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 4/1,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207084:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 4/1,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207089:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 3/0,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207096:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 4/0,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207102:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.207106:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 4/0,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207114:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 5/0,0 mode: CR/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207127:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397990.207130:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.207135:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 3/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207141:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d193340 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207159:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207165:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 2/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207177:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207182:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.207185:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207191:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 4/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207199:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0xf0209d98 (ffff89a806066800) 00010000:00010000:0.0:1787397990.207201:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.207204:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207210:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193347 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207241:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d193339 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8706 expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207255:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8706 expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.207262:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a806066e00) 00010000:00010000:0.0:1787397990.207264:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787397990.207267:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55600, rc 0) 00000100:00100000:0.0:1787397990.207321:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77049:x1874218681321856:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 679us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.207349:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1697 00000100:00100000:1.0:1787397990.232457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.232591:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681322112 00000100:00100000:2.0:1787397990.232601:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681322112 00000100:00100000:2.0:1787397990.232665:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1698 00000100:00100000:2.0:1787397990.232676:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77050:x1874218681322112:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787397990.232696:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.232720:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193355 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d870d expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397990.232826:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1787397990.232952:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193355 lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d870d expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.232967:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a806066e00) 00010000:00010000:2.0:1787397990.232982:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397990.232988:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193355 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d870d expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.233002:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22c00, rc 0) 00000100:00100000:2.0:1787397990.233064:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77050:x1874218681322112:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 391us (616us total) trans 81604378775 rc 301/301 00000100:00100000:2.0:1787397990.233071:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1698 00000100:00100000:1.0:1787397990.244321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.244481:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681322240 00000100:00100000:2.0:1787397990.244492:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681322240 00000100:00100000:2.0:1787397990.244602:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 290 00000100:00100000:2.0:1787397990.244614:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702040450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77050:x1874218681322240:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:2.0:1787397990.244708:0:80567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1787397990.244713:0:80567:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787397990.244785:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702040450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77050:x1874218681322240:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 174us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.244794:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 290 00010000:00010000:0.0:1787397990.245144:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397990.248022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.251314:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681322496 00000100:00100000:0.0:1787397990.251338:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681322496 00000100:00100000:0.0:1787397990.251473:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 291 00000100:00100000:0.0:1787397990.251494:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77050:x1874218681322496:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787397990.251748:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77050:x1874218681322496:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 266us (3734us total) trans 81604378776 rc 0/0 00000100:00100000:0.0:1787397990.251757:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 291 00000100:00100000:1.0:1787397990.282303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.282402:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681322752 00000100:00100000:3.0:1787397990.282412:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681322752 00000100:00100000:3.0:1787397990.282474:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1699 00000100:00100000:3.0:1787397990.282497:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77051:x1874218681322752:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397990.282559:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.282580:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193363 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8714 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.282693:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d19336a lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.282708:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d19336a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.282738:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d19336a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397990.282751:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1787397990.282855:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193363 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8714 expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.282871:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d19336a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8714 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.282879:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a806066e00) 00010000:00010000:3.0:1787397990.282882:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787397990.282885:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:3.0:1787397990.282936:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77051:x1874218681322752:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 453us (643us total) trans 81604378777 rc 0/0 00000100:00100000:3.0:1787397990.282956:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1699 00000100:00100000:1.0:1787397990.289627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.289783:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681322880 00000100:00100000:3.0:1787397990.289794:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681322880 00000100:00100000:3.0:1787397990.289867:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 292 00000100:00100000:3.0:1787397990.289880:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77051:x1874218681322880:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:3.0:1787397990.290006:0:66180:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1787397990.290011:0:66180:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787397990.290101:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77051:x1874218681322880:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 224us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.290109:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 292 00000100:00100000:1.0:1787397990.311317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.311858:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681323008 00000100:00100000:0.0:1787397990.311870:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681323008 00000100:00100000:0.0:1787397990.311941:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1700 00000100:00100000:0.0:1787397990.311951:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:77052:x1874218681323008:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397990.311974:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.311999:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d193378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d871b expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312068:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312083:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312095:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.312143:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1787397990.312160:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787397990.312186:0:66177:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312214:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d193378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d871b expref: 14 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312239:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d871b expref: 13 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.312248:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:0.0:1787397990.312251:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787397990.312255:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54000, rc 0) 00000100:00100000:0.0:1787397990.312322:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:77052:x1874218681323008:12345-192.168.204.60@tcp:101:rm.0 Request processed in 372us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.312339:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1700 00000100:00100000:1.0:1787397990.329318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.329447:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681323264 00000100:00100000:2.0:1787397990.329457:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681323264 00000100:00100000:2.0:1787397990.329553:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1701 00000100:00100000:2.0:1787397990.329564:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:77052:x1874218681323264:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397990.329585:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.329610:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8722 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397990.329715:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1787397990.329808:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193386 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8722 expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.329836:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70242dc00) 00010000:00010000:2.0:1787397990.329839:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787397990.329845:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8722 expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.329864:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22c00, rc 0) 00000100:00100000:2.0:1787397990.329927:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681323264:12345-192.168.204.60@tcp:101:rm.0 Request processed in 364us (618us total) trans 81604378778 rc 301/301 00000100:00100000:2.0:1787397990.329934:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1701 00000100:00100000:1.0:1787397990.342800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.342917:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681323392 00000100:00100000:0.0:1787397990.342927:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681323392 00000100:00100000:0.0:1787397990.342982:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 293 00000100:00100000:0.0:1787397990.342993:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681323392:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:0.0:1787397990.348484:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681323392:12345-192.168.204.60@tcp:37:rm.0 Request processed in 5480us (5681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.348499:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 293 00000100:00100000:1.0:1787397990.356067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.356152:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681323648 00000100:00100000:2.0:1787397990.356162:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681323648 00000100:00100000:2.0:1787397990.356214:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 294 00000100:00100000:2.0:1787397990.356223:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681323648:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787397990.356463:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681323648:12345-192.168.204.60@tcp:35:rm.0 Request processed in 239us (403us total) trans 81604378779 rc 0/0 00000100:00100000:2.0:1787397990.356471:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 294 00000100:00100000:2.0:1787397990.360776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.363468:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681323904 00000100:00100000:3.0:1787397990.363499:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681323904 00000100:00100000:3.0:1787397990.364557:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1702 00000100:00100000:3.0:1787397990.365072:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681323904:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397990.365098:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.365122:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8729 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.365234:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d19339b lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.365249:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d19339b lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.365261:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d19339b lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397990.365271:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:3.0:1787397990.365382:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8729 expref: 18 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.365405:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d19339b lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8729 expref: 17 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.365413:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:3.0:1787397990.365416:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787397990.365419:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa200, rc 0) 00000100:00100000:3.0:1787397990.365504:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:77052:x1874218681323904:12345-192.168.204.60@tcp:101:rm.0 Request processed in 445us (4735us total) trans 81604378780 rc 0/0 00000100:00100000:3.0:1787397990.365512:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1702 00000100:00100000:1.0:1787397990.371718:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.371790:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324032 00000100:00100000:0.0:1787397990.371802:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324032 00000100:00100000:0.0:1787397990.371864:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1703 00000100:00100000:0.0:1787397990.371875:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:77052:x1874218681324032:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397990.371905:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.371942:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1933a9 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8730 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.372004:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1933b0 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.372017:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1933b0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.372029:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1933b0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.372071:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1787397990.372076:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787397990.372112:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1933a9 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8730 expref: 19 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.372132:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1933b0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8730 expref: 18 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.372141:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397990.372145:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787397990.372148:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54400, rc 0) 00000100:00100000:0.0:1787397990.372723:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:77052:x1874218681324032:12345-192.168.204.60@tcp:101:rm.0 Request processed in 847us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.372733:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1703 00000100:00100000:1.0:1787397990.375639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.375832:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324160 00000100:00100000:2.0:1787397990.375842:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324160 00000100:00100000:2.0:1787397990.375899:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1704 00000100:00100000:2.0:1787397990.375909:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681324160:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787397990.375929:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.375967:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1933b7 lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8737 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.376048:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1933be lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.376063:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1933be lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.376075:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1933be lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787397990.376122:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000088d1:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1787397990.376128:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787397990.376170:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1933b7 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8737 expref: 16 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.376204:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1933be lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8737 expref: 15 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.376215:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a70242dc00) 00010000:00010000:2.0:1787397990.376218:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787397990.376222:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:2.0:1787397990.376292:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681324160:12345-192.168.204.60@tcp:101:rm.0 Request processed in 384us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.376300:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1704 00000100:00100000:3.0:1787397990.380608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.380843:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324416 00000100:00100000:0.0:1787397990.380854:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324416 00000100:00100000:0.0:1787397990.380915:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1705 00000100:00100000:0.0:1787397990.380926:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:77052:x1874218681324416:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787397990.380967:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397990.380988:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1933c5 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d873e expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.381144:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.381243:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1933c5 lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d873e expref: 20 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.381257:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:0.0:1787397990.381260:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787397990.381265:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1933c5 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d873e expref: 20 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.381279:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54c00, rc 0) 00000100:00100000:0.0:1787397990.381351:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:77052:x1874218681324416:12345-192.168.204.60@tcp:101:rm.0 Request processed in 427us (751us total) trans 81604378781 rc 301/301 00000100:00100000:0.0:1787397990.381359:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1705 00000100:00100000:1.0:1787397990.390995:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.391084:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324544 00000100:00100000:0.0:1787397990.391094:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324544 00000100:00100000:0.0:1787397990.391157:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 295 00000100:00100000:0.0:1787397990.391168:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:77052:x1874218681324544:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:2.0:1787397990.399002:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702040850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:77052:x1874218681324544:12345-192.168.204.60@tcp:37:rm.0 Request processed in 7825us (8007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.399017:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 295 00000100:00100000:1.0:1787397990.404309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.404389:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324672 00000100:00100000:3.0:1787397990.404399:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324672 00000100:00100000:3.0:1787397990.404505:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 296 00000100:00100000:3.0:1787397990.404517:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681324672:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787397990.411097:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681324672:12345-192.168.204.60@tcp:37:rm.0 Request processed in 6569us (6857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.411112:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 296 00000100:00100000:1.0:1787397990.417792:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.421190:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681324928 00000100:00100000:2.0:1787397990.421223:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681324928 00000100:00100000:2.0:1787397990.421453:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 297 00000100:00100000:2.0:1787397990.421465:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:77052:x1874218681324928:12345-192.168.204.60@tcp:35:rm.0 00000040:00080000:2.0:1787397990.421770:0:66179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].8, 344 off41784 00000040:00080000:2.0:1787397990.421818:0:66179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].8, 424 off42952 00000004:00080000:2.0:1787397990.421824:0:66179:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7036f0000 with version 21 00000004:00080000:3.0:1787397990.424256:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 21 rpc_version 21 00000020:00100000:3.0:1787397990.424306:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397990.424317:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83b523100 x1874218701250688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397990.424360:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701250688:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397990.424427:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.424472:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787397990.424552:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250688 00000100:00100000:1.0:1787397990.424560:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250688 00000100:00100000:1.0:1787397990.424620:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787397990.424629:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701250688:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397990.424832:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701250688:12345-0@lo:1000:osp_up0-1.0 Request processed in 204us (404us total) trans 124554051588 rc 0/0 00000100:00100000:1.0:1787397990.424840:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787397990.425248:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83b523100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701250688:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397990.425456:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:77052:x1874218681324928:12345-192.168.204.60@tcp:35:rm.0 Request processed in 3992us (7672us total) trans 81604378782 rc 0/0 00000100:00100000:1.0:1787397990.425465:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 297 00000100:00100000:2.0:1787397990.431788:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.431883:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681325184 00000100:00100000:3.0:1787397990.431894:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681325184 00000100:00100000:3.0:1787397990.431966:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1706 00000100:00100000:3.0:1787397990.431977:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:77052:x1874218681325184:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787397990.432001:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.432022:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1933d3 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8745 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.432203:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab200/0x274786fe0d1933da lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.432246:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab200/0x274786fe0d1933da lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.432259:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab200/0x274786fe0d1933da lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397990.432272:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1787397990.432380:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1933d3 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8745 expref: 23 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.432399:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab200/0x274786fe0d1933da lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8745 expref: 22 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.432408:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a70242d400) 00010000:00010000:3.0:1787397990.432411:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787397990.432414:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:3.0:1787397990.432564:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681325184:12345-192.168.204.60@tcp:101:rm.0 Request processed in 588us (784us total) trans 81604378783 rc 0/0 00000100:00100000:3.0:1787397990.432572:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1706 00000100:00100000:1.0:1787397990.448840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.448930:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681325312 00000100:00100000:3.0:1787397990.449005:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681325312 00000100:00100000:3.0:1787397990.449094:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 298 00000100:00100000:3.0:1787397990.449104:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681325312:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:0.0:1787397990.456852:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681325312:12345-192.168.204.60@tcp:37:rm.0 Request processed in 7738us (8010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.456868:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 298 00000100:00100000:2.0:1787397990.460171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397990.460397:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681325568 00000100:00100000:1.0:1787397990.460408:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681325568 00000100:00100000:1.0:1787397990.460512:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 299 00000100:00100000:1.0:1787397990.460549:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:77052:x1874218681325568:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:1.0:1787397990.460769:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:77052:x1874218681325568:12345-192.168.204.60@tcp:35:rm.0 Request processed in 248us (606us total) trans 124554051589 rc 0/0 00000100:00100000:1.0:1787397990.460776:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 299 00000100:00100000:1.0:1787397990.463053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.463167:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681325824 00000100:00100000:2.0:1787397990.463175:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681325824 00000100:00100000:2.0:1787397990.463297:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1707 00000100:00100000:2.0:1787397990.463308:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:77052:x1874218681325824:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397990.463379:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397990.463406:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d19332b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ff expref: 16 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463429:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54200/0x274786fe0d19330f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86f1 expref: 15 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463441:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:2.0:1787397990.463451:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d1933be lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8737 expref: 14 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463459:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a70242dc00) 00010000:00010000:2.0:1787397990.463468:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397990.463493:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 3/0,1 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463600:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463612:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463626:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463634:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463641:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463718:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463727:0:66176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463735:0:66176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 4/0,1 mode: --/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463769:0:66176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.463782:0:66176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.463810:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218701250816:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787397990.463929:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce0780 going to sleep for 11 seconds 00010000:00010000:0.0:1787397990.468417:0:66176:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.60@tcp) returned -22 from blocking AST (req@00000000e5f0a519 x1874218701250816) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468463:0:66176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468487:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a70720aa00/0x274786fe0d19306f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86a4 expref: 13 pid: 102348 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397990.468667:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66176:1874218701250816:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787397990.468691:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:0.0:1787397990.468697:0:66176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468706:0:66176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468714:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 4/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468735:0:66176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468744:0:66176:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.468750:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.469094:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x31:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.469111:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469124:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469131:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469137:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.469141:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469149:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469159:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x31:0x0].0x0 (ffff89a70242d900) 00010000:00010000:0.0:1787397990.469162:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397990.469165:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469171:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d1933f6 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469196:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469203:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469208:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469213:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469225:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.469229:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469315:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 5/0,0 mode: CW/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469337:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a70242d100) 00010000:00010000:0.0:1787397990.469340:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.469343:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 3/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469348:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d1933e8 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397990.469360:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075f8d133 reply state 000000006ca134e8 transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469367:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.469380:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a70242d300) 00010000:00010000:0.0:1787397990.469381:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397990.469383:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397990.469797:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:77052:x1874218681325824:12345-192.168.204.60@tcp:36:rm.0 Request processed in 6487us (6747us total) trans 124554051590 rc 0/0 00000100:00100000:0.0:1787397990.469807:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1707 00000100:00100000:3.0:1787397990.473050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.473163:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681325952 00000100:00100000:0.0:1787397990.473172:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681325952 00000100:00100000:0.0:1787397990.473308:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 300 00000100:00100000:0.0:1787397990.473345:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702042050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681325952:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:1.0:1787397990.490954:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702042050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681325952:12345-192.168.204.60@tcp:37:rm.0 Request processed in 17598us (17900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.490981:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 300 00000100:00100000:2.0:1787397990.504398:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.504580:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681326208 00000100:00100000:3.0:1787397990.504604:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681326208 00000100:00100000:3.0:1787397990.504669:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 301 00000100:00100000:3.0:1787397990.504695:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681326208:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787397990.504915:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681326208:12345-192.168.204.60@tcp:35:rm.0 Request processed in 222us (525us total) trans 81604378784 rc 0/0 00000100:00100000:3.0:1787397990.504923:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 301 00000100:00100000:3.0:1787397990.512886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.513223:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681326464 00000100:00100000:0.0:1787397990.513232:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681326464 00000100:00100000:0.0:1787397990.513292:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1708 00000100:00100000:0.0:1787397990.513302:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681326464:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397990.513384:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787397990.513410:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d19336a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8714 expref: 23 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513433:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19334e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8706 expref: 22 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513446:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a806066e00) 00010000:00010000:0.0:1787397990.513462:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1933b0 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8730 expref: 21 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513470:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397990.513476:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397990.513499:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513512:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513569:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513594:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513616:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513623:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513706:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513715:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513722:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787397990.513942:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x8:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.513957:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513964:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513971:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513978:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.513983:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.513991:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514019:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x8:0x0].0x0 (ffff89a806066400) 00010000:00010000:0.0:1787397990.514022:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397990.514036:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514043:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d19340b lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514073:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514080:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514086:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514092:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514098:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.514101:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514107:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 5/0,0 mode: CW/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514116:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a806066800) 00010000:00010000:0.0:1787397990.514118:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.514121:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 3/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514140:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1933fd lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397990.514154:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f040240 reply state 00000000069cf252 transno 81604378785 ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514165:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.514171:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0xf0209d98 (ffff89a806066900) 00010000:00010000:0.0:1787397990.514174:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397990.514176:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397990.514254:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681326464:12345-192.168.204.60@tcp:36:rm.0 Request processed in 951us (1377us total) trans 81604378785 rc 0/0 00000100:00100000:0.0:1787397990.514262:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1708 00000100:00100000:0.0:1787397990.521700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397990.521851:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681326720 00000100:00100000:1.0:1787397990.521862:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681326720 00000100:00100000:1.0:1787397990.521925:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 302 00000100:00100000:1.0:1787397990.521935:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681326720:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:1.0:1787397990.522461:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681326720:12345-192.168.204.60@tcp:35:rm.0 Request processed in 526us (768us total) trans 81604378786 rc 0/0 00000100:00100000:1.0:1787397990.522472:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 302 00000100:00100000:0.0:1787397990.529048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.532748:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681326976 00000100:00100000:3.0:1787397990.532767:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681326976 00000100:00100000:2.0:1787397990.532970:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1709 00000100:00100000:2.0:1787397990.532981:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681326976:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787397990.533049:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787397990.533089:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab200/0x274786fe0d1933da lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8745 expref: 23 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533114:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d1932f3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86ea expref: 22 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533126:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a70242d400) 00010000:00010000:2.0:1787397990.533142:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d19337f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d871b expref: 21 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533152:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:2.0:1787397990.533155:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397990.533176:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533188:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533196:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533224:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533231:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533236:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533305:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533312:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533318:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533348:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,1 mode: --/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533354:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533360:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533393:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533400:0:66178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.533419:0:66178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.533442:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701250944:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787397990.533505:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397990.533568:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397990.534648:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701250944 00000100:00100000:1.0:1787397990.534659:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701250944 00000100:00100000:1.0:1787397990.534714:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787397990.534723:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:66178:x1874218701250944:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787397990.534746:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397990.534767:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d193435 lrc: 2/0,0 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d19342e expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.534791:0:66188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d193435 lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19342e expref: 9 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.534810:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d193435 lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19342e expref: 9 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.534818:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a705b0d900) 00010000:00010000:1.0:1787397990.534821:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787397990.534825:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00000100:00100000:1.0:1787397990.534892:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66178:x1874218701250944:12345-0@lo:101:mdt00_002.0 Request processed in 171us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.534910:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787397990.535139:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701250944:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787397990.535158:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.535168:0:66178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.535915:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701251072:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1787397990.536362:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397990.536448:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787397990.536497:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251072 00000100:00100000:1.0:1787397990.536506:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251072 00000100:00100000:1.0:1787397990.536771:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787397990.536781:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66178:x1874218701251072:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1787397990.539411:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66178:x1874218701251072:12345-0@lo:403:mdt00_002.0 Request processed in 2622us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.539425:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787397990.539567:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701251072:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1787397990.540850:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].9, 936 off42720 00000040:00080000:0.0:1787397990.541352:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].9, 1016 off43968 00000004:00080000:0.0:1787397990.541360:0:66178:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7025e8c00 with version 22 00000004:00080000:3.0:1787397990.541484:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 22 rpc_version 22 00000020:00100000:3.0:1787397990.541554:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397990.541566:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a702619f80 x1874218701251328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397990.541591:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701251328:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397990.541651:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.541687:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8062649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397990.541839:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251328 00000100:00100000:0.0:1787397990.541846:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251328 00000100:00100000:0.0:1787397990.541894:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787397990.541903:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701251328:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397990.542271:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:75622:x1874218701251328:12345-0@lo:1000:osp_up0-1.0 Request processed in 368us (618us total) trans 124554051591 rc 0/0 00000100:00100000:0.0:1787397990.542293:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787397990.542449:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701251328:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787397990.542506:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.542553:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542564:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 2/0,0 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542572:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542578:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.542582:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542590:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 4/0,0 mode: EX/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542606:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0x0 (ffff89a70242df00) 00010000:00010000:0.0:1787397990.542609:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397990.542614:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 2/0,0 mode: --/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542620:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22200/0x274786fe0d193427 lrc: 0/0,0 mode: --/EX res: [0x2400090a0:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542640:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542649:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542667:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542697:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787397990.542705:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000088d1:0x4:0x0] 00010000:00010000:0.0:1787397990.542713:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542719:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542725:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542729:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.542733:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542738:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542746:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x7:0x0].0x0 (ffff89a70242d200) 00010000:00010000:0.0:1787397990.542748:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787397990.542751:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542756:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d193420 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542774:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542786:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542791:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542796:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542801:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.542804:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542809:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542817:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:0.0:1787397990.542820:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.542822:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542828:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d193412 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397990.542838:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f520d1b reply state 00000000cdb8e085 transno 81604378787 ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542849:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.542856:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a70242dc00) 00010000:00010000:0.0:1787397990.542863:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787397990.542866:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787397990.542926:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681326976:12345-192.168.204.60@tcp:36:rm.0 Request processed in 9946us (13887us total) trans 81604378787 rc 0/0 00010000:00010000:3.0:1787397990.543584:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787397990.543591:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 2/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543599:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:3.0:1787397990.543605:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397990.543612:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543644:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 2/0,0 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543657:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787397990.543684:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 1/0,0 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543691:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d23400/0x274786fe0d19342e lrc: 0/0,0 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193435 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543706:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397990.543708:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397990.543710:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397990.543718:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397990.543732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701251456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397990.543773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.543818:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251456 00000100:00100000:3.0:1787397990.543825:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251456 00000100:00100000:3.0:1787397990.543867:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1787397990.543875:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3649:x1874218701251456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787397990.543886:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397990.543902:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63000/0x274786fe0d193435 lrc: 0/0,0 mode: --/EX res: [0x2000088d1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19342e expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.543914:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0x0 (ffff89a705b0d900) 00010000:00010000:3.0:1787397990.543920:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397990.543966:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701251456:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.543973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1787397990.544013:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701251456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787397990.544197:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1709 00000100:00100000:3.0:1787397990.551569:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.552798:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397990.552883:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681327104 00000100:00100000:3.0:1787397990.552893:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681327104 00000100:00100000:3.0:1787397990.552969:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 701 00000100:00100000:3.0:1787397990.552979:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:2404:x1874218681327104:12345-192.168.204.60@tcp:103:rm.0 00010000:00010000:3.0:1787397990.552995:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787397990.553020:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d1932c9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86dc expref: 14 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.553038:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70526e400) 00010000:00010000:3.0:1787397990.553052:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397990.553120:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681327104:12345-192.168.204.60@tcp:103:rm.0 Request processed in 142us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.553128:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 701 00000100:00100000:2.0:1787397990.553434:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681327360 00000100:00100000:2.0:1787397990.553439:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681327360 00000100:00100000:2.0:1787397990.553472:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 303 00000100:00100000:2.0:1787397990.553480:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681327360:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787397990.553692:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681327360:12345-192.168.204.60@tcp:35:rm.0 Request processed in 212us (2176us total) trans 81604378788 rc 0/0 00000100:00100000:2.0:1787397990.553699:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 303 00000100:00100000:2.0:1787397990.578688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397990.579205:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681327616 00000100:00100000:0.0:1787397990.579216:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681327616 00000100:00100000:0.0:1787397990.579283:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1710 00000100:00100000:0.0:1787397990.579293:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:77052:x1874218681327616:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787397990.579380:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787397990.579406:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d19339b lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8729 expref: 23 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.579430:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1932d7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86e3 expref: 22 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.579443:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066500) 00010000:00010000:0.0:1787397990.579455:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787397990.579502:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.579511:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.579548:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397990.579572:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701251584:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787397990.579639:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.579676:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397990.579940:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251584 00000100:00100000:3.0:1787397990.579945:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251584 00000100:00100000:3.0:1787397990.579980:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787397990.579987:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:77740:x1874218701251584:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787397990.580002:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.580018:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d19343c expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.580042:0:66188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.580051:0:66188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.580106:0:66188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 12 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.580120:0:66188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 12 pid: 67264 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397990.580133:0:66188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701251712:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397990.580202:0:66188:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8062649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397990.586183:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397990.586251:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681327744 00000100:00100000:2.0:1787397990.586262:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681327744 00010000:00010000:2.0:1787397990.586317:0:19654:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 13 pid: 67264 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.586381:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2663 00000100:00100000:2.0:1787397990.586392:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681327744:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397990.586408:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397990.586415:0:19654:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 13 pid: 67264 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586429:0:19654:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 13 pid: 67264 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586453:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787397990.586461:0:19654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586472:0:19654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586481:0:19654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586516:0:19654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397990.586561:0:19654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701251840:0@lo:105: 00000100:00100000:2.0:1787397990.586608:0:19654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397990.586650:0:19654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397990.586668:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251840 00000100:00100000:2.0:1787397990.586672:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251840 00000100:00100000:2.0:1787397990.586702:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1787397990.586709:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701251840:12345-0@lo:105: 00010000:00010000:2.0:1787397990.586720:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586729:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586738:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586745:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586752:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586761:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.586776:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a82eb54e00) 00000100:00100000:2.0:1787397990.586813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19654:x1874218701251840:12345-0@lo:105: Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.586820:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1787397990.586863:0:19654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19654:1874218701251840:0@lo:105: 00010000:00010000:2.0:1787397990.586888:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397990.586925:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2404:x1874218681327744:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 535us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.586932:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2663 00010000:00010000:3.0:1787397990.587300:0:66188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d1932ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86d5 expref: 12 pid: 67264 timeout: 3969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397990.587316:0:66188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701251712:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787397990.587347:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.587355:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:3.0:1787397990.587358:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787397990.587360:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab000, rc 0) 00000100:00100000:3.0:1787397990.587422:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:77740:x1874218701251584:12345-0@lo:101:mdt00_005.0 Request processed in 7435us (7782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.587429:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787397990.587567:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701251584:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787397990.587583:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787397990.587603:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787397990.587637:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.587645:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.587654:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397990.587668:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701251968:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787397990.587696:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.587718:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397990.588387:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701251968 00000100:00100000:2.0:1787397990.588395:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701251968 00000100:00100000:2.0:1787397990.588442:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787397990.588451:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:77740:x1874218701251968:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787397990.588468:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397990.588486:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d193451 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d19344a expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.588510:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d193451 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19344a expref: 11 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.588548:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d193451 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19344a expref: 11 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397990.588557:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70242d400) 00010000:00010000:2.0:1787397990.588560:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397990.588563:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23200, rc 0) 00000100:00100000:2.0:1787397990.588606:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701251968:12345-0@lo:101:mdt00_005.0 Request processed in 156us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397990.588612:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787397990.588750:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701251968:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787397990.588763:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.588773:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787397990.588792:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787397990.588832:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252096:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397990.588876:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.588903:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787397990.588971:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252096 00000100:00100000:3.0:1787397990.588976:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252096 00000100:00100000:3.0:1787397990.588998:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787397990.589005:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701252096:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397990.589097:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701252096:12345-0@lo:1000:mdt00_005.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.589104:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787397990.589175:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252096:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397990.589215:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252224:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787397990.589238:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.589261:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397990.589609:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252224 00000100:00100000:3.0:1787397990.589614:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252224 00000100:00100000:3.0:1787397990.589635:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787397990.589640:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701252224:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787397990.589722:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701252224:12345-0@lo:1000:mdt00_005.0 Request processed in 81us (483us total) trans 0 rc 1/1 00000100:00100000:3.0:1787397990.589729:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787397990.589797:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252224:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1787397990.589847:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.589855:0:77740:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.589864:0:77740:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397990.589876:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252352:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787397990.589900:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.589922:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787397990.590013:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252352 00000100:00100000:3.0:1787397990.590017:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252352 00000100:00100000:3.0:1787397990.590034:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787397990.590039:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:77740:x1874218701252352:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787397990.590047:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397990.590074:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19345f lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193458 expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.590093:0:66188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19345f lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193458 expref: 12 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.590104:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19345f lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193458 expref: 12 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397990.590112:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70526e400) 00010000:00010000:3.0:1787397990.590115:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787397990.590118:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00000100:00100000:3.0:1787397990.590174:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:77740:x1874218701252352:12345-0@lo:101:mdt00_005.0 Request processed in 133us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.590180:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787397990.590352:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829848a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701252352:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787397990.590363:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.590385:0:77740:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.590409:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.590428:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.590436:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787397990.590777:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].10, 432 off43152 00000040:00080000:0.0:1787397990.590821:0:77740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].10, 512 off44480 00000004:00080000:0.0:1787397990.590827:0:77740:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7025e8a80 with version 23 00000004:00080000:3.0:1787397990.591096:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 23 rpc_version 23 00000020:00100000:3.0:1787397990.591122:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787397990.591131:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a702618e00 x1874218701252608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787397990.591149:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701252608:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787397990.591218:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.591245:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8062649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787397990.591559:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252608 00000100:00100000:0.0:1787397990.591565:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252608 00000100:00100000:0.0:1787397990.591602:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787397990.591610:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:75622:x1874218701252608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787397990.591929:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:75622:x1874218701252608:12345-0@lo:1000:osp_up0-1.0 Request processed in 319us (710us total) trans 124554051592 rc 0/0 00000100:00100000:0.0:1787397990.592255:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787397990.592517:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701252608:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787397990.592768:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1787397990.592790:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592800:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592807:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592814:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397990.592818:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592840:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592855:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a806066700) 00010000:00010000:0.0:1787397990.592858:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397990.592863:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592869:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d193466 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592890:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592899:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592905:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592927:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787397990.592948:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787397990.592954:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592961:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592967:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.592997:0:77740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1787397990.593002:0:77740:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787397990.593008:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397990.593016:0:77740:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593136:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787397990.593142:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593149:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397990.593163:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397990.593172:0:6511:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593201:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593207:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397990.593227:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 1/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593244:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb55600/0x274786fe0d193458 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d19345f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593258:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397990.593262:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397990.593272:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397990.593279:0:6511:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593296:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593302:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397990.593316:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593336:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54e00/0x274786fe0d19343c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193443 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593347:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397990.593349:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397990.593350:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787397990.593358:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787397990.593388:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701252736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397990.593433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397990.593463:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787397990.593471:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701252864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397990.593493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397990.593542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252736 00000100:00100000:1.0:1787397990.593548:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252736 00000100:00100000:1.0:1787397990.593588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252864 00000100:00100000:1.0:1787397990.593591:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252864 00000100:00100000:1.0:1787397990.593612:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1787397990.593619:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834539c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3648:x1874218701252736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397990.593630:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397990.593645:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d19345f lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193458 expref: 14 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593657:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0x0 (ffff89a70526e400) 00010000:00010000:1.0:1787397990.593667:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397990.593696:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834539c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3648:x1874218701252736:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.593702:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1787397990.593742:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1787397990.593748:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3651:x1874218701252864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397990.593755:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397990.593765:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193443 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19343c expref: 12 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397990.593774:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397990.593777:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397990.593807:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3651:x1874218701252864:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.593813:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1787397990.593850:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701252864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787397990.593875:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701252736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787397990.594130:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397990.594263:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:77052:x1874218681327616:12345-192.168.204.60@tcp:36:rm.0 Request processed in 14969us (15582us total) trans 81604378789 rc 0/0 00000100:00100000:0.0:1787397990.594270:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1710 00000100:00100000:2.0:1787397990.884943:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701252992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.885024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.885252:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701252992 00000100:00100000:0.0:1787397990.885261:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701252992 00000100:00100000:0.0:1787397990.885323:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397990.885334:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.885475:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787397990.885487:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701253120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787397990.885556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.885948:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701253248:0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.885979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397990.886016:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253248 00000100:00100000:3.0:1787397990.886021:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253248 00000100:00100000:3.0:1787397990.886055:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397990.886062:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701253248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.886103:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701253248:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.886110:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787397990.886158:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701253248:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.886270:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701253504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397990.886300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.886379:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701252992:12345-0@lo:400:kworker.0 Request processed in 1046us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.886397:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787397990.886436:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253120 00000100:00100000:0.0:1787397990.886440:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253120 00000100:00100000:0.0:1787397990.886460:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253504 00000100:00100000:0.0:1787397990.886463:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253504 00000100:00100000:0.0:1787397990.886477:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787397990.886482:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3649:x1874218701253120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397990.886537:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:0.0:1787397990.886589:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3649:x1874218701253120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.886608:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787397990.886622:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787397990.886628:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701253504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397990.886645:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:0.0:1787397990.886675:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701253504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.886681:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787397990.886710:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701253376:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.886737:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.886767:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253376 00000100:00100000:0.0:1787397990.886770:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253376 00000100:00100000:0.0:1787397990.886802:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397990.886808:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701253376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.886844:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701253376:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.886864:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787397990.886880:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397990.886901:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701253376:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.886960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701253120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397990.887438:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701253888:0@lo:400:kworker.0 00000100:00100000:1.0:1787397990.887476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397990.887495:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701254400:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.889612:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701253632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.889695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.889738:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701254144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.889761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.889787:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787397990.889809:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701253760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.889834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.889866:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701254272:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.889897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397990.889944:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253888 00000100:00100000:0.0:1787397990.889952:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253888 00000100:00100000:0.0:1787397990.890006:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253632 00000100:00100000:0.0:1787397990.890010:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253632 00000100:00100000:0.0:1787397990.890030:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254144 00000100:00100000:0.0:1787397990.890033:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254144 00000100:00100000:0.0:1787397990.890051:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701253760 00000100:00100000:0.0:1787397990.890054:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701253760 00000100:00100000:0.0:1787397990.890070:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1787397990.890079:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701253888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890135:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701253888:12345-0@lo:400:kworker.0 Request processed in 57us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.890142:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1787397990.890160:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1787397990.890167:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890198:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701253632:12345-0@lo:400:kworker.0 Request processed in 32us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.890205:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1787397990.890216:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1787397990.890221:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701254144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890250:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701254144:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.890256:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1787397990.890275:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1787397990.890281:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701253760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890309:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701253760:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.890330:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00080000:0.0:1787397990.890350:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787397990.890354:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787397990.890398:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701253760:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890413:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701253632:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701254144:0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890511:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254272 00000100:00100000:0.0:1787397990.890516:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254272 00000100:00100000:0.0:1787397990.890580:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787397990.890586:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701254272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397990.890620:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701254272:12345-0@lo:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397990.890626:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787397990.890639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787397990.890653:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701254272:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.891173:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701252992:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.891200:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701254016:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.891242:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397990.891263:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701254528:0@lo:400:kworker.0 00000100:00100000:2.0:1787397990.891287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397990.891349:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701253504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787397990.891443:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254016 00000100:00100000:3.0:1787397990.891449:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254016 00000100:00100000:1.0:1787397990.891516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397990.891573:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701253888:0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.891651:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254528 00000100:00100000:3.0:1787397990.891655:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254528 00000100:00100000:3.0:1787397990.891693:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:3.0:1787397990.891702:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701254016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.891752:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701254016:12345-0@lo:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.891759:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:3.0:1787397990.891778:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1787397990.891785:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701254528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.891816:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701254528:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397990.891822:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1787397990.891869:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701254016:0@lo:400:kworker.0 00000100:00100000:3.0:1787397990.891880:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701254528:0@lo:400:kworker.0 00000100:00100000:1.0:1787397990.891952:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254400 00000100:00100000:1.0:1787397990.891956:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254400 00000100:00080000:2.0:1787397990.891966:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397990.891972:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787397990.891995:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787397990.892002:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701254400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787397990.892041:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701254400:12345-0@lo:400:kworker.0 Request processed in 39us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397990.892048:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787397990.892077:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701254400:0@lo:400:kworker.0 00000100:00100000:2.0:1787397991.194743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397991.194873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397991.194915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397991.194955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397991.195017:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328256 00000100:00100000:1.0:1787397991.195028:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328256 00000100:00100000:1.0:1787397991.195115:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:1.0:1787397991.195127:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681328256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787397991.195195:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681328256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397991.195221:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:3.0:1787397991.197419:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681327872 00000100:00100000:3.0:1787397991.197445:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681327872 00000100:00100000:3.0:1787397991.197558:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787397991.197569:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681327872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397991.197654:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681327872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 87us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397991.197662:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00080000:3.0:1787397991.197847:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397991.203583:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397991.203632:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328384 00000100:00100000:2.0:1787397991.203642:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328384 00000100:00100000:2.0:1787397991.203711:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00100000:2.0:1787397991.203722:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681328384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397991.203826:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681328384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 105us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397991.203835:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 63 00000100:00080000:2.0:1787397991.203862:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787397991.208073:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328000 00000100:00100000:0.0:1787397991.208093:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328000 00000100:00100000:0.0:1787397991.208230:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328128 00000100:00100000:0.0:1787397991.208233:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328128 00000100:00100000:0.0:1787397991.208277:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1678 00000100:00100000:0.0:1787397991.208289:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2402:x1874218681328000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397991.208410:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2402:x1874218681328000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 122us (13676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397991.208436:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1678 00000100:00100000:0.0:1787397991.208461:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1679 00000100:00100000:0.0:1787397991.208467:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2402:x1874218681328128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787397991.208496:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:2402:x1874218681328128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (13541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397991.208502:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1679 00000100:00080000:2.0:1787397991.211054:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397991.211067:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787397991.268713:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787397991.396847:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701254784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397991.396885:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701254912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787397991.396921:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397991.396993:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701254656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397991.398951:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254784 00000100:00100000:1.0:1787397991.398966:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254784 00000100:00100000:1.0:1787397991.399033:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787397991.399044:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701254784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787397991.399090:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397991.400321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397991.400430:0:99643:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787397991.400442:0:99643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787397991.400577:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254912 00000100:00100000:2.0:1787397991.400584:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254912 00000100:00100000:3.0:1787397991.403364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397991.403449:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701254656 00000100:00100000:3.0:1787397991.403458:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701254656 00000100:00100000:3.0:1787397991.403512:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397991.403536:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701254912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787397991.403566:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787397991.403621:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701254912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397991.403630:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787397991.403651:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787397991.403657:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701254656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787397991.403666:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787397991.403696:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701254656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397991.403704:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787397991.403754:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701254912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397991.403790:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701254656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787397991.413802:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701254784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14749us (16872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397991.413818:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787397991.414091:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701254784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787397992.293327:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397993.317140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397994.341755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397994.473258:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787397994.473292:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701255040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787397994.473392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397994.473642:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255040 00000100:00100000:3.0:1787397994.473652:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255040 00000100:00100000:3.0:1787397994.473719:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787397994.473731:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701255040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787397994.473771:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787397994.473824:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701255040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397994.473854:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787397994.473918:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701255040:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787397994.475684:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787397995.364858:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397995.500501:0:75615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787397995.500545:0:75615:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397995.500605:0:75615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397995.500614:0:75615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787397995.500718:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500730:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500737:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500744:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397995.500749:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500756:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500771:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x4:0x0].0xf0209d98 (ffff89a806066900) 00010000:00010000:2.0:1787397995.500774:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397995.500779:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500786:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54600/0x274786fe0d193404 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x4:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500826:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500849:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500857:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500863:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397995.500866:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500873:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500882:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x6:0x0].0xd1d4b922 (ffff89a70242dc00) 00010000:00010000:2.0:1787397995.500885:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397995.500888:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.500893:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d193419 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397995.500947:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787397995.501040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397995.501133:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255168 00000100:00100000:2.0:1787397995.501144:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255168 00000100:00100000:2.0:1787397995.501206:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1787397995.501217:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+11:3648:x1874218701255168:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787397995.501245:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397995.501266:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d193451 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19344a expref: 11 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397995.501285:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff89a70242d400) 00010000:00010000:2.0:1787397995.501294:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397995.501337:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701255168:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397995.501346:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1787397995.501397:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255168:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:1.0:1787397995.511812:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051592 is committed 00000001:00080000:1.0:1787397995.511911:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051590 is committed 00010000:00010000:0.0:1787397995.515062:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515157:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 2/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515168:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515175:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397995.515181:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515191:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 4/0,0 mode: TXN/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515216:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x4:0x0].0xcd52553e (ffff89a70242d300) 00010000:00010000:0.0:1787397995.515395:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397995.515401:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 2/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397995.515409:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d1933ef lrc: 0/0,0 mode: --/TXN res: [0x2000088d1:0x4:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397995.516003:0:75615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a82eb54400/0x274786fe0d19344a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193451 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787397995.516028:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378789 is committed 00000100:00100000:2.0:1787397996.004877:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701255296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787397996.004988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.005143:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255296 00000100:00100000:0.0:1787397996.005154:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255296 00000100:00100000:0.0:1787397996.005663:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787397996.005678:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701255296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787397996.005726:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445519360 avail 1299279872 00000100:00100000:0.0:1787397996.005795:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701255296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.005803:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787397996.006452:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701255296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787397996.006859:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701255424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787397996.006935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.007353:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255424 00000100:00100000:0.0:1787397996.007362:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255424 00000100:00100000:0.0:1787397996.007437:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787397996.007448:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701255424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787397996.007490:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1787397996.007577:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701255424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.007585:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787397996.007629:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051592 gen 3 00000004:00080000:0.0:1787397996.007636:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051588 committed transno 124554051592 00000020:00080000:0.0:1787397996.007806:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a7036f0600 refcount 2 committed 0 result 0 batchid 77309411392 00000020:00080000:0.0:1787397996.007812:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82df3d200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a7036f0000 00000020:00080000:0.0:1787397996.007817:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].8 00000020:00080000:0.0:1787397996.007847:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82df3d900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a83650fc00 00000020:00080000:0.0:1787397996.007851:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].8 00000004:00080000:0.0:1787397996.007884:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051591 committed transno 124554051592 00000020:00080000:0.0:1787397996.007889:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a7025e8e40 refcount 2 committed 0 result 0 batchid 77309411393 00000020:00080000:0.0:1787397996.007892:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82e4bbc00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a7025e8c00 00000020:00080000:0.0:1787397996.007895:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].9 00000020:00080000:0.0:1787397996.007897:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82e4bb600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a836509600 00000020:00080000:0.0:1787397996.007900:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].9 00000004:00080000:0.0:1787397996.007913:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051592 committed transno 124554051592 00000020:00080000:0.0:1787397996.007916:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a7025e8780 refcount 2 committed 0 result 0 batchid 77309411394 00000020:00080000:0.0:1787397996.007919:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82e4bb000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a7025e8a80 00000020:00080000:0.0:1787397996.007922:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].10 00000020:00080000:0.0:1787397996.007924:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82e4bb700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a836508800 00000020:00080000:0.0:1787397996.007927:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].10 00000100:00100000:0.0:1787397996.007947:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701255424:0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787397996.007968:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411394 committed batchid 77309411391 00000020:00080000:0.0:1787397996.008059:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411391 00000100:00100000:2.0:1787397996.009190:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255680:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.009252:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701255552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.009312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009329:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701256192:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.009360:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701256064:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701256704:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009578:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787397996.009586:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009633:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701256320:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009671:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701256832:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.009741:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255680 00000100:00100000:2.0:1787397996.009750:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255680 00000100:00100000:2.0:1787397996.009814:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256704 00000100:00100000:2.0:1787397996.009817:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256704 00000100:00100000:2.0:1787397996.009836:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255808 00000100:00100000:2.0:1787397996.009838:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255808 00000100:00100000:2.0:1787397996.009858:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787397996.009866:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701255680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009929:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701255680:12345-0@lo:400:kworker.0 Request processed in 63us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.009937:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787397996.009957:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397996.009964:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701256704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.009994:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701256704:12345-0@lo:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.010001:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397996.010012:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787397996.010018:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701255808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.010046:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701255808:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.010052:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787397996.010074:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256192 00000100:00100000:2.0:1787397996.010077:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256192 00000100:00100000:2.0:1787397996.010107:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256320 00000100:00100000:2.0:1787397996.010110:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256320 00000100:00100000:2.0:1787397996.010128:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256832 00000100:00100000:2.0:1787397996.010131:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256832 00000100:00100000:2.0:1787397996.010149:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1787397996.010155:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701256192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.013717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.013776:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701256576:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.014156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.014222:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787397996.014232:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701255936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.014279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.014295:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701256448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.014319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787397996.014371:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255552 00000100:00100000:0.0:1787397996.014382:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255552 00000100:00100000:0.0:1787397996.014462:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787397996.014473:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701255552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.014571:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701255552:12345-0@lo:400:kworker.0 Request processed in 99us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.014580:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787397996.014623:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256064 00000100:00100000:0.0:1787397996.014627:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256064 00000100:00100000:0.0:1787397996.016108:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701255936 00000100:00100000:0.0:1787397996.016120:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701255936 00000100:00100000:0.0:1787397996.016137:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256448 00000100:00100000:0.0:1787397996.016140:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256448 00000100:00100000:0.0:1787397996.016163:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1787397996.016173:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701256320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016273:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701256320:12345-0@lo:400:kworker.0 Request processed in 100us (6617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016281:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1787397996.016300:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787397996.016307:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701256832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016339:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701256832:12345-0@lo:400:kworker.0 Request processed in 33us (6647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016346:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787397996.016358:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1787397996.016382:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701256064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016436:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701256064:12345-0@lo:400:kworker.0 Request processed in 55us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016443:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1787397996.016457:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:0.0:1787397996.016463:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701255936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016490:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701255936:12345-0@lo:400:kworker.0 Request processed in 27us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016506:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:0.0:1787397996.016541:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:0.0:1787397996.016548:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701256448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016579:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701256448:12345-0@lo:400:kworker.0 Request processed in 33us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016584:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:0.0:1787397996.016634:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256576 00000100:00100000:0.0:1787397996.016651:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256576 00000100:00100000:0.0:1787397996.016681:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787397996.016689:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701256576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016726:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701256576:12345-0@lo:400:kworker.0 Request processed in 38us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397996.016732:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787397996.016794:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701255936:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016809:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701256448:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.016823:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701255552:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018393:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701256192:12345-0@lo:400:kworker.0 Request processed in 8229us (9017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.018413:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00080000:2.0:1787397996.018494:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787397996.018501:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787397996.018505:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787397996.018508:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787397996.018592:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255808:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018611:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701256320:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018628:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701256832:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018643:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701255680:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018655:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701256192:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.018669:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701256704:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.021491:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701256064:0@lo:400:kworker.0 00000100:00100000:0.0:1787397996.021510:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701256576:0@lo:400:kworker.0 00000100:00100000:2.0:1787397996.299994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397996.300050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397996.300081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397996.300112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397996.300144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397996.300165:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328512 00000100:00100000:2.0:1787397996.300170:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329024 00000100:00100000:2.0:1787397996.300179:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329024 00000100:00100000:3.0:1787397996.300194:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328512 00000100:00100000:2.0:1787397996.300259:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328896 00000100:00100000:2.0:1787397996.300263:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328896 00000100:00100000:3.0:1787397996.300265:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:3.0:1787397996.300276:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681328512:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397996.300287:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:2.0:1787397996.300294:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681329024:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397996.300366:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681328512:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 92us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397996.300375:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:1.0:1787397996.300606:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328768 00000100:00100000:1.0:1787397996.300611:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328768 00000100:00100000:1.0:1787397996.300648:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681328640 00000100:00100000:1.0:1787397996.300652:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681328640 00000100:00100000:1.0:1787397996.300679:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1686 00000100:00100000:1.0:1787397996.300686:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681328768:12345-192.168.204.60@tcp:400:kworker.0 00000100:00080000:3.0:1787397996.303017:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787397996.303029:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787397996.303033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787397996.303036:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787397996.303087:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787397996.303105:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681328896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787397996.303179:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681328896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 81us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.303304:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681329024:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2326us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.303326:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:2.0:1787397996.303381:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1687 00000100:00100000:2.0:1787397996.303394:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681328640:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787397996.303452:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681328640:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 62us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.303459:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1687 00000100:00100000:1.0:1787397996.303517:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681328768:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2829us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397996.303540:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1686 00000100:00100000:3.0:1787397996.304203:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00010000:00010000:3.0:1787397996.393218:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397996.516785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787397996.516819:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701256960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787397996.516919:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397996.517121:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701256960 00000100:00100000:1.0:1787397996.517130:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701256960 00000100:00100000:1.0:1787397996.517194:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787397996.517229:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701256960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787397996.517271:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397996.517323:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701256960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397996.517331:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787397996.517501:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787397996.517515:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701257088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787397996.517582:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397996.517661:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257088 00000100:00100000:1.0:1787397996.517666:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257088 00000100:00100000:1.0:1787397996.517697:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787397996.517705:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701257088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787397996.517717:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787397996.517749:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701257088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397996.517755:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787397996.517839:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701257088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787397996.518146:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701256960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787397996.526810:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787397996.526846:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701257216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787397996.526938:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397996.527167:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257216 00000100:00100000:2.0:1787397996.527179:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257216 00000100:00100000:2.0:1787397996.527264:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397996.527274:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701257216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787397996.527312:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787397996.527364:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701257216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397996.527372:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787397996.527425:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701257216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787397997.412689:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787397998.436743:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787397999.172026:0:103142:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137b: DNE: create under striped dir, fail MDT2 ========================================================== 07:26:36 (1787397996) 00000100:00100000:1.0:1787397999.442489:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397999.442921:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329152 00000100:00100000:3.0:1787397999.442933:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329152 00000100:00100000:3.0:1787397999.442994:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1711 00000100:00100000:3.0:1787397999.443004:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77655:x1874218681329152:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787397999.443024:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397999.443046:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d19346d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d874c expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443104:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443118:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443131:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787397999.443207:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787397999.443210:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787397999.443230:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443254:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d19346d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443268:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.443277:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:3.0:1787397999.443291:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787397999.443295:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:3.0:1787397999.443367:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77655:x1874218681329152:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 363us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397999.443375:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1711 00000100:00080000:3.0:1787397999.443403:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787397999.451758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397999.452576:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329408 00000100:00100000:2.0:1787397999.452588:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329408 00000100:00100000:2.0:1787397999.452675:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1712 00000100:00100000:2.0:1787397999.452688:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77655:x1874218681329408:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787397999.452710:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787397999.452735:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d19347b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8753 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397999.452847:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257344:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787397999.452906:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.452935:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397999.453084:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257344 00000100:00100000:0.0:1787397999.453089:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257344 00000100:00100000:0.0:1787397999.453120:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787397999.453126:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66176:x1874218701257344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787397999.453211:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66176:x1874218701257344:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397999.453218:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787397999.453353:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787397999.453507:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257344:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787397999.453586:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257472:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787397999.453614:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.453630:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397999.454642:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257472 00000100:00100000:0.0:1787397999.454652:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257472 00000100:00100000:0.0:1787397999.454691:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787397999.454700:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66176:x1874218701257472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787397999.454811:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66176:x1874218701257472:12345-0@lo:1000:mdt00_000.0 Request processed in 111us (1195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787397999.454820:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787397999.454951:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257472:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787397999.455012:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.455024:0:66176:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.455035:0:66176:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397999.455051:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257600:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787397999.455080:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.455105:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787397999.455500:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257600 00000100:00100000:0.0:1787397999.455507:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257600 00000100:00100000:0.0:1787397999.455707:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787397999.455715:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66176:x1874218701257600:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787397999.455728:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787397999.455743:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193482 expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.455785:0:66188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 6 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.455795:0:66188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.455824:0:66188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 6 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.455837:0:66188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 6 pid: 74374 timeout: 3978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787397999.455850:0:66188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701257728:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787397999.455963:0:66188:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f09c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787397999.463785:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397999.469401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397999.469478:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329536 00000100:00100000:2.0:1787397999.469500:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329536 00010000:00010000:2.0:1787397999.469563:0:19662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 7 pid: 74374 timeout: 3978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397999.469605:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2664 00000100:00100000:2.0:1787397999.469616:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681329536:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787397999.469632:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397999.469638:0:19662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 7 pid: 74374 timeout: 3978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.469651:0:19662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 7 pid: 74374 timeout: 3978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.469675:0:19662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787397999.469682:0:19662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.469695:0:19662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.469704:0:19662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.469736:0:19662:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397999.469751:0:19662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:19662:1874218701257856:0@lo:105: 00000100:00100000:2.0:1787397999.469801:0:19662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.469848:0:19662:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787397999.469915:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787397999.469927:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257856 00000100:00100000:3.0:1787397999.469931:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257856 00010000:00010000:1.0:1787397999.469941:0:66188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d874c expref: 7 pid: 74374 timeout: 3978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397999.469957:0:66188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701257728:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787397999.469966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1787397999.469973:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19662:x1874218701257856:12345-0@lo:105: 00010000:00010000:1.0:1787397999.469979:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.469983:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.469986:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397999.469990:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397999.469992:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54600, rc 0) 00010000:00010000:3.0:1787397999.470001:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.470010:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.470017:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.470024:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397999.470030:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:66176:x1874218701257600:12345-0@lo:101:mdt00_000.0 Request processed in 14317us (14949us total) trans 0 rc 0/0 00010000:00010000:3.0:1787397999.470033:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.470044:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a704d22c00) 00000100:00100000:1.0:1787397999.470044:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787397999.470081:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257600:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787397999.470087:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19662:x1874218701257856:12345-0@lo:105: Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397999.470092:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00010000:00010000:1.0:1787397999.470095:0:66176:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397999.470112:0:66176:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787397999.470142:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397999.470157:0:19662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:19662:1874218701257856:0@lo:105: 00010000:00010000:1.0:1787397999.470159:0:66176:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.470166:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787397999.470168:0:66176:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397999.470181:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257984:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787397999.470201:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681329536:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 587us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.470205:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.470207:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2664 00000100:00100000:1.0:1787397999.470219:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88480 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.470232:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701257984 00000100:00100000:1.0:1787397999.470235:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701257984 00000100:00100000:1.0:1787397999.470259:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787397999.470265:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66176:x1874218701257984:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787397999.470280:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397999.470294:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193490 expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.470311:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193490 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.470332:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193490 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.470339:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a705b0d500) 00010000:00010000:1.0:1787397999.470341:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397999.470343:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63600, rc 0) 00000100:00100000:1.0:1787397999.470371:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701257984:12345-0@lo:101:mdt00_000.0 Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.470377:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787397999.470404:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701257984:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787397999.470413:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.470421:0:66176:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787397999.470433:0:66176:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787397999.470462:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258112:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.470488:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.470501:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88600 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.470514:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258112 00000100:00100000:1.0:1787397999.470517:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258112 00000100:00100000:1.0:1787397999.470575:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787397999.470581:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.470655:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258112:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.470668:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787397999.470769:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258112:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.470813:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258240:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.470970:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.470991:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.474139:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258240 00000100:00100000:1.0:1787397999.474163:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258240 00000100:00100000:1.0:1787397999.474242:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787397999.474253:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.474425:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258240:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (3453us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397999.474433:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787397999.474466:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258240:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.474610:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258368:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.474650:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.474682:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.474765:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258368 00000100:00100000:1.0:1787397999.474770:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258368 00000100:00100000:1.0:1787397999.474799:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787397999.474805:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.474861:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258368:12345-0@lo:1000:mdt00_000.0 Request processed in 56us (210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787397999.474867:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787397999.474945:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258368:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.474989:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258496:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.475012:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.475033:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.475073:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258496 00000100:00100000:1.0:1787397999.475076:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258496 00000100:00100000:1.0:1787397999.475104:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787397999.475110:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.475176:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258496:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.475183:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787397999.475259:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258496:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.475307:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258624:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787397999.475329:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.475347:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705aac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.477764:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258624 00000100:00100000:1.0:1787397999.477779:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258624 00000100:00100000:1.0:1787397999.477847:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787397999.477856:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.478132:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258624:12345-0@lo:1000:mdt00_000.0 Request processed in 276us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.478141:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787397999.482046:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258624:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787397999.487362:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787397999.487429:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.487467:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.487734:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701258752 00000100:00100000:1.0:1787397999.487742:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701258752 00000100:00100000:1.0:1787397999.487791:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787397999.487799:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787397999.487874:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701258752:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.487882:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787397999.487954:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701258752:0@lo:1000:mdt00_000.0 00000040:00080000:3.0:1787397999.488412:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].11, 1000 off44152 00000040:00080000:3.0:1787397999.488463:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].11, 1152 off45632 00000004:00080000:3.0:1787397999.488469:0:66176:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a705aac0c0 with version 24 00000004:00080000:1.0:1787397999.488654:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 24 rpc_version 24 00000020:00100000:1.0:1787397999.488677:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397999.488685:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83876ea00 x1874218701259008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397999.488702:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701259008:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397999.488736:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.488762:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787397999.488832:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259008 00000100:00100000:2.0:1787397999.488838:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259008 00000100:00100000:2.0:1787397999.488862:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787397999.488868:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701259008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397999.489206:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:75622:x1874218701259008:12345-0@lo:1000:osp_up0-1.0 Request processed in 336us (467us total) trans 124554051593 rc 0/0 00000100:00100000:2.0:1787397999.489215:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787397999.489420:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701259008:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1787397999.489499:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1787397999.489637:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23200/0x274786fe0d19349e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489653:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23200/0x274786fe0d19349e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489664:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23200/0x274786fe0d19349e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397999.489679:0:66176:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397999.489688:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489697:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489704:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489776:0:66176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787397999.489784:0:66176:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787397999.489789:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489796:0:66176:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489845:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23e00/0x274786fe0d19347b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8753 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489868:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23200/0x274786fe0d19349e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8753 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.489877:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:2.0:1787397999.489880:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787397999.489883:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23200, rc 0) 00000100:00100000:2.0:1787397999.489936:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77655:x1874218681329408:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 37251us (38189us total) trans 81604378790 rc 0/0 00000100:00100000:2.0:1787397999.489943:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1712 00010000:00010000:0.0:1787397999.509180:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787397999.509197:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.509210:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787397999.509217:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787397999.509227:0:56853:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.509393:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.509402:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397999.509444:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.509453:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22c00/0x274786fe0d193482 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193489 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.509488:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397999.509490:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397999.509492:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787397999.509567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701259136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397999.509637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.509761:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259136 00000100:00100000:1.0:1787397999.509770:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259136 00000100:00100000:1.0:1787397999.509822:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1787397999.509832:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3649:x1874218701259136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397999.509846:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787397999.509877:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193489 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193482 expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.509891:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397999.509896:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787397999.509931:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701259136:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.509939:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1787397999.510086:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701259136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787397999.517176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397999.518012:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329664 00000100:00100000:1.0:1787397999.518024:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329664 00000100:00100000:1.0:1787397999.518087:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1713 00000100:00100000:1.0:1787397999.518097:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77656:x1874218681329664:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397999.518116:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397999.518138:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d1934a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d875a expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518212:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518241:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518253:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397999.518299:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787397999.518303:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787397999.518326:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518352:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63200/0x274786fe0d1934a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d875a expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518370:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d875a expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.518378:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397999.518381:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787397999.518384:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63800, rc 0) 00000100:00100000:1.0:1787397999.519636:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77656:x1874218681329664:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1532us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.519647:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1713 00000100:00100000:1.0:1787397999.526270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787397999.526355:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329792 00000100:00100000:3.0:1787397999.526365:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329792 00000100:00100000:3.0:1787397999.526425:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1714 00000100:00100000:3.0:1787397999.526436:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77656:x1874218681329792:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787397999.526458:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787397999.526482:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d1934b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8761 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526718:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526734:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526744:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526754:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526849:0:74374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193490 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526926:0:74374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.526963:0:74374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d193490 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397999.526980:0:74374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:74374:1874218701259264:0@lo:104: 00000100:00100000:3.0:1787397999.527052:0:74374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787397999.527213:0:74374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a806264f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787397999.528240:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259264 00000100:00100000:0.0:1787397999.528264:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259264 00000100:00100000:0.0:1787397999.528432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787397999.528442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:74374:x1874218701259264:12345-0@lo:104: 00010000:00010000:0.0:1787397999.528459:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.528567:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787397999.528573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:74374:x1874218701259264:12345-0@lo:104: Request processed in 134us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787397999.528580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1787397999.528660:0:74374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:74374:1874218701259264:0@lo:104: 00010000:00010000:2.0:1787397999.528684:0:74374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528745:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787397999.528753:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528784:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:1.0:1787397999.528791:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397999.528800:0:56852:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528847:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528854:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787397999.528891:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528899:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a835e63c00/0x274786fe0d193490 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193497 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.528919:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397999.528921:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787397999.528923:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787397999.529032:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701259392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787397999.529072:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.529266:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259392 00000100:00100000:1.0:1787397999.529271:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259392 00010000:00010000:1.0:1787397999.529303:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x274786fe0d193490 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397999.529332:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:1.0:1787397999.529340:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701259392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397999.529361:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787397999.531713:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051593 is committed 00010000:00010000:2.0:1787397999.531836:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63600/0x274786fe0d193497 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d193490 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.531856:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a705b0d500) 00010000:00010000:2.0:1787397999.531873:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.531883:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.531890:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.531921:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787397999.531998:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3650:x1874218701259392:12345-0@lo:103:ldlm_bl.0 Request processed in 2657us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397999.532007:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1787397999.532068:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701259392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787397999.532258:0:74374:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.532267:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787397999.532396:0:74374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:74374:1874218701259520:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787397999.532436:0:74374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.532465:0:74374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397999.532662:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259520 00000100:00100000:2.0:1787397999.532669:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259520 00000100:00100000:2.0:1787397999.532711:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787397999.532719:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:74374:x1874218701259520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787397999.532788:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:74374:x1874218701259520:12345-0@lo:1000:mdt00_004.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787397999.532795:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787397999.532879:0:74374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:74374:1874218701259520:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787397999.532922:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.532933:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.532943:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787397999.532964:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533129:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533135:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533141:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533171:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397999.533176:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533184:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533195:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787397999.533199:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397999.533203:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533208:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d1934ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533220:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533226:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533232:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533236:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787397999.533239:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533244:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533262:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a705b0d500) 00010000:00010000:1.0:1787397999.533265:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397999.533267:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533272:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d1934c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533507:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d1934b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8761 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533551:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8761 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.533557:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a818432f00) 00010000:00010000:1.0:1787397999.533560:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397999.533562:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:1.0:1787397999.533615:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77656:x1874218681329792:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 7180us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.533622:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1714 00000100:00100000:3.0:1787397999.537327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397999.537443:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681329920 00000100:00100000:1.0:1787397999.537452:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681329920 00000100:00100000:1.0:1787397999.537582:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1715 00000100:00100000:1.0:1787397999.537593:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77656:x1874218681329920:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397999.537619:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397999.537642:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d1934cf lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8768 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.537723:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1934d6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.537737:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1934d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.537748:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1934d6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397999.537810:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1787397999.537815:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787397999.537851:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d1934cf lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8768 expref: 9 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.537881:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1934d6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8768 expref: 8 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.537891:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:1.0:1787397999.537894:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787397999.537898:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62a00, rc 0) 00000100:00100000:1.0:1787397999.537977:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77656:x1874218681329920:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 374us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.537985:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1715 00000100:00100000:2.0:1787397999.540832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397999.541169:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681330048 00000100:00100000:0.0:1787397999.541180:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681330048 00000100:00100000:0.0:1787397999.541258:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1716 00000100:00100000:2.0:1787397999.541262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787397999.541273:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77656:x1874218681330048:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787397999.541294:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787397999.541311:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681330176 00010000:00010000:0.0:1787397999.541315:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1934dd lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d876f expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787397999.541317:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681330176 00000100:00100000:3.0:1787397999.541364:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 706 00000100:00100000:3.0:1787397999.541373:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2402:x1874218681330176:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787397999.541384:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787397999.541396:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.541406:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1934d6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8768 expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.541411:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.541425:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787397999.541429:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:3.0:1787397999.541435:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787397999.541491:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681330176:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787397999.541499:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 706 00010000:00010000:0.0:1787397999.541948:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.541974:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.541981:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542028:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542035:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542041:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542048:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542053:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397999.542058:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542064:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542074:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:0.0:1787397999.542077:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397999.542082:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542088:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d1934e4 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542106:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542113:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542118:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542124:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787397999.542126:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542132:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542140:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a806066900) 00010000:00010000:0.0:1787397999.542212:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397999.542217:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.542223:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54e00/0x274786fe0d1934eb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.544251:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1934dd lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d876f expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.544272:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:0.0:1787397999.544275:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787397999.544297:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1934dd lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d876f expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787397999.544309:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54400, rc 0) 00000100:00100000:0.0:1787397999.544376:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77656:x1874218681330048:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 3106us (3551us total) trans 0 rc 301/301 00000100:00100000:0.0:1787397999.544386:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1716 00000100:00100000:2.0:1787397999.550256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787397999.550341:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681330432 00000100:00100000:1.0:1787397999.550351:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681330432 00000100:00100000:1.0:1787397999.550428:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1717 00000100:00100000:1.0:1787397999.550437:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77656:x1874218681330432:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787397999.550474:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397999.550497:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d1934f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8776 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787397999.550634:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00010000:00010000:1.0:1787397999.550741:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d1934f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8776 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.550755:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a818432a00) 00010000:00010000:1.0:1787397999.550758:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787397999.550763:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d1934f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8776 expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.550779:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63a00, rc 0) 00000100:00100000:1.0:1787397999.550836:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77656:x1874218681330432:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 400us (589us total) trans 81604378791 rc 301/301 00000100:00100000:1.0:1787397999.550844:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1717 00000100:00100000:3.0:1787397999.554412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397999.554565:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681330688 00000100:00100000:2.0:1787397999.554585:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681330688 00000100:00100000:2.0:1787397999.554638:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1718 00000100:00100000:2.0:1787397999.554647:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77656:x1874218681330688:12345-192.168.204.60@tcp:36:lfs.0 00010000:00010000:2.0:1787397999.554705:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787397999.554736:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23200/0x274786fe0d19349e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8753 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.554753:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32500) 00010000:00010000:2.0:1787397999.554822:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787397999.554973:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.554988:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.554996:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.555008:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.555014:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.555019:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787397999.557471:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].12, 2152 off46304 00000040:00080000:2.0:1787397999.557598:0:66176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].12, 2352 off47984 00000004:00080000:2.0:1787397999.557606:0:66176:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a70311ecc0 with version 25 00000004:00080000:1.0:1787397999.557734:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 25 rpc_version 25 00000020:00100000:1.0:1787397999.557784:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787397999.557794:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a82f4abb80 x1874218701259776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787397999.557817:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701259776:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787397999.557898:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.557932:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c88480 going to sleep for 11 seconds 00000100:00100000:2.0:1787397999.558139:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259776 00000100:00100000:2.0:1787397999.558175:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259776 00000100:00100000:2.0:1787397999.558227:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787397999.558235:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e49d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701259776:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787397999.558718:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e49d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701259776:12345-0@lo:1000:osp_up0-1.0 Request processed in 482us (819us total) trans 124554051594 rc 0/0 00000100:00100000:2.0:1787397999.558728:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787397999.560923:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051593 gen 3 00000004:00080000:3.0:1787397999.560934:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051593 committed transno 124554051593 00000100:00100000:3.0:1787397999.560983:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a82f4abb80 x1874218701259776/t124554051594(124554051594) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 1787398015 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787397999.561028:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701259776:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787397999.561389:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561404:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561415:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561431:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561437:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561443:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561477:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561484:0:66176:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.561493:0:66176:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787397999.561556:0:66176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701259904:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787397999.561609:0:66176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787397999.561644:0:66176:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723540 going to sleep for 11 seconds 00000100:00100000:1.0:1787397999.561884:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701259904 00000100:00100000:1.0:1787397999.561891:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701259904 00000100:00100000:1.0:1787397999.561944:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787397999.561962:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66176:x1874218701259904:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787397999.561981:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787397999.561998:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193523 lrc: 2/0,0 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d19351c expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.562018:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193523 lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19351c expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.562029:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193523 lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19351c expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787397999.562038:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a818432a00) 00010000:00010000:1.0:1787397999.562040:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787397999.562043:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63a00, rc 0) 00000100:00100000:1.0:1787397999.562266:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66176:x1874218701259904:12345-0@lo:101:mdt00_000.0 Request processed in 304us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.562274:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787397999.562491:0:66176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66176:1874218701259904:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787397999.562505:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562516:0:66176:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397999.562635:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb38b66a reply state 000000005ca9515e transno 81604378792 ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562647:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562654:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a82df32300) 00010000:00010000:2.0:1787397999.562657:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397999.562660:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787397999.562666:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 4/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562674:0:66176:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787397999.562684:0:66176:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000088d1:0x5:0x0] 00000004:00010000:2.0:1787397999.562690:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb38b66a reply state 000000005ca9515e transno 81604378792 ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562709:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562715:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:2.0:1787397999.562717:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397999.562718:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787397999.562723:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787397999.562731:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562737:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562743:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.562749:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563128:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787397999.563136:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563153:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563165:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32100) 00010000:00010000:2.0:1787397999.563167:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787397999.563171:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563197:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22400/0x274786fe0d193500 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787397999.563218:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb38b66a reply state 000000005ca9515e transno 81604378792 ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563227:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787397999.563232:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a82df32900) 00010000:00010000:2.0:1787397999.563235:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787397999.563237:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787397999.563370:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77656:x1874218681330688:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 8721us (8966us total) trans 81604378792 rc 0/0 00000100:00100000:2.0:1787397999.563378:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1718 00000100:00100000:3.0:1787397999.567622:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787397999.567687:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681330944 00000100:00100000:2.0:1787397999.567697:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681330944 00000100:00100000:2.0:1787397999.567758:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 304 00000100:00100000:2.0:1787397999.567769:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77656:x1874218681330944:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:2.0:1787397999.568026:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77656:x1874218681330944:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 259us (413us total) trans 81604378793 rc 0/0 00000100:00100000:2.0:1787397999.568034:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 304 00000100:00100000:0.0:1787397999.588762:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787397999.588789:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701260032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787397999.588973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787397999.589915:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701260032 00000100:00100000:1.0:1787397999.589924:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701260032 00000100:00100000:1.0:1787397999.589991:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787397999.590009:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701260032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787397999.590035:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787397999.590367:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787397999.590452:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701260032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 451us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787397999.590461:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787397999.590567:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701260032:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1787398000.209214:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051594 is committed 00010000:00010000:0.0:1787398000.209593:0:75615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398000.209612:0:75615:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 3/0,0 mode: PW/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.209659:0:75615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 2/0,0 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209663:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.209681:0:75615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398000.209695:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209702:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209707:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398000.209712:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.209716:0:75615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22e00/0x274786fe0d19351c lrc: 0/0,0 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193523 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209723:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209744:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a82df32900) 00010000:00010000:3.0:1787398000.209747:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398000.209752:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209757:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23400/0x274786fe0d193507 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209775:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209780:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209785:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209789:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398000.209800:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209806:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209814:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a82df32d00) 00010000:00010000:3.0:1787398000.209816:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398000.209818:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209822:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22800/0x274786fe0d19350e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209834:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209839:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209844:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209849:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398000.209851:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209856:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209862:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a82df32300) 00010000:00010000:3.0:1787398000.209863:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398000.209872:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398000.209877:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23000/0x274786fe0d193515 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787398000.209926:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378793 is committed 00000100:00100000:2.0:1787398000.209941:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701260160:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1787398000.209949:0:75615:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a705aac300 refcount 2 committed 0 result 0 batchid 77309411395 00000020:00080000:0.0:1787398000.209954:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a834618e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a705aac0c0 00000020:00080000:0.0:1787398000.209958:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].11 00000020:00080000:0.0:1787398000.209966:0:75615:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a834618f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a82f5f3000 00000020:00080000:0.0:1787398000.209969:0:75615:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].11 00000020:00080000:0.0:1787398000.209992:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411394 batchid updated 00000100:00100000:2.0:1787398000.210016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787398000.210490:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411395 committed batchid 77309411394 00000004:00080000:3.0:1787398000.210629:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a80607cb40 with version 26 00000020:00080000:3.0:1787398000.210642:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411392 cancel update log [0x2000088d1:0x2:0x0].8: rc = 0 00000020:00080000:3.0:1787398000.210679:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411392 cancel update log [0x2400090a0:0x2:0x0].8: rc = 0 00000004:00080000:3.0:1787398000.210702:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a836546d80 with version 27 00000020:00080000:3.0:1787398000.210704:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411393 cancel update log [0x2000088d1:0x2:0x0].9: rc = 0 00000020:00080000:3.0:1787398000.210720:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411393 cancel update log [0x2400090a0:0x2:0x0].9: rc = 0 00000004:00080000:3.0:1787398000.210738:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a819111240 with version 28 00000020:00080000:3.0:1787398000.210741:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411394 cancel update log [0x2000088d1:0x2:0x0].10: rc = 0 00000020:00080000:3.0:1787398000.210758:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411394 cancel update log [0x2400090a0:0x2:0x0].10: rc = 0 00000020:00080000:3.0:1787398000.210764:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411394 00000100:00100000:0.0:1787398000.210825:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701260160 00000100:00100000:0.0:1787398000.210833:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701260160 00000100:00100000:0.0:1787398000.210897:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1787398000.210905:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701260160:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787398000.210919:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398000.210938:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193523 lrc: 0/0,0 mode: --/PW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19351c expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.210950:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a818432a00) 00010000:00010000:0.0:1787398000.210958:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398000.211013:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701260160:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 108us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398000.211020:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1787398000.211180:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701260160:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:2.0:1787398000.211216:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 26 rpc_version 26 00000020:00100000:2.0:1787398000.211241:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787398000.211248:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83fa10e00 x1874218701260416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398000.211275:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260416:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398000.211312:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398000.211354:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830e24a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398000.211355:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701260416 00000100:00100000:1.0:1787398000.211359:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701260416 00000100:00100000:1.0:1787398000.211400:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787398000.211407:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701260416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398000.211562:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701260416:12345-0@lo:1000:osp_up0-1.0 Request processed in 155us (249us total) trans 124554051595 rc 0/0 00000100:00100000:3.0:1787398000.211570:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051594 gen 3 00000100:00100000:1.0:1787398000.211570:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:3.0:1787398000.211575:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051594 committed transno 124554051594 00000020:00080000:3.0:1787398000.211580:0:75622:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a70311ef00 refcount 2 committed 0 result 0 batchid 77309411396 00000020:00080000:3.0:1787398000.211583:0:75622:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82df3d300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a70311ecc0 00000020:00080000:3.0:1787398000.211586:0:75622:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].12 00000020:00080000:3.0:1787398000.211589:0:75622:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a82df3d100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a808054600 00000020:00080000:3.0:1787398000.211592:0:75622:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].12 00000020:00080000:1.0:1787398000.211626:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411396 committed batchid 77309411394 00000020:00080000:1.0:1787398000.211649:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411394 00000100:00100000:3.0:1787398000.212182:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a83fa10e00 x1874218701260416/t124554051595(124554051595) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787398016 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398000.212216:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260416:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787398000.212226:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 27 rpc_version 27 00000020:00100000:3.0:1787398000.213181:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787398000.213193:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70698ce00 x1874218701260672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398000.213215:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260672:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398000.213268:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398000.213335:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819111840 going to sleep for 11 seconds 00000100:00100000:1.0:1787398000.213728:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701260672 00000100:00100000:1.0:1787398000.213736:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701260672 00000100:00100000:1.0:1787398000.213825:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787398000.213835:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701260672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398000.213986:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701260672:12345-0@lo:1000:osp_up0-1.0 Request processed in 151us (716us total) trans 124554051596 rc 0/0 00000100:00100000:1.0:1787398000.213994:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787398000.214070:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260672:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398000.214081:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 28 rpc_version 28 00000020:00100000:0.0:1787398000.214099:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398000.214105:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af24700 x1874218701260928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398000.214121:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260928:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398000.214166:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398000.217901:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787398000.220508:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701260928 00000100:00100000:3.0:1787398000.220625:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701260928 00000100:00100000:3.0:1787398000.220693:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787398000.220702:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701260928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398000.220888:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:75622:x1874218701260928:12345-0@lo:1000:osp_up0-1.0 Request processed in 187us (6721us total) trans 124554051597 rc 0/0 00000100:00100000:3.0:1787398000.220993:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787398000.221027:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701260928:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1787398000.228408:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411396 batchid updated 00000020:00080000:0.0:1787398000.228437:0:75615:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411395 batchid updated 00000020:00080000:1.0:1787398000.228962:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000004:00080000:1.0:1787398000.229031:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a819136900 with version 29 00000020:00080000:1.0:1787398000.229039:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411395 cancel update log [0x2000088d1:0x2:0x0].11: rc = 0 00000020:00080000:1.0:1787398000.229116:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411395 cancel update log [0x2400090a0:0x2:0x0].11: rc = 0 00000004:00080000:1.0:1787398000.229153:0:75636:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a705aac300 with version 30 00000020:00080000:1.0:1787398000.229156:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411396 cancel update log [0x2000088d1:0x2:0x0].12: rc = 0 00000020:00080000:1.0:1787398000.229178:0:75636:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411396 cancel update log [0x2400090a0:0x2:0x0].12: rc = 0 00000020:00080000:1.0:1787398000.229186:0:75636:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000001:00080000:1.0:1787398000.229557:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051597 is committed 00000004:00080000:0.0:1787398000.230060:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 29 rpc_version 29 00000020:00100000:0.0:1787398000.230098:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398000.230109:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af24000 x1874218701261184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398000.230145:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701261184:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398000.230212:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398000.230245:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787398000.230310:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261184 00000100:00100000:3.0:1787398000.230320:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261184 00000100:00100000:3.0:1787398000.230376:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787398000.230385:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75622:x1874218701261184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398000.231778:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701261184:12345-0@lo:1000:osp_up0-1.0 Request processed in 1389us (1561us total) trans 124554051598 rc 0/0 00000100:00100000:3.0:1787398000.231791:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787398000.232586:0:75622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051597 gen 3 00000004:00080000:0.0:1787398000.232595:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051595 committed transno 124554051597 00000004:00080000:0.0:1787398000.232613:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051596 committed transno 124554051597 00000004:00080000:0.0:1787398000.232623:0:75622:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051597 committed transno 124554051597 00000100:00100000:0.0:1787398000.232637:0:75622:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a83af24000 x1874218701261184/t124554051598(124554051598) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787398016 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398000.232659:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701261184:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398000.232673:0:75622:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a809568840 version 30 rpc_version 30 00000020:00100000:0.0:1787398000.232698:0:75622:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398000.232703:0:75622:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af24700 x1874218701261440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398000.232721:0:75622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701261440:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398000.232777:0:75622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398000.232802:0:75622:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7036f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787398000.234828:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261440 00000100:00100000:1.0:1787398000.234840:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261440 00000100:00100000:1.0:1787398000.234902:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787398000.234916:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75622:x1874218701261440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398000.235083:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75622:x1874218701261440:12345-0@lo:1000:osp_up0-1.0 Request processed in 171us (2304us total) trans 124554051599 rc 0/0 00000100:00100000:1.0:1787398000.235091:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787398000.235563:0:75622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75622:1874218701261440:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1787398000.239010:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051599 is committed 00000100:00100000:0.0:1787398000.295405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398000.295445:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331072 00000100:00100000:0.0:1787398000.295454:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331072 00000100:00100000:0.0:1787398000.295515:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1719 00000100:00100000:0.0:1787398000.295544:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77665:x1874218681331072:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787398000.295584:0:66178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:0.0:1787398000.295815:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77665:x1874218681331072:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 290us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398000.295823:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1719 00000100:00100000:2.0:1787398000.306114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398000.309063:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331200 00000100:00100000:1.0:1787398000.309079:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331200 00000100:00100000:1.0:1787398000.309152:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1720 00000100:00100000:1.0:1787398000.309163:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331200:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787398000.309205:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:1.0:1787398000.309286:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331200:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 125us (3181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398000.309294:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1720 00000100:00100000:1.0:1787398000.317629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398000.317704:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331328 00000100:00100000:2.0:1787398000.317715:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331328 00000100:00100000:2.0:1787398000.317782:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00100000:2.0:1787398000.317793:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331328:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787398000.317822:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398000.317892:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331328:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398000.317901:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 67 00000100:00080000:3.0:1787398000.318748:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398000.324816:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398000.326280:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331456 00000100:00100000:1.0:1787398000.326295:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331456 00000100:00100000:1.0:1787398000.326377:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:1.0:1787398000.326388:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331456:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787398000.326425:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398000.326499:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77665:x1874218681331456:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 114us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398000.326508:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00080000:3.0:1787398000.326660:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398000.395163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398000.395579:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331712 00000100:00100000:1.0:1787398000.395594:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331712 00000100:00100000:1.0:1787398000.395646:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1721 00000100:00100000:1.0:1787398000.395656:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77672:x1874218681331712:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:1.0:1787398000.395710:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787398000.395738:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d1934ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d875a expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395755:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787398000.395760:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398000.395819:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395833:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395843:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395857:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395864:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.395869:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396248:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396256:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396270:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396276:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396282:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398000.396286:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396294:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396303:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787398000.396306:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398000.396310:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396316:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d19352a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787398000.396326:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088276a2b reply state 000000005f82acbd transno 124554051600 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396335:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.396341:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d000) 00010000:00010000:1.0:1787398000.396344:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787398000.396346:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787398000.396423:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77672:x1874218681331712:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 766us (1266us total) trans 124554051600 rc 0/0 00000100:00100000:1.0:1787398000.396435:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1721 00000100:00100000:1.0:1787398000.426885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398000.430977:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331840 00000100:00100000:2.0:1787398000.430991:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331840 00000100:00100000:2.0:1787398000.431086:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1722 00000100:00100000:2.0:1787398000.431096:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77675:x1874218681331840:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398000.431121:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398000.431153:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d193538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d877d expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431220:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431235:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431247:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398000.431308:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787398000.431312:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398000.431331:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431356:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23c00/0x274786fe0d193538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d877d expref: 11 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431371:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d877d expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.431380:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787398000.431383:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398000.431387:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23200, rc 0) 00000100:00100000:2.0:1787398000.431450:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77675:x1874218681331840:12345-192.168.204.60@tcp:101:rm.0 Request processed in 355us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398000.431458:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1722 00000100:00100000:1.0:1787398000.436797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398000.437015:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681331968 00000100:00100000:2.0:1787398000.437026:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681331968 00000100:00100000:2.0:1787398000.437083:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1723 00000100:00100000:2.0:1787398000.437093:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77675:x1874218681331968:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398000.437112:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398000.437143:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8784 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437204:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437230:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437242:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437253:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437260:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437266:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437341:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437348:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437354:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398000.437398:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x32:0x0]: returning size 0 00000004:00200000:2.0:1787398000.437402:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398000.437419:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437430:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437449:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437455:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437462:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437469:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398000.437473:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437481:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437493:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787398000.437496:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398000.437500:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437506:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23000/0x274786fe0d19354d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437517:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437556:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437561:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437653:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398000.437656:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437663:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437672:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d000) 00010000:00010000:2.0:1787398000.437674:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398000.437677:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437683:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22800/0x274786fe0d193554 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437710:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8784 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437723:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8784 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.437731:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x32:0x0].0x0 (ffff89a82df32b00) 00010000:00010000:2.0:1787398000.437733:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787398000.437735:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23400, rc 0) 00000100:00100000:2.0:1787398000.437866:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77675:x1874218681331968:12345-192.168.204.60@tcp:101:rm.0 Request processed in 773us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398000.437874:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1723 00000100:00100000:3.0:1787398000.451847:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398000.451971:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332224 00000100:00100000:1.0:1787398000.451981:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332224 00000100:00100000:1.0:1787398000.452050:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1724 00000100:00100000:1.0:1787398000.452061:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77675:x1874218681332224:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787398000.452120:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787398000.452157:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19355b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8784 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452175:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x32:0x0].0x0 (ffff89a82df32b00) 00010000:00010000:1.0:1787398000.452193:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23200/0x274786fe0d19353f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d877d expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452202:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787398000.452206:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398000.452225:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452237:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452246:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452255:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452279:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452285:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452367:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452375:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398000.452382:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454010:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454084:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454095:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454103:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454110:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454116:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454185:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398000.454207:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454214:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454221:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454227:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398000.454232:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454239:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454262:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x32:0x0].0x0 (ffff89a705b0d200) 00010000:00010000:2.0:1787398000.454265:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398000.454269:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454275:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63400/0x274786fe0d193570 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454296:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454303:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454309:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454315:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454320:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398000.454323:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454330:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454337:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:2.0:1787398000.454339:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398000.454342:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454357:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62600/0x274786fe0d193562 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398000.454367:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071083e20 reply state 00000000a85cc699 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454378:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398000.454384:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d000) 00010000:00010000:2.0:1787398000.454386:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398000.454390:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787398000.454475:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77675:x1874218681332224:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2413us (2634us total) trans 124554051601 rc 0/0 00000100:00100000:2.0:1787398000.454484:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1724 00010000:00010000:0.0:1787398000.459846:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398000.459859:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.459872:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398000.459876:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.459885:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.459905:0:15258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x32:0x0].0x0 (ffff89a705b0d200) 00010000:00010000:0.0:1787398000.459909:0:15258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787398000.459913:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.459919:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d193577 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398000.459943:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398000.459945:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398000.459948:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398000.484867:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398001.124794:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701261824:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.124868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.124900:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701262336:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.124926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.124945:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701262848:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.124966:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.124991:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787398001.124996:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701261696:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.125021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.125041:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701262208:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.125076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701261568:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125461:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701262080:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125484:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125502:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701262592:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701263104:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125595:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787398001.125601:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701261952:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125621:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125638:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701262464:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125674:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701262976:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125695:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.125768:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261568 00000100:00100000:0.0:1787398001.125775:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261568 00000100:00100000:0.0:1787398001.125819:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398001.125827:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701261568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.125879:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701261568:12345-0@lo:400:kworker.0 Request processed in 52us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398001.125886:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398001.125922:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262336 00000100:00100000:0.0:1787398001.125926:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262336 00000100:00100000:0.0:1787398001.125954:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262208 00000100:00100000:0.0:1787398001.125958:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262208 00000100:00100000:0.0:1787398001.125972:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262080 00000100:00100000:0.0:1787398001.125974:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262080 00000100:00100000:0.0:1787398001.125983:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262592 00000100:00100000:0.0:1787398001.125993:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262592 00000100:00100000:0.0:1787398001.126012:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263104 00000100:00100000:0.0:1787398001.126014:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263104 00000100:00100000:0.0:1787398001.126025:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262464 00000100:00100000:0.0:1787398001.126027:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262464 00000100:00100000:0.0:1787398001.126043:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:0.0:1787398001.126050:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.126083:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701262336:12345-0@lo:400:kworker.0 Request processed in 33us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398001.126089:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:0.0:1787398001.126102:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1787398001.126308:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701262720:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.126375:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701262336:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126390:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398001.126398:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701263232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398001.126417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.126439:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261824 00000100:00100000:2.0:1787398001.126442:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261824 00000100:00100000:2.0:1787398001.126467:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262848 00000100:00100000:2.0:1787398001.126470:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262848 00000100:00100000:2.0:1787398001.126486:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261952 00000100:00100000:2.0:1787398001.126489:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261952 00000100:00100000:2.0:1787398001.126503:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262976 00000100:00100000:2.0:1787398001.126505:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262976 00000100:00100000:2.0:1787398001.126518:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398001.126541:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701261824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126578:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701261824:12345-0@lo:400:kworker.0 Request processed in 37us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.126584:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398001.126595:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787398001.126601:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701262848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126627:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701262848:12345-0@lo:400:kworker.0 Request processed in 26us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.126632:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787398001.126641:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787398001.126648:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701261952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126673:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701261952:12345-0@lo:400:kworker.0 Request processed in 26us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.126686:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787398001.126698:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787398001.126705:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701262976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.126733:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701262976:12345-0@lo:400:kworker.0 Request processed in 29us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.126740:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787398001.126900:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701262208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.126934:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701262208:12345-0@lo:400:kworker.0 Request processed in 38us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127020:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1787398001.127029:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701262080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127063:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701262080:12345-0@lo:400:kworker.0 Request processed in 35us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127069:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1787398001.127085:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1787398001.127092:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701262592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127192:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701262592:12345-0@lo:400:kworker.0 Request processed in 100us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127198:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1787398001.127285:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1787398001.127294:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701263104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127326:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701263104:12345-0@lo:400:kworker.0 Request processed in 34us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127332:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1787398001.127345:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:2.0:1787398001.127352:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701262464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127379:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701262464:12345-0@lo:400:kworker.0 Request processed in 28us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127393:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:2.0:1787398001.127419:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701261696 00000100:00100000:2.0:1787398001.127424:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701261696 00000100:00100000:2.0:1787398001.127442:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701262720 00000100:00100000:2.0:1787398001.127445:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701262720 00000100:00100000:2.0:1787398001.127453:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263232 00000100:00100000:2.0:1787398001.127456:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263232 00000100:00100000:2.0:1787398001.127464:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787398001.127470:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127505:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701261696:12345-0@lo:400:kworker.0 Request processed in 35us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127511:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787398001.127554:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787398001.127561:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701262720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127602:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701262720:12345-0@lo:400:kworker.0 Request processed in 43us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127608:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787398001.127621:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787398001.127627:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701263232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787398001.127650:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:2.0:1787398001.127680:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701263232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.127686:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787398001.127731:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701263360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398001.127760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.127795:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051599 gen 3 00000004:00080000:2.0:1787398001.127808:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051598 committed transno 124554051599 00000004:00080000:2.0:1787398001.127823:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051599 committed transno 124554051599 00000100:00100000:2.0:1787398001.127839:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701263232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398001.127852:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701261696:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127864:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701262208:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127872:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701262720:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127883:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701261824:0@lo:400:kworker.0 00000100:00100000:2.0:1787398001.127895:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701262848:0@lo:400:kworker.0 00000100:00080000:2.0:1787398001.127940:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398001.127945:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398001.127947:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398001.127949:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787398001.128386:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263360 00000100:00100000:1.0:1787398001.128391:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263360 00000100:00100000:1.0:1787398001.128418:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787398001.128425:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701263360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398001.128444:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00000100:00100000:1.0:1787398001.128482:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701263360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398001.128489:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787398001.128733:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701263360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398001.129398:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:0.0:1787398001.129463:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701261952:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129475:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701262464:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129487:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701262976:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701261568:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129507:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701262080:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129518:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701262592:0@lo:400:kworker.0 00000100:00100000:0.0:1787398001.129738:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701263104:0@lo:400:kworker.0 00000020:00000080:1.0:1787398001.348493:0:103241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd0e77cc40 00000020:00000080:1.0:1787398001.348510:0:103241:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0001 00000020:00000080:1.0:1787398001.348803:0:103241:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0001, dev 6 00000100:00100000:1.0:1787398001.415291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398001.415337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398001.415369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398001.415405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398001.415426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398001.415455:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332864 00000100:00100000:1.0:1787398001.415464:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332864 00000100:00100000:1.0:1787398001.415510:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332736 00000100:00100000:1.0:1787398001.415513:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332736 00000100:00100000:1.0:1787398001.415571:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:1.0:1787398001.415581:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398001.415667:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398001.415676:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 74 00000100:00100000:1.0:1787398001.415693:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:1.0:1787398001.415699:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332736:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398001.415723:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332736:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398001.415729:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 75 00000100:00100000:2.0:1787398001.415997:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332608 00000100:00100000:2.0:1787398001.416002:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332608 00000100:00100000:2.0:1787398001.416045:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332480 00000100:00100000:2.0:1787398001.416049:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332480 00000100:00100000:2.0:1787398001.416071:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1694 00000100:00100000:2.0:1787398001.416078:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332608:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:2.0:1787398001.416096:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82f4a8e00 x1874218681332608/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:442/0 lens 224/224 e 0 to 0 dl 1787398012 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398001.416139:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681332608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 60us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.416146:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1694 00000100:00100000:2.0:1787398001.416171:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1695 00000100:00100000:2.0:1787398001.416178:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681332480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398001.416208:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681332480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.416214:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1695 00000100:00100000:3.0:1787398001.416289:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332352 00000100:00100000:3.0:1787398001.416295:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332352 00000100:00100000:3.0:1787398001.416335:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00100000:3.0:1787398001.416343:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681332352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398001.416373:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681332352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398001.416379:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 83 00000100:00080000:1.0:1787398001.416422:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398001.416426:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787398001.508790:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398001.642237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787398001.642268:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701263488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398001.642338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398001.643343:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263488 00000100:00100000:1.0:1787398001.643355:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263488 00000100:00100000:1.0:1787398001.643403:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787398001.643414:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701263488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398001.643439:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398001.643502:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701263488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398001.643509:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787398001.643587:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701263488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398001.644144:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398001.644155:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701263616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398001.644193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398001.644237:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263616 00000100:00100000:2.0:1787398001.644241:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263616 00000100:00100000:2.0:1787398001.644272:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398001.644280:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701263616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398001.644294:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398001.644325:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701263616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398001.644331:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398001.644360:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701263616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398001.646852:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398001.646875:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701263744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398001.646938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398001.647174:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263744 00000100:00100000:0.0:1787398001.647182:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263744 00000100:00100000:0.0:1787398001.647244:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787398001.647255:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701263744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398001.647284:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398001.647331:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701263744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398001.647338:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787398001.647387:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701263744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787398002.537698:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398003.557417:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398004.586404:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398004.714970:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701263872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398004.715056:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398004.715122:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701263872 00000100:00100000:0.0:1787398004.715130:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701263872 00000100:00100000:0.0:1787398004.715186:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787398004.715195:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701263872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787398004.715238:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398004.715290:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701263872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398004.715298:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787398004.715325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398004.715390:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701263872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787398005.605098:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787398005.736908:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051601 is committed 00010000:00010000:0.0:1787398005.736970:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.736997:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737004:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737010:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398005.737015:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737032:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737054:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d000) 00010000:00010000:0.0:1787398005.737057:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398005.737063:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737069:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d193531 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737089:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737095:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737100:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737105:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398005.737114:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737121:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737128:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a705b0d000) 00010000:00010000:0.0:1787398005.737131:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398005.737133:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398005.737138:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193569 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398006.247736:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701264000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398006.247807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.247867:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264000 00000100:00100000:0.0:1787398006.247874:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264000 00000100:00100000:0.0:1787398006.247914:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787398006.247921:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701264000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787398006.247954:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:0.0:1787398006.247989:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3648:x1874218701264000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.247996:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787398006.248051:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701264000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398006.248240:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701264256:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248291:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701264768:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248339:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265280:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248380:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787398006.248385:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701264384:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248415:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701264896:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248445:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265408:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248460:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248483:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264768 00000100:00100000:0.0:1787398006.248487:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264768 00000100:00100000:0.0:1787398006.248517:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264896 00000100:00100000:0.0:1787398006.248540:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264896 00000100:00100000:0.0:1787398006.248560:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1787398006.248565:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701264768:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398006.248580:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af27b80 x1874218701264768/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1787398017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398006.248608:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701264768:12345-0@lo:400:kworker.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248615:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1787398006.248625:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:0.0:1787398006.248629:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701264896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248649:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701264896:12345-0@lo:400:kworker.0 Request processed in 19us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248654:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:0.0:1787398006.248676:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264256 00000100:00100000:0.0:1787398006.248678:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264256 00000100:00100000:0.0:1787398006.248700:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265280 00000100:00100000:0.0:1787398006.248702:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265280 00000100:00100000:0.0:1787398006.248713:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264384 00000100:00100000:0.0:1787398006.248714:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264384 00000100:00100000:0.0:1787398006.248724:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265408 00000100:00100000:0.0:1787398006.248726:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265408 00000100:00100000:0.0:1787398006.248736:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787398006.248741:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701264256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248766:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701264256:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248771:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787398006.248779:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787398006.248784:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248801:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265280:12345-0@lo:400:kworker.0 Request processed in 18us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248806:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787398006.248813:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787398006.248818:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701264384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248835:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701264384:12345-0@lo:400:kworker.0 Request processed in 17us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248840:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787398006.248848:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787398006.248852:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248870:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265408:12345-0@lo:400:kworker.0 Request processed in 18us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.248883:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787398006.248902:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398006.248905:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398006.248907:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398006.248909:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398006.248927:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701264128:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.248976:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701264640:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.248992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.249005:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701265152:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249042:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.249059:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787398006.249065:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701264512:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.249095:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701265024:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.249120:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701265536:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398006.249152:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264128 00000100:00100000:0.0:1787398006.249156:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264128 00000100:00100000:0.0:1787398006.249179:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398006.249184:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701264128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249212:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701264128:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249218:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398006.249251:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264640 00000100:00100000:0.0:1787398006.249254:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264640 00000100:00100000:0.0:1787398006.249274:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701264512 00000100:00100000:0.0:1787398006.249276:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701264512 00000100:00100000:0.0:1787398006.249286:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265024 00000100:00100000:0.0:1787398006.249287:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265024 00000100:00100000:0.0:1787398006.249296:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265536 00000100:00100000:0.0:1787398006.249298:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265536 00000100:00100000:0.0:1787398006.249308:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1787398006.249313:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701264640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249335:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701264640:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249341:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1787398006.249349:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1787398006.249353:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701264512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249371:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701264512:12345-0@lo:400:kworker.0 Request processed in 18us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249376:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1787398006.249384:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1787398006.249389:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701265024:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398006.249398:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd6a00 x1874218701265024/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1787398017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398006.249416:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701265024:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249422:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1787398006.249429:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:0.0:1787398006.249434:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701265536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249465:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701265536:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249471:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00080000:0.0:1787398006.249489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398006.249491:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398006.249498:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265152 00000100:00100000:0.0:1787398006.249500:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265152 00000100:00100000:0.0:1787398006.249518:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787398006.249544:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701265152:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398006.249555:0:66188:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70aa92d80 x1874218701265152/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398006.249577:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701265152:12345-0@lo:400:kworker.0 Request processed in 35us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.249583:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787398006.249618:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701264512:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249626:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701265024:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249633:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701265536:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249640:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701264128:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249648:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701264640:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249655:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701265152:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249681:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701264384:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249690:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701264896:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249707:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265408:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249715:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701264256:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249723:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701264768:0@lo:400:kworker.0 00000100:00100000:0.0:1787398006.249731:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265280:0@lo:400:kworker.0 00000100:00100000:1.0:1787398006.253774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398006.253798:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701265664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398006.253879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398006.254190:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265664 00000100:00100000:3.0:1787398006.254200:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265664 00000100:00100000:3.0:1787398006.254257:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787398006.254266:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701265664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787398006.254302:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445502976 avail 1299263488 00010000:00000080:3.0:1787398006.254318:0:66188:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82f4abb80 x1874218701265664/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:447/0 lens 224/368 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398006.254368:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701265664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398006.254375:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787398006.254431:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701265664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398006.534023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.534068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.534109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398006.534187:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333120 00000100:00100000:0.0:1787398006.534197:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333120 00000100:00100000:0.0:1787398006.534265:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1702 00000100:00100000:0.0:1787398006.534276:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681333120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398006.534353:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681333120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.534361:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1702 00000100:00080000:0.0:1787398006.534386:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398006.534441:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333376 00000100:00100000:2.0:1787398006.534446:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333376 00000100:00100000:2.0:1787398006.534492:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:2.0:1787398006.534499:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398006.534557:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 58us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.534578:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00080000:0.0:1787398006.534666:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398006.534900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.534999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398006.535220:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333504 00000100:00100000:2.0:1787398006.535225:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333504 00000100:00100000:2.0:1787398006.535270:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787398006.535277:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398006.535317:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.535325:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:0.0:1787398006.535384:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333248 00000100:00100000:0.0:1787398006.535389:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333248 00000100:00100000:0.0:1787398006.535427:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1703 00000100:00100000:0.0:1787398006.535435:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333248:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787398006.535453:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82f4ab480 x1874218681333248/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:447/0 lens 224/224 e 0 to 0 dl 1787398017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398006.535478:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681333248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 45us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.535485:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1703 00000100:00080000:1.0:1787398006.536276:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398006.536282:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398006.537969:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681332992 00000100:00100000:3.0:1787398006.537984:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681332992 00000100:00100000:2.0:1787398006.539975:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:2.0:1787398006.539992:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681332992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398006.540105:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681332992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 116us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.540113:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00010000:00010000:3.0:1787398006.636792:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398006.735846:0:103537:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:2.0:1787398006.757655:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398006.757729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398006.757788:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265792 00000100:00100000:2.0:1787398006.757796:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265792 00000100:00100000:2.0:1787398006.757843:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787398006.757851:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787398006.757881:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398006.757926:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701265792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.757933:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787398006.758016:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701265792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398006.758233:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701265920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398006.758266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398006.758348:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701265920 00000100:00100000:1.0:1787398006.758353:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701265920 00000100:00100000:1.0:1787398006.758386:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787398006.758394:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701265920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787398006.758406:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398006.758439:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701265920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398006.758445:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787398006.758780:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701265920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398006.764122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701266048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398006.764194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398006.764722:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266048 00000100:00100000:2.0:1787398006.764731:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266048 00000100:00100000:2.0:1787398006.764784:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787398006.764793:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701266048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398006.764824:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398006.766421:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701266048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1621us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.766435:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787398006.767689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701266048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398006.844600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398006.844694:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333632 00000100:00100000:0.0:1787398006.844709:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333632 00000100:00100000:0.0:1787398006.844767:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1725 00000100:00100000:0.0:1787398006.844777:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77746:x1874218681333632:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:0.0:1787398006.844796:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398006.844815:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d19357e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d878b expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.844875:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.844888:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.844902:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398006.844948:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787398006.844952:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787398006.844973:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.844995:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54400/0x274786fe0d19357e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d878b expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.845021:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d878b expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.845029:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:0.0:1787398006.845032:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398006.845036:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54600, rc 0) 00000100:00100000:0.0:1787398006.845148:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77746:x1874218681333632:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 371us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.845157:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1725 00000100:00100000:1.0:1787398006.858463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398006.858551:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333760 00000100:00100000:0.0:1787398006.858561:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333760 00000100:00100000:0.0:1787398006.858618:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1726 00000100:00100000:0.0:1787398006.858629:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77746:x1874218681333760:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:0.0:1787398006.858651:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398006.858673:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d19358c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8792 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858746:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858762:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858774:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858792:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858800:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858807:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858858:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858873:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858880:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398006.858900:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858925:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858933:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858940:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858947:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398006.858951:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858958:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858970:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:0.0:1787398006.858973:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398006.858978:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.858984:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54000/0x274786fe0d193593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859011:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859018:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859024:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859029:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398006.859032:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859038:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859047:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a82ebb1f00) 00010000:00010000:0.0:1787398006.859049:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398006.859052:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859058:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54e00/0x274786fe0d19359a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859091:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54c00/0x274786fe0d19358c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8792 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859105:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8792 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.859123:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a818432f00) 00010000:00010000:0.0:1787398006.859126:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787398006.859128:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55600, rc 0) 00000100:00100000:0.0:1787398006.859195:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77746:x1874218681333760:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 567us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.859202:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1726 00000100:00100000:3.0:1787398006.863402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398006.863480:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398006.863713:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681333888 00000100:00100000:2.0:1787398006.863724:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681333888 00000100:00100000:2.0:1787398006.863787:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1727 00000100:00100000:2.0:1787398006.863799:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:77746:x1874218681333888:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787398006.863819:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398006.863844:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d1935a8 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8799 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.864995:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d1935af lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.865026:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d1935af lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.865040:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d1935af lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398006.865088:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1787398006.865092:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787398006.865131:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22c00/0x274786fe0d1935a8 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8799 expref: 7 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.865161:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d1935af lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8799 expref: 6 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.865170:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:2.0:1787398006.865174:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787398006.865177:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23800, rc 0) 00010000:00000080:2.0:1787398006.865186:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bfdf80 x1874218681333888/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:447/0 lens 576/584 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787398006.865251:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77746:x1874218681333888:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1454us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398006.865259:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1727 00000100:00100000:1.0:1787398006.870878:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334016 00000100:00100000:1.0:1787398006.870894:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334016 00000100:00100000:3.0:1787398006.876230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.876381:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 708 00000100:00100000:1.0:1787398006.876398:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681334016:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787398006.876428:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787398006.876456:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb55600/0x274786fe0d1935a1 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8792 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.876476:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a818432f00) 00010000:00010000:1.0:1787398006.876481:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787398006.876555:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2402:x1874218681334016:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 163us (13073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398006.876563:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 708 00000100:00100000:0.0:1787398006.877228:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334144 00000100:00100000:0.0:1787398006.877240:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334144 00000100:00100000:0.0:1787398006.877294:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1728 00000100:00100000:0.0:1787398006.877303:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:77746:x1874218681334144:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:0.0:1787398006.877319:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398006.877339:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d1935b6 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87a0 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877409:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877424:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877436:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877451:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877457:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877479:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877717:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877727:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877734:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398006.877820:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787398006.877825:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787398006.877849:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877864:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877870:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877876:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877881:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877887:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398006.877891:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877917:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877928:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a82df32f00) 00010000:00010000:0.0:1787398006.877931:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398006.877936:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877942:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55000/0x274786fe0d1935bd lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877952:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877958:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877964:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877969:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398006.877972:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877978:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.877984:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a82ebb1d00) 00010000:00010000:0.0:1787398006.877987:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398006.877989:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.878014:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54400/0x274786fe0d1935c4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.878051:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54200/0x274786fe0d1935b6 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a0 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.878063:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a0 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398006.878070:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a82ebb1f00) 00010000:00010000:0.0:1787398006.878073:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787398006.878075:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54c00, rc 0) 00010000:00000080:0.0:1787398006.878083:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835bfea00 x1874218681334144/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:447/0 lens 584/672 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787398006.878152:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77746:x1874218681334144:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 850us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398006.878160:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1728 00000100:00100000:0.0:1787398006.888438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.889873:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334272 00000100:00100000:1.0:1787398006.889885:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334272 00000100:00100000:1.0:1787398006.889953:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1729 00000100:00100000:1.0:1787398006.889965:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:77746:x1874218681334272:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398006.889987:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398006.890020:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d1935d2 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87a7 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.890081:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1935d9 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.890095:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1935d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.890107:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1935d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398006.890166:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1787398006.890172:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787398006.890224:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d1935d2 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a7 expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.890241:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1935d9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a7 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.890249:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a705b0de00) 00010000:00010000:1.0:1787398006.890252:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787398006.890255:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00010000:00000080:1.0:1787398006.890264:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a82ebd4380 x1874218681334272/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:447/0 lens 576/640 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398006.890336:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77746:x1874218681334272:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 374us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398006.890344:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1729 00000100:00100000:3.0:1787398006.896484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398006.896543:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334400 00000100:00100000:3.0:1787398006.896554:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334400 00000100:00100000:3.0:1787398006.896610:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1730 00000100:00100000:3.0:1787398006.896743:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77746:x1874218681334400:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787398006.896766:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398006.896792:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1935e0 lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87ae expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398006.896854:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d1935e7 lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398006.896867:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d1935e7 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398006.896878:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d1935e7 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398006.896988:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000088d1:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1787398006.896994:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787398006.897047:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1935e0 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ae expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398006.897072:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d1935e7 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ae expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398006.897080:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a70526e700) 00010000:00010000:3.0:1787398006.897084:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787398006.897087:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:3.0:1787398006.897155:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77746:x1874218681334400:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 417us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398006.897162:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1730 00000100:00100000:3.0:1787398006.901720:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398006.901830:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334656 00000100:00100000:2.0:1787398006.901841:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334656 00000100:00100000:2.0:1787398006.901912:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1731 00000100:00100000:2.0:1787398006.901924:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:77746:x1874218681334656:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787398006.901957:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398006.901960:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787398006.901989:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d1935e7 lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ae expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902016:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a70526e700) 00010000:00010000:2.0:1787398006.902029:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787398006.902048:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1935ee lrc: 2/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87b5 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902227:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 3/0,1 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902244:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902256:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902276:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902282:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902289:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398006.902876:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1787398006.902898:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d193603 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902908:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d193603 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902916:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d193603 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902928:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902948:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902953:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902959:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902965:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398006.902969:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902977:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 5/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.902986:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a82df32500) 00010000:00010000:2.0:1787398006.902989:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398006.902993:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 3/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.903010:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22200/0x274786fe0d1935f5 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398006.903023:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001bbe5705 reply state 0000000044aeec63 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.903034:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.903040:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0xcd52553e (ffff89a82df32400) 00010000:00010000:2.0:1787398006.903047:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398006.903050:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787398006.903087:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22c00/0x274786fe0d1935ee lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87b5 expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.903109:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d193603 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87b5 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398006.903116:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a82df32700) 00010000:00010000:2.0:1787398006.903119:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398006.903121:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22400, rc 0) 00000100:00100000:2.0:1787398006.903194:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:77746:x1874218681334656:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1271us (1482us total) trans 124554051602 rc 0/0 00000100:00100000:2.0:1787398006.903204:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1731 00000100:00100000:0.0:1787398006.922676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398006.923035:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334912 00000100:00100000:1.0:1787398006.923047:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334912 00000100:00100000:1.0:1787398006.923115:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1732 00000100:00100000:1.0:1787398006.923125:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:77747:x1874218681334912:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398006.923148:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398006.923151:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787398006.923176:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d1935d9 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a7 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923194:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a705b0de00) 00010000:00010000:1.0:1787398006.923204:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398006.923230:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d19360a lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87bc expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923382:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923395:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923405:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923418:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923425:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923431:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398006.923955:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1787398006.923973:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d19361f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923981:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d19361f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.923995:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d19361f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924015:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924035:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 2/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924041:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924047:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398006.924051:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924059:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924069:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a705b0d100) 00010000:00010000:1.0:1787398006.924072:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398006.924075:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924081:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63800/0x274786fe0d193611 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787398006.924092:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e07bc2ca reply state 000000007f510a75 transno 81604378794 ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924102:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924109:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a705b0d400) 00010000:00010000:1.0:1787398006.924110:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787398006.924113:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787398006.924144:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62e00/0x274786fe0d19360a lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924168:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d19361f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398006.924175:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a705b0da00) 00010000:00010000:1.0:1787398006.924177:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398006.924179:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00010000:00000080:1.0:1787398006.924187:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a829b41c00 x1874218681334912/t81604378794(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:447/0 lens 520/584 e 0 to 0 dl 1787398017 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398006.924252:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:77747:x1874218681334912:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1128us (1589us total) trans 81604378794 rc 0/0 00000100:00100000:1.0:1787398006.924260:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1732 00010000:00010000:2.0:1787398007.656354:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398008.676807:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787398008.887946:0:103635:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787398008.888082:0:103635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.888098:0:103635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.888107:0:103635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.888115:0:103635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.888141:0:103635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787398008.888147:0:103635:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787398008.888185:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398008.888191:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787398008.888198:0:103635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787398008.888224:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787398008.888294:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398008.888301:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888310:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398008.888314:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888323:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398008.888331:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398008.888337:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787398008.888346:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787398008.888348:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787398008.888374:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888381:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398008.888403:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888411:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836583400/0x274786fe0d192f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fa4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888423:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398008.888425:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398008.888426:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398008.888470:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701266304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398008.888494:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701266176:0@lo:39:umount.0 00000100:00100000:3.0:1787398008.888556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398008.888608:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266176 00000100:00100000:3.0:1787398008.888616:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266176 00000100:00100000:3.0:1787398008.888661:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:3.0:1787398008.888669:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701266176:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787398008.888694:0:77740:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19301b 00000100:00080000:3.0:1787398008.888708:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a83670c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787398008.888718:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398008.888753:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398008.888764:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+1:3647:x1874218701266176:12345-0@lo:39:umount.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398008.888772:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000020:00000080:3.0:1787398008.888782:0:77740:0:(genops.c:906:class_export_put()) final put ffff89a83670e800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:2.0:1787398008.888811:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266304 00000100:00100000:2.0:1787398008.888815:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266304 00000100:00100000:2.0:1787398008.888855:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1787398008.888863:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701266304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398008.888873:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398008.888887:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836583600/0x274786fe0d192fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f9d expref: 24 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.888900:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1787398008.888947:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787398008.889079:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83670c000 for lustre-MDT0000 00000100:00100000:2.0:1787398008.889162:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701266304:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398008.889169:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1787398008.889205:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701266304:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787398008.889232:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787398008.889252:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701266176:0@lo:39:umount.0 00000100:00080000:1.0:1787398008.889297:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398008.889300:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787398008.889305:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787398008.893573:0:103635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893594:0:103635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893602:0:103635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893609:0:103635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893635:0:103635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398008.893643:0:103635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893650:0:103635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893677:0:103635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893684:0:103635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893696:0:103635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398008.893704:0:103635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893711:0:103635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893718:0:103635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893725:0:103635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893747:0:103635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787398008.893752:0:103635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893758:0:103635:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893763:0:103635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893763:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787398008.893771:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893780:0:103635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893780:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720bc00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787398008.893784:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.893791:0:103635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787398008.893795:0:103635:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787398008.893802:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398008.893809:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398008.893814:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787398008.893817:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1787398008.893819:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:01000004:1.0:1787398008.893839:0:103635:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787398008.893843:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1787398008.893847:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787398008.893852:0:103635:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:0.0:1787398008.893856:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893861:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398008.893892:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893899:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720bc00/0x274786fe0d192fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fc0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893909:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787398008.893912:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893917:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787398008.893920:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.893925:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398008.893941:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398008.893946:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787398008.893948:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787398008.893950:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787398008.893976:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894654:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398008.894666:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894674:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836582600/0x274786fe0d192fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894688:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398008.894692:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894697:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787398008.894700:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894707:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398008.894712:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398008.894730:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787398008.894733:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787398008.894735:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787398008.894755:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894759:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398008.894779:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894785:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee30200/0x274786fe0d192fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fdc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894793:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398008.894796:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894801:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31a00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:0.0:1787398008.894803:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894809:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398008.894814:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398008.894819:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787398008.894821:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787398008.894823:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787398008.894842:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894848:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398008.894854:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894860:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee31a00/0x274786fe0d192fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192fce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398008.894871:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398008.894873:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398008.894874:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398008.894900:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701266432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398008.895103:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701266560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398008.895180:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398008.895255:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701266688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398008.895279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398008.895294:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398008.895299:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701266816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398008.895318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398008.895563:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266432 00000100:00100000:3.0:1787398008.895571:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266432 00000100:00100000:3.0:1787398008.895628:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266688 00000100:00100000:3.0:1787398008.895632:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266688 00000100:00100000:3.0:1787398008.895651:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266816 00000100:00100000:3.0:1787398008.895654:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266816 00000100:00100000:3.0:1787398008.895676:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1787398008.895683:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+25:3650:x1874218701266432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398008.895696:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398008.895711:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31c00/0x274786fe0d192fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192fb9 expref: 25 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.895724:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398008.895762:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701266432:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398008.895769:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1787398008.895785:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1787398008.895790:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701266688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398008.895798:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398008.895806:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b600/0x274786fe0d192fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192fd5 expref: 23 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.895815:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398008.895838:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701266688:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398008.895845:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1787398008.895856:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1787398008.895861:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701266816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398008.895869:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398008.895876:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23600/0x274786fe0d192fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192fc7 expref: 21 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.895891:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398008.895912:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701266816:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398008.895918:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1787398008.895937:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398008.895974:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266560 00010000:00010000:2.0:1787398008.896618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398008.896627:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398008.896632:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398008.897075:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266560 00000100:00100000:3.0:1787398008.897177:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1787398008.897187:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+20:3651:x1874218701266560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398008.897200:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398008.897216:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a000/0x274786fe0d192fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192fab expref: 20 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.897227:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398008.897279:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701266560:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398008.897285:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1787398008.898318:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701266560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398008.898365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701266816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398008.898374:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701266688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398008.898464:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701266432:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1787398008.898854:0:103635:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1787398008.899507:0:75615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378794 is committed 00010000:00010000:2.0:1787398008.899575:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899588:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899595:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899601:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398008.899606:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899613:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899630:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a705b0d400) 00010000:00010000:2.0:1787398008.899634:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398008.899639:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398008.899645:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193618 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787398008.899886:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1787398008.899895:0:103635:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a7037c1800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398008.899900:0:103635:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a702023800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398008.899905:0:103635:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a817ece000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398008.899911:0:103635:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a829b1c800 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 7 (0 0 3) 0 0 0 0: 0000000000000000 81604378794 stale:0 00000020:00080000:0.0:1787398008.899916:0:103635:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff89a83549b380) has exports, disconnecting them 00000020:00080000:0.0:1787398008.899921:0:103635:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a7037c1800), last request at 1787397970 00000020:00000080:0.0:1787398008.899936:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ec4 00000100:00080000:0.0:1787398008.899945:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a837bc3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787398008.899986:0:103635:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7037c1800): rc 0 00000020:00000080:0.0:1787398008.899989:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a7037c1800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787398008.899995:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787398008.900005:0:103635:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a702023800), last request at 1787398006 00000020:00000080:3.0:1787398008.900293:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7037c1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787398008.900344:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bc3000 for lustre-MDT0001 00000020:00000080:0.0:1787398008.900410:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192674 00000100:00080000:0.0:1787398008.900416:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a702027800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787398008.900440:0:103635:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a702023800): rc 0 00000020:00000080:0.0:1787398008.900443:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a702023800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:2.0:1787398008.900470:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787398008.900484:0:103635:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a817ece000), last request at 1787398006 00000020:00000080:0.0:1787398008.900498:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1925cc 00000100:00080000:0.0:1787398008.900509:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a817ecc000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787398008.900549:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787398008.900568:0:103635:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817ece000): rc 0 00000020:00000080:0.0:1787398008.900570:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a817ece000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787398008.900921:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702023800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787398008.900978:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702027800 for lustre-MDT0001 00000020:00080000:0.0:1787398008.901111:0:103635:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.204.60@tcp (ffff89a829b1c800), last request at 1787398006 00000020:00000080:0.0:1787398008.901116:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d190a43 00000020:00010000:0.0:1787398008.901122:0:103635:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a829b1c800: total 1 00000100:00080000:0.0:1787398008.901124:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a829b1f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787398008.901175:0:103635:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a829b1c800): rc 0 00000020:00000080:2.0:1787398008.901182:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ece000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000004:00000080:0.0:1787398008.901182:0:103635:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadfe41fa3ae0 00000100:00080000:0.0:1787398008.901201:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787398008.901208:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051599 gen 4 00010000:00010000:0.0:1787398008.901334:0:103635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x274786fe0d193076 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398008.901346:0:103635:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x274786fe0d193076 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787398008.901398:0:103635:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787398008.901434:0:103635:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787398008.901445:0:103635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a704d22000/0x274786fe0d190de6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x274786fe0d193076 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1787398008.905023:0:56853:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a829b1c800: total 0 00010000:00010000:3.0:1787398008.905099:0:56853:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a829b1c800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1787398008.905144:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54c00/0x274786fe0d1935cb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87a0 expref: 4 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.905170:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62c00/0x274786fe0d19361f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 3 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.905188:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d23800/0x274786fe0d1935af lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8799 expref: 2 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398008.905203:0:56853:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a829b1c800, canceled 3 locks, left on hash table 0. 00000100:00080000:1.0:1787398008.907683:0:103635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:00000080:2.0:1787398008.907703:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecc000 for lustre-MDT0001 00000100:00080000:1.0:1787398008.907721:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787398008.907810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701266944:0@lo:39:umount.0 00000100:00100000:2.0:1787398008.907883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398008.908104:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787398008.908108:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 4 00000004:00080000:2.0:1787398008.908126:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787398008.908225:0:103635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787398008.908255:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787398008.908266:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787398008.908268:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968717 gen 4 00000004:00080000:2.0:1787398008.908274:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787398008.909078:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701267072:0@lo:9:umount.0 00000100:00100000:2.0:1787398008.909131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398008.909181:0:103635:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787398008.909213:0:103635:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787398008.909269:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a83549b380) has no exports 00000100:00100000:1.0:1787398008.909646:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267072 00000100:00100000:1.0:1787398008.909666:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267072 00000100:00100000:1.0:1787398008.909735:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787398008.909746:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701267072:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787398008.909774:0:100418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1925fd 00000100:00080000:1.0:1787398008.909783:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787398008.909824:0:100418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901910 00000100:00100000:1.0:1787398008.909951:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701267072:12345-0@lo:9:umount.0 Request processed in 207us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398008.909969:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1787398008.910238:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398008.910302:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701267200:0@lo:9:umount.0 00000100:00100000:0.0:1787398008.910337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787398008.910382:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83670c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787398008.910392:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787398008.910394:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787398008.910397:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701267072:0@lo:9:umount.0 00000100:00100000:1.0:1787398008.910450:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267200 00000100:00100000:1.0:1787398008.910454:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267200 00000100:00100000:1.0:1787398008.910487:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787398008.910507:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701267200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787398008.910551:0:99641:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1926ba 00000100:00080000:1.0:1787398008.910558:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a702325800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787398008.910679:0:99641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1787398008.911725:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701267200:12345-0@lo:9:umount.0 Request processed in 1215us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398008.911736:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1787398008.911778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398008.914672:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398008.914684:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787398008.915076:0:103635:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 26, last_idx 28 00000040:00080000:2.0:1787398008.915114:0:103635:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 27, last_idx 28 00000020:00080000:2.0:1787398008.915640:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a83549b380) has no exports 00000100:00080000:0.0:1787398008.916138:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a837bc5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787398008.916195:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1787398008.919602:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701266944 00000100:00100000:1.0:1787398008.919619:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701266944 00000100:00100000:1.0:1787398008.919687:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787398008.919696:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1874218701266944:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787398008.919732:0:66188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e7e 00000020:00010000:1.0:1787398008.919744:0:66188:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7090fb000: total 0 00000100:00080000:1.0:1787398008.919748:0:66188:0:(import.c:65:import_set_state_nolock()) ffff89a70378c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787398008.919770:0:66188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051602 00000100:00100000:1.0:1787398008.919941:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701266944:12345-0@lo:39:umount.0 Request processed in 245us (12057us total) trans 124554051603 rc 0/0 00000100:00100000:1.0:1787398008.919949:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000020:00010000:1.0:1787398008.919990:0:56852:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7090fb000: total 0 00010000:00010000:1.0:1787398008.920162:0:56852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7090fb000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787398008.920202:0:56852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:1.0:1787398008.920206:0:56852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787398008.920214:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82ee31200/0x274786fe0d193076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d190de6 expref: 4 pid: 102348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398008.920236:0:56852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7090fb000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787398008.920247:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398008.920264:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398008.920266:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787398008.920361:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787398008.920370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701267200:0@lo:9:umount.0 00000100:00080000:0.0:1787398008.920403:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787398008.920409:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701266944:0@lo:39:umount.0 00000020:00000080:3.0:1787398008.936372:0:56853:0:(genops.c:906:class_export_put()) final put ffff89a829b1c800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00010000:00010000:3.0:1787398008.936423:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398008.936426:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398008.936429:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787398008.937887:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1c800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0001 00000020:00000080:1.0:1787398008.937970:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1f800 for lustre-MDT0001 00000020:01000000:0.0:1787398008.984277:0:103635:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a830cc7780 - data ffff89a83fd3ce58/ffff89a813327c00 00000020:01000000:0.0:1787398008.984469:0:103635:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a835a58a20 - data ffff89a83ff6c288/ffff89a8366c5400 00000100:00080000:0.0:1787398009.043725:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787398009.043734:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051599 gen 5 00000100:00100000:0.0:1787398009.043749:0:103635:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a82f4a9180 x1874218701266944/t124554051603(124554051603) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398018 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398009.043781:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787398009.048034:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787398009.048042:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 5 00000004:00080000:0.0:1787398009.048062:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787398009.048065:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787398009.049056:0:75624:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787398009.049063:0:75624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4c:0x0] index 2 count 1 00000040:00080000:1.0:1787398009.049079:0:75624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 19 count 2 00000100:00080000:0.0:1787398009.049656:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787398009.049661:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968717 gen 5 00000004:00080000:0.0:1787398009.049671:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787398009.049673:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787398009.049996:0:75626:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787398009.050001:0:75626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4e:0x0] index 1 count 1 00000040:00080000:2.0:1787398009.050012:0:75626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 19 count 2 00000020:00000080:0.0:1787398009.052947:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b268 00000020:00000080:0.0:1787398009.052969:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a83563b800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787398009.054693:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b27d 00000020:00000080:2.0:1787398009.054706:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a835660000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.054755:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83563b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787398009.055833:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787398009.055843:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398009.055865:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787398009.055870:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff89a835498000) has no exports 00000020:00000080:1.0:1787398009.056069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835660000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1787398009.056509:0:103635:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787398009.056548:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2e6 00000020:00000080:2.0:1787398009.056559:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a8364ee000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787398009.056570:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787398009.056576:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398009.056583:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787398009.056586:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff89a7069219c0) has no exports 00000020:00000080:2.0:1787398009.056596:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2df 00000020:00000080:2.0:1787398009.056599:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a837bc6800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1787398009.056952:0:103635:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787398009.056968:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787398009.056972:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968717 gen 6 00000020:00000080:1.0:1787398009.057187:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364ee000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787398009.057197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000004:00080000:2.0:1787398009.057231:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787398009.057234:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787398009.057314:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398009.057322:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787398009.057331:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2ca 00000020:00000080:2.0:1787398009.057336:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a706ff2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.058073:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a837bc5000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787398009.058084:0:8:0:(genops.c:906:class_export_put()) final put ffff89a706ff5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.058087:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787398009.058094:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787398009.058322:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787398009.058329:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398009.058337:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787398009.058340:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff89a7024799c0) has no exports 00000020:00000080:2.0:1787398009.058347:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2bc 00000020:00000080:2.0:1787398009.058352:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a83670f800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787398009.059076:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787398009.059085:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83670f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787398009.059109:0:103635:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787398009.059113:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787398009.059117:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968731 gen 6 00000004:00080000:2.0:1787398009.059122:0:103635:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787398009.059125:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787398009.059232:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398009.059249:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787398009.059267:0:103635:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787398009.059273:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2ae 00000020:00000080:2.0:1787398009.059279:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a706ff7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.059328:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83670c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787398009.059335:0:8:0:(genops.c:906:class_export_put()) final put ffff89a830a0e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.059337:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a830a0e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787398009.059341:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787398009.059724:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:2.0:1787398009.059730:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398009.059734:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787398009.059738:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff89a82e4fb380) has no exports 00000020:00000080:2.0:1787398009.059744:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b2a7 00000020:00000080:2.0:1787398009.059748:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a803ee3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787398009.059769:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787398009.059831:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803ee3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787398009.070709:0:103635:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787398009.070719:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787398009.070723:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051599 gen 6 00000100:00100000:0.0:1787398009.070731:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787398009.070788:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398009.070801:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398009.070907:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83563e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787398009.070920:0:8:0:(genops.c:906:class_export_put()) final put ffff89a706ff2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398009.070923:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706ff2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787398009.070948:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398009.070952:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398009.070963:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a80623a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787398009.070965:0:103635:0:(genops.c:865:class_export_destroy()) destroying export ffff89a80623a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787398009.071036:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787398009.071121:0:103635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398009.071192:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b284 00000020:00000080:0.0:1787398009.071198:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a835664000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787398009.071208:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787398009.071211:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398009.071216:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787398009.071220:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff89a8354999c0) has no exports 00000020:00000080:0.0:1787398009.071238:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398009.071241:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787398009.071245:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b28b 00000020:00000080:0.0:1787398009.071249:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a835661000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787398009.071256:0:103635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a835594800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787398009.071259:0:103635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a835594800 2 00000020:01000004:0.0:1787398009.071262:0:103635:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a835594800 from lustre-MDT0001 00000020:00000080:0.0:1787398009.071283:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398009.071287:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787398009.071296:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a83563f800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787398009.071299:0:103635:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83563f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787398009.071306:0:103635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:1.0:1787398009.071345:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835664000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787398009.071348:0:8:0:(genops.c:906:class_export_put()) final put ffff89a7025d5000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787398009.071352:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787398009.071355:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787398009.071381:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835661000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:0.0:1787398009.071635:0:103635:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1787398009.071707:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787398009.071715:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398009.071740:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787398009.071746:0:103635:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff89a837bb7800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398009.071752:0:103635:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff89a703f5cd40) has exports, disconnecting them 00000020:00080000:0.0:1787398009.071756:0:103635:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff89a837bb7800), last request at 1787396912 00000020:00000080:0.0:1787398009.071760:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b325 00000020:00080000:0.0:1787398009.071793:0:103635:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a837bb7800): rc 0 00000020:00000080:0.0:1787398009.071797:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a837bb7800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787398009.074254:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb7800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787398009.074802:0:103635:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787398009.074808:0:103635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398009.074812:0:103635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787398009.074818:0:103635:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398009.074844:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7054c2800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787398009.074998:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398009.075009:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787398009.075014:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a837bb3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787398009.075018:0:103635:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bb3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787398009.075026:0:103635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787398009.075115:0:103635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a835594800 1 00000020:00000080:1.0:1787398009.075121:0:103635:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d18b23e 00000020:00000080:1.0:1787398009.075127:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a705067000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787398009.075136:0:103635:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787398009.075145:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a705067000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787398009.075153:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398009.075158:0:103635:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787398009.075162:0:103635:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff89a7033a0000) has no exports 00000020:00000080:0.0:1787398009.180857:0:103635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398009.180871:0:103635:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787398009.180878:0:103635:0:(genops.c:906:class_export_put()) final put ffff89a81ab4e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787398009.180883:0:103635:0:(genops.c:865:class_export_destroy()) destroying export ffff89a81ab4e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787398009.180898:0:103635:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787398009.181136:0:103635:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a81103c800 00000020:02000400:0.0:1787398009.181203:0:103635:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787398009.701775:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398010.732221:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398011.364968:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701267456:0@lo:400:kworker.0 00000100:00100000:0.0:1787398011.365044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398011.365089:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701267968:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.365138:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267456 00000100:00100000:1.0:1787398011.365147:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267456 00000100:00100000:0.0:1787398011.365173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398011.365200:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787398011.365206:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701267328:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.365220:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:1.0:1787398011.365231:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701267456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398011.365236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398011.365260:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701267840:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.365278:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701267456:12345-0@lo:400:kworker.0 Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.365291:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1787398011.365292:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.365309:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267840 00000100:00100000:1.0:1787398011.365312:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267840 00000100:00100000:1.0:1787398011.365329:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1787398011.365333:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1874218701267840:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787398011.365340:0:67264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787398011.365370:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1874218701267840:12345-0@lo:400:kworker.0 Request processed in 35us (76us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787398011.365377:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1787398011.365399:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267968 00000100:00100000:1.0:1787398011.365403:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267968 00000100:00100000:1.0:1787398011.365613:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787398011.365619:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1874218701267968:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787398011.365625:0:66188:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787398011.365658:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1874218701267968:12345-0@lo:400:kworker.0 Request processed in 38us (483us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787398011.365664:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787398011.365714:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701267712:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.365853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.365875:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268224:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.365900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.366047:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787398011.366055:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701267584:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.366080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.366097:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268096:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.366116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.366159:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268224 00000100:00100000:1.0:1787398011.366164:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268224 00000100:00100000:1.0:1787398011.366512:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268096 00000100:00100000:1.0:1787398011.366518:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268096 00000100:00100000:1.0:1787398011.366581:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787398011.366589:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.366636:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268224:12345-0@lo:400:kworker.0 Request processed in 49us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.366643:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787398011.366659:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787398011.366665:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787398011.366690:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787398011.366691:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268096:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.366696:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787398011.366697:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787398011.366701:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787398011.366706:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398011.366710:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3792 00000100:00080000:0.0:1787398011.366716:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398011.366744:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8047c9c00 x1874218701268480/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398011.366766:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701267840:0@lo:400:kworker.0 00000100:00100000:0.0:1787398011.366774:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701268352:0@lo:400:kworker.0 00000100:00100000:0.0:1787398011.366800:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398011.366837:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701267456:0@lo:400:kworker.0 00000100:00080000:0.0:1787398011.366848:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787398011.366851:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787398011.366854:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787398011.366858:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398011.366861:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787398011.366865:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398011.366878:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8047c9500 x1874218701268608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398011.366888:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701267968:0@lo:400:kworker.0 00000100:00080000:2.0:1787398011.367228:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398011.367234:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398011.367237:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398011.367249:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267712 00000100:00100000:2.0:1787398011.367253:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267712 00000100:00100000:2.0:1787398011.367293:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267584 00000100:00100000:2.0:1787398011.367296:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267584 00000100:00100000:2.0:1787398011.367307:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268352 00000100:00100000:2.0:1787398011.367309:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268352 00000100:00100000:2.0:1787398011.367322:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:2.0:1787398011.367328:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701267712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398011.367366:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701267712:12345-0@lo:400:kworker.0 Request processed in 38us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398011.367372:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:2.0:1787398011.367386:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:2.0:1787398011.367392:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701268352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398011.367418:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701268352:12345-0@lo:400:kworker.0 Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398011.367434:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:2.0:1787398011.367448:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:2.0:1787398011.367452:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1874218701267584:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787398011.367458:0:66176:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787398011.367483:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1874218701267584:12345-0@lo:400:kworker.0 Request processed in 29us (1402us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787398011.367489:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00080000:2.0:1787398011.367509:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398011.367831:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787398011.367835:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787398011.367838:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787398011.367842:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398011.367845:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3776 00000100:00080000:1.0:1787398011.367851:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398011.367870:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702189880 x1874218701268736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398011.367881:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701267584:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.367895:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268096:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.368497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701267712:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.368654:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268224:0@lo:400:kworker.0 00000100:00100000:0.0:1787398011.369057:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701268480:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787398011.369120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398011.369213:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701268608:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787398011.369239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.369269:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701267328 00000100:00100000:0.0:1787398011.369271:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701268736:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787398011.369275:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701267328 00000100:00100000:0.0:1787398011.369291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398011.369323:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787398011.369331:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701267328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398011.369332:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268608 00000100:00100000:3.0:1787398011.369336:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268608 00000100:00100000:3.0:1787398011.369359:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787398011.369364:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701268608:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787398011.369373:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701267328:12345-0@lo:400:kworker.0 Request processed in 43us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.369379:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00020000:3.0:1787398011.369384:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398011.369413:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701268608:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 48us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398011.369419:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787398011.369843:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398011.369850:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398011.369853:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701268608:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787398011.369981:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701267328:0@lo:400:kworker.0 00000100:00100000:1.0:1787398011.369996:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701268352:0@lo:400:kworker.0 00000100:00100000:2.0:1787398011.372802:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268480 00000100:00100000:2.0:1787398011.372817:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268480 00000100:00100000:2.0:1787398011.372893:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268736 00000100:00100000:2.0:1787398011.372897:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268736 00000100:00100000:2.0:1787398011.372989:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1787398011.373000:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701268480:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1787398011.373029:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398011.373115:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701268480:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 116us (3994us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398011.373123:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1787398011.373140:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1787398011.373144:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701268736:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787398011.373154:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398011.373177:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701268736:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32us (3885us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398011.373184:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00080000:1.0:1787398011.374327:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398011.374339:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398011.374344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701268480:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1787398011.374359:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398011.374363:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398011.374365:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701268736:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787398011.661984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398011.662033:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398011.662069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398011.662095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398011.662120:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335296 00000100:00100000:0.0:1787398011.662131:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335296 00000100:00100000:3.0:1787398011.662152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398011.662175:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335168 00000100:00100000:0.0:1787398011.662179:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335168 00000100:00100000:3.0:1787398011.662181:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335552 00000100:00100000:3.0:1787398011.662187:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335552 00000100:00100000:3.0:1787398011.662227:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335424 00000100:00100000:3.0:1787398011.662229:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335424 00000100:00100000:0.0:1787398011.662248:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1707 00000100:00100000:3.0:1787398011.662255:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:0.0:1787398011.662262:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681335168:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398011.662269:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681335552:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398011.662341:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681335552:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398011.662349:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:3.0:1787398011.662368:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:3.0:1787398011.662374:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681335424:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398011.662411:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1738 00000100:00100000:1.0:1787398011.662418:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1874218681335296:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:1.0:1787398011.662425:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:2.0:1787398011.663168:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335040 00000100:00100000:2.0:1787398011.663178:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335040 00000100:00100000:2.0:1787398011.663236:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:2.0:1787398011.663244:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681335040:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398011.664884:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681335168:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 2617us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398011.664900:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1707 00000100:00080000:0.0:1787398011.666128:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398011.666137:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398011.666141:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398011.676207:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681335424:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 13818us (14040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398011.676223:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:1.0:1787398011.677641:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1874218681335296:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 15212us (15597us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787398011.677655:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1738 00000100:00100000:0.0:1787398011.683030:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398011.683117:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335680 00000100:00100000:3.0:1787398011.683127:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335680 00000100:00100000:3.0:1787398011.683183:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1739 00000100:00100000:3.0:1787398011.683190:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681335680:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1787398011.683216:0:67264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398011.683300:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1874218681335680:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 Request processed in 109us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398011.683308:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1739 00000100:00100000:0.0:1787398011.685377:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681335040:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22114us (23384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398011.685392:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00010000:00010000:1.0:1787398011.748945:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398011.877155:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398011.877184:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701268864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398011.877377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398011.877651:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268864 00000100:00100000:2.0:1787398011.877660:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268864 00000100:00100000:1.0:1787398011.877696:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398011.877708:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398011.877721:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787398011.877733:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701268864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398011.877745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787398011.877768:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398011.877797:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701268992 00000100:00100000:1.0:1787398011.877804:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701268992 00000100:00100000:2.0:1787398011.877830:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701268864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.877832:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787398011.877845:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787398011.877845:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398011.877868:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398011.877928:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701268864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398011.877934:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701268992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398011.877943:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787398011.877986:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701268992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787398012.773618:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787398012.902193:0:102316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787398012.902210:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051603 is committed 00000020:00000080:1.0:1787398012.902216:0:102316:0:(genops.c:906:class_export_put()) final put ffff89a7090fb000/lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787398012.902256:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051602 is committed 00010000:00010000:0.0:1787398012.902331:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902343:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 2/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902351:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902357:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398012.902362:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902370:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 4/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902387:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0xcd52553e (ffff89a82df32400) 00010000:00010000:0.0:1787398012.902390:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398012.902395:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 2/0,0 mode: --/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398012.902401:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23e00/0x274786fe0d1935fc lrc: 0/0,0 mode: --/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787398012.902481:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787398012.902691:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70378c000 for lustre-MDT0000 00010000:00010000:3.0:1787398013.796668:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787398014.438603:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398014.438612:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a702324800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787398014.438707:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702324800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787398014.438763:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702325800 for lustre-OST0001 00000001:00100000:3.0:1787398014.447823:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398014.447835:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a817ec9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787398014.449187:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ec9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787398014.449267:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecb800 for lustre-OST0000 00010000:00010000:2.0:1787398014.820784:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398015.847761:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787398016.484897:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398016.484906:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398016.484928:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398016.484938:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3890 00000100:00080000:0.0:1787398016.484945:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787398016.484954:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398016.484988:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828410000 x1874218701269376/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398016.485015:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398016.485018:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398016.485020:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398016.485024:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3890 00000100:00080000:0.0:1787398016.485027:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787398016.485030:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398016.485044:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984bb80 x1874218701269632/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398016.485052:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398016.485055:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398016.485056:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398016.485060:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3890 00000100:00080000:0.0:1787398016.485062:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787398016.485066:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398016.485076:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82984b480 x1874218701269760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398016.485132:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701269504:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398016.485283:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787398016.485289:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701269248:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398016.485325:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701270144:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398016.485391:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269504 00000100:00100000:0.0:1787398016.485400:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269504 00000100:00100000:0.0:1787398016.485627:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269248 00000100:00100000:0.0:1787398016.485631:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269248 00000100:00100000:0.0:1787398016.485653:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270144 00000100:00100000:0.0:1787398016.485656:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270144 00000100:00100000:0.0:1787398016.485680:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:0.0:1787398016.485690:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701269504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485754:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701269504:12345-0@lo:400:kworker.0 Request processed in 65us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398016.485763:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:0.0:1787398016.485783:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:0.0:1787398016.485790:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701269248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485832:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701269248:12345-0@lo:400:kworker.0 Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398016.485839:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:0.0:1787398016.485852:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:0.0:1787398016.485858:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701270144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485887:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701270144:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398016.485893:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00080000:0.0:1787398016.485922:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398016.485982:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701269248:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.485995:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701270144:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.486006:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701269504:0@lo:400:kworker.0 00000100:00100000:2.0:1787398016.486132:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701269888:0@lo:400:kworker.0 00000100:00100000:2.0:1787398016.486176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398016.486214:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787398016.486222:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701269120:0@lo:400:kworker.0 00000100:00100000:2.0:1787398016.486253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398016.486279:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701270016:0@lo:400:kworker.0 00000100:00100000:2.0:1787398016.486301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398016.486772:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701269376:0@lo:38:kworker.0 00000100:00100000:1.0:1787398016.486828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398016.486859:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701269632:0@lo:38:kworker.0 00000100:00100000:1.0:1787398016.486883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398016.486908:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701269760:0@lo:38:kworker.0 00000100:00100000:1.0:1787398016.486937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398016.486971:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269376 00000100:00100000:1.0:1787398016.486977:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269376 00000100:00100000:1.0:1787398016.487006:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269632 00000100:00100000:1.0:1787398016.487007:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269632 00000100:00100000:1.0:1787398016.487037:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:1.0:1787398016.487044:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701269376:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398016.487069:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398016.487109:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701269376:12345-0@lo:38:kworker.0 Request processed in 64us (280us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398016.487116:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:1.0:1787398016.487137:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:1.0:1787398016.487140:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701269632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398016.487148:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398016.487172:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701269632:12345-0@lo:38:kworker.0 Request processed in 30us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398016.487177:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:1.0:1787398016.487197:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269120 00000100:00100000:1.0:1787398016.487200:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269120 00000100:00100000:1.0:1787398016.487230:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787398016.487236:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701269120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398016.487277:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701269120:12345-0@lo:400:kworker.0 Request processed in 40us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398016.487283:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787398016.487316:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269888 00000100:00100000:1.0:1787398016.487320:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269888 00000100:00100000:1.0:1787398016.487353:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270016 00000100:00100000:1.0:1787398016.487357:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270016 00000100:00100000:3.0:1787398016.487593:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701269760 00000100:00100000:3.0:1787398016.487598:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701269760 00000100:00100000:3.0:1787398016.487624:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787398016.487642:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1874218701269760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787398016.487652:0:66189:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398016.487687:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1874218701269760:12345-0@lo:38:kworker.0 Request processed in 45us (749us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398016.487692:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787398016.487743:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398016.487749:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398016.487752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701269376:0@lo:38:kworker.0 00000100:00080000:3.0:1787398016.487764:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398016.487767:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398016.487770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701269632:0@lo:38:kworker.0 00000100:00080000:3.0:1787398016.487779:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398016.487782:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398016.487785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701269760:0@lo:38:kworker.0 00000100:00100000:3.0:1787398016.487858:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701269120:0@lo:400:kworker.0 00000100:00080000:3.0:1787398016.487886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398016.487890:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398016.487910:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787398016.487920:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701269888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398016.487963:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701269888:12345-0@lo:400:kworker.0 Request processed in 46us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398016.487980:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787398016.487995:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787398016.488002:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701270016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398016.488035:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701270016:12345-0@lo:400:kworker.0 Request processed in 34us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398016.488041:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787398016.488071:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701270016:0@lo:400:kworker.0 00000100:00100000:3.0:1787398016.488083:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701269888:0@lo:400:kworker.0 00000100:00100000:0.0:1787398016.773920:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398016.773977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398016.774016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398016.774047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398016.774071:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398016.774164:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336320 00000100:00100000:1.0:1787398016.774178:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336320 00000100:00100000:1.0:1787398016.774264:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336192 00000100:00100000:1.0:1787398016.774268:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336192 00000100:00100000:1.0:1787398016.774296:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:1.0:1787398016.774326:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681336320:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398016.774445:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681336320:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 122us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398016.774454:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 88 00000100:00100000:1.0:1787398016.774479:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:1.0:1787398016.774486:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681336192:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398016.774580:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681336192:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 94us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398016.774587:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:1.0:1787398016.774620:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335936 00000100:00100000:1.0:1787398016.774625:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335936 00000100:00100000:1.0:1787398016.774852:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336064 00000100:00100000:1.0:1787398016.774857:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336064 00000100:00100000:1.0:1787398016.774876:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1711 00000100:00100000:1.0:1787398016.774884:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681335936:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398016.774921:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681335936:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 38us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398016.774928:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1711 00000100:00100000:1.0:1787398016.774942:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1742 00000100:00100000:1.0:1787398016.774947:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681336064:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787398016.774975:0:74374:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398016.775008:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681336064:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 59us (935us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398016.775015:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1742 00000100:00100000:2.0:1787398016.775452:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681335808 00000100:00100000:2.0:1787398016.775459:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681335808 00000100:00100000:2.0:1787398016.775565:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:2.0:1787398016.775574:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681335808:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398016.775614:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681335808:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398016.775621:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00080000:0.0:1787398016.776215:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398016.776223:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398016.776226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787398016.868782:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398016.996962:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398016.997073:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398016.997362:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270272 00000100:00100000:2.0:1787398016.997374:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270272 00000100:00100000:2.0:1787398016.997467:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787398016.997480:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701270272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787398016.997548:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398016.997618:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701270272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398016.997627:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787398016.997788:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701270272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398016.998126:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701270400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398016.998174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398016.998260:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270400 00000100:00100000:0.0:1787398016.998267:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270400 00000100:00100000:0.0:1787398016.998310:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787398016.998318:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701270400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398016.998341:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398016.998391:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701270400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398016.998398:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787398016.998721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701270400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787398017.893426:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398018.916745:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398019.943290:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398020.964790:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398021.607434:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701270528:0@lo:400:kworker.0 00000100:00100000:3.0:1787398021.607516:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398021.607779:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398021.607784:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398021.607788:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398021.607793:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3895 00000100:00080000:2.0:1787398021.607798:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398021.607805:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398021.607828:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702189f80 x1874218701270784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398021.607852:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398021.607855:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398021.607868:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398021.607873:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3895 00000100:00080000:2.0:1787398021.607875:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398021.607880:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398021.607893:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705479f80 x1874218701271040/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398021.607902:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398021.607906:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398021.607907:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398021.607911:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3895 00000100:00080000:2.0:1787398021.607914:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398021.607918:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398021.607928:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705478a80 x1874218701271168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398021.608019:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270528 00000100:00100000:0.0:1787398021.608027:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270528 00000100:00100000:0.0:1787398021.608098:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787398021.608107:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701270528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701271296:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398021.609198:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398021.609204:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701271424:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398021.609255:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701270912:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398021.609301:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787398021.609307:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701270656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398021.609346:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701271552:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398021.609404:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270912 00000100:00100000:2.0:1787398021.609409:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270912 00000100:00100000:2.0:1787398021.609452:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270656 00000100:00100000:2.0:1787398021.609455:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270656 00000100:00100000:2.0:1787398021.609474:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271552 00000100:00100000:2.0:1787398021.609476:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271552 00000100:00100000:2.0:1787398021.609496:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:2.0:1787398021.609505:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701270912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609574:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701270912:12345-0@lo:400:kworker.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398021.609582:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:2.0:1787398021.609598:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:2.0:1787398021.609605:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701270656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609632:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701270656:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398021.609638:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:2.0:1787398021.609649:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:2.0:1787398021.609656:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701271552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609697:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701271552:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398021.609703:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00080000:2.0:1787398021.609734:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398021.609773:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701270656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609786:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701271552:0@lo:400:kworker.0 00000100:00100000:2.0:1787398021.609795:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701270912:0@lo:400:kworker.0 00000100:00100000:1.0:1787398021.610232:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271296 00000100:00100000:1.0:1787398021.610238:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271296 00000100:00100000:1.0:1787398021.610284:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271424 00000100:00100000:1.0:1787398021.610288:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271424 00000100:00100000:1.0:1787398021.610307:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787398021.610316:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701271296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398021.610362:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701271296:12345-0@lo:400:kworker.0 Request processed in 48us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398021.610368:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787398021.610381:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787398021.610388:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701271424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398021.610414:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701271424:12345-0@lo:400:kworker.0 Request processed in 27us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398021.610420:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787398021.610465:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701271424:0@lo:400:kworker.0 00000100:00100000:1.0:1787398021.610476:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701271296:0@lo:400:kworker.0 00000100:00080000:2.0:1787398021.610546:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398021.610550:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398021.610624:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701270784:0@lo:38:kworker.0 00000100:00100000:1.0:1787398021.610656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398021.610698:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701271040:0@lo:38:kworker.0 00000100:00100000:1.0:1787398021.610731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398021.610748:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701271168:0@lo:38:kworker.0 00000100:00100000:1.0:1787398021.610771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398021.610817:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701270784 00000100:00100000:1.0:1787398021.610821:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701270784 00000100:00100000:1.0:1787398021.610842:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271040 00000100:00100000:1.0:1787398021.610846:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271040 00000100:00100000:1.0:1787398021.610862:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1787398021.610867:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701270784:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398021.610888:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398021.610923:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701270784:12345-0@lo:38:kworker.0 Request processed in 54us (265us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398021.610929:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1787398021.610941:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1787398021.610945:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701271040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398021.610955:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398021.610978:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701271040:12345-0@lo:38:kworker.0 Request processed in 31us (246us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398021.610984:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1787398021.611000:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271168 00000100:00100000:1.0:1787398021.611003:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271168 00000100:00100000:1.0:1787398021.611023:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787398021.611027:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701271168:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398021.611037:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398021.611061:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701271168:12345-0@lo:38:kworker.0 Request processed in 32us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398021.611067:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787398021.611508:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398021.611515:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398021.611518:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701270784:0@lo:38:kworker.0 00000100:00080000:1.0:1787398021.611566:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398021.611570:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398021.611573:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701271040:0@lo:38:kworker.0 00000100:00080000:1.0:1787398021.611580:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398021.611583:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398021.611586:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701271168:0@lo:38:kworker.0 00000100:00100000:0.0:1787398021.611975:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701270528:12345-0@lo:400:kworker.0 Request processed in 3867us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398021.611986:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787398021.615430:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701270528:0@lo:400:kworker.0 00000100:00100000:3.0:1787398021.899159:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398021.899215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398021.899322:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336576 00000100:00100000:0.0:1787398021.899344:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336576 00000100:00080000:1.0:1787398021.899420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398021.899431:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1715 00000100:00100000:0.0:1787398021.899442:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681336576:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398021.899564:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681336576:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398021.899572:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1715 00000100:00100000:2.0:1787398021.899752:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336448 00000100:00100000:2.0:1787398021.899758:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336448 00000100:00100000:2.0:1787398021.899803:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:2.0:1787398021.899811:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681336448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398021.899868:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681336448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 58us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398021.899874:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:0.0:1787398021.905375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398021.905417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398021.905447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398021.905517:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336832 00000100:00100000:3.0:1787398021.905564:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336832 00000100:00100000:3.0:1787398021.905621:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336960 00000100:00100000:3.0:1787398021.905624:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336960 00000100:00100000:3.0:1787398021.905650:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787398021.905659:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681336832:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787398021.905687:0:100418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193298 00000100:00080000:3.0:1787398021.905696:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a817efb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398021.905766:0:100418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901910 00000100:00100000:3.0:1787398021.905937:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681336832:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 277us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398021.905946:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 71 00000100:00100000:3.0:1787398021.905963:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 72 00000100:00100000:3.0:1787398021.905970:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681336960:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787398021.905982:0:100418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19329f 00000100:00080000:3.0:1787398021.905987:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a817efe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398021.906011:0:100418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787398021.906079:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681336960:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 108us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398021.906085:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 72 00010000:00010000:3.0:1787398021.906110:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398021.906116:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398021.906343:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681336704 00000100:00100000:1.0:1787398021.906348:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681336704 00000100:00100000:1.0:1787398021.906378:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1745 00000100:00100000:1.0:1787398021.906384:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681336704:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787398021.906403:0:66178:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398021.906438:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681336704:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 53us (1073us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398021.906444:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1745 00000100:00080000:0.0:1787398021.906993:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398021.906999:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787398021.990755:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398022.117695:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398022.117729:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701271808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398022.117802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398022.117864:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271808 00000100:00100000:1.0:1787398022.117871:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271808 00000100:00100000:1.0:1787398022.117919:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787398022.117928:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701271808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398022.117957:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398022.117999:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701271808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398022.118025:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787398022.118073:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701271808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398022.118289:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701271680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398022.118323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398022.118404:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271680 00000100:00100000:0.0:1787398022.118409:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271680 00000100:00100000:0.0:1787398022.118444:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787398022.118452:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701271680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398022.118468:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398022.118511:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701271680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398022.118517:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787398022.118756:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701271680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787398023.018274:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398024.038084:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398025.060706:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398026.085810:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398026.724719:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398026.724727:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398026.724731:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398026.724738:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3900 00000100:00080000:2.0:1787398026.724744:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398026.724752:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398026.724777:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83fa12a00 x1874218701272192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398026.724806:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398026.724809:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398026.724811:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398026.724814:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3900 00000100:00080000:2.0:1787398026.724825:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398026.724830:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398026.724848:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828cf8380 x1874218701272448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398026.724858:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398026.724862:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398026.724864:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398026.724868:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3900 00000100:00080000:2.0:1787398026.724870:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398026.724875:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398026.724889:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a828cfad80 x1874218701272576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398026.724963:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701271936:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398026.725086:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701271936 00000100:00100000:1.0:1787398026.725094:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701271936 00000100:00100000:2.0:1787398026.725096:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701272832:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398026.725151:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787398026.725162:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725163:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398026.725172:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701272704:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398026.725232:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701271936:12345-0@lo:400:kworker.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398026.725240:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787398026.725249:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701272064:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725305:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701272960:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725324:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725341:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398026.725354:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701272320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701272192:0@lo:38:kworker.0 00000100:00100000:2.0:1787398026.725425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725440:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701272448:0@lo:38:kworker.0 00000100:00100000:2.0:1787398026.725460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701272576:0@lo:38:kworker.0 00000100:00100000:2.0:1787398026.725501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398026.725551:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272832 00000100:00100000:2.0:1787398026.725556:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272832 00000100:00100000:2.0:1787398026.725594:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272704 00000100:00100000:2.0:1787398026.725598:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272704 00000100:00100000:2.0:1787398026.725634:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787398026.725643:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701272832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725678:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701272832:12345-0@lo:400:kworker.0 Request processed in 37us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398026.725685:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787398026.725698:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787398026.725705:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701272704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725732:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701272704:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398026.725738:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787398026.725762:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272064 00000100:00100000:2.0:1787398026.725766:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272064 00000100:00100000:2.0:1787398026.725794:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272960 00000100:00100000:2.0:1787398026.725797:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272960 00000100:00100000:2.0:1787398026.725809:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272320 00000100:00100000:2.0:1787398026.725819:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272320 00000100:00100000:2.0:1787398026.725836:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272192 00000100:00100000:2.0:1787398026.725839:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272192 00000100:00100000:2.0:1787398026.725849:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272448 00000100:00100000:2.0:1787398026.725851:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272448 00000100:00100000:2.0:1787398026.725862:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1787398026.725868:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701272064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725908:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701272064:12345-0@lo:400:kworker.0 Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398026.725914:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1787398026.725926:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:2.0:1787398026.725932:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701272960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.725959:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701272960:12345-0@lo:400:kworker.0 Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398026.725965:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:2.0:1787398026.725976:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:2.0:1787398026.725983:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701272320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726012:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701272320:12345-0@lo:400:kworker.0 Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398026.726017:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:2.0:1787398026.726029:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1787398026.726033:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701272192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787398026.726052:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398026.726081:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701272192:12345-0@lo:38:kworker.0 Request processed in 47us (655us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398026.726087:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1787398026.726110:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:2.0:1787398026.726115:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701272448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787398026.726124:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398026.726148:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701272448:12345-0@lo:38:kworker.0 Request processed in 32us (688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398026.726155:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:2.0:1787398026.726185:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701272576 00000100:00100000:2.0:1787398026.726189:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701272576 00000100:00100000:2.0:1787398026.726211:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787398026.726216:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701272576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787398026.726225:0:66188:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398026.726247:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701272576:12345-0@lo:38:kworker.0 Request processed in 30us (745us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398026.726252:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787398026.726264:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398026.726269:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398026.726272:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398026.726309:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398026.726315:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398026.726319:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701272192:0@lo:38:kworker.0 00000100:00080000:2.0:1787398026.726330:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398026.726334:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398026.726337:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701272448:0@lo:38:kworker.0 00000100:00080000:2.0:1787398026.726347:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398026.726350:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398026.726353:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701272576:0@lo:38:kworker.0 00000100:00100000:2.0:1787398026.726404:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701272320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726415:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701272064:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726425:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701272960:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726452:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701272704:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701271936:0@lo:400:kworker.0 00000100:00100000:2.0:1787398026.726472:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701272832:0@lo:400:kworker.0 00000100:00100000:1.0:1787398027.020416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398027.020468:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398027.020500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398027.020554:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337216 00000100:00100000:1.0:1787398027.020564:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337216 00000100:00100000:1.0:1787398027.020642:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337344 00000100:00100000:1.0:1787398027.020645:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337344 00000100:00100000:1.0:1787398027.020667:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1719 00000100:00100000:1.0:1787398027.020678:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681337216:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398027.020754:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681337216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398027.020763:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1719 00000100:00100000:1.0:1787398027.020784:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1748 00000100:00100000:1.0:1787398027.020790:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681337344:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787398027.020811:0:66176:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398027.020837:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681337344:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 46us (335us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398027.020857:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1748 00000100:00080000:1.0:1787398027.020882:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398027.021987:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337088 00000100:00100000:3.0:1787398027.022000:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337088 00000100:00100000:3.0:1787398027.022062:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:3.0:1787398027.022072:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681337088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398027.022127:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681337088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 57us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398027.022134:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00010000:00010000:3.0:1787398027.108747:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398027.237841:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787398027.237866:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701273088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398027.237956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398027.238433:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273088 00000100:00100000:0.0:1787398027.238443:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273088 00000100:00100000:0.0:1787398027.238504:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398027.238560:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701273088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398027.238593:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398027.238655:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701273088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398027.238663:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787398027.238870:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701273088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398027.240343:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701273216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398027.240406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398027.240501:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273216 00000100:00100000:3.0:1787398027.240509:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273216 00000100:00100000:3.0:1787398027.240595:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398027.240614:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701273216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398027.240639:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398027.240685:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701273216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398027.240692:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398027.240733:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701273216:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787398027.754902:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787398027.754910:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a817eff800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787398027.755110:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817eff800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:0.0:1787398027.755154:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efb000 for lustre-OST0000 00000001:00100000:2.0:1787398027.755399:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787398027.755403:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a817ef9000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787398027.755440:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ef9000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:0.0:1787398027.755476:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efe800 for lustre-OST0001 00010000:00010000:1.0:1787398028.133762:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398029.160118:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398030.182200:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398031.206678:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787398031.373560:0:104253:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787398031.373565:0:104253:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787398031.373566:0:104253:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787398031.373691:0:104253:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a828850000 00000020:01000004:0.0:1787398031.373709:0:104253:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787398031.373724:0:104253:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787398031.373740:0:104253:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff89a82e4f8000) 00000020:00000080:0.0:1787398031.373759:0:104253:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787398031.716050:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787398031.716865:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787398031.722901:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.723629:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.723878:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.724050:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.724376:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.724845:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.725168:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.725492:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.725706:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.725871:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.726037:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.726224:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.726449:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.726722:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.726911:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.727112:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.727867:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.728065:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.728545:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.728784:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.729114:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.729489:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.729978:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.730239:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.730551:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.730809:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.731063:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.731341:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.731662:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.732086:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.732341:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787398031.733430:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787398031.738867:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787398031.739257:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.741891:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.742217:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787398031.742856:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787398031.743167:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.743730:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787398031.748258:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.750564:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787398031.751334:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.751809:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787398031.752119:0:104253:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787398031.758713:0:104253:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787398031.758971:0:104253:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787398031.758979:0:104253:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787398031.758996:0:104253:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d19362d 00000020:01000004:3.0:1787398031.759002:0:104253:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787398031.759029:0:104253:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787398031.759038:0:104253:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787398031.759044:0:104253:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787398031.759068:0:104253:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787398031.759072:0:104253:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787398031.779607:0:104253:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787398031.779653:0:104253:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787398031.779658:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787398031.779663:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787398031.779665:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398031.779666:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398031.779667:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398031.779668:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398031.779669:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398031.779671:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398031.779673:0:104253:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787398031.779676:0:104253:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787398031.779678:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787398031.779679:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787398031.779680:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398031.779681:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398031.779682:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398031.779683:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398031.779684:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398031.779685:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398031.779686:0:104253:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787398031.779710:0:104253:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787398031.779730:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787398031.779800:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.779872:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773180 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.780294:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273344 00000100:00100000:3.0:1787398031.780303:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273344 00000100:00100000:3.0:1787398031.780362:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787398031.780371:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:104253:x1874218701273344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787398031.780411:0:102321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787398031.780415:0:102321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787398031.780424:0:102321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787398031.780949:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:104253:x1874218701273344:12345-0@lo:253:mount.lustre.0 Request processed in 577us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.780959:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787398031.781090:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787398031.781102:0:104253:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787398031.781105:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787398031.781106:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787398031.781108:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398031.781109:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398031.781110:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398031.781111:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398031.781112:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398031.781113:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398031.781115:0:104253:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787398031.781282:0:104253:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a828850000 from lustre-MDT0001 10000000:01000000:2.0:1787398031.781314:0:104253:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787398031.781317:0:104253:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787398031.781326:0:104253:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:2.0:1787398031.781349:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398031.781663:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398031.781705:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.781774:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.787500:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273472 00000100:00100000:3.0:1787398031.788018:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273472 00000100:00100000:3.0:1787398031.788107:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787398031.788120:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:104253:x1874218701273472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398031.788331:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:104253:x1874218701273472:12345-0@lo:501:mount.lustre.0 Request processed in 214us (6624us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787398031.788339:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787398031.788468:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273472:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787398031.788498:0:104253:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787398031.788574:0:104253:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787398031.788584:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.788596:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398031.788629:0:104253:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a828850000 10000000:01000000:2.0:1787398031.788634:0:104253:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787398031.788641:0:104253:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a828850000 10000000:01000000:2.0:1787398031.788644:0:104253:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787398031.788648:0:104253:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a828850000 from 1 10000000:01000000:2.0:1787398031.788650:0:104253:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787398031.788680:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.788688:0:104253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.788696:0:104253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398031.788738:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398031.788772:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.788801:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.788863:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273600 00000100:00100000:1.0:1787398031.788868:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273600 00000100:00100000:1.0:1787398031.788905:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787398031.788913:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:104253:x1874218701273600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398031.788922:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398031.788934:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63e00/0x274786fe0d19363b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193634 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.788959:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63e00/0x274786fe0d19363b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193634 expref: 20 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.788970:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63e00/0x274786fe0d19363b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193634 expref: 20 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.788979:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63e00, rc 0) 00000100:00100000:1.0:1787398031.789017:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:104253:x1874218701273600:12345-0@lo:101:mount.lustre.0 Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.789024:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787398031.789156:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398031.789168:0:104253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.789176:0:104253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398031.789187:0:104253:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787398031.789204:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.789210:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398031.789215:0:104253:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787398031.789219:0:104253:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787398031.789223:0:104253:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a828850000 10000000:01000000:2.0:1787398031.789226:0:104253:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787398031.789229:0:104253:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787398031.789232:0:104253:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787398031.789245:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.789251:0:104253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.789264:0:104253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398031.789275:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398031.789300:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.789314:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787398031.789857:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273728 00000100:00100000:0.0:1787398031.789864:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273728 00000100:00100000:0.0:1787398031.789908:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787398031.789917:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+20:104253:x1874218701273728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398031.789925:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398031.789937:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a82eb54e00/0x274786fe0d193649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193642 expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.789954:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a82eb54e00/0x274786fe0d193649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193642 expref: 21 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.789963:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a82eb54e00/0x274786fe0d193649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193642 expref: 21 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.789978:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb54e00, rc 0) 00000100:00100000:0.0:1787398031.790017:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701273728:12345-0@lo:101:mount.lustre.0 Request processed in 100us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.790024:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787398031.790210:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398031.790223:0:104253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.790231:0:104253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787398031.790442:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6e:0x0] index 46 count 46 00000040:00080000:2.0:1787398031.790913:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398031.795865:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].1, 224 off8416 00000040:00080000:2.0:1787398031.795929:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].2, 136 off8552 00000040:00080000:2.0:1787398031.795946:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].3, 176 off8728 00000040:00080000:2.0:1787398031.795959:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].4, 224 off8952 00000040:00080000:2.0:1787398031.795972:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].5, 224 off9176 00000040:00080000:2.0:1787398031.795984:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].6, 120 off9296 00000040:00080000:2.0:1787398031.795997:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].7, 112 off9408 00000040:00080000:2.0:1787398031.796014:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].8, 160 off9568 00000040:00080000:2.0:1787398031.796035:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].9, 224 off9792 00000040:00080000:2.0:1787398031.796048:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].10, 224 off10016 00000040:00080000:2.0:1787398031.796062:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].11, 88 off10104 00000040:00080000:2.0:1787398031.796076:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].12, 144 off10248 00000040:00080000:2.0:1787398031.796089:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].13, 152 off10400 00000040:00080000:2.0:1787398031.796116:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].14, 168 off10568 00000040:00080000:2.0:1787398031.796145:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].15, 224 off10792 00000040:00080000:2.0:1787398031.796158:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].16, 224 off11016 00000040:00080000:2.0:1787398031.796170:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].17, 80 off11096 00000040:00080000:2.0:1787398031.796181:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].18, 224 off11320 00000040:00080000:2.0:1787398031.796193:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].19, 224 off11544 00000040:00080000:2.0:1787398031.796206:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].20, 160 off11704 00000040:00080000:2.0:1787398031.796221:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].21, 224 off11928 00000040:00080000:2.0:1787398031.796235:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].22, 224 off12152 00000040:00080000:2.0:1787398031.796247:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].23, 80 off12232 00000040:00080000:2.0:1787398031.796259:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].24, 224 off12456 00000040:00080000:2.0:1787398031.796269:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].25, 224 off12680 00000040:00080000:2.0:1787398031.796281:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].26, 88 off12768 00000040:00080000:2.0:1787398031.796291:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].27, 144 off12912 00000040:00080000:2.0:1787398031.796303:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].28, 152 off13064 00000040:00080000:2.0:1787398031.796314:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].29, 136 off13200 00000040:00080000:2.0:1787398031.796325:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].30, 224 off13424 00000040:00080000:2.0:1787398031.796337:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].31, 224 off13648 00000040:00080000:2.0:1787398031.796350:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].32, 80 off13728 00000040:00080000:2.0:1787398031.796362:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].33, 224 off13952 00000040:00080000:2.0:1787398031.796373:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].34, 224 off14176 00000040:00080000:2.0:1787398031.796384:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].35, 88 off14264 00000040:00080000:2.0:1787398031.796398:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].36, 144 off14408 00000040:00080000:2.0:1787398031.796411:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].37, 152 off14560 00000040:00080000:2.0:1787398031.796424:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].38, 136 off14696 00000040:00080000:2.0:1787398031.796518:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].39, 224 off14920 00000040:00080000:2.0:1787398031.796570:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].40, 224 off15144 00000040:00080000:2.0:1787398031.796582:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].41, 80 off15224 00000040:00080000:2.0:1787398031.796593:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].42, 224 off15448 00000040:00080000:2.0:1787398031.796606:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].43, 224 off15672 00000040:00080000:2.0:1787398031.796620:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].44, 120 off15792 00000040:00080000:2.0:1787398031.796650:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].45, 224 off16016 00000040:00080000:2.0:1787398031.796655:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6e:0x0] index 45 count 46 00000100:00100000:2.0:1787398031.796783:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398031.796852:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.796887:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702773240 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.797034:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273856 00000100:00100000:1.0:1787398031.797042:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273856 00000100:00100000:1.0:1787398031.797097:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787398031.797116:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701273856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398031.797273:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701273856:12345-0@lo:501:mount.lustre.0 Request processed in 159us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.797281:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787398031.797437:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398031.797474:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787398031.797553:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.797584:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.797702:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701273984 00000100:00100000:1.0:1787398031.797707:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701273984 00000100:00100000:1.0:1787398031.797739:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787398031.797746:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701273984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787398031.797836:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701273984:12345-0@lo:503:mount.lustre.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.797842:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787398031.798138:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701273984:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787398031.798719:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787398031.798795:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398031.798844:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.798985:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.799220:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274112 00000100:00100000:1.0:1787398031.799226:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274112 00000100:00100000:1.0:1787398031.799301:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787398031.799309:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398031.800030:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274112:12345-0@lo:502:mount.lustre.0 Request processed in 717us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.800040:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787398031.800309:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398031.806075:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].1, 224 off8416 00000040:00080000:0.0:1787398031.806506:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].2, 136 off8552 00000040:00080000:0.0:1787398031.806734:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].3, 176 off8728 00000040:00080000:0.0:1787398031.806751:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].4, 224 off8952 00000040:00080000:0.0:1787398031.806765:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].5, 224 off9176 00000040:00080000:0.0:1787398031.806778:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].6, 120 off9296 00000040:00080000:0.0:1787398031.806795:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].7, 112 off9408 00000040:00080000:0.0:1787398031.806807:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].8, 160 off9568 00000040:00080000:0.0:1787398031.806819:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].9, 224 off9792 00000040:00080000:0.0:1787398031.806833:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].10, 224 off10016 00000040:00080000:0.0:1787398031.806847:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].11, 88 off10104 00000040:00080000:0.0:1787398031.806861:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].12, 144 off10248 00000040:00080000:0.0:1787398031.806875:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].13, 152 off10400 00000040:00080000:0.0:1787398031.806889:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].14, 168 off10568 00000040:00080000:0.0:1787398031.807019:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].15, 224 off10792 00000040:00080000:0.0:1787398031.807038:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].16, 224 off11016 00000040:00080000:0.0:1787398031.807053:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].17, 80 off11096 00000040:00080000:0.0:1787398031.807068:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].18, 224 off11320 00000040:00080000:0.0:1787398031.807082:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].19, 224 off11544 00000040:00080000:0.0:1787398031.807096:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].20, 160 off11704 00000040:00080000:0.0:1787398031.807110:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].21, 224 off11928 00000040:00080000:0.0:1787398031.807202:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].22, 224 off12152 00000040:00080000:0.0:1787398031.807224:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].23, 80 off12232 00000040:00080000:0.0:1787398031.807238:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].24, 224 off12456 00000040:00080000:0.0:1787398031.807268:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].25, 224 off12680 00000040:00080000:0.0:1787398031.807281:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].26, 88 off12768 00000040:00080000:0.0:1787398031.807294:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].27, 144 off12912 00000040:00080000:0.0:1787398031.807306:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].28, 152 off13064 00000040:00080000:0.0:1787398031.807320:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].29, 136 off13200 00000040:00080000:0.0:1787398031.807333:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].30, 224 off13424 00000040:00080000:0.0:1787398031.807345:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].31, 224 off13648 00000040:00080000:0.0:1787398031.807357:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].32, 80 off13728 00000040:00080000:0.0:1787398031.807370:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].33, 224 off13952 00000040:00080000:0.0:1787398031.807452:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].34, 224 off14176 00000040:00080000:0.0:1787398031.807465:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].35, 88 off14264 00000040:00080000:0.0:1787398031.807477:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].36, 144 off14408 00000040:00080000:0.0:1787398031.807490:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].37, 152 off14560 00000040:00080000:0.0:1787398031.807500:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].38, 136 off14696 00000040:00080000:0.0:1787398031.807637:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].39, 224 off14920 00000040:00080000:0.0:1787398031.807654:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].40, 224 off15144 00000040:00080000:0.0:1787398031.807664:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].41, 80 off15224 00000040:00080000:0.0:1787398031.807674:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].42, 224 off15448 00000040:00080000:0.0:1787398031.807685:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].43, 224 off15672 00000040:00080000:0.0:1787398031.807696:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].44, 120 off15792 00000040:00080000:0.0:1787398031.807705:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].45, 224 off16016 00000040:00080000:0.0:1787398031.807715:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].46, 224 off16240 00000040:00080000:0.0:1787398031.807725:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].47, 120 off16360 00000040:00080000:0.0:1787398031.807736:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].48, 24 off16384 00000100:00100000:0.0:1787398031.807792:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398031.807886:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.808072:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.808204:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274240 00000100:00100000:3.0:1787398031.808212:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274240 00000100:00100000:3.0:1787398031.808319:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787398031.808330:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398031.808611:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274240:12345-0@lo:502:mount.lustre.0 Request processed in 281us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.808619:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787398031.808731:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398031.808936:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].49, 224 off16608 00000040:00080000:0.0:1787398031.808962:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].50, 224 off16832 00000040:00080000:0.0:1787398031.808976:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].51, 144 off16976 00000040:00080000:0.0:1787398031.809001:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].52, 224 off17200 00000040:00080000:0.0:1787398031.809016:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].53, 224 off17424 00000040:00080000:0.0:1787398031.809029:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].54, 144 off17568 00000040:00080000:0.0:1787398031.809041:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].55, 224 off17792 00000040:00080000:0.0:1787398031.809053:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].56, 224 off18016 00000040:00080000:0.0:1787398031.809065:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].57, 120 off18136 00000100:00100000:0.0:1787398031.809093:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398031.809146:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.809177:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.809297:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274368 00000100:00100000:1.0:1787398031.809303:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274368 00000100:00100000:1.0:1787398031.809344:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787398031.809352:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398031.809450:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701274368:12345-0@lo:502:mount.lustre.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.809457:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787398031.809645:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701274368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398031.809684:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].58, 224 off18360 00000040:00080000:0.0:1787398031.809692:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:3.0:1787398031.810998:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787398031.811013:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.811015:0:104257:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787398031.811021:0:104257:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787398031.811024:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787398031.811040:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff89a703f5cd40) 00000020:00000080:3.0:1787398031.811065:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1787398031.811071:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787398031.811151:0:104257:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787398031.811158:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193657 00000020:00000080:3.0:1787398031.811445:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787398031.811451:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787398031.811454:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.811456:0:104257:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787398031.811459:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787398031.811462:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.811469:0:104257:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787398031.811474:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787398031.811483:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff89a703f58000) 00000020:00000080:3.0:1787398031.811497:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1787398031.811502:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787398031.811504:0:104257:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787398031.811517:0:104257:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787398031.811867:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787398031.812293:0:104257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a828850000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787398031.812308:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff89a83b9d3380) 00000020:00000080:2.0:1787398031.812321:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1787398031.812381:0:104257:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787398031.812389:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d19366c 00000020:00000080:2.0:1787398031.813302:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787398031.813312:0:104257:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787398031.813321:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x274786fe0d193673 00080000:01000000:2.0:1787398031.813329:0:104257:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787398031.813334:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d19367a 00000100:00080000:1.0:1787398031.847324:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398031.847346:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787398031.847350:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398031.847360:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3906 00000100:00080000:1.0:1787398031.847365:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787398031.847372:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398031.847385:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398031.847408:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701274496:0@lo:400:kworker.0 00000100:00100000:1.0:1787398031.847409:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876df80 x1874218701274624/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398031.847449:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398031.847452:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787398031.847454:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398031.847457:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3906 00000100:00080000:1.0:1787398031.847459:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787398031.847463:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398031.847472:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705985f80 x1874218701274880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398031.847478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398031.847481:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398031.847484:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787398031.847485:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398031.847488:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3906 00000100:00080000:1.0:1787398031.847490:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787398031.847494:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398031.847504:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a705985880 x1874218701275008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398031.847585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701274624:0@lo:38:kworker.0 00000100:00100000:1.0:1787398031.847621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.847649:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701274880:0@lo:38:kworker.0 00000100:00100000:1.0:1787398031.847670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.847686:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701275008:0@lo:38:kworker.0 00000100:00100000:1.0:1787398031.847724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.847757:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701274752:0@lo:400:kworker.0 00000100:00100000:1.0:1787398031.847782:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.847799:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398031.847805:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701275136:0@lo:400:kworker.0 00000100:00100000:3.0:1787398031.847825:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274496 00000100:00100000:1.0:1787398031.847828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.847832:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274496 00000100:00100000:3.0:1787398031.847885:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274624 00000100:00100000:3.0:1787398031.847889:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274624 00000100:00100000:3.0:1787398031.847903:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274880 00000100:00100000:3.0:1787398031.847905:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274880 00000100:00100000:3.0:1787398031.847913:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701274752 00000100:00100000:3.0:1787398031.847915:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701274752 00000100:00100000:3.0:1787398031.847935:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:3.0:1787398031.847942:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701274496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.847955:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701275392:0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.847983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.847989:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701274496:12345-0@lo:400:kworker.0 Request processed in 48us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.847996:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398031.847997:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:0.0:1787398031.848000:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701275264:0@lo:400:kworker.0 00000100:00100000:3.0:1787398031.848012:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275392 00000100:00100000:3.0:1787398031.848015:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275392 00000100:00100000:0.0:1787398031.848019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.848028:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1787398031.848034:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701274752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.848044:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275136 00000100:00100000:0.0:1787398031.848047:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275136 00000100:00100000:3.0:1787398031.848062:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701274752:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.848068:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1787398031.848074:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275264 00000100:00100000:0.0:1787398031.848076:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275264 00000100:00100000:3.0:1787398031.848087:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:3.0:1787398031.848092:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701275392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.848095:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787398031.848100:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701275136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398031.848126:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701275392:12345-0@lo:400:kworker.0 Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.848132:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1787398031.848142:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701275136:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.848144:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1787398031.848148:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701274624:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787398031.848148:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787398031.848158:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00010000:02000000:3.0:1787398031.848163:0:67264:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:0.0:1787398031.848163:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701275264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.848196:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701275264:12345-0@lo:400:kworker.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.848202:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787398031.848243:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701275264:0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.848256:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701275392:0@lo:400:kworker.0 00000100:00100000:0.0:1787398031.848299:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:0.0:1787398031.848303:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701274880:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787398031.848311:0:77740:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:0.0:1787398031.848343:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701274880:12345-0@lo:38:kworker.0 Request processed in 37us (671us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398031.848349:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:0.0:1787398031.848367:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275008 00000100:00100000:0.0:1787398031.848371:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275008 00000100:00100000:0.0:1787398031.848405:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787398031.848409:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701275008:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787398031.848416:0:66188:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:0.0:1787398031.848441:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701275008:12345-0@lo:38:kworker.0 Request processed in 30us (717us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398031.848446:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787398031.848480:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701274496:0@lo:400:kworker.0 00000100:00080000:0.0:1787398031.848541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398031.848545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398031.848548:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398031.848585:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398031.848590:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398031.848593:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701274880:0@lo:38:kworker.0 00000100:00080000:0.0:1787398031.848612:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398031.848616:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398031.848618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701275008:0@lo:38:kworker.0 00000100:00100000:1.0:1787398031.848826:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701275136:0@lo:400:kworker.0 00000100:00100000:1.0:1787398031.848839:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701274752:0@lo:400:kworker.0 00000100:00100000:3.0:1787398031.862572:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701274624:12345-0@lo:38:kworker.0 Request processed in 14412us (14940us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398031.862586:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00080000:0.0:1787398031.865313:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398031.865326:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398031.865333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701274624:0@lo:38:kworker.0 00010000:00010000:1.0:1787398031.903030:0:104257:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:1.0:1787398031.903200:0:104257:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 81604378773 lx: 0 gen 28 00000001:00080000:1.0:1787398031.903250:0:104257:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 0 srv lr: 81604378773 lx: 0 gen 25 00000001:00000004:1.0:1787398031.903272:0:104257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 20, last_transno is 81604378773 00000001:00080000:1.0:1787398031.903373:0:104257:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1787398031.903515:0:104257:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a8356a36c0: xid 1874218681330944, transno 81604378793, client gen 25, slot idx 0 00000001:00080000:1.0:1787398031.903551:0:104257:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a8356a3900: xid 1874218681330688, transno 81604378792, client gen 25, slot idx 1 00000020:00000080:1.0:1787398031.910838:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787398031.910855:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.910912:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.910915:0:104257:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787398031.910920:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.910926:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.910927:0:104257:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787398031.910931:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787398031.910936:0:104257:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:0.0:1787398031.910966:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398031.910984:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff89a82e4f99c0) 00000020:00000080:0.0:1787398031.911011:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787398031.911017:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787398031.911101:0:104257:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787398031.911108:0:104257:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787398031.911115:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193696 00010000:00080000:0.0:1787398031.911152:0:104257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a835664000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787398031.917652:0:104257:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:0.0:1787398031.920932:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398031.920950:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787398031.920993:0:104257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787398031.921015:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d19369d 00000100:00080000:0.0:1787398031.921025:0:104257:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398031.921031:0:104257:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a835664000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398031.921079:0:104257:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876df80 x1874218701275520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398031.921140:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701275520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787398031.921221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.921357:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275520 00000100:00100000:2.0:1787398031.921367:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275520 00000100:00100000:2.0:1787398031.921491:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787398031.921515:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1874218701275520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787398031.921570:0:66188:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3911 last 0 00000020:00000080:2.0:1787398031.921610:0:66188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1936a4 00000004:00100000:2.0:1787398031.921627:0:66188:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787398031.921812:0:66188:0:(import.c:65:import_set_state_nolock()) ffff89a8310aa800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787398031.922046:0:104257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787398031.922132:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.922137:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922139:0:104257:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787398031.922143:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398031.922146:0:104257:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787398031.922147:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.922148:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.922150:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398031.922152:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922153:0:104257:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398031.922156:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.922160:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922161:0:104257:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787398031.922165:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787398031.922206:0:104257:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787398031.922219:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.922223:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922224:0:104257:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787398031.922227:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398031.922229:0:104257:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787398031.922230:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.922231:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.922233:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398031.922236:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922237:0:104257:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398031.922239:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787398031.922242:0:104257:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787398031.922245:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.922246:0:104257:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787398031.922249:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787398031.922275:0:104257:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787398031.922296:0:104257:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787398031.922299:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398031.922312:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89a82e4fb380) 00000020:00000080:0.0:1787398031.922330:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787398031.922335:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787398031.922614:0:104257:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787398031.922621:0:104257:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787398031.922630:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d1936b2 00010000:00080000:0.0:1787398031.922669:0:104257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a817ecb800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787398031.922901:0:104257:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000040:01000000:0.0:1787398031.923654:0:104257:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787398031.924014:0:104257:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787398031.924492:0:104257:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 18, last_idx 19 00000040:00080000:0.0:1787398031.925363:0:104257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787398031.925470:0:104257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].20, 64 off9472 00000040:00080000:0.0:1787398031.925832:0:104257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x50:0x0].1, 64 off8256 00000100:00100000:1.0:1787398031.926474:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787398031.926485:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:1.0:1787398031.926495:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787398031.926501:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787398031.926505:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787398031.926596:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701275520:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787398031.926849:0:104262:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:1.0:1787398031.926854:0:104262:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787398031.927011:0:104262:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1787398031.927030:0:104262:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787398031.927168:0:104262:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:1.0:1787398031.927172:0:104262:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787398031.927315:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701275520:12345-0@lo:38:llog_process_th.0 Request processed in 5805us (6090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.927328:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000020:00000080:1.0:1787398031.928457:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398031.928472:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787398031.928826:0:104257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787398031.928847:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1936b9 00000100:00080000:1.0:1787398031.928858:0:104257:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398031.928864:0:104257:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a817ecb800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398031.928902:0:104257:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83037a300 x1874218701275648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398031.928923:0:104257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787398031.929003:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398031.929008:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398031.929010:0:104257:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787398031.929012:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398031.929015:0:104257:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787398031.929017:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398031.929018:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398031.929019:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398031.929033:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398031.929034:0:104257:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398031.929037:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787398031.929041:0:104257:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787398031.929044:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398031.929045:0:104257:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787398031.929048:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398031.929052:0:104257:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787398031.929076:0:104257:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787398031.929079:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398031.929091:0:104257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89a829b93380) 00000020:00000080:1.0:1787398031.929109:0:104257:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787398031.929114:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398031.929197:0:104257:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787398031.929203:0:104257:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787398031.929208:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d1936c7 00010000:00080000:1.0:1787398031.929240:0:104257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a828852000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.160@tcp at head 00000100:00100000:0.0:1787398031.929766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701275648:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787398031.929854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787398031.930110:0:104257:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787398031.930226:0:104257:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398031.930248:0:104257:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787398031.931020:0:104257:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 18, last_idx 19 00000100:00100000:3.0:1787398031.931699:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398031.931719:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701275776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398031.931788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.931838:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275776 00000100:00100000:3.0:1787398031.931846:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275776 00000100:00100000:3.0:1787398031.931900:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787398031.931908:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701275776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398031.931948:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445064704 avail 1298825216 00000100:00100000:3.0:1787398031.931996:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701275776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.932003:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787398031.932054:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701275776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398031.932854:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275648 00000100:00100000:1.0:1787398031.932864:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275648 00000100:00100000:1.0:1787398031.932907:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787398031.932913:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218701275648:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787398031.932947:0:101069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3911 last 0 00000020:00000080:1.0:1787398031.932987:0:101069:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1936ce 00002000:00100000:1.0:1787398031.933004:0:101069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a828850800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787398031.933009:0:101069:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787398031.933020:0:101069:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787398031.933092:0:101069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787398031.933118:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a817eff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398031.933200:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701275648:12345-0@lo:8:llog_process_th.0 Request processed in 285us (3346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.933207:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787398031.933248:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787398031.933255:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:1.0:1787398031.933350:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787398031.933357:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787398031.933359:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787398031.933764:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787398031.933773:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701275648:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787398031.933803:0:104262:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787398031.933856:0:104262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3911224332378ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787398031.933863:0:104262:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787398031.933921:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398031.933935:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701275904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398031.933979:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787398031.934468:0:104257:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787398031.934519:0:104257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].20, 64 off9472 00000040:00080000:0.0:1787398031.934957:0:104257:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x52:0x0].1, 64 off8256 00000100:00100000:3.0:1787398031.935845:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701275904 00000100:00100000:3.0:1787398031.935857:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701275904 00000100:00100000:3.0:1787398031.935922:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787398031.935933:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701275904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398031.935985:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398031.936076:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701275904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.936085:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787398031.936110:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398031.936188:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701275904:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787398031.939903:0:104264:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:1.0:1787398031.939912:0:104264:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787398031.940163:0:104264:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1787398031.940191:0:104264:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1787398031.940980:0:104254:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:1.0:1787398031.943918:0:104264:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:1.0:1787398031.943928:0:104264:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787398031.944984:0:104257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398031.944997:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787398031.945044:0:104257:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787398031.945067:0:104257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1936d5 00000100:00080000:0.0:1787398031.945079:0:104257:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398031.945087:0:104257:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a828852000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398031.945146:0:104257:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547b480 x1874218701276032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398031.945183:0:104257:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787398031.945298:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.945302:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945304:0:104257:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787398031.945307:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.945312:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945313:0:104257:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787398031.945316:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787398031.945318:0:104257:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787398031.945319:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.945322:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945323:0:104257:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787398031.945325:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.945327:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945328:0:104257:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787398031.945332:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787398031.945338:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.945340:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945341:0:104257:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000020:01000000:0.0:1787398031.945343:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398031.945345:0:104257:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #42 00000020:01000000:0.0:1787398031.945347:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.945348:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.945370:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398031.945373:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945386:0:104257:0:(obd_config.c:1561:class_process_config()) marker 42 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:0.0:1787398031.945389:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398031.945391:0:104257:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #45 00000020:01000000:0.0:1787398031.945393:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.945394:0:104257:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398031.945396:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398031.945399:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945401:0:104257:0:(obd_config.c:1561:class_process_config()) marker 45 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1787398031.945412:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.945415:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945416:0:104257:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1787398031.945420:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:0.0:1787398031.945427:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.945430:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945431:0:104257:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1787398031.945434:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398031.945437:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945438:0:104257:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:0.0:1787398031.945442:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000020:01000000:0.0:1787398031.945452:0:104257:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398031.945455:0:104257:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398031.945456:0:104257:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:0.0:1787398031.945460:0:104257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 59 count 58 00000020:01000000:0.0:1787398031.945568:0:104253:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 10000000:01000000:0.0:1787398031.945605:0:104253:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787398031.945620:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.945632:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398031.945641:0:104253:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a828850000 from 1 10000000:01000000:0.0:1787398031.945644:0:104253:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787398031.945685:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.945694:0:104253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.945705:0:104253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398031.945730:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787398031.945802:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.945840:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.947563:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701276032:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787398031.947645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.947962:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276032 00000100:00100000:0.0:1787398031.947970:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276032 00000100:00100000:0.0:1787398031.948018:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787398031.948026:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701276032:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787398031.948059:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3911 last 0 00000020:00000080:0.0:1787398031.948089:0:100418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1936e3 00002000:00100000:0.0:1787398031.948103:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89a829b18000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787398031.948107:0:100418:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787398031.948109:0:100418:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787398031.948200:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787398031.948226:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a829b1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398031.948285:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701276032:12345-0@lo:8:llog_process_th.0 Request processed in 259us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.948293:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787398031.948337:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787398031.948344:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787398031.948352:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787398031.948358:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787398031.948360:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828852000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787398031.948369:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787398031.948500:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276160 00000100:00100000:2.0:1787398031.948515:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276160 00000100:00100000:2.0:1787398031.948570:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787398031.948577:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:104253:x1874218701276160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398031.948599:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398031.948615:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1936dc expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.948640:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1936dc expref: 22 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.948651:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1936dc expref: 22 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.948672:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22e00, rc 0) 00000100:00100000:2.0:1787398031.948709:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:104253:x1874218701276160:12345-0@lo:101:mount.lustre.0 Request processed in 132us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.948715:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787398031.948804:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701276288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398031.948840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.948874:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276288 00000100:00100000:2.0:1787398031.948877:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276288 00000100:00100000:2.0:1787398031.948910:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787398031.948917:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701276288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398031.948936:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398031.948971:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701276288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.948977:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787398031.949007:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701276288:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787398031.949025:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787398031.949249:0:104264:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787398031.949312:0:104264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3911239789073ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787398031.949318:0:104264:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787398031.949363:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701276032:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787398031.949414:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398031.949441:0:104253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.949451:0:104253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398031.950111:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276416:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787398031.950187:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.950224:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398031.951991:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276416 00000100:00100000:2.0:1787398031.952037:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276416 00000100:00100000:2.0:1787398031.952134:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787398031.952145:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:104253:x1874218701276416:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787398031.952179:0:102326:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787398031.952201:0:102326:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787398031.952206:0:102326:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787398031.952209:0:102326:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787398031.952212:0:102326:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787398031.952214:0:102326:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 132 00000100:00100000:2.0:1787398031.952347:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+22:104253:x1874218701276416:12345-0@lo:256:mount.lustre.0 Request processed in 205us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.952355:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787398031.952684:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276416:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787398031.953359:0:104253:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787398031.954110:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.954138:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398031.954148:0:104253:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a828850000 from 1 10000000:01000000:0.0:1787398031.954151:0:104253:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787398031.954194:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.954203:0:104253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.954213:0:104253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398031.954236:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787398031.954308:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.954350:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.954551:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276544 00000100:00100000:3.0:1787398031.954559:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276544 00000100:00100000:3.0:1787398031.954605:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787398031.954615:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:104253:x1874218701276544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398031.954628:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398031.954642:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aba00/0x274786fe0d1936f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1936f1 expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398031.954679:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aba00/0x274786fe0d1936f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1936f1 expref: 23 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398031.954691:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aba00/0x274786fe0d1936f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1936f1 expref: 23 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398031.954700:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:3.0:1787398031.954737:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276544:12345-0@lo:101:mount.lustre.0 Request processed in 124us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.954744:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787398031.958236:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398031.958271:0:104253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398031.958284:0:104253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787398031.958559:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x70:0x0] index 7 count 7 00000040:00080000:0.0:1787398031.958850:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787398031.959042:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].1, 224 off8416 00000040:00080000:0.0:1787398031.959068:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].2, 112 off8528 00000040:00080000:0.0:1787398031.959082:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].3, 224 off8752 00000040:00080000:0.0:1787398031.959095:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].4, 224 off8976 00000040:00080000:0.0:1787398031.959109:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].5, 112 off9088 00000040:00080000:0.0:1787398031.959128:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].6, 224 off9312 00000040:00080000:0.0:1787398031.959133:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x70:0x0] index 6 count 7 00000100:00100000:0.0:1787398031.959203:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398031.959271:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398031.959307:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70311ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.959782:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276672 00000100:00100000:3.0:1787398031.959791:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276672 00000100:00100000:3.0:1787398031.959845:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787398031.959855:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7027a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398031.960028:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7027a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276672:12345-0@lo:501:mount.lustre.0 Request processed in 173us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.960036:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787398031.960298:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398031.960342:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787398031.960409:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.960437:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8356a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.960824:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276800 00000100:00100000:3.0:1787398031.960830:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276800 00000100:00100000:3.0:1787398031.960875:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787398031.960883:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787398031.960992:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276800:12345-0@lo:503:mount.lustre.0 Request processed in 109us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.960999:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787398031.961198:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787398031.961734:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787398031.961823:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398031.961879:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.961907:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.962471:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701276928 00000100:00100000:3.0:1787398031.962478:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701276928 00000100:00100000:3.0:1787398031.962561:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787398031.962571:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398031.962703:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701276928:12345-0@lo:502:mount.lustre.0 Request processed in 133us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.962710:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:3.0:1787398031.963064:0:104254:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787398031.963159:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701276928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787398031.963470:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].1, 224 off8416 00000040:00080000:1.0:1787398031.963518:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].2, 112 off8528 00000040:00080000:1.0:1787398031.963561:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].3, 224 off8752 00000040:00080000:1.0:1787398031.963576:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].4, 224 off8976 00000040:00080000:1.0:1787398031.963591:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].5, 112 off9088 00000100:00100000:1.0:1787398031.963623:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398031.963781:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398031.963808:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787398031.963887:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277056 00000100:00100000:0.0:1787398031.963893:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277056 00000100:00100000:0.0:1787398031.963932:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787398031.963939:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701277056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398031.964020:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701277056:12345-0@lo:502:mount.lustre.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.964027:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787398031.964104:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787398031.964200:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].6, 224 off9312 00000040:00080000:1.0:1787398031.964208:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1787398031.970371:0:104266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787398031.970386:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.970389:0:104266:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787398031.970401:0:104266:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a828850000 00000020:00000080:3.0:1787398031.970404:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787398031.970413:0:104266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787398031.970415:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.970416:0:104266:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787398031.970419:0:104266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787398031.970421:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.970435:0:104266:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787398031.970442:0:104266:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a828850000 00000020:00000080:3.0:1787398031.970444:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787398031.971416:0:104266:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787398031.971426:0:104266:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787398031.971428:0:104266:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787398031.971433:0:104266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 7 count 7 00000020:01000000:2.0:1787398031.973966:0:104253:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787398031.974020:0:104253:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787398031.974046:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.974058:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398031.974140:0:104253:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787398031.974143:0:104253:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a828850000 10000000:01000000:2.0:1787398031.974146:0:104253:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a828850000 10000000:01000000:2.0:1787398031.974150:0:104253:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787398031.974156:0:104253:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a828850000 from 1 10000000:01000000:2.0:1787398031.974159:0:104253:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787398031.974200:0:104253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.974209:0:104253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.974233:0:104253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398031.974264:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398031.974342:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.974400:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1787398031.974983:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277184 00000100:00100000:1.0:1787398031.974993:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277184 00000100:00100000:1.0:1787398031.975060:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787398031.975070:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:104253:x1874218701277184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398031.975084:0:102323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398031.975103:0:102323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62c00/0x274786fe0d193706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1936ff expref: -99 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.975146:0:102323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62c00/0x274786fe0d193706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1936ff expref: 24 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.975158:0:102323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62c00/0x274786fe0d193706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1936ff expref: 24 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398031.975168:0:102323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62c00, rc 0) 00000100:00100000:1.0:1787398031.975230:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277184:12345-0@lo:101:mount.lustre.0 Request processed in 160us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398031.975237:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787398031.975389:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398031.975407:0:104253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398031.975416:0:104253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787398031.975691:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x72:0x0] index 52 count 51 00000040:00080000:2.0:1787398031.975973:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398031.976188:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].1, 224 off8416 00000040:00080000:2.0:1787398031.976215:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].2, 120 off8536 00000040:00080000:2.0:1787398031.976230:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].3, 168 off8704 00000040:00080000:2.0:1787398031.976243:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].4, 224 off8928 00000040:00080000:2.0:1787398031.976256:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].5, 224 off9152 00000040:00080000:2.0:1787398031.976268:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].6, 120 off9272 00000040:00080000:2.0:1787398031.976282:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].7, 168 off9440 00000040:00080000:2.0:1787398031.976297:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].8, 224 off9664 00000040:00080000:2.0:1787398031.976312:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].9, 224 off9888 00000040:00080000:2.0:1787398031.976325:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].10, 120 off10008 00000040:00080000:2.0:1787398031.976339:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].11, 224 off10232 00000040:00080000:2.0:1787398031.976354:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].12, 224 off10456 00000040:00080000:2.0:1787398031.976368:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].13, 88 off10544 00000040:00080000:2.0:1787398031.976394:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].14, 128 off10672 00000040:00080000:2.0:1787398031.976408:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].15, 144 off10816 00000040:00080000:2.0:1787398031.976421:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].16, 160 off10976 00000040:00080000:2.0:1787398031.976434:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].17, 224 off11200 00000040:00080000:2.0:1787398031.976446:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].18, 224 off11424 00000040:00080000:2.0:1787398031.976459:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].19, 80 off11504 00000040:00080000:2.0:1787398031.976472:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].20, 224 off11728 00000040:00080000:2.0:1787398031.976487:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].21, 224 off11952 00000040:00080000:2.0:1787398031.976501:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].22, 88 off12040 00000040:00080000:2.0:1787398031.976556:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].23, 128 off12168 00000040:00080000:2.0:1787398031.976575:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].24, 144 off12312 00000040:00080000:2.0:1787398031.976591:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].25, 160 off12472 00000040:00080000:2.0:1787398031.976606:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].26, 224 off12696 00000040:00080000:2.0:1787398031.976620:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].27, 224 off12920 00000040:00080000:2.0:1787398031.976635:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].28, 80 off13000 00000040:00080000:2.0:1787398031.976650:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].29, 224 off13224 00000040:00080000:2.0:1787398031.976663:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].30, 224 off13448 00000040:00080000:2.0:1787398031.976675:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].31, 88 off13536 00000040:00080000:2.0:1787398031.976687:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].32, 128 off13664 00000040:00080000:2.0:1787398031.976699:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].33, 144 off13808 00000040:00080000:2.0:1787398031.976714:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].34, 128 off13936 00000040:00080000:2.0:1787398031.976728:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].35, 224 off14160 00000040:00080000:2.0:1787398031.976742:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].36, 224 off14384 00000040:00080000:2.0:1787398031.976757:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].37, 80 off14464 00000040:00080000:2.0:1787398031.976770:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].38, 224 off14688 00000040:00080000:2.0:1787398031.976784:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].39, 224 off14912 00000040:00080000:2.0:1787398031.976801:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].40, 88 off15000 00000040:00080000:2.0:1787398031.976816:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].41, 128 off15128 00000040:00080000:2.0:1787398031.976830:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].42, 144 off15272 00000040:00080000:2.0:1787398031.976843:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].43, 128 off15400 00000040:00080000:2.0:1787398031.976854:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].44, 224 off15624 00000040:00080000:2.0:1787398031.976866:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].45, 224 off15848 00000040:00080000:2.0:1787398031.976877:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].46, 80 off15928 00000040:00080000:2.0:1787398031.976900:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].47, 224 off16152 00000040:00080000:2.0:1787398031.976914:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].48, 232 off16384 00000040:00080000:2.0:1787398031.977023:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].49, 224 off16608 00000040:00080000:2.0:1787398031.977040:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].50, 120 off16728 00000040:00080000:2.0:1787398031.977054:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].51, 224 off16952 00000040:00080000:2.0:1787398031.977059:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x72:0x0] index 51 count 51 00000100:00100000:2.0:1787398031.977164:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398031.977235:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.977281:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.977831:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277312 00000100:00100000:3.0:1787398031.977841:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277312 00000100:00100000:3.0:1787398031.977912:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787398031.977924:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398031.978081:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277312:12345-0@lo:501:mount.lustre.0 Request processed in 160us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.978090:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787398031.979283:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398031.979344:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787398031.984654:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.984918:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1787398031.985039:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277440 00000100:00100000:0.0:1787398031.985049:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277440 00000100:00100000:0.0:1787398031.985114:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787398031.985268:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787398031.985619:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277440:12345-0@lo:503:mount.lustre.0 Request processed in 355us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398031.985628:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787398031.995584:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787398031.996101:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787398031.996191:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398031.996266:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398031.996316:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787398031.997045:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277568 00000100:00100000:2.0:1787398031.997055:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277568 00000100:00100000:2.0:1787398031.997124:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787398031.997135:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398031.997312:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277568:12345-0@lo:502:mount.lustre.0 Request processed in 178us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.997320:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787398031.997412:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398031.997644:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].1, 224 off8416 00000040:00080000:2.0:1787398031.997686:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].2, 120 off8536 00000040:00080000:2.0:1787398031.997700:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].3, 168 off8704 00000040:00080000:2.0:1787398031.997714:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].4, 224 off8928 00000040:00080000:2.0:1787398031.997727:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].5, 224 off9152 00000040:00080000:2.0:1787398031.997740:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].6, 120 off9272 00000040:00080000:2.0:1787398031.997753:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].7, 168 off9440 00000040:00080000:2.0:1787398031.997767:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].8, 224 off9664 00000040:00080000:2.0:1787398031.997793:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].9, 224 off9888 00000040:00080000:2.0:1787398031.997808:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].10, 120 off10008 00000040:00080000:2.0:1787398031.997823:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].11, 224 off10232 00000040:00080000:2.0:1787398031.997835:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].12, 224 off10456 00000040:00080000:2.0:1787398031.997848:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].13, 88 off10544 00000040:00080000:2.0:1787398031.997862:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].14, 128 off10672 00000040:00080000:2.0:1787398031.997875:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].15, 144 off10816 00000040:00080000:2.0:1787398031.997886:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].16, 160 off10976 00000040:00080000:2.0:1787398031.997899:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].17, 224 off11200 00000040:00080000:2.0:1787398031.997910:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].18, 224 off11424 00000040:00080000:2.0:1787398031.997920:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].19, 80 off11504 00000040:00080000:2.0:1787398031.997931:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].20, 224 off11728 00000040:00080000:2.0:1787398031.997943:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].21, 224 off11952 00000040:00080000:2.0:1787398031.997954:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].22, 88 off12040 00000040:00080000:2.0:1787398031.997967:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].23, 128 off12168 00000040:00080000:2.0:1787398031.997978:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].24, 144 off12312 00000040:00080000:2.0:1787398031.997990:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].25, 160 off12472 00000040:00080000:2.0:1787398031.998001:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].26, 224 off12696 00000040:00080000:2.0:1787398031.998012:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].27, 224 off12920 00000040:00080000:2.0:1787398031.998024:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].28, 80 off13000 00000040:00080000:2.0:1787398031.998036:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].29, 224 off13224 00000040:00080000:2.0:1787398031.998049:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].30, 224 off13448 00000040:00080000:2.0:1787398031.998061:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].31, 88 off13536 00000040:00080000:2.0:1787398031.998074:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].32, 128 off13664 00000040:00080000:2.0:1787398031.998085:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].33, 144 off13808 00000040:00080000:2.0:1787398031.998096:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].34, 128 off13936 00000040:00080000:2.0:1787398031.998107:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].35, 224 off14160 00000040:00080000:2.0:1787398031.998117:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].36, 224 off14384 00000040:00080000:2.0:1787398031.998127:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].37, 80 off14464 00000040:00080000:2.0:1787398031.998138:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].38, 224 off14688 00000040:00080000:2.0:1787398031.998150:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].39, 224 off14912 00000040:00080000:2.0:1787398031.998162:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].40, 88 off15000 00000040:00080000:2.0:1787398031.998174:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].41, 128 off15128 00000040:00080000:2.0:1787398031.998198:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].42, 144 off15272 00000040:00080000:2.0:1787398031.998211:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].43, 128 off15400 00000040:00080000:2.0:1787398031.998222:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].44, 224 off15624 00000040:00080000:2.0:1787398031.998235:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].45, 224 off15848 00000040:00080000:2.0:1787398031.998250:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].46, 80 off15928 00000040:00080000:2.0:1787398031.998262:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].47, 224 off16152 00000040:00080000:2.0:1787398031.998273:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].48, 232 off16384 00000100:00100000:2.0:1787398031.998319:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398031.998375:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.998424:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.998596:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277696 00000100:00100000:3.0:1787398031.998603:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277696 00000100:00100000:2.0:1787398031.998763:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787398031.998772:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398031.998876:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277696:12345-0@lo:502:mount.lustre.0 Request processed in 104us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398031.998884:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787398031.998938:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398031.999094:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].49, 224 off16608 00000040:00080000:2.0:1787398031.999129:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].50, 120 off16728 00000040:00080000:2.0:1787398031.999145:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].51, 224 off16952 00000040:00080000:2.0:1787398031.999155:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].52, 224 off17176 00000040:00080000:2.0:1787398031.999165:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].53, 112 off17288 00000040:00080000:2.0:1787398031.999176:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].54, 224 off17512 00000040:00080000:2.0:1787398031.999188:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].55, 224 off17736 00000040:00080000:2.0:1787398031.999199:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].56, 136 off17872 00000040:00080000:2.0:1787398031.999211:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].57, 224 off18096 00000040:00080000:2.0:1787398031.999223:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].58, 224 off18320 00000040:00080000:2.0:1787398031.999235:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].59, 136 off18456 00000040:00080000:2.0:1787398031.999249:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].60, 224 off18680 00000040:00080000:2.0:1787398031.999262:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].61, 224 off18904 00000040:00080000:2.0:1787398031.999287:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].62, 112 off19016 00000100:00100000:2.0:1787398031.999311:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398031.999353:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398031.999381:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398031.999394:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277824 00000100:00100000:3.0:1787398031.999398:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277824 00000100:00100000:3.0:1787398031.999434:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787398031.999442:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398031.999563:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701277824:12345-0@lo:502:mount.lustre.0 Request processed in 121us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398031.999593:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787398031.999610:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701277824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398031.999646:0:104253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].63, 224 off19240 00000040:00080000:2.0:1787398031.999654:0:104253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:2.0:1787398032.000892:0:104269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787398032.000910:0:104269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff89a703c8cd40) 00000020:00000080:2.0:1787398032.000943:0:104269:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787398032.002459:0:104269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a828850000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787398032.002468:0:104269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a828850000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787398032.002471:0:104269:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a828850000 3 00010000:00080000:2.0:1787398032.002538:0:104269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7033bc000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787398032.010800:0:104269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:2.0:1787398032.010959:0:104269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787398032.011012:0:104269:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787398032.011031:0:104269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x274786fe0d193714 00000100:00080000:2.0:1787398032.011043:0:104269:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787398032.011049:0:104269:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a7033bc000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398032.011091:0:104269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a702189880 x1874218701277952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398032.011138:0:104269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787398032.012342:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701277952:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787398032.015767:0:104269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 64 count 63 00000100:00100000:1.0:1787398032.015774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787398032.015888:0:104253:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1787398032.015921:0:104253:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787398032.015947:0:104253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398032.015960:0:104253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787398032.016014:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787398032.016017:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398032.016018:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398032.016019:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398032.016021:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398032.016022:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398032.016024:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398032.016026:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398032.016027:0:104253:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787398032.016032:0:104253:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787398032.016035:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787398032.016036:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398032.016037:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398032.016038:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398032.016040:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398032.016041:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398032.016042:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398032.016043:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398032.016044:0:104253:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787398032.016071:0:104253:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787398032.016087:0:104253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701278080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787398032.016130:0:104253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398032.016279:0:104253:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83577c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.018364:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701277952 00000100:00100000:2.0:1787398032.018562:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278080 00000100:00100000:2.0:1787398032.018576:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278080 00000100:00100000:0.0:1787398032.018904:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701277952 00000100:00100000:0.0:1787398032.018984:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:0.0:1787398032.018993:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701277952:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787398032.019027:0:77740:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 3911 last 0 00000020:00000080:0.0:1787398032.019068:0:77740:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d19371b 00000004:00100000:0.0:1787398032.019085:0:77740:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787398032.019131:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a8369ca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398032.019226:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701277952:12345-0@lo:38:llog_process_th.0 Request processed in 233us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.019234:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:2.0:1787398032.019275:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787398032.019285:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701278080:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787398032.019315:0:102321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787398032.019344:0:102321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787398032.031226:0:102316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787398032.031967:0:102321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787398032.031983:0:102321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787398032.032363:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:104253:x1874218701278080:12345-0@lo:253:mount.lustre.0 Request processed in 13076us (16227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398032.032375:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787398032.032469:0:104253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:104253:1874218701278080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787398032.032482:0:104253:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787398032.032485:0:104253:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787398032.032487:0:104253:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398032.032488:0:104253:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398032.032489:0:104253:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398032.032490:0:104253:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398032.032491:0:104253:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398032.032493:0:104253:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398032.032495:0:104253:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398032.032496:0:104253:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787398032.032548:0:104253:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787398032.034786:0:102324:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787398032.034798:0:102324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787398032.034826:0:102324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034845:0:102324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d192f3b expref: 23 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034856:0:102324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 9 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034884:0:102324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034892:0:102324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034935:0:102324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.034950:0:102324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398032.034967:0:102324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278208:0@lo:104: 00000100:00100000:1.0:1787398032.035028:0:102324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787398032.035082:0:102324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 9 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.035090:0:102324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 9 pid: 102321 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398032.035100:0:102324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278336:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787398032.035157:0:102324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 23 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.035165:0:102324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 23 pid: 102326 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398032.035173:0:102324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278464:0@lo:104: 00000100:00100000:1.0:1787398032.035204:0:102324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398032.035230:0:102324:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8192966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398032.035253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278208 00000100:00100000:1.0:1787398032.035259:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278208 00000100:00100000:1.0:1787398032.035301:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278464 00000100:00100000:1.0:1787398032.035304:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278464 00000100:00100000:1.0:1787398032.035319:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787398032.035327:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:102324:x1874218701278208:12345-0@lo:104: 00010000:00010000:1.0:1787398032.035340:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.035405:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787398032.035411:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+4:102324:x1874218701278208:12345-0@lo:104: Request processed in 85us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398032.035418:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787398032.035434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1787398032.035439:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:102324:x1874218701278464:12345-0@lo:104: 00010000:00010000:1.0:1787398032.035446:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.035475:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787398032.035481:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:102324:x1874218701278464:12345-0@lo:104: Request processed in 42us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398032.035486:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:1.0:1787398032.035631:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398032.035637:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.035645:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398032.036762:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036783:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398032.036793:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398032.036801:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398032.036851:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036858:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398032.036889:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036896:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54000/0x274786fe0d1936dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1936ea expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036914:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398032.036917:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036923:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398032.036926:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036933:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398032.036950:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398032.036955:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398032.036970:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.036976:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398032.036995:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.037002:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836582400/0x274786fe0d192f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d192f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.037018:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398032.037020:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398032.037022:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398032.037033:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398032.037064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701278720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398032.037117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398032.037178:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278720 00000100:00100000:1.0:1787398032.037185:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278720 00010000:00010000:1.0:1787398032.037222:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 24 pid: 102326 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398032.037255:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1787398032.037264:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834539050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701278720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787398032.037278:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787398032.037291:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 24 pid: 102326 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.037302:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 24 pid: 102326 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.037324:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787398032.037359:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834539050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701278720:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398032.037366:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1787398032.037560:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701278720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398032.037594:0:102324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278208:0@lo:104: 00010000:00010000:1.0:1787398032.037606:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b800/0x274786fe0d192f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d192f3b expref: 23 pid: 102326 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398032.037616:0:102324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278464:0@lo:104: 00000100:00100000:2.0:1787398032.038517:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701278592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398032.038595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.038730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278592 00000100:00100000:2.0:1787398032.038737:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278592 00000100:00100000:0.0:1787398032.039639:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787398032.039652:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1787398032.039671:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787398032.039678:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787398032.039682:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787398032.039691:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701277952:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787398032.039983:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398032.040024:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1787398032.040035:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701278592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398032.040051:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398032.040057:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398032.040069:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398032.040087:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22e00/0x274786fe0d1936ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1936dc expref: 23 pid: 102323 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398032.040100:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398032.040148:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701278592:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.040154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1787398032.040193:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701278592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398032.045651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398032.045842:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337472 00000100:00100000:0.0:1787398032.045850:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337472 00000100:00100000:1.0:1787398032.045857:0:102324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102324:1874218701278336:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787398032.045888:0:102324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.045898:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 10 pid: 102321 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398032.045930:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2668 00000100:00100000:0.0:1787398032.045940:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681337472:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787398032.045955:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398032.045961:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 10 pid: 102321 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.045972:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 10 pid: 102321 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.045992:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55a00/0x274786fe0d192fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b2 expref: 10 pid: 102321 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046007:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046015:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787398032.046031:0:19657:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011233984s 00010000:00010000:0.0:1787398032.046037:0:19657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046044:0:19657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046050:0:19657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046067:0:19657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046073:0:19657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398032.046078:0:19657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046086:0:19657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046109:0:19657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398032.046127:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398032.046178:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2404:x1874218681337472:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 239us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.046186:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2668 00010000:00010000:1.0:1787398032.046431:0:102324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.046439:0:102324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398032.046446:0:102324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62400/0x274786fe0d193722 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787398032.058695:0:104253:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 77309411396 00000040:01000000:2.0:1787398032.060597:0:104253:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787398032.060947:0:104274:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 77309411396 00000020:00080000:3.0:1787398032.060951:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000040:01000000:1.0:1787398032.062710:0:104275:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787398032.066876:0:104275:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x240002340:0x1:0x0] first idx 13, last_idx 14 00000040:00080000:1.0:1787398032.066985:0:104275:0:(llog.c:805:llog_process_thread()) index: 14, lh_last_idx: 14 synced_idx: 14 lgh_last_idx: 14 00000040:00080000:1.0:1787398032.066990:0:104275:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x2400090a0:0x2:0x0] at index 14 of catalog [0x240002340:0x1:0x0] 00000040:01000000:2.0:1787398032.067047:0:104253:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787398032.070594:0:104275:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x2400090a0:0x2:0x0] at index 14 of catalog [0x240002340:0x1:0x0] 00000040:00080000:1.0:1787398032.070629:0:104275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240002340:0x1:0x0] index 14 count 1 00000004:00080000:1.0:1787398032.070714:0:104275:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787398032.071896:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701278848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.071973:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.072036:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278848 00000100:00100000:2.0:1787398032.072043:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278848 00000100:00100000:2.0:1787398032.072093:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787398032.072102:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701278848:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.072176:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701278848:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.072184:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787398032.072207:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787398032.072233:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701278848:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787398032.072264:0:104276:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787398032.072288:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701278976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.072318:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.072337:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701278976 00000100:00100000:2.0:1787398032.072340:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701278976 00000100:00100000:2.0:1787398032.072359:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787398032.072365:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701278976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.074008:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701278976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1635us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.074020:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787398032.074079:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398032.074105:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701278976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.074201:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104276:1874218701279104:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.074242:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.074273:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398032.074295:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279104 00000100:00100000:1.0:1787398032.074303:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279104 00000100:00100000:1.0:1787398032.074343:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787398032.074353:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104276:x1874218701279104:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787398032.074403:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104276:x1874218701279104:12345-0@lo:900:lod0001_rec0000.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398032.074410:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787398032.074475:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104276:1874218701279104:0@lo:900:lod0001_rec0000.0 00000040:01000000:3.0:1787398032.074543:0:104253:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1787398032.074555:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279232:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787398032.074586:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398032.074587:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398032.074601:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777b40 going to sleep for 11 seconds 00000004:00000080:3.0:1787398032.075027:0:104253:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787398032.075035:0:104253:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787398032.075072:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398032.075991:0:104253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787398032.076466:0:104253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787398032.076499:0:104253:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787398032.076656:0:104253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787398032.077584:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279232 00000100:00100000:2.0:1787398032.077598:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279232 00000100:00100000:2.0:1787398032.077688:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787398032.077698:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.077852:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 154us (3262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.077860:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787398032.077918:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.078019:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.078099:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.078132:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.080363:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279360 00000100:00100000:0.0:1787398032.080379:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279360 00000100:00100000:0.0:1787398032.080450:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787398032.080460:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279360:12345-0@lo:1000:lod0001_rec0000.0 00080000:10000000:3.0:1787398032.082123:0:104253:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x41:0x0] (8/32) registered 00000100:00100000:0.0:1787398032.086091:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 5624us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.086129:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787398032.087129:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279360:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787398032.087202:0:104276:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 26, last_idx 28 00000100:00100000:2.0:1787398032.087344:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.087428:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.087452:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7f00 going to sleep for 11 seconds 00010000:00080000:3.0:1787398032.089356:0:104253:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 81604378793 00000100:00100000:0.0:1787398032.090102:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279488 00000100:00100000:0.0:1787398032.090113:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279488 00000100:00100000:0.0:1787398032.090174:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787398032.090184:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279488:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:0.0:1787398032.091147:0:104277:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 104277 00010000:02000000:0.0:1787398032.091166:0:104277:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1787398032.091169:0:104277:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787398032.091172:0:104277:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1787398032.091280:0:104253:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787398032.091313:0:104253:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787398032.091334:0:104253:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787398032.091365:0:104253:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787398032.093927:0:104253:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787398032.094205:0:104253:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787398032.099020:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 8826us (11580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398032.099036:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787398032.099618:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279488:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787398032.105726:0:104276:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:2.0:1787398032.105738:0:104276:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x2000088d1:0x2:0x0] at index 27 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:2.0:1787398032.105860:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.105946:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.106024:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279616 00000100:00100000:2.0:1787398032.106033:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279616 00000100:00100000:2.0:1787398032.106104:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787398032.106113:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.106205:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.106214:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787398032.120172:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398032.120224:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.120363:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.120454:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.120492:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279744 00000100:00100000:2.0:1787398032.120517:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279744 00000100:00100000:2.0:1787398032.120605:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787398032.120615:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279744:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.121951:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.134859:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 14236us (14395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.134876:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787398032.135041:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.135190:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.135228:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.135258:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.135380:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701279872 00000100:00100000:0.0:1787398032.135386:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701279872 00000100:00100000:0.0:1787398032.135430:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787398032.135438:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279872:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398032.135514:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104276:x1874218701279872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.135544:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787398032.135615:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701279872:0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1787398032.135676:0:104276:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7044d73c0 with version 1 00000040:00080000:2.0:1787398032.135701:0:104276:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 27, last_idx 28 00000004:00080000:2.0:1787398032.135714:0:104276:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7044d7f00 with version 2 00000040:00080000:2.0:1787398032.135718:0:104276:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x2000088d1:0x2:0x0] at index 27 of catalog [0x200000bd3:0x1:0x0] 00000004:00080000:0.0:1787398032.135838:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 1 rpc_version 1 00000020:00100000:0.0:1787398032.135857:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398032.135867:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a705985f80 x1874218701280128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398032.135882:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280128:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398032.135916:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398032.135952:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.136935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398032.136967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398032.136992:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337600 00000100:00100000:0.0:1787398032.136999:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337600 00000100:00100000:0.0:1787398032.137050:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337728 00000100:00100000:0.0:1787398032.137053:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337728 00000100:00100000:0.0:1787398032.137076:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1723 00000100:00100000:0.0:1787398032.137084:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681337600:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398032.137159:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681337600:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.137167:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1723 00000100:00100000:0.0:1787398032.137183:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1752 00000100:00100000:0.0:1787398032.137188:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681337728:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:0.0:1787398032.137213:0:66177:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a8364ed000, cookie 0x274786fe0d193688 00010000:00080000:0.0:1787398032.137219:0:66177:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t81604378794 exp ffff89a8364ed000 cur 3911 last 1787398031 00010000:02000400:0.0:1787398032.137227:0:66177:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787398032.137232:0:66177:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1787398032.137256:0:66177:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787398032.137400:0:66177:0:(import.c:65:import_set_state_nolock()) ffff89a70374a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398032.137436:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681337728:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398032.137442:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1752 00000100:00080000:0.0:1787398032.137466:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398032.139267:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701280128 00000100:00100000:2.0:1787398032.139280:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701280128 00000100:00100000:2.0:1787398032.139340:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787398032.139351:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701280128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398032.139762:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104260:x1874218701280128:12345-0@lo:1000:osp_up0-1.0 Request processed in 412us (3844us total) trans 124554051604 rc 0/0 00000100:00100000:2.0:1787398032.139772:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787398032.140840:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705985f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280128:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398032.140860:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 2 rpc_version 2 00000020:00100000:0.0:1787398032.140917:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398032.140925:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a705984a80 x1874218701280384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398032.140952:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280384:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398032.141003:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398032.141030:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398032.141050:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701280384 00000100:00100000:0.0:1787398032.141056:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701280384 00000100:00100000:0.0:1787398032.141103:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787398032.141113:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104260:x1874218701280384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398032.143267:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104260:x1874218701280384:12345-0@lo:1000:osp_up0-1.0 Request processed in 2152us (2259us total) trans 124554051605 rc 0/0 00000100:00100000:0.0:1787398032.143279:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787398032.143365:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705984a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280384:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398032.143611:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701280512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.143691:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.143722:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701280512 00000100:00100000:2.0:1787398032.143727:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701280512 00000100:00100000:2.0:1787398032.143761:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787398032.143770:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104276:x1874218701280512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.143903:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104276:x1874218701280512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 134us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.143911:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787398032.143935:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398032.143951:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701280512:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787398032.144000:0:104276:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1787398032.144005:0:104276:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x2000088d1:0x3:0x0] at index 28 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:2.0:1787398032.144065:0:104276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701280640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.144102:0:104276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398032.144125:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701280640 00000100:00100000:2.0:1787398032.144129:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701280640 00000100:00100000:2.0:1787398032.144150:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787398032.144155:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104276:x1874218701280640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398032.144207:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104276:x1874218701280640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 52us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398032.144213:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787398032.144229:0:104276:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7044d7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398032.144241:0:104276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701529880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104276:1874218701280640:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787398032.144272:0:104276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787398032.144309:0:104276:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7044d70c0 with version 3 00000004:00080000:2.0:1787398032.144354:0:104276:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7044d7c00 with version 4 00000040:00080000:2.0:1787398032.144358:0:104276:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x2000088d1:0x3:0x0] at index 28 of catalog [0x200000bd3:0x1:0x0] 00000040:00080000:2.0:1787398032.144370:0:104276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd3:0x1:0x0] index 28 count 1 00000004:00080000:2.0:1787398032.144429:0:104276:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787398032.144433:0:104276:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:1.0:1787398032.144979:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 3 rpc_version 3 00000020:00100000:1.0:1787398032.145004:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398032.145013:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a830379880 x1874218701280896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398032.145034:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280896:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398032.145075:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398032.145098:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296240 going to sleep for 11 seconds 00000100:00100000:1.0:1787398032.145114:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701280896 00000100:00100000:1.0:1787398032.145119:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701280896 00000100:00100000:1.0:1787398032.145158:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787398032.145167:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104260:x1874218701280896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398032.145354:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701280896:12345-0@lo:1000:osp_up0-1.0 Request processed in 187us (278us total) trans 124554051606 rc 0/0 00000100:00100000:1.0:1787398032.145362:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787398032.145408:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701280896:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398032.145421:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 4 rpc_version 4 00000020:00100000:1.0:1787398032.145434:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398032.145440:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83037bb80 x1874218701281152/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398032.145454:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701281152:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398032.145487:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398032.145516:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296240 going to sleep for 11 seconds 00000100:00100000:1.0:1787398032.145570:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281152 00000100:00100000:1.0:1787398032.145574:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281152 00000100:00100000:1.0:1787398032.145604:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787398032.145612:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701281152:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1787398032.146405:0:104277:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1787398032.151691:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:104260:x1874218701281152:12345-0@lo:1000:osp_up0-1.0 Request processed in 6069us (6194us total) trans 124554051607 rc 0/0 00000100:00100000:0.0:1787398032.151691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398032.151712:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787398032.151762:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681334912 00000100:00100000:1.0:1787398032.151771:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681334912 00000100:00100000:1.0:1787398032.151826:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1753 00000100:00100000:1.0:1787398032.151836:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681334912:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00080000:1.0:1787398032.151857:0:66176:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 81604378794, current: 81604378794, replaying 00000100:00100000:1.0:1787398032.151872:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681334912:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 38us (189us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398032.151887:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1753 00000100:00100000:2.0:1787398032.152314:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701281152:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1787398032.153018:0:104277:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1787398032.234751:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398032.357830:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701281280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398032.358079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398032.358173:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281280 00000100:00100000:3.0:1787398032.358184:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281280 00000100:00100000:3.0:1787398032.358253:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787398032.358276:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701281280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398032.358308:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398032.358367:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701281280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398032.358376:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787398032.360254:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701281280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398032.370617:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787398032.370646:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701281408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398032.370730:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398032.371027:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281408 00000100:00100000:3.0:1787398032.371044:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281408 00000100:00100000:3.0:1787398032.371133:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787398032.371150:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701281408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787398032.371186:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398032.371282:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701281408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398032.371291:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787398032.371369:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701281408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398033.093309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398033.094061:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337856 00000100:00100000:2.0:1787398033.094074:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337856 00000100:00100000:2.0:1787398033.094165:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:2.0:1787398033.094177:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681337856:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398033.094207:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398033.094227:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22200/0x274786fe0d193729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87c3 expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.094258:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22200/0x274786fe0d193729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87c3 expref: 10 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.094269:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22200/0x274786fe0d193729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87c3 expref: 10 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.094290:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22200, rc 0) 00000100:00100000:2.0:1787398033.094361:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681337856:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398033.094368:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 117 00000100:00100000:0.0:1787398033.096625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398033.096726:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681337984 00000100:00100000:2.0:1787398033.096735:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681337984 00000100:00100000:2.0:1787398033.096787:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 118 00000100:00100000:2.0:1787398033.096796:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681337984:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787398033.096818:0:102323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787398033.096842:0:102323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787398033.096845:0:102323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 133 00000100:00100000:2.0:1787398033.101116:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681337984:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 4309us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398033.101131:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 118 00010000:00010000:0.0:1787398033.252646:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787398033.445285:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787398033.445292:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a828850000 from 133 10000000:01000000:1.0:1787398033.445298:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787398033.445371:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.445385:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.445395:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398033.445421:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787398033.445504:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398033.445576:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398033.445705:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281536 00000100:00100000:2.0:1787398033.445715:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281536 00000100:00100000:2.0:1787398033.445779:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787398033.445790:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701281536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398033.445809:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398033.445826:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d22c00/0x274786fe0d193737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193730 expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.445853:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d22c00/0x274786fe0d193737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193730 expref: 23 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.445865:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d22c00/0x274786fe0d193737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193730 expref: 23 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.445891:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d22c00, rc 0) 00000100:00100000:2.0:1787398033.445949:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701281536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398033.445957:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787398033.446475:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398033.446503:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.446513:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398033.446588:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787398033.446625:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398033.453812:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398033.453958:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281664 00000100:00100000:3.0:1787398033.453969:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281664 00000100:00100000:3.0:1787398033.454047:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787398033.454057:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701281664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787398033.454080:0:102321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787398033.454117:0:102321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787398033.454120:0:102321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 133 00000100:00100000:3.0:1787398033.454260:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701281664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 203us (7632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398033.454268:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787398033.454492:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787398033.454576:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787398033.454587:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.454598:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398033.454607:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787398033.454610:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a7024bf000 from 133 10000000:01000000:1.0:1787398033.454613:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787398033.454646:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.454654:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.454663:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398033.454684:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787398033.454719:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398033.454747:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398033.454805:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281792 00000100:00100000:2.0:1787398033.454810:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281792 00000100:00100000:2.0:1787398033.454854:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787398033.454862:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701281792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398033.454871:0:102322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398033.454884:0:102322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a704d23c00/0x274786fe0d193745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19373e expref: -99 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.454905:0:102322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a704d23c00/0x274786fe0d193745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19373e expref: 24 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.454915:0:102322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a704d23c00/0x274786fe0d193745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19373e expref: 24 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398033.454923:0:102322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a704d23c00, rc 0) 00000100:00100000:2.0:1787398033.454971:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701281792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398033.454978:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787398033.455074:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398033.455103:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.455115:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398033.455177:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787398033.455214:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398033.455245:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a819296900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398033.455360:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701281920 00000100:00100000:2.0:1787398033.455365:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701281920 00000100:00100000:2.0:1787398033.455399:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787398033.455405:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a842070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701281920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787398033.455417:0:102321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787398033.455434:0:102321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787398033.455437:0:102321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 133 00000100:00100000:2.0:1787398033.455513:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a842070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701281920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398033.455519:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787398033.455623:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701281920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787398033.455664:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787398033.455669:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398033.455678:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398034.276655:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398035.303936:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398036.324814:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398036.781630:0:104518:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787398036.971094:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701282048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398036.971169:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398036.971388:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282048 00000100:00100000:2.0:1787398036.971396:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282048 00000100:00100000:2.0:1787398036.971478:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787398036.971486:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701282048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787398036.971547:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:2.0:1787398036.971598:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701282048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398036.971605:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787398036.971654:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701282048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398037.253067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398037.253116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398037.253272:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338112 00000100:00100000:2.0:1787398037.253283:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338112 00000100:00100000:2.0:1787398037.253357:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:2.0:1787398037.253369:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681338112:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398037.253463:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681338112:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.253472:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:1.0:1787398037.253567:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338240 00000100:00100000:1.0:1787398037.253572:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338240 00000100:00100000:1.0:1787398037.253616:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1724 00000100:00100000:1.0:1787398037.253624:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681338240:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398037.253659:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2402:x1874218681338240:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398037.253665:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1724 00000100:00080000:2.0:1787398037.253792:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787398037.352216:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398037.477385:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701282304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398037.477753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787398037.478488:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398037.478495:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398037.478500:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398037.478507:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3911 00000100:00080000:3.0:1787398037.478512:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787398037.478600:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398037.478624:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e55f80 x1874218701282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398037.478648:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398037.478652:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398037.478654:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398037.478658:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3911 00000100:00080000:3.0:1787398037.478660:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787398037.478665:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398037.478677:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a706e55500 x1874218701282944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398037.478686:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398037.478688:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398037.478690:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398037.478704:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3911 00000100:00080000:3.0:1787398037.478707:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787398037.478712:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398037.478725:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70547b480 x1874218701283072/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398037.481745:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282304 00000100:00100000:0.0:1787398037.481762:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282304 00000100:00100000:0.0:1787398037.481833:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398037.481841:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701282304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787398037.481876:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398037.482819:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701282176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398037.482885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398037.482917:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701283200:0@lo:400:kworker.0 00000100:00100000:2.0:1787398037.483703:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701282560:0@lo:400:kworker.0 00000100:00100000:3.0:1787398037.484119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701282432:0@lo:400:kworker.0 00000100:00100000:2.0:1787398037.488812:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398037.488886:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701283456:0@lo:400:kworker.0 00000100:00100000:2.0:1787398037.488934:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398037.489002:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398037.489022:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283456 00000100:00100000:2.0:1787398037.489030:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283456 00000100:00100000:2.0:1787398037.489092:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787398037.489105:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701283456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398037.489173:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701283456:12345-0@lo:400:kworker.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.489182:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787398037.489201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398037.489204:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398037.489237:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701283456:0@lo:400:kworker.0 00000100:00100000:3.0:1787398037.489378:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.489423:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701283328:0@lo:400:kworker.0 00000100:00100000:3.0:1787398037.489453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.489492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701282688:0@lo:38:kworker.0 00000100:00100000:3.0:1787398037.489519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.489556:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701282944:0@lo:38:kworker.0 00000100:00100000:3.0:1787398037.489581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.489601:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701283072:0@lo:38:kworker.0 00000100:00100000:3.0:1787398037.489625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.489662:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282560 00000100:00100000:3.0:1787398037.489667:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282560 00000100:00100000:3.0:1787398037.489702:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283328 00000100:00100000:3.0:1787398037.489706:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283328 00000100:00100000:3.0:1787398037.489722:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282688 00000100:00100000:3.0:1787398037.489725:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282688 00000100:00100000:3.0:1787398037.489734:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282944 00000100:00100000:3.0:1787398037.489737:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282944 00000100:00100000:3.0:1787398037.489746:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1787398037.489752:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701282560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398037.489790:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701282560:12345-0@lo:400:kworker.0 Request processed in 38us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398037.489808:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1787398037.489826:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1787398037.489835:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701283328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398037.489836:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283072 00000100:00100000:2.0:1787398037.489842:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283072 00000100:00100000:2.0:1787398037.489870:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787398037.489876:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1874218701283072:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787398037.489882:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701283328:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398037.489890:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1787398037.489905:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:3.0:1787398037.489910:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701282688:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787398037.489926:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3916 last 0 00000020:00000080:3.0:1787398037.489985:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d19374c 00010000:00080000:2.0:1787398037.490009:0:66189:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a8364e9800, cookie 0x274786fe0d193681 00010000:00080000:2.0:1787398037.490015:0:66189:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff89a8364e9800 cur 3916 last 1787398031 00000004:00100000:3.0:1787398037.490018:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:2.0:1787398037.490027:0:66189:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787398037.490062:0:66189:0:(import.c:65:import_set_state_nolock()) ffff89a83563b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398037.490119:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701283072:12345-0@lo:38:kworker.0 Request processed in 242us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.490129:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1787398037.490146:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398037.490171:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701282560:0@lo:400:kworker.0 00000100:00080000:3.0:1787398037.490177:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a8310aa000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1787398037.490198:0:104277:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1787398037.490205:0:104277:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 81604378794 00000020:00080000:2.0:1787398037.490211:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00000100:00100000:3.0:1787398037.490217:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701282688:12345-0@lo:38:kworker.0 Request processed in 304us (696us total) trans 0 rc 0/0 00010000:00080000:2.0:1787398037.490223:0:104277:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 81604378794, next_transno: 81604378794 00000100:00100000:3.0:1787398037.490229:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00010000:00080000:2.0:1787398037.490231:0:104277:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (81604378794) 00000020:00080000:2.0:1787398037.490235:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1787398037.490246:0:104277:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681334912 t81604378794 from 192.168.204.60@tcp req@ffff89a702189880 x1874218681334912/t0(81604378794) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:473/0 lens 520/0 e 0 to 0 dl 1787398043 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787398037.490247:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:3.0:1787398037.490258:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701282944:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787398037.490275:0:67264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3916 last 0 00010000:00010000:2.0:1787398037.490278:0:104277:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000080:3.0:1787398037.490306:0:67264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x274786fe0d193753 00010000:00010000:2.0:1787398037.490307:0:104277:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d19375a lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87bc expref: -99 pid: 104277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:3.0:1787398037.490316:0:67264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787398037.490336:0:67264:0:(import.c:65:import_set_state_nolock()) ffff89a8310a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398037.490367:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874218701282944:12345-0@lo:38:kworker.0 Request processed in 109us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398037.490374:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:3.0:1787398037.490427:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701283328:0@lo:400:kworker.0 00010000:00080000:2.0:1787398037.490638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e55f80 x1874218701282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398037.490651:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 20 00000100:00080000:2.0:1787398037.492599:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff89a706e55f80 x1874218701282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398062 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398037.492616:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787398037.492621:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787398037.492626:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787398037.494248:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701282304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12389us (16478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398037.494266:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398037.494485:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282176 00000100:00100000:0.0:1787398037.494494:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282176 00000100:00100000:0.0:1787398037.494561:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787398037.494570:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701282176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398037.494605:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398037.494671:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701282176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (11785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398037.494677:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000004:00080000:0.0:1787398037.496961:0:104277:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6353us 00000001:00100000:0.0:1787398037.500171:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787398037.500676:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701283712:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.500751:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398037.500835:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701282176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398037.500853:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787398037.500861:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701282816:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.500886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398037.500908:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701283584:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.500949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398037.501223:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283712 00000100:00100000:0.0:1787398037.501243:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283712 00000100:00100000:0.0:1787398037.501292:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282816 00000100:00100000:0.0:1787398037.501296:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282816 00000100:00100000:0.0:1787398037.501332:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1787398037.501341:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701283712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398037.501416:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701283712:12345-0@lo:400:kworker.0 Request processed in 75us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398037.501424:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1787398037.501453:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:0.0:1787398037.501460:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701282816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398037.501487:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701282816:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398037.501493:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00100000:1.0:1787398037.501875:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283200 00000100:00100000:1.0:1787398037.501881:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283200 00000100:00100000:1.0:1787398037.501918:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283584 00000100:00100000:1.0:1787398037.501922:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283584 00000100:00100000:1.0:1787398037.502125:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787398037.502132:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701283200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.502172:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701283200:12345-0@lo:400:kworker.0 Request processed in 41us (12974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398037.502178:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787398037.502192:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787398037.502198:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701283584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.502227:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701283584:12345-0@lo:400:kworker.0 Request processed in 29us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398037.502302:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787398037.502395:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701282688:0@lo:38:kworker.0 00010000:00080000:2.0:1787398037.502441:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a706e55500 x1874218701282944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398037.502457:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 20 00000100:00100000:1.0:1787398037.503536:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701282432 00000100:00100000:1.0:1787398037.503544:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701282432 00000100:00100000:1.0:1787398037.503583:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787398037.503592:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701282432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.503669:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701282432:12345-0@lo:400:kworker.0 Request processed in 77us (14291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398037.503677:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787398037.503833:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701282432:0@lo:400:kworker.0 00000001:00100000:0.0:1787398037.505335:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787398037.505690:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701282304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398037.505733:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701282816:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.505748:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701283584:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.505760:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701283200:0@lo:400:kworker.0 00000100:00100000:1.0:1787398037.505771:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701283712:0@lo:400:kworker.0 00000100:00080000:2.0:1787398037.507195:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff89a706e55500 x1874218701282944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398062 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398037.507209:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1787398037.507215:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1787398037.507230:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1787398037.507237:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701282944:0@lo:38:kworker.0 00000100:00080000:2.0:1787398037.507291:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 20 00000100:00080000:2.0:1787398037.507486:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1787398037.507493:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:2.0:1787398037.507496:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a819129800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:2.0:1787398037.507500:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00080000:2.0:1787398037.507552:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398037.507559:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398037.507563:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398037.511483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701283072:0@lo:38:kworker.0 00010000:00080000:0.0:1787398037.511485:0:104552:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:0.0:1787398037.511494:0:104552:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:0.0:1787398037.511500:0:104552:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000001:00080000:1.0:1787398037.511624:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051607 is committed 00000100:00080000:0.0:1787398037.511921:0:104552:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787398037.512029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701283840:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787398037.512106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398037.514379:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283840 00000100:00100000:0.0:1787398037.514393:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283840 00000100:00100000:0.0:1787398037.514500:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787398037.514512:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701283840:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787398037.514555:0:66189:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70547b480 x1874218701283840/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:478/0 lens 224/0 e 0 to 0 dl 1787398048 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398037.514568:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701283840:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 59us (2462us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787398037.514575:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:0.0:1787398037.541553:0:104277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 104277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.541579:0:104277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.541596:0:104277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.541624:0:104277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 104277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.541631:0:104277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.541638:0:104277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398037.542585:0:104277:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1787398037.542612:0:104277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 104277 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542624:0:104277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542634:0:104277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542647:0:104277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542653:0:104277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 2/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542661:0:104277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542667:0:104277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398037.542671:0:104277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542688:0:104277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542702:0:104277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a702453600) 00010000:00010000:0.0:1787398037.542704:0:104277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398037.542708:0:104277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542714:0:104277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb54000/0x274786fe0d193761 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398037.542727:0:104277:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d0a5a75 reply state 00000000a190a2f5 transno 81604378794 ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542738:0:104277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542744:0:104277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a813152500) 00010000:00010000:0.0:1787398037.542747:0:104277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398037.542750:0:104277:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787398037.542815:0:104277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a704d22e00/0x274786fe0d19375a lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 9 pid: 104277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542838:0:104277:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 8 pid: 104277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.542845:0:104277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:0.0:1787398037.542847:0:104277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398037.542849:0:104277:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a82eb55600, rc 0) 00010000:00080000:0.0:1787398037.543123:0:104277:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1787398037.543466:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398037.543471:0:104277:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378795 00000020:00080000:0.0:1787398037.543476:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398037.543478:0:104277:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378795 00000100:00100000:0.0:1787398037.565911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398037.566001:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338368 00000100:00100000:3.0:1787398037.566024:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338368 00000100:00100000:3.0:1787398037.566093:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1729 00000100:00100000:3.0:1787398037.566103:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681338368:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787398037.566136:0:67264:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a82e045c00 x1874218681338368/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:478/0 lens 224/0 e 0 to 0 dl 1787398048 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398037.566171:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681338368:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 70us (276us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787398037.566180:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1729 00000020:00080000:0.0:1787398037.566513:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398037.566519:0:104277:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 81604378795 00010000:00080000:0.0:1787398037.566550:0:104277:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1787398037.566553:0:104277:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398037.566560:0:104277:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787398037.566563:0:104277:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1787398037.566693:0:104277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 20, last_transno is 85899345920 00000001:00100000:3.0:1787398037.568609:0:104254:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:3.0:1787398037.568621:0:104254:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787398037.568642:0:104254:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378794 is committed 00010000:00010000:2.0:1787398037.568671:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568686:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568693:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568699:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398037.568705:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568714:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568737:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.568744:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55a00/0x274786fe0d193768 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 104277 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787398037.574585:0:104277:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1787398037.574645:0:104277:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:0.0:1787398037.574662:0:104277:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a70547b480 x1874218701283840/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:478/0 lens 224/0 e 0 to 0 dl 1787398048 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787398037.574784:0:104277:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a82e045c00 x1874218681338368/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:478/0 lens 224/0 e 0 to 0 dl 1787398048 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1787398037.574853:0:104277:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1787398037.575036:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787398037.575046:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a82e044700 x1874218701283840/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398053 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398037.575057:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a82e044700 x1874218701283840/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398053 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398037.575066:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398037.575109:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398037.575114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701283840:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1787398037.575551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701283968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398037.575606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398037.577272:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701283968 00000100:00100000:2.0:1787398037.577286:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701283968 00000100:00100000:2.0:1787398037.577796:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787398037.577808:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701283968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787398037.577850:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445531648 avail 1299292160 00000100:00100000:2.0:1787398037.577934:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701283968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.577942:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787398037.577994:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701283968:0@lo:41:osp-pre-1-0.0 00000004:00000080:1.0:1787398037.616079:0:104277:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadfe456f7e10 00100000:10000000:1.0:1787398037.616096:0:104277:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:0.0:1787398037.620992:0:104265:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x243:0x0] 00000100:00100000:0.0:1787398037.621057:0:104265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e045f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104265:1874218701284096:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787398037.621136:0:104265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398037.621171:0:104265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398037.621276:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284096 00000100:00100000:1.0:1787398037.621285:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284096 00000100:00100000:1.0:1787398037.621430:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787398037.621439:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:104265:x1874218701284096:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787398037.621466:0:101069:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -30 00002000:02000040:1.0:1787398037.621471:0:101069:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:580 to 0x2c0000400:609) 00000004:00080000:2.0:1787398037.623190:0:104263:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x242:0x0] 00000100:00100000:2.0:1787398037.623236:0:104263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104263:1874218701284224:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787398037.623308:0:104263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398037.623339:0:104263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787398037.623361:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284224 00000100:00100000:2.0:1787398037.623368:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284224 00000100:00100000:2.0:1787398037.623423:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787398037.623432:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:104263:x1874218701284224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787398037.623457:0:100418:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -31 00002000:02000040:2.0:1787398037.623461:0:100418:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:579 to 0x280000400:609) 00002000:00010000:1.0:1787398037.639804:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.639821:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639840:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x261:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.639846:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.639854:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639885:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639895:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639915:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639937:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.639950:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.639957:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639964:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.639970:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639979:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.639997:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.640004:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d193776 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.640022:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.640024:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.640026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.641650:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.641673:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641687:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x260:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.641692:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.641697:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641711:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641721:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641730:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641752:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.641764:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.641770:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641777:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.641782:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641792:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641813:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641821:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19377d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.641840:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.641842:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.641844:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.643830:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.643842:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.643857:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25f:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.643969:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.643977:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.643992:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.644001:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.644008:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.645403:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398037.648015:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.648028:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.648047:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25e:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.648052:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.648059:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.648074:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.648083:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.648091:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398037.648426:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.648434:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.648442:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x261:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.648445:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.648450:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.648471:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.648480:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.648486:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649053:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787398037.649065:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649086:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398037.649091:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649101:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649120:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649127:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015cca1ab/0x274786fe0d193784 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649170:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398037.649174:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649181:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398037.649185:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649193:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649203:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649217:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398037.649221:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649227:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398037.649230:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649237:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649248:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.649256:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.649257:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.649259:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.651223:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787398037.651237:0:101069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d19378b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.651247:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398037.651253:0:100418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d193792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.651278:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.653750:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.656518:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.656568:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.656590:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25d:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.656596:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.656612:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.656632:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.656643:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.657645:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.657680:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.658069:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.658078:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.658087:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.658092:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.658102:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.658134:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.658142:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001feced3f/0x274786fe0d193799 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.658168:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.658170:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.658171:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.660628:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.660645:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.660661:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x260:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.660672:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.660679:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.660693:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.660703:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.660711:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.660740:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.661020:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.661027:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.661035:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.661040:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.661049:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.661074:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.661082:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1937a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.661100:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.661102:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.661104:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.661495:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.661503:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661512:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25c:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.661515:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.661567:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661580:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661588:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661596:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661614:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398037.661839:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.661844:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661853:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.661861:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.661866:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661875:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661883:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661890:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661904:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398037.661913:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398037.661918:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661925:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.661929:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661937:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661947:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661966:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ee1aa5/0x274786fe0d1937a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661981:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.661985:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.661991:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.661994:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.662002:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.662012:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.662019:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d1937ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.662030:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.662032:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.662033:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.662185:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.663284:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.663295:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.663314:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25b:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.663318:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.663324:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.663335:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.663343:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664464:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664495:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398037.664773:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.664779:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664790:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25e:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.664794:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.664799:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664811:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664827:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664834:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664850:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398037.664859:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398037.664864:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664871:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.664876:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664884:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664900:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664907:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607c7812/0x274786fe0d1937b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664926:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.664935:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664942:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.664946:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664954:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664965:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664972:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d1937bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.664984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.664986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.664987:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.665482:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.666956:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.666971:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.666991:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25d:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.666995:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.667002:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667032:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667044:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667052:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667072:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.667084:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.667090:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667098:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.667103:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667113:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667128:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667135:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1937c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.667160:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.667161:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.667163:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.668128:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.668138:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.668147:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25a:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.668151:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.668161:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.668172:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.668180:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.668200:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.668254:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.668517:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.668619:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.668628:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.668633:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.668641:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.668655:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.668662:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060580334/0x274786fe0d1937ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.668679:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.668681:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.668683:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.669557:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.669566:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.669589:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25c:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.669593:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.669598:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.669611:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.669620:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.669628:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.669653:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398037.669672:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.669678:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669685:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x259:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.669688:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.669692:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669702:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669709:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669715:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669731:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398037.669739:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398037.669743:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669755:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.669759:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669767:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669779:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669786:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d1937d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669803:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.669806:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669813:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.669816:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669823:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669833:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669847:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d1937d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.669860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.669862:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.669864:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.669989:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.670446:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.670452:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.670461:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x258:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.670464:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.670468:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.670477:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.670485:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.670492:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.670515:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398037.670689:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.670696:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.670705:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.670709:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.670719:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.670743:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.670750:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35500af/0x274786fe0d1937df lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.670768:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.670769:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.670771:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.670909:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.670916:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.670925:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25b:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.670927:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.670931:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.670940:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.670954:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.670960:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.670981:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.671043:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.671048:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671056:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.671059:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671067:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671080:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671086:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc0205e9/0x274786fe0d1937e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671101:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.671104:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.671105:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.671630:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.671638:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671646:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x257:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.671649:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.671654:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671676:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671684:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671692:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.671712:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398037.671775:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.671782:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.671790:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25a:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.671793:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.671796:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.671805:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.671812:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.671834:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.671866:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787398037.671885:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.671890:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671898:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.671903:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671911:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671923:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671930:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1937ed lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671955:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.671959:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671966:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.671969:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671977:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671987:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.671994:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001970d96b/0x274786fe0d1937f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672007:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.672009:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.672010:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.672213:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.672518:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.672543:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.672552:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x256:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.672555:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.672559:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.672568:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.672577:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.672584:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.672606:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787398037.672633:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.672638:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672647:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x259:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.672655:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.672659:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672668:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672676:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672683:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672696:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787398037.672705:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.672710:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672717:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.672721:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672729:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672740:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dedfa282/0x274786fe0d1937fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672772:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.672776:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672782:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.672785:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672792:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672802:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672810:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.672822:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.672824:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.672826:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.673117:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.673179:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1787398037.673179:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.673187:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673187:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673195:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x255:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.673199:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x258:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.673202:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.673202:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.673207:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673207:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673217:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673217:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673227:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673227:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673236:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.673236:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673286:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398037.673639:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787398037.673773:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.673778:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673786:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.673790:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673799:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398037.673806:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.673811:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673822:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673830:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d193810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673844:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.673848:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673853:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.673856:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673862:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673873:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673879:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047ecf766/0x274786fe0d193809 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.673893:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.673895:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.673902:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.674295:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.676145:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.676155:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.676164:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.676181:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.676192:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.676207:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787398037.677657:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.677669:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.677683:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x254:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.677687:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.677692:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.677704:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.677713:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.677720:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.677748:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.677775:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.677782:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.677791:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.677795:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.677804:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.677831:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.677839:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d19381e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.677855:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.677856:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.677858:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.677946:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.677991:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.677997:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.678010:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.678014:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.678022:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.678034:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.678041:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d193817 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.678067:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.678069:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.678071:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.678983:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.678993:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.679003:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x253:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.679006:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.679022:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.679041:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.679050:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.679058:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.679073:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787398037.679268:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.679274:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679282:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x256:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.679284:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.679288:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679309:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679317:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679323:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679343:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787398037.679783:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.679789:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679797:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x255:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.679800:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.679805:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679814:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679822:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679841:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.679862:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787398037.680145:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398037.680151:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680159:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.680164:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680172:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680187:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680194:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d193825 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680218:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.680221:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680227:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.680230:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680237:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680246:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680252:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d19382c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680264:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.680267:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680273:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.680275:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680295:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680306:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680313:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d193833 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.680325:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.680327:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.680329:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787398037.680502:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.680508:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680516:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x252:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.680518:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.680557:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680566:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680573:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680579:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680608:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787398037.680931:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.680936:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680951:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x251:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.680954:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.680959:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680969:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680977:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680984:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.680998:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787398037.681133:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.681140:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681148:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.681151:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.681155:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681165:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681173:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681188:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681204:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787398037.681212:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398037.681215:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681221:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.681225:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681234:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681247:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681254:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064d43af/0x274786fe0d19383a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681270:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.681273:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681291:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.681294:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681303:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681313:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681321:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000310b1da0/0x274786fe0d193841 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681335:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.681338:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.681345:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.681348:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.681623:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.682102:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.682116:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.682133:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d193848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.682151:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.682153:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.682155:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398037.682496:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398037.682504:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.682515:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x250:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:1.0:1787398037.682563:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398037.682571:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.682586:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.682608:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.682616:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.682635:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.683175:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.683184:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.683193:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.683197:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.683206:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.683226:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.683233:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1ce42e1/0x274786fe0d19384f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.683250:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.683252:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.683254:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.683262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.683267:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.683493:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787398037.683930:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.683939:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.683952:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x253:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.683955:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.683960:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.683972:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.683988:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.683995:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684012:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398037.684192:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.684199:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.684207:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24f:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.684210:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.684214:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.684225:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.684232:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.684253:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.684429:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398037.684636:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398037.684643:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684650:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.684655:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684663:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684678:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684685:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d193856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684703:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.684712:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684719:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.684722:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684730:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684741:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684748:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a78001/0x274786fe0d19385d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.684765:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.684767:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.684769:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787398037.684831:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.684837:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684844:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.684847:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.684850:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684859:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684867:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684874:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.684902:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398037.686284:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.686297:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.686309:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.686314:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.686324:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.686341:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787398037.686571:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.686578:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.686588:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x251:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.686591:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.686596:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.686606:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.686614:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.686620:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.686642:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787398037.687111:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.687119:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687128:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x250:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.687140:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.687145:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687154:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687162:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687169:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687186:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787398037.687514:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.687553:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687562:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.687564:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.687569:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687577:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687584:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687597:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687611:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787398037.687854:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.687859:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687868:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24e:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.687870:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.687874:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687882:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687890:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687898:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.687907:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1787398037.688041:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004332fbfc/0x274786fe0d193864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688070:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787398037.688081:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688088:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.688092:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688102:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688117:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688123:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9ecf57/0x274786fe0d19386b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688137:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398037.688140:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688146:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.688150:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688158:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688179:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688186:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fff8416/0x274786fe0d193872 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688199:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398037.688202:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688208:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.688211:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688218:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688227:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688234:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000231f33a/0x274786fe0d193879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688244:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.688247:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688258:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.688261:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688269:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688278:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.688285:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.688286:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd05e11c/0x274786fe0d193880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688298:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.688300:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.688302:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.688308:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787398037.688658:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398037.688664:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.688679:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24e:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:0.0:1787398037.688682:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398037.688686:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.688696:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.688703:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.688710:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.688725:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.688775:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.688782:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.688790:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.688793:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.688809:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787398037.688931:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.688937:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688945:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24d:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.688947:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.688951:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688971:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688980:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.688987:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.689011:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.689071:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.689077:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689084:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.689087:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689095:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689107:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689115:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d19388e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689130:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.689132:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.689134:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.689321:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.689468:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1787398037.689468:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.689475:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689475:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.689485:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.689485:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24d:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.689489:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.689489:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.689494:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689494:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.689505:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689505:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.689513:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689513:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689539:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.689557:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398037.689572:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398037.689577:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.689585:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398037.689589:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.689596:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.689614:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.689621:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7c0981a/0x274786fe0d19389c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.689639:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.689641:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.689643:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.689692:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.689701:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004409d76/0x274786fe0d193887 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.689715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.689717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.689718:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.689723:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.690071:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.690091:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398037.690176:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.690181:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.690190:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.690193:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.690202:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.690214:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.690227:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d193895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.690241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.690243:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.690244:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.690693:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.690701:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690710:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24b:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.690713:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.690718:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690740:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690749:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690756:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690773:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.690782:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.690785:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690791:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.690794:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690803:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690813:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690821:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.690841:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.690842:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.690844:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.691054:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.691061:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.691070:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24c:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.691073:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.691077:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.691089:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.691096:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.691102:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.691123:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.691763:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.691774:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691783:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.691787:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691796:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691810:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691817:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6a6032/0x274786fe0d1938aa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691833:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.691835:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.691837:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.691885:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.691891:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691913:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24a:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.691917:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.691921:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691931:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691939:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691945:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.691967:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398037.692102:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398037.692108:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.692116:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398037.692120:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.692128:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.692139:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398037.692145:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bdbb143/0x274786fe0d1938b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787398037.692511:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.692546:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.692563:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24b:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.692566:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.692570:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.692580:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.692587:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.692594:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.692613:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.692785:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.692791:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.692799:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.692803:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.692811:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.692833:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.692841:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52855bf/0x274786fe0d1938b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.692857:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.692859:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.692860:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.692915:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.692917:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.692919:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.693128:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.693134:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.693143:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x249:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.693146:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.693150:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.693159:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.693172:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.693180:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398037.693297:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.693303:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.693312:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24a:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.693315:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.693319:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.693328:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.693336:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.693344:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.693467:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398037.693602:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398037.693825:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398037.693834:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693844:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.693850:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693860:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693875:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693884:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d1938bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693900:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398037.693903:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.693917:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398037.693921:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.694229:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.694245:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.694252:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f40df3f2/0x274786fe0d1938c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398037.694268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.694270:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398037.694272:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.694286:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.694293:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694301:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x248:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.694305:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.694309:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694319:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694329:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694336:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694373:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.694561:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.694568:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.694576:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.694579:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.694588:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.694600:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.694608:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d1938cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.694622:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.694625:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.694627:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.694799:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.694805:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694815:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x249:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.694818:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.694822:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694831:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694839:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694847:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.694862:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.694996:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.695000:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695013:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.695025:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695033:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695045:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695052:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fc23bf/0x274786fe0d1938d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695065:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.695067:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.695069:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.695377:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.695383:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695391:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x248:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.695415:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.695420:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695431:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695439:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695446:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695463:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398037.695472:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.695476:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695483:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.695486:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695494:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695505:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695556:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba5f126/0x274786fe0d1938db lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.695573:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.695575:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.695577:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.695832:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.695838:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695847:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.695850:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.695854:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695864:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695885:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695891:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.695912:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398037.696229:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.696235:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.696243:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.696247:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.696255:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.696267:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.696274:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b42df0fd/0x274786fe0d1938e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.696293:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.696295:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.696303:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.696418:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.696425:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696433:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x247:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.696436:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.696440:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696450:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696458:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696465:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696492:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.696500:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.696503:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696510:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.696513:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696548:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696560:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696567:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e9eca7/0x274786fe0d1938e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696582:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.696584:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.696587:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.696968:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.696973:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.696982:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x246:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.696992:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.696996:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697017:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697026:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697033:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697049:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.697058:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.697061:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697068:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.697072:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697081:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697091:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697111:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f84df52d/0x274786fe0d1938f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697126:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.697128:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.697129:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.697471:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.697477:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697485:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x245:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.697488:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.697493:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697502:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697511:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697518:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697559:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.697575:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.697579:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697586:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.697590:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697598:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697610:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697616:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b61345/0x274786fe0d1938f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.697631:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.697633:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.697635:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.697825:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.697831:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.697840:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x246:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.697843:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.697847:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.697858:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.697867:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.697874:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.697895:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398037.698247:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.698252:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.698260:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.698263:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.698283:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.698294:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.698302:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dab264b/0x274786fe0d1938fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.698319:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.698321:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.698323:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398037.698430:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398037.698436:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.698443:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:3.0:1787398037.698445:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398037.698449:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.698470:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.698478:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.698485:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.698496:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787398037.698557:0:101069:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:579 00000100:00100000:3.0:1787398037.698662:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:104265:x1874218701284096:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77220us (77521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398037.698673:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787398037.698742:0:104265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e045f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104265:1874218701284096:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787398037.698757:0:104265:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x261:0x0] from OST, last_created [0x2c0000400:0x261:0x0]last_used is [0x2c0000400:0x243:0x0] 00000100:00100000:3.0:1787398037.698825:0:104265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104265:1874218701284480:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787398037.698869:0:104265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.698892:0:104265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398037.698907:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398037.698917:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701284352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398037.698949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.698981:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284480 00000100:00100000:3.0:1787398037.698987:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284480 00000100:00100000:3.0:1787398037.699048:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787398037.699057:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:104265:x1874218701284480:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787398037.699094:0:99641:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 610 00000100:00100000:3.0:1787398037.699191:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284352 00000100:00100000:3.0:1787398037.699196:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284352 00000100:00100000:3.0:1787398037.699224:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787398037.699230:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701284352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398037.699242:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398037.699282:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701284352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398037.699287:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787398037.699330:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701284352:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787398037.699666:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.699673:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699685:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.699689:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699698:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699713:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699732:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000001c0edb/0x274786fe0d193905 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699752:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.699754:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.699756:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.699824:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.699831:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699841:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x245:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.699845:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.699851:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699861:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699870:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699878:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.699897:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398037.700278:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.700284:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700293:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x244:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.700296:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.700300:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700309:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700316:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700323:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700337:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398037.700344:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398037.700429:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700439:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.700443:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700461:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700473:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700480:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006062dce6/0x274786fe0d19390c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700495:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398037.700499:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700505:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398037.700508:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700516:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700547:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700554:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a01bb0f7/0x274786fe0d193913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.700581:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.700582:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398037.700584:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398037.700862:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.701049:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398037.701162:0:100418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398037.701168:0:100418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.701176:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=3916s v=(0 0) 00010000:00010000:2.0:1787398037.701180:0:100418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398037.701184:0:100418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.701192:0:100418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.701199:0:100418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.701206:0:100418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398037.701228:0:100418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787398037.701262:0:100418:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:578 00000100:00100000:2.0:1787398037.701345:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:104263:x1874218701284224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77911us (78045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.701366:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787398037.701430:0:104263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104263:1874218701284224:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787398037.701444:0:104263:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x261:0x0] from OST, last_created [0x280000400:0x261:0x0]last_used is [0x280000400:0x242:0x0] 00000100:00100000:2.0:1787398037.701512:0:104263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104263:1874218701284736:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787398037.701581:0:104263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398037.701609:0:104263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787398037.701626:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701284608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398037.701650:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398037.701689:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284608 00000100:00100000:2.0:1787398037.701694:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284608 00000100:00100000:2.0:1787398037.701729:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787398037.701738:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701284608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398037.701756:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398037.701785:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284736 00000100:00100000:1.0:1787398037.701791:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284736 00000100:00100000:2.0:1787398037.701792:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701284608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.701802:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787398037.701831:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787398037.701838:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701284608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398037.701842:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:104263:x1874218701284736:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787398037.701876:0:99640:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 610 00010000:00010000:3.0:1787398037.702004:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398037.702017:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.702027:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398037.702032:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.702041:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.702055:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.702074:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d19391a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398037.702095:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.702097:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398037.702099:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398037.707678:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:104263:x1874218701284736:12345-0@lo:5:osp-pre-0-1.0 Request processed in 5829us (6085us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1787398037.707696:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787398037.707858:0:104263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104263:1874218701284736:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787398037.707880:0:104263:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x261:0x0]-[0x280000400:0x281:0x0] 00000100:00100000:1.0:1787398037.707926:0:104263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104263:1874218701284864:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787398037.707969:0:104263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398037.708082:0:104263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787398037.708088:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284864 00000100:00100000:2.0:1787398037.708095:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284864 00000100:00100000:2.0:1787398037.708179:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787398037.708189:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104263:x1874218701284864:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787398037.708248:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104263:x1874218701284864:12345-0@lo:900:osp-pre-0-1.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398037.708256:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787398037.708312:0:104263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104263:1874218701284864:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787398037.710636:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:104265:x1874218701284480:12345-0@lo:5:osp-pre-1-1.0 Request processed in 11570us (11757us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787398037.710650:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787398037.710718:0:104265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104265:1874218701284480:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787398037.710735:0:104265:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x261:0x0]-[0x2c0000400:0x281:0x0] 00000100:00100000:3.0:1787398037.710781:0:104265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104265:1874218701284992:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787398037.710824:0:104265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398037.713065:0:104265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398037.717091:0:66197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701284992 00000100:00100000:0.0:1787398037.717107:0:66197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701284992 00000100:00100000:0.0:1787398037.717158:0:66197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787398037.717168:0:66197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104265:x1874218701284992:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787398037.718486:0:66197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104265:x1874218701284992:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1313us (7655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398037.718500:0:66197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787398037.719487:0:104265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104265:1874218701284992:0@lo:900:osp-pre-1-1.0 00000020:00000004:3.0:1787398037.767932:0:104574:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787398037.772452:0:104574:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787398038.376610:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787398038.661426:0:104624:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787398038.661817:0:104624:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787398039.397581:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398040.424613:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398040.481838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398040.481940:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338496 00000100:00100000:1.0:1787398040.481952:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338496 00000100:00100000:1.0:1787398040.482038:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1756 00000100:00100000:1.0:1787398040.482051:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78066:x1874218681338496:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787398040.482091:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:1.0:1787398040.482168:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78066:x1874218681338496:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 119us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398040.482176:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1756 00000100:00080000:0.0:1787398040.482465:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398040.483424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398040.483574:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338624 00000100:00100000:1.0:1787398040.483582:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338624 00000100:00100000:1.0:1787398040.483644:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1757 00000100:00100000:1.0:1787398040.483654:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78066:x1874218681338624:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787398040.483683:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445531648 avail 1299292160 00000100:00100000:1.0:1787398040.483755:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78066:x1874218681338624:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398040.483762:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1757 00000100:00080000:0.0:1787398040.483825:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787398040.486805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398040.486964:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338752 00000100:00100000:3.0:1787398040.486976:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338752 00000100:00100000:3.0:1787398040.487025:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787398040.487034:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1874218681338752:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:3.0:1787398040.487068:0:101069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t8589934593 exp 0000000000000000 cur 3919 last 0 00000020:00000080:3.0:1787398040.487099:0:101069:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d193921 00002000:00100000:3.0:1787398040.487112:0:101069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a806907800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787398040.487144:0:101069:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787398040.487220:0:101069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787398040.487264:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a806901000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398040.487952:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681338752:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 914us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398040.487962:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 79 00000100:00100000:3.0:1787398040.500963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398040.501070:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681338880 00000100:00100000:0.0:1787398040.501080:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681338880 00000100:00100000:0.0:1787398040.501161:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00100000:0.0:1787398040.501171:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:78066:x1874218681338880:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:0.0:1787398040.501198:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398040.501284:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:78066:x1874218681338880:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398040.501292:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 92 00000100:00080000:2.0:1787398040.501475:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398040.507077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398040.512611:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339008 00000100:00100000:1.0:1787398040.512627:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339008 00000100:00100000:1.0:1787398040.512722:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:1.0:1787398040.512731:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681339008:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:1.0:1787398040.512780:0:99639:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 3919 last 0 00000020:00000080:1.0:1787398040.512814:0:99639:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d193928 00002000:00100000:1.0:1787398040.512825:0:99639:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a8364e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787398040.512844:0:99639:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787398040.512913:0:99639:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787398040.512958:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a817ecd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398040.513120:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681339008:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 388us (6052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398040.513129:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:3.0:1787398040.519394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398040.519651:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339136 00000100:00100000:2.0:1787398040.519664:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339136 00000100:00100000:2.0:1787398040.519750:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:2.0:1787398040.519764:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:78066:x1874218681339136:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787398040.519792:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398040.519874:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:78066:x1874218681339136:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 114us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398040.519882:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00080000:0.0:1787398040.520192:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787398041.445727:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398042.085884:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701285120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398042.085965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.086206:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285120 00000100:00100000:0.0:1787398042.086215:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285120 00000100:00100000:0.0:1787398042.086271:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787398042.086280:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701285120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787398042.086325:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787398042.086575:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701285120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 294us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.086584:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787398042.086859:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051607 gen 2 00000004:00080000:2.0:1787398042.086866:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051604 committed transno 124554051607 00000004:00080000:2.0:1787398042.086888:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051605 committed transno 124554051607 00000004:00080000:2.0:1787398042.086898:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051606 committed transno 124554051607 00000004:00080000:2.0:1787398042.086908:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051607 committed transno 124554051607 00000100:00100000:2.0:1787398042.086923:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701285120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398042.375786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398042.375930:0:102322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339264 00000100:00100000:2.0:1787398042.375952:0:102322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339264 00000100:00100000:2.0:1787398042.376021:0:102322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 125 00000100:00100000:2.0:1787398042.376033:0:102322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681339264:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398042.376120:0:102322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681339264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.376128:0:102322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 125 00000100:00100000:1.0:1787398042.385028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398042.385584:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339392 00000100:00100000:2.0:1787398042.385596:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339392 00000100:00100000:3.0:1787398042.385609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398042.385651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:0.0:1787398042.385726:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398042.385743:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339648 00000100:00100000:0.0:1787398042.385747:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339648 00000100:00100000:0.0:1787398042.385831:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:0.0:1787398042.385845:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681339648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398042.385914:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681339648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.385921:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00080000:0.0:1787398042.385938:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398042.386656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398042.386697:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339776 00000100:00100000:3.0:1787398042.386706:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339776 00000100:00100000:3.0:1787398042.386775:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:3.0:1787398042.386787:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681339776:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398042.386861:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681339776:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398042.386870:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:2.0:1787398042.387419:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339520 00000100:00100000:2.0:1787398042.387431:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339520 00000100:00100000:0.0:1787398042.387463:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1730 00000100:00100000:0.0:1787398042.387481:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681339392:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398042.387506:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1731 00000100:00100000:2.0:1787398042.387542:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681339520:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398042.387575:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681339392:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 98us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.387585:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1730 00000100:00080000:0.0:1787398042.387617:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398042.387623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398042.387631:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2405:x1874218681339520:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 109us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.387642:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1731 00010000:00010000:3.0:1787398042.468954:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398042.597151:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398042.597225:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398042.597284:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285248 00000100:00100000:1.0:1787398042.597292:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285248 00000100:00100000:2.0:1787398042.597505:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398042.597514:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701285504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398042.597568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787398042.610563:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398042.616025:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701285376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398042.616116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.616346:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285504 00000100:00100000:0.0:1787398042.616355:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285504 00000100:00100000:0.0:1787398042.616402:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787398042.616411:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701285504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787398042.616446:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445531648 avail 1299292160 00000100:00100000:0.0:1787398042.616492:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701285504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (18923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.616500:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787398042.617446:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285376 00000100:00100000:0.0:1787398042.617457:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285376 00000100:00100000:1.0:1787398042.617698:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787398042.617711:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398042.617737:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398042.617789:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (20563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398042.617796:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787398042.619822:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701285504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398042.620326:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701285632:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398042.620439:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701286144:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398042.620493:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701286656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398042.620566:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787398042.620587:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701286016:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398042.620646:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701286528:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620668:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398042.620695:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285632 00000100:00100000:2.0:1787398042.620708:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285632 00000100:00100000:2.0:1787398042.620756:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398042.620765:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701285632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620813:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701285632:12345-0@lo:400:kworker.0 Request processed in 48us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.620820:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398042.620851:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286144 00000100:00100000:2.0:1787398042.620855:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286144 00000100:00100000:2.0:1787398042.620882:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286656 00000100:00100000:2.0:1787398042.620885:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286656 00000100:00100000:2.0:1787398042.620901:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286016 00000100:00100000:2.0:1787398042.620903:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286016 00000100:00100000:2.0:1787398042.620926:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1787398042.620933:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701286144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.620964:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701286144:12345-0@lo:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.620970:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1787398042.620981:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:2.0:1787398042.620987:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701286656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621011:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701286656:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.621018:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:2.0:1787398042.621028:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:2.0:1787398042.621034:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701286016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621057:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701286016:12345-0@lo:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.621062:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:2.0:1787398042.621093:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286528 00000100:00100000:2.0:1787398042.621097:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286528 00000100:00100000:2.0:1787398042.621125:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787398042.621132:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701286528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621163:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701286528:12345-0@lo:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.621169:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787398042.621201:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701286016:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621212:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701286528:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621221:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701286144:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621228:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701286656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.621235:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701285632:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.621579:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787398042.621591:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701285376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787398042.621713:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398042.621753:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701285376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.621760:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787398042.623108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398042.623117:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398042.623120:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787398042.623148:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701285888:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.623205:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.623242:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701286400:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.623270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.623334:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701285376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398042.623355:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787398042.623369:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701285760:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.623394:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.623413:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701286272:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.623430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398042.623458:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286400 00000100:00100000:0.0:1787398042.623463:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286400 00000100:00100000:0.0:1787398042.623514:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787398042.623537:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701286400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.623857:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701286400:12345-0@lo:400:kworker.0 Request processed in 334us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398042.623865:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787398042.624053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398042.624079:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701286400:0@lo:400:kworker.0 00000100:00100000:0.0:1787398042.624165:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398042.624263:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285888 00000100:00100000:2.0:1787398042.624268:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285888 00000100:00100000:2.0:1787398042.624321:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701285760 00000100:00100000:2.0:1787398042.624324:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701285760 00000100:00100000:2.0:1787398042.624348:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286272 00000100:00100000:2.0:1787398042.624351:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286272 00000100:00100000:2.0:1787398042.624372:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:2.0:1787398042.624380:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701285888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.624426:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701285888:12345-0@lo:400:kworker.0 Request processed in 47us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.624432:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00100000:2.0:1787398042.624445:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1787398042.624452:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701285760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.624590:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701285760:12345-0@lo:400:kworker.0 Request processed in 135us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.624597:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1787398042.624897:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1787398042.624968:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.625004:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874218701286272:12345-0@lo:400:kworker.0 Request processed in 101us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398042.625011:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00080000:2.0:1787398042.625160:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398042.625164:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787398042.625230:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701285760:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.625246:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874218701286272:0@lo:400:kworker.0 00000100:00100000:2.0:1787398042.625258:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701285888:0@lo:400:kworker.0 00000100:00100000:0.0:1787398043.108752:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398043.108839:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398043.109299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398043.109309:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701286912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398043.109338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398043.109371:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286784 00000100:00100000:0.0:1787398043.109378:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286784 00000100:00100000:0.0:1787398043.109427:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701286912 00000100:00100000:0.0:1787398043.109430:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701286912 00000100:00100000:0.0:1787398043.109447:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787398043.109455:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701286784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787398043.109479:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398043.109560:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701286784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398043.109567:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787398043.109584:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787398043.109590:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701286912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787398043.109599:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398043.109601:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701286784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398043.109625:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701286912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398043.109631:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701286912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398043.109631:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1787398043.505031:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787398043.631329:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:3.0:1787398043.631357:0:99635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901911 is committed 00000001:00100000:2.0:1787398043.639689:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:2.0:1787398043.640307:0:100452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1787398044.516805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398045.541493:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398046.564910:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398047.206334:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398047.206358:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701287040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398047.206434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398047.206604:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287040 00000100:00100000:3.0:1787398047.206614:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287040 00000100:00100000:3.0:1787398047.206664:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787398047.206672:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701287040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398047.206722:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:3.0:1787398047.206768:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701287040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398047.206774:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787398047.206860:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701287040:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787398047.262277:0:104817:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00000100:00100000:3.0:1787398047.496321:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398047.496378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398047.496440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398047.496460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398047.496489:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398047.496552:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340160 00000100:00100000:3.0:1787398047.496563:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340160 00000100:00100000:3.0:1787398047.496619:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1738 00000100:00100000:3.0:1787398047.496630:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681340160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398047.496705:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2404:x1874218681340160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398047.496714:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1738 00000100:00100000:3.0:1787398047.496730:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340032 00000100:00100000:3.0:1787398047.496734:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340032 00000100:00100000:3.0:1787398047.496758:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1739 00000100:00100000:3.0:1787398047.496764:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681340032:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398047.496790:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2404:x1874218681340032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398047.496797:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1739 00000100:00100000:3.0:1787398047.496816:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340416 00000100:00100000:3.0:1787398047.496819:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340416 00000100:00100000:3.0:1787398047.496846:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340288 00000100:00100000:3.0:1787398047.496863:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340288 00000100:00100000:3.0:1787398047.496888:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787398047.497035:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681340416:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398047.497066:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681340416:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 171us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398047.497074:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787398047.497086:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:3.0:1787398047.497093:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681340288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398047.497175:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681340288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398047.497181:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 104 00000100:00100000:2.0:1787398047.497869:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681339904 00000100:00100000:2.0:1787398047.497876:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681339904 00000100:00100000:2.0:1787398047.497937:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:2.0:1787398047.497945:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681339904:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398047.497991:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681339904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 47us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398047.497998:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00080000:2.0:1787398047.498033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398047.498037:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398047.498040:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398047.498043:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787398047.588691:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398047.717007:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398047.717036:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701287168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398047.717132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398047.717379:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287168 00000100:00100000:1.0:1787398047.717387:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287168 00000100:00100000:1.0:1787398047.717462:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787398047.717472:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701287168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398047.717543:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398047.717595:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701287168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398047.717604:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787398047.717658:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701287168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787398047.717733:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398047.717919:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398047.717932:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398047.717963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398047.717993:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287296 00000100:00100000:2.0:1787398047.717997:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287296 00000100:00100000:2.0:1787398047.718029:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787398047.718036:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701287296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787398047.718053:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398047.718083:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701287296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398047.718089:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1787398047.718103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398047.718254:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398047.718264:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398047.718293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398047.718322:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287424 00000100:00100000:1.0:1787398047.718326:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287424 00000100:00100000:2.0:1787398047.718384:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398047.725150:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787398047.725185:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701287424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398047.725245:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445531648 avail 1299292160 00000100:00100000:1.0:1787398047.725352:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701287424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (7058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398047.725360:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787398047.725840:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398047.730190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701287936:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730281:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398047.730353:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288448:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398047.730403:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787398047.730408:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701287808:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730428:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398047.730455:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287936 00000100:00100000:2.0:1787398047.730462:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287936 00000100:00100000:2.0:1787398047.730558:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287808 00000100:00100000:2.0:1787398047.730561:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287808 00000100:00100000:2.0:1787398047.730586:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1787398047.730595:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701287936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730640:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701287936:12345-0@lo:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398047.730648:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1787398047.730663:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:2.0:1787398047.730670:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701287808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730696:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701287808:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398047.730702:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00080000:2.0:1787398047.730718:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787398047.730722:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398047.730750:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701287808:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730757:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.730779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398047.730800:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701287936:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731151:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701287680:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731222:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701288192:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731245:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731267:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701288704:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731286:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731304:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787398047.731310:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701287552:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731366:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701288064:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731397:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701288576:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398047.731439:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288448 00000100:00100000:0.0:1787398047.731443:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288448 00000100:00100000:0.0:1787398047.731479:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288576 00000100:00100000:0.0:1787398047.731482:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288576 00000100:00100000:0.0:1787398047.731501:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787398047.731508:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731574:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288448:12345-0@lo:400:kworker.0 Request processed in 66us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731582:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787398047.731594:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787398047.731600:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701288576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731628:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701288576:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731633:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787398047.731649:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287680 00000100:00100000:0.0:1787398047.731652:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287680 00000100:00100000:0.0:1787398047.731674:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288192 00000100:00100000:0.0:1787398047.731677:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288192 00000100:00100000:0.0:1787398047.731689:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288704 00000100:00100000:0.0:1787398047.731692:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288704 00000100:00100000:0.0:1787398047.731702:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288064 00000100:00100000:0.0:1787398047.731704:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288064 00000100:00100000:0.0:1787398047.731717:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1787398047.731723:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701287680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731761:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701287680:12345-0@lo:400:kworker.0 Request processed in 37us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731766:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1787398047.731778:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1787398047.731783:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701288192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731807:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701288192:12345-0@lo:400:kworker.0 Request processed in 23us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731813:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1787398047.731823:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:0.0:1787398047.731829:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701288704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731852:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701288704:12345-0@lo:400:kworker.0 Request processed in 24us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731858:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:0.0:1787398047.731868:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1787398047.731873:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701288064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731898:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701288064:12345-0@lo:400:kworker.0 Request processed in 25us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731904:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1787398047.731922:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701287552 00000100:00100000:0.0:1787398047.731925:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701287552 00000100:00100000:0.0:1787398047.731947:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787398047.731952:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701287552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.731980:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701287552:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398047.731986:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787398047.732023:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398047.732027:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398047.732030:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398047.732032:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398047.732057:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701287552:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.732070:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701288064:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.732077:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787398047.732090:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701288576:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.732100:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701287680:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.732110:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701288192:0@lo:400:kworker.0 00000100:00100000:0.0:1787398047.732119:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701288704:0@lo:400:kworker.0 00000100:00100000:2.0:1787398047.732368:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 2 00000100:00100000:2.0:1787398047.732389:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288448:0@lo:400:kworker.0 00000100:00100000:1.0:1787398047.732479:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288320 00000100:00100000:1.0:1787398047.732485:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288320 00000100:00100000:1.0:1787398047.732558:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787398047.732566:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398047.732628:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288320:12345-0@lo:400:kworker.0 Request processed in 64us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398047.732635:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787398047.732712:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398048.228804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398048.228835:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398048.228910:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398048.229099:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288832 00000100:00100000:0.0:1787398048.229109:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288832 00000100:00100000:0.0:1787398048.229172:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787398048.229182:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787398048.229217:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398048.229267:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398048.229276:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787398048.229748:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398048.229796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398048.229851:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398048.229995:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701288960 00000100:00100000:0.0:1787398048.230000:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701288960 00000100:00100000:0.0:1787398048.230036:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787398048.230044:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787398048.230058:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398048.230102:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701288960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398048.230123:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787398048.230235:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701288960:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787398048.612804:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398049.637630:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787398049.857987:0:104865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1787398050.663282:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398051.636206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.637071:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340544 00000100:00100000:0.0:1787398051.637092:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340544 00000100:00100000:0.0:1787398051.637221:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1758 00000100:00100000:0.0:1787398051.637238:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78534:x1874218681340544:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787398051.637293:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445113856 avail 1298874368 00000100:00100000:0.0:1787398051.637390:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78534:x1874218681340544:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 158us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.637399:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1758 00000100:00080000:1.0:1787398051.638303:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398051.640919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398051.641012:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340672 00000100:00100000:3.0:1787398051.641023:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340672 00000100:00100000:3.0:1787398051.641112:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1759 00000100:00100000:3.0:1787398051.641134:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78534:x1874218681340672:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787398051.641178:0:66176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445531648 avail 1299292160 00000100:00080000:1.0:1787398051.641203:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398051.641272:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78534:x1874218681340672:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 150us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398051.641419:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1759 00000100:00100000:3.0:1787398051.649678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.651041:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340800 00000100:00100000:2.0:1787398051.651062:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340800 00000100:00100000:2.0:1787398051.651194:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:2.0:1787398051.651215:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:78534:x1874218681340800:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787398051.651263:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398051.651405:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:78534:x1874218681340800:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 200us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398051.651415:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00080000:1.0:1787398051.652139:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398051.658010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398051.658690:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681340928 00000100:00100000:1.0:1787398051.658710:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681340928 00000100:00100000:1.0:1787398051.658882:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:1.0:1787398051.658897:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:78534:x1874218681340928:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787398051.658949:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398051.659081:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:78534:x1874218681340928:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 188us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398051.659089:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00080000:0.0:1787398051.659615:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787398051.687078:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398051.724583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.725263:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341056 00000100:00100000:0.0:1787398051.725283:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341056 00000100:00100000:0.0:1787398051.725408:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 714 00000100:00100000:0.0:1787398051.725422:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:70886:x1874218681341056:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787398051.725447:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787398051.725485:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a82eb54600/0x274786fe0d193585 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d878b expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.725513:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70c7dc300) 00010000:00010000:0.0:1787398051.725603:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d193603 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87b5 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.725649:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a82df32700) 00010000:00010000:0.0:1787398051.725670:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62200/0x274786fe0d1934c8 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8761 expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.725681:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a818432f00) 00010000:00010000:0.0:1787398051.725689:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398051.725786:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:70886:x1874218681341056:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 367us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.725797:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 714 00000100:00100000:3.0:1787398051.779064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.779206:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341184 00000100:00100000:0.0:1787398051.779227:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341184 00000100:00100000:0.0:1787398051.779332:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1760 00000100:00100000:0.0:1787398051.779345:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:78558:x1874218681341184:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787398051.779387:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398051.779423:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d19392f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87ca expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.779591:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.779609:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.779624:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398051.779692:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787398051.779710:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787398051.779842:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.779891:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75200/0x274786fe0d19392f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.779919:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 7 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.779931:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13700) 00010000:00010000:1.0:1787398051.779934:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398051.779938:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74a00, rc 0) 00000100:00100000:1.0:1787398051.780212:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78558:x1874218681341184:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 869us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398051.780222:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1760 00000100:00100000:3.0:1787398051.787463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.787753:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341312 00000100:00100000:0.0:1787398051.787765:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341312 00000100:00100000:0.0:1787398051.787831:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1761 00000100:00100000:0.0:1787398051.787842:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78558:x1874218681341312:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787398051.787864:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398051.787887:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19393d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87d1 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.787962:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.787977:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.787989:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788004:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788012:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788018:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788085:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788093:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788129:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398051.788150:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788164:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788170:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788177:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788183:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788189:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398051.788193:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788200:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788212:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13700) 00010000:00010000:0.0:1787398051.788215:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398051.788220:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788228:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788251:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788257:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788262:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788267:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398051.788270:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788276:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788284:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a809a13500) 00010000:00010000:0.0:1787398051.788286:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398051.788289:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788296:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19394b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788328:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19393d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d1 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788341:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d1 expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.788359:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a809a13d00) 00010000:00010000:0.0:1787398051.788362:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787398051.788364:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75e00, rc 0) 00000100:00100000:0.0:1787398051.788441:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:78558:x1874218681341312:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 600us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.788448:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1761 00000100:00100000:3.0:1787398051.793488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.794015:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341440 00000100:00100000:2.0:1787398051.794045:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341440 00000100:00100000:2.0:1787398051.794113:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1762 00000100:00100000:2.0:1787398051.794134:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:78558:x1874218681341440:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398051.794155:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398051.794198:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193959 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87d8 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.794374:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74e00/0x274786fe0d193960 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.794390:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74e00/0x274786fe0d193960 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.794406:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74e00/0x274786fe0d193960 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398051.794442:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1787398051.794446:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787398051.794505:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193959 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d8 expref: 9 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.794561:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74e00/0x274786fe0d193960 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d8 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.794571:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:2.0:1787398051.794575:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787398051.794579:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00000100:00100000:2.0:1787398051.794653:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:78558:x1874218681341440:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 521us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398051.794662:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1762 00000100:00100000:3.0:1787398051.801638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398051.801853:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341568 00000100:00100000:1.0:1787398051.801866:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341568 00000100:00100000:1.0:1787398051.801939:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1763 00000100:00100000:1.0:1787398051.801950:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:78558:x1874218681341568:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:1.0:1787398051.801989:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398051.802017:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193967 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87df expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802101:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802126:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802141:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802157:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802164:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802171:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802353:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802361:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802368:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398051.802441:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787398051.802453:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787398051.802479:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802493:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802500:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802506:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802512:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802518:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398051.802566:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802574:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802586:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:1.0:1787398051.802589:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398051.802593:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802600:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d19396e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802612:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802627:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802633:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802638:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398051.802641:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802646:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802654:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a81301c900) 00010000:00010000:1.0:1787398051.802657:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398051.802660:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802665:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d193975 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802700:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193967 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87df expref: 10 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802713:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87df expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398051.802721:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a81301cf00) 00010000:00010000:1.0:1787398051.802723:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398051.803321:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63000, rc 0) 00000100:00100000:1.0:1787398051.803459:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78558:x1874218681341568:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 1508us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398051.803469:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1763 00000100:00100000:3.0:1787398051.812093:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.826326:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341696 00000100:00100000:0.0:1787398051.826346:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341696 00000100:00100000:0.0:1787398051.826431:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1764 00000100:00100000:0.0:1787398051.826441:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:78558:x1874218681341696:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787398051.826464:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398051.826488:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d193983 lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87e6 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826593:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 3/1,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826608:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 3/1,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826619:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 3/1,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826632:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826641:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826661:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826953:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826963:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.826971:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398051.827019:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1787398051.827023:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787398051.827057:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827072:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 4/1,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827080:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 4/1,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827087:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 3/0,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827093:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 4/0,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827100:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398051.827104:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 4/0,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827130:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 5/0,0 mode: CR/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827145:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a809a13500) 00010000:00010000:0.0:1787398051.827148:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398051.827153:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 3/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827161:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75600/0x274786fe0d19398a lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827177:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827183:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 2/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827190:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827195:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398051.827197:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827204:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 4/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827211:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0xcd52553e (ffff89a809a13800) 00010000:00010000:0.0:1787398051.827214:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398051.827217:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 2/0,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827234:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d193991 lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827271:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d193983 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87e6 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827288:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87e6 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398051.827296:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a809a13900) 00010000:00010000:0.0:1787398051.827298:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398051.827301:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:0.0:1787398051.827420:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78558:x1874218681341696:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 978us (15336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.827428:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1764 00000100:00100000:3.0:1787398051.862067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.862182:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681341952 00000100:00100000:2.0:1787398051.862193:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681341952 00000100:00100000:2.0:1787398051.862259:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1765 00000100:00100000:2.0:1787398051.862269:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78563:x1874218681341952:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398051.862302:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398051.862322:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19399f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87ed expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398051.862426:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1787398051.862583:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19399f lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ed expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.862598:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a809a13900) 00010000:00010000:2.0:1787398051.862601:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398051.862607:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d19399f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ed expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.862621:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:2.0:1787398051.862685:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78563:x1874218681341952:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 417us (630us total) trans 124554051608 rc 301/301 00000100:00100000:2.0:1787398051.862693:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1765 00000100:00100000:2.0:1787398051.866763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398051.866844:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681342080 00000100:00100000:3.0:1787398051.866856:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681342080 00000100:00100000:3.0:1787398051.866916:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 305 00000100:00100000:3.0:1787398051.866927:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78563:x1874218681342080:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:3.0:1787398051.867039:0:66179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1787398051.867043:0:66179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787398051.867112:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78563:x1874218681342080:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 187us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398051.867133:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 305 00000100:00100000:3.0:1787398051.882211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.882421:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681342336 00000100:00100000:0.0:1787398051.882432:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681342336 00000100:00100000:0.0:1787398051.882486:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 306 00000100:00100000:0.0:1787398051.882496:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702041850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78563:x1874218681342336:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787398051.882794:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702041850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78563:x1874218681342336:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 298us (592us total) trans 124554051609 rc 0/0 00000100:00100000:0.0:1787398051.882804:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 306 00000100:00100000:0.0:1787398051.903688:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.904848:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681342592 00000100:00100000:2.0:1787398051.904865:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681342592 00000100:00100000:2.0:1787398051.904949:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1766 00000100:00100000:2.0:1787398051.904961:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78566:x1874218681342592:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398051.904987:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398051.905015:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1939ad lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87f4 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.905158:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1939b4 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.905188:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1939b4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.905199:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1939b4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398051.905215:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1787398051.905418:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74c00/0x274786fe0d1939ad lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87f4 expref: 14 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.905439:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1939b4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87f4 expref: 13 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.905449:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a809a13900) 00010000:00010000:2.0:1787398051.905452:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787398051.905456:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74600, rc 0) 00000100:00100000:2.0:1787398051.905787:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:78566:x1874218681342592:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 827us (2293us total) trans 124554051610 rc 0/0 00000100:00100000:2.0:1787398051.905795:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1766 00000100:00100000:2.0:1787398051.920138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.920249:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681342720 00000100:00100000:0.0:1787398051.920261:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681342720 00000100:00100000:0.0:1787398051.920322:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 307 00000100:00100000:0.0:1787398051.920348:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:78566:x1874218681342720:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398051.920455:0:80567:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1787398051.920460:0:80567:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398051.920594:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:78566:x1874218681342720:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 248us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.920602:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 307 00000100:00100000:3.0:1787398051.945993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.946150:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681342848 00000100:00100000:2.0:1787398051.946162:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681342848 00000100:00100000:2.0:1787398051.946223:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1767 00000100:00100000:2.0:1787398051.946233:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:78568:x1874218681342848:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398051.946253:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398051.946277:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d1939c2 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d87fb expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946366:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 3/1,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946380:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946391:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946402:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946409:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946414:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946487:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946496:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946503:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398051.946577:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1787398051.946582:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398051.946600:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946625:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 4/1,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946631:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 4/1,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946637:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946643:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 4/0,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946649:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398051.946653:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 4/0,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946660:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 5/0,0 mode: CR/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946673:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a702453c00) 00010000:00010000:2.0:1787398051.946676:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398051.946681:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 3/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946687:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d1939c9 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946702:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946707:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 2/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946719:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946724:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398051.946854:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946861:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 4/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946869:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a702453900) 00010000:00010000:2.0:1787398051.946871:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398051.946874:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946880:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d1939d0 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946912:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d1939c2 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87fb expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946926:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87fb expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.946933:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:2.0:1787398051.946935:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398051.946937:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74400, rc 0) 00000100:00100000:2.0:1787398051.947004:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78568:x1874218681342848:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 772us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398051.947163:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1767 00000100:00100000:3.0:1787398051.965828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398051.965929:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681343104 00000100:00100000:2.0:1787398051.965940:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681343104 00000100:00100000:2.0:1787398051.966002:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1768 00000100:00100000:2.0:1787398051.966014:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:78569:x1874218681343104:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398051.966045:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398051.966066:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d1939de lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8802 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398051.966175:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1787398051.966298:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d1939de lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8802 expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.966312:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:2.0:1787398051.966315:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398051.966320:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d1939de lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8802 expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398051.966333:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:2.0:1787398051.966397:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78569:x1874218681343104:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 386us (587us total) trans 85899345921 rc 301/301 00000100:00100000:2.0:1787398051.966404:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1768 00000100:00100000:3.0:1787398051.970911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398051.973275:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681343232 00000100:00100000:0.0:1787398051.973291:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681343232 00000100:00100000:0.0:1787398051.973410:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 308 00000100:00100000:0.0:1787398051.973423:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78569:x1874218681343232:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398051.973559:0:66179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1787398051.973564:0:66179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398051.973658:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78569:x1874218681343232:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 237us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398051.973667:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 308 00000100:00100000:3.0:1787398051.978119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398051.978201:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681343488 00000100:00100000:3.0:1787398051.978211:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681343488 00000100:00100000:3.0:1787398051.978263:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 309 00000100:00100000:3.0:1787398051.978273:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78569:x1874218681343488:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787398051.978489:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:78569:x1874218681343488:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 218us (389us total) trans 85899345922 rc 0/0 00000100:00100000:3.0:1787398051.978499:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 309 00000100:00100000:3.0:1787398052.008927:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398052.009124:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681343744 00000100:00100000:1.0:1787398052.009135:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681343744 00000100:00100000:1.0:1787398052.009198:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1769 00000100:00100000:1.0:1787398052.009207:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:78570:x1874218681343744:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:1.0:1787398052.009230:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398052.009262:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d1939ec lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8809 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.009400:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1939f3 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.009415:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1939f3 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.009428:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1939f3 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398052.009440:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1787398052.009585:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63c00/0x274786fe0d1939ec lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8809 expref: 15 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.009607:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1939f3 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8809 expref: 14 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.009617:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:1.0:1787398052.009627:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787398052.009631:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62a00, rc 0) 00000100:00100000:1.0:1787398052.009696:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78570:x1874218681343744:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 490us (778us total) trans 85899345923 rc 0/0 00000100:00100000:1.0:1787398052.009704:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1769 00000100:00100000:3.0:1787398052.016306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.017939:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681343872 00000100:00100000:0.0:1787398052.017953:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681343872 00000100:00100000:0.0:1787398052.018029:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 310 00000100:00100000:0.0:1787398052.018040:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78570:x1874218681343872:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398052.018148:0:66179:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1787398052.018153:0:66179:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398052.018359:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78570:x1874218681343872:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 320us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.018368:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 310 00000100:00100000:3.0:1787398052.036452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.036647:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681344000 00000100:00100000:0.0:1787398052.036658:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681344000 00000100:00100000:0.0:1787398052.036751:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1770 00000100:00100000:0.0:1787398052.036760:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78571:x1874218681344000:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787398052.036782:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398052.036808:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d193a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8810 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.036892:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:77740:1874218701289088:0@lo:900:mdt00_005.0 00000100:00100000:0.0:1787398052.036957:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.036990:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.037874:0:66198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289088 00000100:00100000:3.0:1787398052.037882:0:66198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289088 00000100:00100000:3.0:1787398052.037934:0:66198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787398052.037944:0:66198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:77740:x1874218701289088:12345-0@lo:900:mdt00_005.0 00000100:00100000:3.0:1787398052.038031:0:66198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:77740:x1874218701289088:12345-0@lo:900:mdt00_005.0 Request processed in 89us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.038040:0:66198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787398052.038192:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e045f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:77740:1874218701289088:0@lo:900:mdt00_005.0 00000100:00100000:1.0:1787398052.038255:0:77740:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701289216:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787398052.038289:0:77740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.038317:0:77740:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.038440:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289216 00000100:00100000:2.0:1787398052.038446:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289216 00000100:00100000:2.0:1787398052.038490:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787398052.038498:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:77740:x1874218701289216:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787398052.038644:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:77740:x1874218701289216:12345-0@lo:1000:mdt00_005.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.038651:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787398052.038811:0:77740:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:77740:1874218701289216:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787398052.038899:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.038927:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.038941:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398052.038988:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1787398052.038992:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398052.039050:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.039084:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d193a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8810 expref: 16 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.039108:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8810 expref: 15 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.039141:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:3.0:1787398052.039144:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787398052.039148:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:3.0:1787398052.039205:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:78571:x1874218681344000:12345-192.168.204.60@tcp:101:rm.0 Request processed in 2445us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.039212:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1770 00000100:00100000:1.0:1787398052.043255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.043665:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681344256 00000100:00100000:2.0:1787398052.043693:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681344256 00000100:00100000:2.0:1787398052.043800:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1771 00000100:00100000:2.0:1787398052.043811:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:78571:x1874218681344256:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398052.043833:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.043856:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8817 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398052.043975:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1787398052.044094:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8817 expref: 17 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.044109:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453c00) 00010000:00010000:2.0:1787398052.044122:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398052.044128:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8817 expref: 17 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.044149:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74c00, rc 0) 00000100:00100000:2.0:1787398052.044217:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:78571:x1874218681344256:12345-192.168.204.60@tcp:101:rm.0 Request processed in 408us (983us total) trans 85899345924 rc 301/301 00000100:00100000:2.0:1787398052.044225:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1771 00000100:00100000:0.0:1787398052.049969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.050100:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681344384 00000100:00100000:3.0:1787398052.050120:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681344384 00000100:00100000:3.0:1787398052.050180:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 311 00000100:00100000:3.0:1787398052.050190:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702042450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:78571:x1874218681344384:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787398052.057369:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702042450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:78571:x1874218681344384:12345-192.168.204.60@tcp:37:rm.0 Request processed in 7169us (7399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.057385:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 311 00000100:00100000:1.0:1787398052.072149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.072305:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681344640 00000100:00100000:3.0:1787398052.072316:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681344640 00000100:00100000:3.0:1787398052.072376:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 312 00000100:00100000:3.0:1787398052.072388:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:78571:x1874218681344640:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787398052.072980:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:78571:x1874218681344640:12345-192.168.204.60@tcp:35:rm.0 Request processed in 591us (839us total) trans 85899345925 rc 0/0 00000100:00100000:2.0:1787398052.072991:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 312 00000100:00100000:0.0:1787398052.077326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.077427:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681344896 00000100:00100000:2.0:1787398052.077439:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681344896 00000100:00100000:2.0:1787398052.077501:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1772 00000100:00100000:2.0:1787398052.077511:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:78571:x1874218681344896:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398052.077640:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.077663:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d881e expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.077838:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193a24 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.077852:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193a24 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.077864:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193a24 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398052.077875:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1787398052.078203:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d881e expref: 20 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.078229:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193a24 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d881e expref: 19 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.078237:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:2.0:1787398052.078240:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787398052.078244:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75600, rc 0) 00000100:00100000:2.0:1787398052.078328:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:78571:x1874218681344896:12345-192.168.204.60@tcp:101:rm.0 Request processed in 818us (1011us total) trans 85899345926 rc 0/0 00000100:00100000:2.0:1787398052.078353:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1772 00000100:00100000:0.0:1787398052.086784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.087167:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345024 00000100:00100000:2.0:1787398052.087179:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345024 00000100:00100000:2.0:1787398052.087336:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1773 00000100:00100000:2.0:1787398052.087346:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:78571:x1874218681345024:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398052.087371:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.087396:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a32 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8825 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.087696:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d193a39 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.087710:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d193a39 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.087722:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d193a39 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398052.087827:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1787398052.087831:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787398052.087867:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74c00/0x274786fe0d193a32 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8825 expref: 21 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.087884:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d193a39 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8825 expref: 20 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.087893:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a702453c00) 00010000:00010000:2.0:1787398052.087896:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787398052.087912:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:2.0:1787398052.088057:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:78571:x1874218681345024:12345-192.168.204.60@tcp:101:rm.0 Request processed in 712us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.088065:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1773 00000100:00100000:1.0:1787398052.091942:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.092094:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345152 00000100:00100000:3.0:1787398052.092104:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345152 00000100:00100000:3.0:1787398052.092224:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1774 00000100:00100000:3.0:1787398052.092235:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:78571:x1874218681345152:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398052.092255:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398052.092279:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d193a40 lrc: 2/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d882c expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.092364:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193a47 lrc: 3/1,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.092377:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193a47 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.092388:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193a47 lrc: 3/1,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398052.092431:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000088d1:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1787398052.092437:0:66177:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787398052.093010:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab600/0x274786fe0d193a40 lrc: 0/0,0 mode: --/CR res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d882c expref: 15 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.093104:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193a47 lrc: 3/0,0 mode: PR/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d882c expref: 14 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.093124:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a807d24800) 00010000:00010000:3.0:1787398052.093128:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787398052.093132:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:3.0:1787398052.093247:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78571:x1874218681345152:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1014us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.093255:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1774 00000100:00100000:0.0:1787398052.097181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.097299:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345408 00000100:00100000:3.0:1787398052.097309:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345408 00000100:00100000:3.0:1787398052.097367:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1775 00000100:00100000:3.0:1787398052.097377:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:78571:x1874218681345408:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398052.097415:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398052.097435:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d193a4e lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8833 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398052.097626:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787398052.097716:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d193a4e lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8833 expref: 22 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.097958:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:3.0:1787398052.097962:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787398052.097968:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d193a4e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8833 expref: 22 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.097983:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab000, rc 0) 00000100:00100000:3.0:1787398052.098049:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:78571:x1874218681345408:12345-192.168.204.60@tcp:101:rm.0 Request processed in 673us (877us total) trans 85899345927 rc 301/301 00000100:00100000:3.0:1787398052.098057:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1775 00000100:00100000:0.0:1787398052.102078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.102161:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345536 00000100:00100000:3.0:1787398052.102171:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345536 00000100:00100000:3.0:1787398052.102235:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 313 00000100:00100000:3.0:1787398052.102245:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:78571:x1874218681345536:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787398052.106181:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:78571:x1874218681345536:12345-192.168.204.60@tcp:37:rm.0 Request processed in 3926us (4101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.106599:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 313 00000100:00100000:2.0:1787398052.109822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398052.109943:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345664 00000100:00100000:1.0:1787398052.109953:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345664 00000100:00100000:1.0:1787398052.110009:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 314 00000100:00100000:1.0:1787398052.110019:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78571:x1874218681345664:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:1.0:1787398052.116562:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:78571:x1874218681345664:12345-192.168.204.60@tcp:37:rm.0 Request processed in 6531us (6735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.116577:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 314 00000100:00100000:2.0:1787398052.120125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.120209:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681345920 00000100:00100000:3.0:1787398052.120219:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681345920 00000100:00100000:3.0:1787398052.120298:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 315 00000100:00100000:3.0:1787398052.120319:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+21:78571:x1874218681345920:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787398052.120608:0:80567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:80567:1874218701289344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787398052.120654:0:80567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.120717:0:80567:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802ac2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.120873:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289344 00000100:00100000:2.0:1787398052.120877:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289344 00000100:00100000:2.0:1787398052.120942:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787398052.120950:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:80567:x1874218701289344:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787398052.121025:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:80567:x1874218701289344:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 69us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.121032:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787398052.121093:0:80567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:80567:1874218701289344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787398052.121172:0:80567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:80567:1874218701289472:0@lo:700:mdt_rdpg00_002.0 00000100:00100000:3.0:1787398052.121196:0:80567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.123173:0:80567:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787398052.123355:0:66196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289472 00000100:00100000:0.0:1787398052.123364:0:66196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289472 00000100:00100000:0.0:1787398052.123470:0:66196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787398052.123480:0:66196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:80567:x1874218701289472:12345-0@lo:700:mdt_rdpg00_002.0 00000100:00100000:0.0:1787398052.123598:0:66196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:80567:x1874218701289472:12345-0@lo:700:mdt_rdpg00_002.0 Request processed in 119us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.123605:0:66196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787398052.123677:0:80567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:80567:1874218701289472:0@lo:700:mdt_rdpg00_002.0 00000040:00080000:3.0:1787398052.123805:0:80567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398052.123823:0:80567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].29, 64 off34624 00000004:00080000:3.0:1787398052.123830:0:80567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a70367f540 with version 5 00000040:00080000:3.0:1787398052.123883:0:80567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398052.123894:0:80567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].30, 64 off34688 00000004:00080000:3.0:1787398052.123899:0:80567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7025be240 with version 6 00000040:00080000:3.0:1787398052.124231:0:80567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398052.124263:0:80567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].15, 64 off33728 00000040:00080000:3.0:1787398052.124518:0:80567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].1, 344 off33112 00000040:00080000:3.0:1787398052.124691:0:80567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000dec1:0x1:0x0].1, 424 off33192 00000004:00080000:3.0:1787398052.124703:0:80567:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a802ac2000 with version 7 00000004:00080000:1.0:1787398052.125431:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 5 rpc_version 5 00000020:00100000:1.0:1787398052.125470:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398052.125480:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835bfca80 x1874218701289728/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398052.125504:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701289728:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398052.125599:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.125630:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777540 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.126334:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289728 00000100:00100000:3.0:1787398052.126344:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289728 00000100:00100000:3.0:1787398052.126400:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787398052.126408:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701289728:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1787398052.129117:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051611 is committed 00000001:00080000:1.0:1787398052.129133:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051610 is committed 00000100:00100000:2.0:1787398052.129651:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701289728:12345-0@lo:1000:osp_up0-1.0 Request processed in 3238us (4047us total) trans 124554051611 rc 0/0 00000100:00100000:2.0:1787398052.129665:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000004:00080000:1.0:1787398052.129801:0:104260:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051611 committed transno 124554051611 00000100:00100000:1.0:1787398052.129807:0:104260:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051611 gen 2 00000100:00100000:1.0:1787398052.129827:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701289728:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398052.129858:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 6 rpc_version 6 00000020:00100000:1.0:1787398052.129883:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398052.129891:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835bfca80 x1874218701289984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398052.129911:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701289984:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398052.129952:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.130027:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777540 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.130416:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701289984 00000100:00100000:2.0:1787398052.130424:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701289984 00000100:00100000:2.0:1787398052.130651:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787398052.130661:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701289984:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1787398052.142401:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051612 is committed 00000100:00100000:2.0:1787398052.142934:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701289984:12345-0@lo:1000:osp_up0-1.0 Request processed in 12269us (12976us total) trans 124554051612 rc 0/0 00000100:00100000:2.0:1787398052.142949:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000004:00080000:1.0:1787398052.143098:0:104260:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051612 committed transno 124554051612 00000100:00100000:1.0:1787398052.143105:0:104260:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051612 gen 2 00000100:00100000:1.0:1787398052.143137:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bfca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701289984:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398052.143225:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 7 rpc_version 7 00000020:00100000:1.0:1787398052.143255:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398052.143263:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83af26680 x1874218701290240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398052.143284:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701290240:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398052.143324:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.143392:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.143432:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701290240 00000100:00100000:2.0:1787398052.143439:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701290240 00000100:00100000:2.0:1787398052.143514:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787398052.143550:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104260:x1874218701290240:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398052.144610:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104260:x1874218701290240:12345-0@lo:1000:osp_up0-1.0 Request processed in 1085us (1280us total) trans 124554051613 rc 0/0 00000100:00100000:2.0:1787398052.144619:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787398052.144864:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af26680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701290240:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398052.145123:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:78571:x1874218681345920:12345-192.168.204.60@tcp:35:rm.0 Request processed in 24794us (25003us total) trans 85899345928 rc 0/0 00000100:00100000:2.0:1787398052.145133:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 315 00000100:00100000:2.0:1787398052.148255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.148347:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681346176 00000100:00100000:3.0:1787398052.148356:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681346176 00000100:00100000:3.0:1787398052.148447:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1776 00000100:00100000:3.0:1787398052.148458:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+22:78571:x1874218681346176:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398052.148483:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398052.148503:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d193a5c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d883a expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.148687:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193a63 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.148700:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193a63 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.148711:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193a63 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398052.148732:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787398052.148832:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab000/0x274786fe0d193a5c lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d883a expref: 25 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.148852:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193a63 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d883a expref: 24 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.148861:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a81301cf00) 00010000:00010000:3.0:1787398052.148864:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787398052.148868:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:3.0:1787398052.148978:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681346176:12345-192.168.204.60@tcp:101:rm.0 Request processed in 522us (732us total) trans 85899345929 rc 0/0 00000100:00100000:3.0:1787398052.149005:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1776 00000100:00100000:0.0:1787398052.157883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398052.158127:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681346304 00000100:00100000:1.0:1787398052.158139:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681346304 00000100:00100000:1.0:1787398052.158197:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 316 00000100:00100000:1.0:1787398052.158207:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702041c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78571:x1874218681346304:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:2.0:1787398052.163563:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702041c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78571:x1874218681346304:12345-192.168.204.60@tcp:37:rm.0 Request processed in 5313us (5644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.163579:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 316 00000100:00100000:2.0:1787398052.167709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.167793:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681346560 00000100:00100000:3.0:1787398052.167804:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681346560 00000100:00100000:3.0:1787398052.167854:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 317 00000100:00100000:3.0:1787398052.167864:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78571:x1874218681346560:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787398052.168093:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:78571:x1874218681346560:12345-192.168.204.60@tcp:35:rm.0 Request processed in 230us (393us total) trans 124554051614 rc 0/0 00000100:00100000:3.0:1787398052.168101:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 317 00000100:00100000:0.0:1787398052.170634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.170736:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681346816 00000100:00100000:2.0:1787398052.170746:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681346816 00000100:00100000:2.0:1787398052.170807:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1777 00000100:00100000:2.0:1787398052.170817:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:78571:x1874218681346816:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787398052.170867:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787398052.170893:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74600/0x274786fe0d1939b4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87f4 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.170914:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193998 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87e6 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.170925:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a809a13900) 00010000:00010000:2.0:1787398052.170941:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193a47 lrc: 0/0,0 mode: --/PR res: [0x2000088d1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d882c expref: 10 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.170971:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a807d24800) 00010000:00010000:2.0:1787398052.170978:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787398052.171001:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 3/0,1 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171012:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171035:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 3/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171048:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: --/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171056:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171061:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171427:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171438:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171447:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398052.171690:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1787398052.171706:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171780:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171789:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171795:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398052.171799:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171807:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171818:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x33:0x0].0x0 (ffff89a702453a00) 00010000:00010000:2.0:1787398052.171820:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398052.171824:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171830:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75000/0x274786fe0d193a7f lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171852:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171858:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 4/0,1 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171863:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 3/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171869:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171882:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398052.171885:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 4/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171891:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 5/0,0 mode: CW/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171899:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a702453900) 00010000:00010000:2.0:1787398052.171902:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398052.171905:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 3/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171911:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193a71 lrc: 0/0,0 mode: --/CW res: [0x2000088d1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398052.171922:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c5f3e08 reply state 00000000c1778f41 transno 124554051615 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: PW/PW res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171933:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.171940:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0xcd52553e (ffff89a702453100) 00010000:00010000:2.0:1787398052.171943:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398052.171945:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787398052.172012:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:78571:x1874218681346816:12345-192.168.204.60@tcp:36:rm.0 Request processed in 1196us (1386us total) trans 124554051615 rc 0/0 00000100:00100000:2.0:1787398052.172033:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1777 00000100:00100000:2.0:1787398052.178365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.178438:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681346944 00000100:00100000:0.0:1787398052.178449:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681346944 00000100:00100000:0.0:1787398052.178505:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 318 00000100:00100000:0.0:1787398052.178515:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681346944:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:2.0:1787398052.183388:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681346944:12345-192.168.204.60@tcp:37:rm.0 Request processed in 4863us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.183416:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 318 00000100:00100000:1.0:1787398052.187465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.187566:0:66179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681347200 00000100:00100000:0.0:1787398052.187578:0:66179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681347200 00000100:00100000:0.0:1787398052.187639:0:66179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 319 00000100:00100000:0.0:1787398052.187649:0:66179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681347200:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787398052.187891:0:66179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:78571:x1874218681347200:12345-192.168.204.60@tcp:35:rm.0 Request processed in 243us (437us total) trans 85899345930 rc 0/0 00000100:00100000:0.0:1787398052.187899:0:66179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 319 00000100:00100000:0.0:1787398052.190569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.190691:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681347456 00000100:00100000:2.0:1787398052.190700:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681347456 00000100:00100000:2.0:1787398052.190770:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1778 00000100:00100000:2.0:1787398052.190780:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+25:78571:x1874218681347456:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:2.0:1787398052.190841:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787398052.190868:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62a00/0x274786fe0d1939f3 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8809 expref: 25 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190888:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74400/0x274786fe0d1939d7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87fb expref: 24 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190898:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:2.0:1787398052.190908:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75e00/0x274786fe0d193a39 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8825 expref: 23 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190916:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a702453c00) 00010000:00010000:2.0:1787398052.190924:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787398052.190947:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190960:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190969:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.190980:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191001:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191008:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191102:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191123:0:74374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191131:0:74374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 4/0,1 mode: --/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191163:0:74374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.191176:0:74374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398052.191190:0:74374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:74374:1874218701290368:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787398052.191267:0:74374:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf000 going to sleep for 11 seconds 00010000:00010000:1.0:1787398052.196077:0:74374:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.60@tcp) returned -22 from blocking AST (req@00000000b4e40c41 x1874218701290368) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196103:0:74374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196137:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a82eb55600/0x274786fe0d19376f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87bc expref: 22 pid: 104277 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398052.196155:0:74374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:74374:1874218701290368:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787398052.196181:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:1.0:1787398052.196199:0:74374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196209:0:74374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196216:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196238:0:74374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196247:0:74374:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398052.196252:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398052.196890:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1787398052.196909:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196917:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196924:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196930:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398052.196934:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196941:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196951:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xb:0x0].0x0 (ffff89a813152200) 00010000:00010000:0.0:1787398052.196954:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787398052.196958:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.196977:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193a94 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197009:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197015:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 2/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197020:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197025:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398052.197028:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197034:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197042:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a702453900) 00010000:00010000:0.0:1787398052.197045:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398052.197047:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197052:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75000/0x274786fe0d193a86 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398052.197062:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed4d5cef reply state 0000000014f95f39 transno 85899345931 ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197072:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.197087:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a702453a00) 00010000:00010000:0.0:1787398052.197090:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398052.197092:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787398052.197184:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:78571:x1874218681347456:12345-192.168.204.60@tcp:36:rm.0 Request processed in 6405us (6673us total) trans 85899345931 rc 0/0 00000100:00100000:0.0:1787398052.197204:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1778 00000100:00100000:1.0:1787398052.200199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.200294:0:66180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681347712 00000100:00100000:2.0:1787398052.200304:0:66180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681347712 00000100:00100000:2.0:1787398052.200365:0:66180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 320 00000100:00100000:2.0:1787398052.200376:0:66180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:78571:x1874218681347712:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787398052.200649:0:66180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681347712:12345-192.168.204.60@tcp:35:rm.0 Request processed in 274us (472us total) trans 85899345932 rc 0/0 00000100:00100000:2.0:1787398052.200672:0:66180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 320 00000100:00100000:2.0:1787398052.202917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.203061:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681347968 00000100:00100000:0.0:1787398052.203071:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681347968 00000100:00100000:0.0:1787398052.203133:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1779 00000100:00100000:0.0:1787398052.203143:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681347968:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787398052.203210:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787398052.203243:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193a63 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d883a expref: 24 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203262:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63000/0x274786fe0d19397c lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87df expref: 23 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203271:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a81301cf00) 00010000:00010000:0.0:1787398052.203285:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193a08 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8810 expref: 22 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203292:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:0.0:1787398052.203295:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787398052.203314:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203326:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203349:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203362:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203368:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203374:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203457:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203465:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203471:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203489:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,1 mode: --/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203496:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203502:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203570:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203587:0:67264:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.203597:0:67264:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,1 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.203620:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290496:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787398052.203666:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.203961:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.204636:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701290496 00000100:00100000:2.0:1787398052.204644:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701290496 00000100:00100000:2.0:1787398052.204686:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787398052.204694:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:67264:x1874218701290496:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787398052.204709:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.204845:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193abe lrc: 2/0,0 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193ab7 expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.204873:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193abe lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193ab7 expref: 7 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.204885:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193abe lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ab7 expref: 7 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.204892:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a702453c00) 00010000:00010000:2.0:1787398052.204895:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398052.204898:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:2.0:1787398052.204952:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:67264:x1874218701290496:12345-0@lo:101:mdt00_003.0 Request processed in 259us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.204959:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787398052.205044:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290496:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787398052.205061:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.205074:0:67264:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.206092:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290624:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787398052.206162:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.206284:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec840 going to sleep for 11 seconds 00000100:00100000:1.0:1787398052.211863:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701290624 00000100:00100000:1.0:1787398052.211881:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701290624 00000100:00100000:1.0:1787398052.212058:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787398052.212071:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:67264:x1874218701290624:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787398052.214549:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:67264:x1874218701290624:12345-0@lo:403:mdt00_003.0 Request processed in 2447us (8351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.214563:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787398052.216150:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290624:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1787398052.217673:0:67264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].2, 936 off34048 00000100:00100000:1.0:1787398052.217986:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290752:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398052.218059:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.218177:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.218447:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701290752 00000100:00100000:3.0:1787398052.218457:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701290752 00000100:00100000:3.0:1787398052.218573:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787398052.218585:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:67264:x1874218701290752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787398052.218673:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:67264:x1874218701290752:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.218680:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787398052.218780:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:67264:1874218701290752:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1787398052.218827:0:67264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000dec1:0x1:0x0].2, 1016 off34208 00000004:00080000:0.0:1787398052.218834:0:67264:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8357773c0 with version 8 00000004:00080000:2.0:1787398052.218893:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 8 rpc_version 8 00000020:00100000:2.0:1787398052.218916:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787398052.218925:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83037aa00 x1874218701291008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398052.218941:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701291008:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398052.218986:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398052.219175:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787398052.219454:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291008 00000100:00100000:1.0:1787398052.219460:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291008 00000100:00100000:1.0:1787398052.219492:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787398052.219499:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104260:x1874218701291008:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398052.219943:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701291008:12345-0@lo:1000:osp_up0-1.0 Request processed in 443us (953us total) trans 124554051616 rc 0/0 00000100:00100000:1.0:1787398052.219951:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787398052.220102:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701291008:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787398052.220170:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787398052.220382:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220393:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 2/0,0 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220415:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220422:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398052.220427:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220436:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 4/0,0 mode: EX/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220452:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0x0 (ffff89a809a13b00) 00010000:00010000:0.0:1787398052.220455:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787398052.220459:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 2/0,0 mode: --/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220465:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d193ab0 lrc: 0/0,0 mode: --/EX res: [0x2400090a0:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220490:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220499:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 4/0,1 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220505:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.220698:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787398052.220710:0:67264:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000088d1:0x5:0x0] 00010000:00010000:3.0:1787398052.220837:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398052.220845:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 2/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.220852:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75c00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:3.0:1787398052.220857:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398052.220864:0:6511:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 3/0,0 mode: EX/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.220908:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 2/0,0 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.220915:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398052.220943:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 1/0,0 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.220950:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a75c00/0x274786fe0d193ab7 lrc: 0/0,0 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193abe expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.220969:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398052.220971:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398052.220973:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398052.221004:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787398052.221024:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701291136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398052.221069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.221173:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291136 00000100:00100000:3.0:1787398052.221178:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291136 00000100:00100000:3.0:1787398052.221328:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:3.0:1787398052.221338:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+8:3651:x1874218701291136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398052.221350:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398052.221366:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193abe lrc: 0/0,0 mode: --/EX res: [0x2000088d1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193ab7 expref: 8 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.221379:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0x0 (ffff89a702453c00) 00010000:00010000:3.0:1787398052.221386:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398052.221434:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701291136:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.221440:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1787398052.221508:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701291136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398052.221807:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221815:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221822:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221827:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398052.221831:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221839:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221849:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xa:0x0].0x0 (ffff89a809a13a00) 00010000:00010000:2.0:1787398052.221851:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398052.221854:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221859:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75000/0x274786fe0d193aa9 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221882:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221889:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221903:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221909:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221915:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398052.221918:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221924:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221932:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:2.0:1787398052.221935:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398052.221938:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221943:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74800/0x274786fe0d193a9b lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398052.221954:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4e40c41 reply state 000000004c4b3616 transno 85899345933 ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221965:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.221972:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a809a13800) 00010000:00010000:2.0:1787398052.221975:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398052.221977:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787398052.222073:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:78571:x1874218681347968:12345-192.168.204.60@tcp:36:rm.0 Request processed in 18931us (19164us total) trans 85899345933 rc 0/0 00000100:00100000:2.0:1787398052.222087:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1779 00000100:00100000:2.0:1787398052.229423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398052.229512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.229621:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348096 00000100:00100000:0.0:1787398052.229633:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348096 00000100:00100000:0.0:1787398052.229707:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 716 00000100:00100000:0.0:1787398052.229718:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681348096:12345-192.168.204.60@tcp:103:rm.0 00010000:00010000:0.0:1787398052.229743:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398052.229768:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193952 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d1 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.229786:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a809a13d00) 00010000:00010000:0.0:1787398052.229797:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398052.229855:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681348096:12345-192.168.204.60@tcp:103:rm.0 Request processed in 138us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.229863:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 716 00000100:00100000:3.0:1787398052.235931:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348352 00000100:00100000:3.0:1787398052.235964:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348352 00000100:00100000:3.0:1787398052.236039:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 321 00000100:00100000:3.0:1787398052.236049:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:78571:x1874218681348352:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787398052.236303:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681348352:12345-192.168.204.60@tcp:35:rm.0 Request processed in 254us (6890us total) trans 85899345934 rc 0/0 00000100:00100000:3.0:1787398052.236310:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 321 00000100:00100000:2.0:1787398052.238981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.239116:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348608 00000100:00100000:3.0:1787398052.239126:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348608 00000100:00100000:3.0:1787398052.239184:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1780 00000100:00100000:3.0:1787398052.239289:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+24:78571:x1874218681348608:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787398052.239351:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787398052.239378:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193a24 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d881e expref: 24 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.239400:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74e00/0x274786fe0d193960 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87d8 expref: 23 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.239409:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a702453500) 00010000:00010000:3.0:1787398052.239420:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398052.239470:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.239479:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.239489:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398052.239509:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291264:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787398052.239689:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.239730:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.239824:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291264 00000100:00100000:2.0:1787398052.239828:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291264 00000100:00100000:2.0:1787398052.239867:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787398052.239874:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66177:x1874218701291264:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787398052.239887:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.239901:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193ac5 expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.239922:0:66188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.239933:0:66188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.239955:0:66188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.239968:0:66188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 9 pid: 66178 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398052.239978:0:66188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701291392:192.168.204.60@tcp:104: 00000100:00100000:2.0:1787398052.240057:0:66188:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.242655:0:66188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66188:1874218701291392:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787398052.242690:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.242703:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13700) 00010000:00010000:2.0:1787398052.242707:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398052.242711:0:66188:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 8 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.242732:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74400, rc 0) 00000100:00100000:2.0:1787398052.242786:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701291264:12345-0@lo:101:mdt00_001.0 Request processed in 2911us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.242794:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787398052.243221:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291264:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787398052.243239:0:66177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.243250:0:66177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398052.243435:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398052.243623:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348736 00000100:00100000:0.0:1787398052.243631:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348736 00010000:00010000:0.0:1787398052.243665:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 10 pid: 66178 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.243697:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2669 00000100:00100000:0.0:1787398052.243705:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681348736:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787398052.243730:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398052.243737:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 10 pid: 66178 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243749:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 10 pid: 66178 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243784:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87ca expref: 10 pid: 66178 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243799:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13700) 00010000:00010000:0.0:1787398052.243804:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243815:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243824:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.243859:0:19657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.243872:0:19657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:19657:1874218701291520:0@lo:105: 00000100:00100000:0.0:1787398052.243911:0:19657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.243949:0:19657:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.244343:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291520 00000100:00100000:2.0:1787398052.244349:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291520 00000100:00100000:2.0:1787398052.244391:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1787398052.244398:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1874218701291520:12345-0@lo:105: 00010000:00010000:2.0:1787398052.244409:0:93049:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244420:0:93049:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244429:0:93049:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244437:0:93049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244453:0:93049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244462:0:93049:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.244482:0:93049:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a7050ab000) 00000100:00100000:2.0:1787398052.244545:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1874218701291520:12345-0@lo:105: Request processed in 122us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.244553:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:3.0:1787398052.245091:0:66177:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.245103:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787398052.245140:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787398052.245180:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.245201:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.245212:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398052.245229:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291648:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787398052.245266:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.245286:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:2.0:1787398052.246039:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291648 00000100:00100000:2.0:1787398052.246052:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291648 00000100:00100000:2.0:1787398052.246118:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787398052.246127:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66177:x1874218701291648:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787398052.246144:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398052.246167:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193ada lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193ad3 expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.246208:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193ada lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193ad3 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.246223:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193ada lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ad3 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398052.246231:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a702453c00) 00010000:00010000:2.0:1787398052.246234:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398052.246250:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:2.0:1787398052.246303:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701291648:12345-0@lo:101:mdt00_001.0 Request processed in 177us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.246310:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787398052.246453:0:19657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:19657:1874218701291520:0@lo:105: 00010000:00010000:0.0:1787398052.246473:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398052.246540:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2405:x1874218681348736:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 2816us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.246549:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2669 00000100:00100000:3.0:1787398052.246678:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291648:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787398052.246699:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.246708:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787398052.246735:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787398052.246779:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.246811:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.246839:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.246857:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291776 00000100:00100000:3.0:1787398052.246861:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291776 00000100:00100000:3.0:1787398052.246882:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787398052.246888:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701291776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.246959:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701291776:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.246967:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787398052.246990:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247047:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291904:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247073:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.247081:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.247091:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701291904 00000100:00100000:3.0:1787398052.247094:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701291904 00000100:00100000:3.0:1787398052.247122:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787398052.247128:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e49dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701291904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247198:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e49dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701291904:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.247213:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787398052.247434:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701291904:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247468:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701292032:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247567:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.247578:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.247595:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292032 00000100:00100000:3.0:1787398052.247599:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292032 00000100:00100000:3.0:1787398052.247614:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787398052.247620:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701292032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398052.247688:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701292032:12345-0@lo:1000:mdt00_001.0 Request processed in 67us (120us total) trans 0 rc 1/1 00000100:00100000:3.0:1787398052.247695:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787398052.247717:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701292032:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787398052.247758:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247766:0:66177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247775:0:66177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398052.247785:0:66177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701292160:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787398052.247807:0:66177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.247815:0:66177:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398052.247826:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292160 00000100:00100000:3.0:1787398052.247829:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292160 00000100:00100000:3.0:1787398052.247852:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787398052.247858:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66177:x1874218701292160:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787398052.247866:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398052.247879:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193ae8 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193ae1 expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247899:0:66188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193ae8 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193ae1 expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247910:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193ae8 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193ae1 expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247918:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a809953300) 00010000:00010000:3.0:1787398052.247921:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787398052.247924:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:3.0:1787398052.247950:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:66177:x1874218701292160:12345-0@lo:101:mdt00_001.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.247956:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787398052.247978:0:66177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66177:1874218701292160:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787398052.247988:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.247997:0:66177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.248018:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.248034:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398052.248043:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787398052.248376:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].3, 432 off34480 00000040:00080000:3.0:1787398052.248423:0:66177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000dec1:0x1:0x0].3, 512 off34720 00000004:00080000:3.0:1787398052.248430:0:66177:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a7025be600 with version 9 00000004:00080000:2.0:1787398052.248803:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 9 rpc_version 9 00000020:00100000:2.0:1787398052.248829:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787398052.248839:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a706e54000 x1874218701292416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398052.248857:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701292416:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398052.248894:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398052.248918:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787398052.249478:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292416 00000100:00100000:0.0:1787398052.249486:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292416 00000100:00100000:0.0:1787398052.249544:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787398052.249552:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:104260:x1874218701292416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398052.249910:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:104260:x1874218701292416:12345-0@lo:1000:osp_up0-1.0 Request processed in 358us (1013us total) trans 124554051617 rc 0/0 00000100:00100000:0.0:1787398052.249919:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787398052.249979:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701292416:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787398052.250008:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1787398052.250039:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250049:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250056:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250062:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398052.250067:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250075:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250090:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a809953f00) 00010000:00010000:0.0:1787398052.250093:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398052.250098:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250104:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab600/0x274786fe0d193aef lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250146:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250154:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250161:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250177:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787398052.250200:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787398052.250210:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250218:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250225:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250239:0:66177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1787398052.250244:0:66177:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787398052.250249:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250256:0:66177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398052.250334:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+23:78571:x1874218681348608:12345-192.168.204.60@tcp:36:rm.0 Request processed in 11047us (11360us total) trans 85899345935 rc 0/0 00000100:00100000:0.0:1787398052.250342:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1780 00010000:00010000:0.0:1787398052.250364:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398052.250370:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250377:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787398052.250382:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398052.250389:0:56852:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250415:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250421:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398052.250444:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 1/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250451:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aa200/0x274786fe0d193ae1 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193ae8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250465:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398052.250467:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250482:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787398052.250487:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398052.250493:0:56852:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250509:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250515:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398052.250565:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250573:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050ab000/0x274786fe0d193ac5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193acc expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250585:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398052.250586:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398052.250588:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398052.250594:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398052.250602:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398052.250619:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701292544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398052.250659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.250691:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701292672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398052.250714:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.250748:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292544 00000100:00100000:0.0:1787398052.250761:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292544 00000100:00100000:0.0:1787398052.250800:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292672 00000100:00100000:0.0:1787398052.250803:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292672 00000100:00100000:0.0:1787398052.250825:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1787398052.250832:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834538450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3650:x1874218701292544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787398052.250843:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398052.250859:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193ae8 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193ae1 expref: 12 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250871:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0x0 (ffff89a809953300) 00010000:00010000:0.0:1787398052.250877:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398052.250904:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834538450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3650:x1874218701292544:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.250911:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1787398052.250946:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1787398052.250952:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701292672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787398052.250959:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398052.250969:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193acc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193ac5 expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398052.250979:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13700) 00010000:00010000:0.0:1787398052.250985:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398052.251009:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3648:x1874218701292672:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.251015:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1787398052.251048:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a806916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701292672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398052.251071:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a829b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701292544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398052.326330:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701292800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398052.326405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398052.326547:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292800 00000100:00100000:2.0:1787398052.326555:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292800 00000100:00100000:2.0:1787398052.326614:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787398052.326624:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701292800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787398052.326661:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1787398052.326715:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701292800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.326731:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787398052.328688:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701292800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398052.629411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.629476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398052.629519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398052.629653:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349120 00000100:00100000:1.0:1787398052.629663:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349120 00000100:00100000:1.0:1787398052.629719:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348992 00000100:00100000:1.0:1787398052.629723:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348992 00000100:00100000:1.0:1787398052.629759:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:1.0:1787398052.629767:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681349120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398052.629841:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681349120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 74us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.629849:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:1.0:1787398052.629867:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:1.0:1787398052.629874:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681348992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398052.629899:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681348992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.629905:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 108 00000100:00100000:2.0:1787398052.630340:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681348864 00000100:00100000:2.0:1787398052.630346:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681348864 00000100:00100000:2.0:1787398052.630391:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 129 00000100:00100000:2.0:1787398052.630399:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681348864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398052.630430:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681348864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398052.630436:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 129 00010000:00010000:0.0:1787398052.708874:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398052.838455:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701292928:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838558:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.838598:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701293440:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.838647:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701293952:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838668:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.838684:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701294464:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.838701:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701293056:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.838744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.838748:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701292928 00000100:00100000:0.0:1787398052.838756:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701292928 00000100:00100000:3.0:1787398052.838762:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701293568:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.838783:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.838796:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701294080:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838802:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787398052.838812:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701292928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.838814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.838841:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293440 00000100:00100000:3.0:1787398052.838844:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293440 00000100:00100000:0.0:1787398052.838864:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701292928:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.838871:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787398052.838876:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293952 00000100:00100000:3.0:1787398052.838878:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293952 00000100:00100000:3.0:1787398052.838895:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294464 00000100:00100000:3.0:1787398052.838898:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294464 00000100:00080000:0.0:1787398052.838905:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398052.838909:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293056 00000100:00100000:3.0:1787398052.838910:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293056 00000100:00100000:0.0:1787398052.838916:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701293312:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.838931:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1787398052.838936:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701293440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.838952:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701293824:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.838972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.838982:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701293440:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.838989:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1787398052.838996:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701294336:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839001:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293312 00000100:00100000:3.0:1787398052.839017:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293312 00000100:00100000:0.0:1787398052.839017:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.839034:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787398052.839035:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1787398052.839039:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701293184:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839040:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701293952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839059:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.839063:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a829b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701293952:12345-0@lo:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.839068:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:3.0:1787398052.839078:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293184 00000100:00100000:3.0:1787398052.839081:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293184 00000100:00100000:0.0:1787398052.839081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701293696:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839106:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1787398052.839112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398052.839121:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839130:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701294208:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.839176:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293824 00000100:00100000:0.0:1787398052.839179:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293824 00000100:00100000:0.0:1787398052.839204:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294336 00000100:00100000:0.0:1787398052.839207:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294336 00000100:00100000:0.0:1787398052.839220:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293696 00000100:00100000:0.0:1787398052.839222:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293696 00000100:00100000:0.0:1787398052.839234:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294208 00000100:00100000:0.0:1787398052.839236:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294208 00000100:00100000:0.0:1787398052.839247:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787398052.839253:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701293824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839287:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701293824:12345-0@lo:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839294:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787398052.839305:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787398052.839311:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701294336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839335:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701294336:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839341:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787398052.839359:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787398052.839365:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701293696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839393:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701293696:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839399:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787398052.839409:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787398052.839414:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701294208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839438:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701294208:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839443:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1787398052.839463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398052.839466:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398052.839468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398052.839469:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398052.839480:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70218b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701294464:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.839487:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1787398052.839496:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701292928:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839501:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1787398052.839507:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701293056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839509:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701293440:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839517:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701293952:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839549:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701294464:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839564:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701293056:12345-0@lo:400:kworker.0 Request processed in 57us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.839569:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:0.0:1787398052.839579:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701293696:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839582:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1787398052.839588:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701293312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839588:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701294208:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839597:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701293824:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839606:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701294336:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839612:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701293312:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839621:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701293312:0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839623:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1787398052.839636:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:3.0:1787398052.839641:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701293184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839673:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701293184:12345-0@lo:400:kworker.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839673:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701293568 00000100:00100000:0.0:1787398052.839677:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701293568 00000100:00100000:3.0:1787398052.839679:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:0.0:1787398052.839695:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294080 00000100:00100000:0.0:1787398052.839698:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294080 00000100:00100000:3.0:1787398052.839702:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701293056:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839709:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787398052.839714:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398052.839736:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701293184:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839751:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701293568:12345-0@lo:400:kworker.0 Request processed in 36us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398052.839755:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701293568:0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839757:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787398052.839768:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787398052.839773:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701294080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398052.839812:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701294080:12345-0@lo:400:kworker.0 Request processed in 38us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.839818:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787398052.839868:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701294080:0@lo:400:kworker.0 00000100:00100000:1.0:1787398052.840037:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398052.840046:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701294592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398052.840087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398052.840128:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294592 00000100:00100000:3.0:1787398052.840132:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398052.840132:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294592 00000100:00100000:3.0:1787398052.840139:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701294720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398052.840160:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787398052.840167:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701294592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398052.840174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787398052.840191:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398052.840223:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701294592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.840230:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787398052.840242:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294720 00000100:00100000:1.0:1787398052.840244:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294720 00000100:00100000:1.0:1787398052.840258:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787398052.840263:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701294720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398052.840288:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398052.840334:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701294720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398052.840340:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787398052.840383:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701294592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398052.840436:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701294720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398052.840798:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701294848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398052.840824:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398052.840905:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294848 00000100:00100000:0.0:1787398052.840910:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294848 00000100:00100000:0.0:1787398052.840985:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787398052.840994:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701294848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787398052.841028:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445486592 avail 1299247104 00000100:00100000:0.0:1787398052.841071:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701294848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398052.841078:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787398052.841158:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701294848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398053.348886:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398053.348941:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701294976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398053.349060:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398053.349243:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701294976 00000100:00100000:0.0:1787398053.349255:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701294976 00000100:00100000:0.0:1787398053.349353:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787398053.349367:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701294976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787398053.349410:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398053.349490:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701294976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398053.349499:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787398053.349603:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701294976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398053.350233:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701295104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398053.350290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398053.350360:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295104 00000100:00100000:2.0:1787398053.350367:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295104 00000100:00100000:2.0:1787398053.350421:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787398053.350430:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701295104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398053.350447:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398053.350724:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701295104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 294us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398053.350733:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787398053.350803:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70538bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701295104:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787398053.734359:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398054.759918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398055.785870:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398056.806232:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398057.449823:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398057.449860:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701295232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398057.449975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398057.450041:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295232 00000100:00100000:0.0:1787398057.450053:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295232 00000100:00100000:1.0:1787398057.450639:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787398057.450655:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701295232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398057.450780:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1787398057.450867:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701295232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 216us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398057.450876:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787398057.451045:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701295232:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1787398057.455419:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051617 is committed 00000001:00080000:1.0:1787398057.455484:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051615 is committed 00010000:00010000:0.0:1787398057.456275:0:104254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398057.456308:0:104254:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398057.456373:0:104254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398057.456380:0:104254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398057.456417:0:104254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a7050aaa00/0x274786fe0d193ad3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193ada expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787398057.456456:0:104254:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345935 is committed 00000100:00100000:0.0:1787398057.456571:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398057.456600:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701295360:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1787398057.456739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398057.456831:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295360 00000100:00100000:0.0:1787398057.456841:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295360 00000100:00100000:0.0:1787398057.456905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1787398057.456915:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701295360:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787398057.456930:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398057.456954:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75e00/0x274786fe0d193ada lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193ad3 expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398057.456971:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff89a702453c00) 00010000:00010000:0.0:1787398057.456982:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398057.457032:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701295360:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398057.457040:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1787398057.457098:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a702618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701295360:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1787398057.458013:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458028:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458055:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458062:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398057.458069:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458078:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458098:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x5:0x0].0xf0209d98 (ffff89a702453a00) 00010000:00010000:3.0:1787398057.458102:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398057.458107:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458114:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe74600/0x274786fe0d193a8d lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x5:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458154:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458161:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458167:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458173:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398057.458176:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458192:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458201:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x9:0x0].0xd1d4b922 (ffff89a809a13800) 00010000:00010000:3.0:1787398057.458203:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398057.458206:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398057.458212:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75400/0x274786fe0d193aa2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.459966:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,1 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.459988:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 2/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.459995:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.460000:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398057.460015:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 3/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.460024:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 4/0,0 mode: TXN/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.460044:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000088d1:0x5:0x0].0xcd52553e (ffff89a702453100) 00010000:00010000:2.0:1787398057.460066:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398057.460198:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 2/0,0 mode: --/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398057.460206:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74a00/0x274786fe0d193a78 lrc: 0/0,0 mode: --/TXN res: [0x2000088d1:0x5:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398057.735015:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398057.735075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398057.735112:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398057.735125:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349504 00000100:00100000:2.0:1787398057.735142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398057.735148:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349504 00000100:00100000:2.0:1787398057.735174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00080000:2.0:1787398057.735223:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398057.735237:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349376 00000100:00100000:0.0:1787398057.735241:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349376 00000100:00100000:2.0:1787398057.735247:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1752 00000100:00100000:2.0:1787398057.735269:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681349504:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398057.735283:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1753 00000100:00100000:3.0:1787398057.735284:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349248 00000100:00100000:3.0:1787398057.735291:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349248 00000100:00100000:0.0:1787398057.735297:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681349376:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398057.735341:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 131 00000100:00100000:3.0:1787398057.735352:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681349248:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398057.735379:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681349376:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398057.735389:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1753 00000100:00100000:0.0:1787398057.735416:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349760 00000100:00100000:0.0:1787398057.735420:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349760 00000100:00100000:0.0:1787398057.735462:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349632 00000100:00100000:0.0:1787398057.735465:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349632 00000100:00100000:0.0:1787398057.735490:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:0.0:1787398057.735512:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681349760:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398057.738510:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681349504:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3229us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398057.738550:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1752 00000100:00100000:3.0:1787398057.738555:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681349248:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3200us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.738571:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 131 00000100:00100000:3.0:1787398057.738801:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00100000:3.0:1787398057.738826:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681349632:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398057.738896:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681349632:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.739027:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 114 00000100:00080000:3.0:1787398057.739100:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398057.739106:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398057.739111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398057.739491:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681349760:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3976us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398057.739501:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 113 00010000:00010000:0.0:1787398057.830105:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398057.957051:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787398057.957093:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701295488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398057.957200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398057.957414:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295488 00000100:00100000:1.0:1787398057.957434:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295488 00000100:00100000:1.0:1787398057.957557:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787398057.957571:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701295488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398057.957618:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398057.957694:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701295488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398057.957703:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787398057.957771:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701295488:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787398057.957936:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398057.957980:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787398057.957991:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701295616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398057.958039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.958073:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295616 00000100:00100000:3.0:1787398057.958078:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295616 00000100:00100000:3.0:1787398057.958112:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787398057.958119:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701295616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787398057.958141:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398057.958177:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701295616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.958184:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1787398057.958201:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398057.958226:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705388a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701295616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398057.958492:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398057.958569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.958901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701295872:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.958945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.958985:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701296384:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.959050:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701296896:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959074:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.959093:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787398057.959098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701296256:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.959139:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701296768:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959161:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.959193:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296384 00000100:00100000:3.0:1787398057.959215:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296384 00000100:00100000:3.0:1787398057.959266:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296256 00000100:00100000:3.0:1787398057.959269:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296256 00000100:00100000:3.0:1787398057.959297:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:3.0:1787398057.959306:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701296384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398057.959455:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295744 00000100:00100000:1.0:1787398057.959460:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295744 00000100:00100000:1.0:1787398057.959498:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787398057.959507:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701295744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398057.959561:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445502976 avail 1299263488 00000100:00100000:3.0:1787398057.959720:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701296384:12345-0@lo:400:kworker.0 Request processed in 414us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.959729:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:3.0:1787398057.959750:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:3.0:1787398057.959755:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959784:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701296256:12345-0@lo:400:kworker.0 Request processed in 29us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.959790:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:3.0:1787398057.959822:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296896 00000100:00100000:3.0:1787398057.959826:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296896 00000100:00100000:3.0:1787398057.959856:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296768 00000100:00100000:3.0:1787398057.959859:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296768 00000100:00100000:3.0:1787398057.959882:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787398057.959888:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701296896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959923:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701296896:12345-0@lo:400:kworker.0 Request processed in 35us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.959930:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787398057.959941:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787398057.959947:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701296768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.959976:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701296768:12345-0@lo:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.959982:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787398057.960038:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398057.960043:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398057.960046:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787398057.960048:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398057.960064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701296000:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.960127:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701296512:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.960171:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701297024:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.960209:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787398057.960215:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701296128:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.960250:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701296640:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398057.960296:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296000 00000100:00100000:3.0:1787398057.960300:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296000 00000100:00100000:3.0:1787398057.960333:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296512 00000100:00100000:3.0:1787398057.960336:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296512 00000100:00100000:3.0:1787398057.960350:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297024 00000100:00100000:3.0:1787398057.960353:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297024 00000100:00100000:3.0:1787398057.960365:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296128 00000100:00100000:3.0:1787398057.960367:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296128 00000100:00100000:3.0:1787398057.960381:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1787398057.960387:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701296000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960420:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701296000:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.960426:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1787398057.960445:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1787398057.960450:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960477:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701296512:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.960483:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1787398057.960494:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1787398057.960499:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701297024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960551:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70538b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701297024:12345-0@lo:400:kworker.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.960557:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1787398057.960569:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:3.0:1787398057.960575:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701296128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960602:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701296128:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398057.960608:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00080000:3.0:1787398057.960636:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787398057.960639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398057.960678:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701296256:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960693:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701296768:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960707:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701296384:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960719:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701296896:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960760:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701296128:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960770:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701296000:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960792:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701296512:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.960801:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701297024:0@lo:400:kworker.0 00000100:00100000:1.0:1787398057.960939:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701295744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1431us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398057.960948:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787398057.960968:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701296640 00000100:00100000:1.0:1787398057.960972:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701296640 00000100:00100000:1.0:1787398057.960992:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787398057.961010:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398057.961044:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701296640:12345-0@lo:400:kworker.0 Request processed in 36us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398057.961051:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787398057.961179:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701295744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398057.961346:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701295872 00000100:00100000:0.0:1787398057.961352:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701295872 00000100:00100000:0.0:1787398057.961395:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787398057.961404:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701295872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398057.961448:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701295872:12345-0@lo:400:kworker.0 Request processed in 46us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398057.961455:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787398057.961980:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70261b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701295872:0@lo:400:kworker.0 00000100:00100000:3.0:1787398057.962060:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051617 gen 2 00000004:00080000:3.0:1787398057.962068:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051613 committed transno 124554051617 00000020:00080000:3.0:1787398057.962076:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a802ac2540 refcount 2 committed 0 result 0 batchid 81604378794 00000020:00080000:3.0:1787398057.962081:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a836543f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a802ac2000 00000020:00080000:3.0:1787398057.962084:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000dec1:0x1:0x0].1 00000020:00080000:3.0:1787398057.962087:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a836543400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a804ea1c00 00000020:00080000:3.0:1787398057.962090:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].1 00000020:00080000:2.0:1787398057.962134:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 81604378794 committed batchid 77309411396 00000020:00080000:2.0:1787398057.962247:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000004:00080000:3.0:1787398057.962469:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051616 committed transno 124554051617 00000020:00080000:3.0:1787398057.962474:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a835777b40 refcount 2 committed 0 result 0 batchid 81604378795 00000020:00080000:3.0:1787398057.962477:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a704fda900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a8357773c0 00000020:00080000:3.0:1787398057.962480:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000dec1:0x1:0x0].2 00000020:00080000:3.0:1787398057.962483:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a704fdaa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a7059dba00 00000020:00080000:3.0:1787398057.962486:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].2 00000020:00080000:2.0:1787398057.962541:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 81604378795 committed batchid 77309411396 00000020:00080000:2.0:1787398057.962561:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000004:00080000:3.0:1787398057.962620:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051617 committed transno 124554051617 00000020:00080000:3.0:1787398057.962625:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a7025be900 refcount 2 committed 0 result 0 batchid 81604378796 00000020:00080000:3.0:1787398057.962628:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a836543100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a7025be600 00000020:00080000:3.0:1787398057.962631:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000dec1:0x1:0x0].3 00000020:00080000:3.0:1787398057.962634:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a836543c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a705abfa00 00000020:00080000:3.0:1787398057.962637:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].3 00000020:00080000:2.0:1787398057.962665:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 81604378796 committed batchid 77309411396 00000020:00080000:2.0:1787398057.962681:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411396 00000100:00100000:3.0:1787398057.962737:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701296640:0@lo:400:kworker.0 00000100:00100000:2.0:1787398058.473978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398058.474034:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701297152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398058.474166:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398058.474275:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297152 00000100:00100000:2.0:1787398058.474286:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297152 00000100:00100000:2.0:1787398058.474361:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787398058.474373:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701297152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398058.474413:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398058.474472:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701297152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398058.474481:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787398058.474596:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701297152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398058.477298:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398058.477333:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701297280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398058.477444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398058.477511:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297280 00000100:00100000:3.0:1787398058.477551:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297280 00000100:00100000:3.0:1787398058.477624:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787398058.477636:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701297280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398058.477667:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398058.477736:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70261b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701297280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398058.477746:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787398058.477811:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a705987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701297280:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787398058.854509:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398059.878614:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398060.904722:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398061.351372:0:105062:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137c: DNE: create under striped dir, fail MDT1/MDT2 ========================================================== 07:27:38 (1787398058) 00000100:00100000:2.0:1787398061.638892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398061.639182:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681349888 00000100:00100000:0.0:1787398061.639198:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681349888 00000100:00100000:0.0:1787398061.639282:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1781 00000100:00100000:0.0:1787398061.639305:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79176:x1874218681349888:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:0.0:1787398061.639325:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398061.639348:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8841 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639417:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639451:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639467:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398061.639551:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787398061.639556:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787398061.639579:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639621:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8841 expref: 8 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639641:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8841 expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.639651:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13b00) 00010000:00010000:0.0:1787398061.639655:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398061.639658:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:0.0:1787398061.639724:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79176:x1874218681349888:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 433us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.639733:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1781 00000100:00080000:2.0:1787398061.640768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398061.656730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398061.660409:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350144 00000100:00100000:3.0:1787398061.660426:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350144 00000100:00100000:3.0:1787398061.660508:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1782 00000100:00100000:3.0:1787398061.660544:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79176:x1874218681350144:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787398061.660568:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398061.660571:0:77740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787398061.660602:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193afd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8841 expref: 7 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660625:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a809a13b00) 00010000:00010000:3.0:1787398061.660637:0:77740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398061.660653:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8848 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660794:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660808:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660819:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660832:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660839:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.660847:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398061.661367:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00010000:00010000:3.0:1787398061.661382:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661391:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661399:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661411:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661429:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661435:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661442:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661448:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398061.661452:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661460:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661469:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:3.0:1787398061.661472:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398061.661476:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661482:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398061.661494:0:77740:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000775fd22c reply state 0000000085cc8b74 transno 124554051618 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661505:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661511:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a81a964700) 00010000:00010000:3.0:1787398061.661548:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787398061.661551:0:77740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787398061.661580:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661600:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 8 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.661607:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:3.0:1787398061.661610:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398061.661612:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:3.0:1787398061.661679:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79176:x1874218681350144:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1161us (4962us total) trans 124554051618 rc 0/0 00000100:00100000:3.0:1787398061.661686:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1782 00000100:00100000:1.0:1787398061.702938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398061.703218:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350272 00000100:00100000:3.0:1787398061.703231:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350272 00000100:00100000:3.0:1787398061.703394:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1783 00000100:00100000:3.0:1787398061.703405:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79177:x1874218681350272:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787398061.703430:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398061.703456:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d884f expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703539:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703553:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703565:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398061.703640:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787398061.703644:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398061.703665:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703689:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d884f expref: 11 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703707:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d884f expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.703715:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:3.0:1787398061.703718:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398061.703721:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:3.0:1787398061.703789:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681350272:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 386us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398061.703796:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1783 00000100:00100000:2.0:1787398061.713818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398061.716076:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350400 00000100:00100000:0.0:1787398061.716093:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350400 00000100:00100000:0.0:1787398061.716175:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1784 00000100:00100000:0.0:1787398061.716185:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681350400:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787398061.716223:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398061.716245:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193b2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8856 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716315:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716329:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716343:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716368:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716375:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716382:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716468:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716477:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716483:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398061.716567:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00000004:00200000:0.0:1787398061.716577:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787398061.716601:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716625:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716631:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716637:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716643:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398061.716647:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716653:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716665:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:0.0:1787398061.716668:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398061.716673:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716678:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716691:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716697:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716713:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716718:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398061.716722:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716728:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716735:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a81a964700) 00010000:00010000:0.0:1787398061.716738:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398061.716742:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716747:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d193b3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716773:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193b2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8856 expref: 12 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716786:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8856 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.716793:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:0.0:1787398061.716795:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787398061.716798:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:0.0:1787398061.716861:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:79177:x1874218681350400:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 677us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.716879:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1784 00000100:00100000:1.0:1787398061.727315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398061.727426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398061.727753:0:19654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350528 00000100:00100000:2.0:1787398061.727765:0:19654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350528 00000100:00100000:2.0:1787398061.727841:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 720 00000100:00100000:2.0:1787398061.727853:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2403:x1874218681350528:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787398061.727870:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398061.727899:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75c00/0x274786fe0d193b43 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8856 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.727930:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:2.0:1787398061.727936:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398061.728010:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2403:x1874218681350528:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 159us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.728047:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 720 00000100:00100000:3.0:1787398061.728427:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350656 00000100:00100000:3.0:1787398061.728434:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350656 00000100:00100000:3.0:1787398061.728483:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1785 00000100:00100000:3.0:1787398061.728492:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681350656:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787398061.728508:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398061.728557:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b4a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d885d expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.728624:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.728653:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.728667:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728713:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728725:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728735:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728794:0:77740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728803:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728809:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728816:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728822:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398061.728828:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728835:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728846:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:2.0:1787398061.728849:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398061.728861:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728867:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193b51 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728880:0:77740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728886:0:77740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728892:0:77740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728897:0:77740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398061.728900:0:77740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728906:0:77740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728913:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a82df32500) 00010000:00010000:2.0:1787398061.728915:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398061.728918:0:77740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728934:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75800/0x274786fe0d193b58 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728971:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b4a lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d885d expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.728992:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:2.0:1787398061.728995:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398061.728999:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193b4a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d885d expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.729009:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:2.0:1787398061.729132:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681350656:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 641us (1705us total) trans 0 rc 301/301 00000100:00100000:2.0:1787398061.729141:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1785 00000100:00100000:1.0:1787398061.742634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398061.743197:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681350912 00000100:00100000:0.0:1787398061.743209:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681350912 00000100:00100000:0.0:1787398061.743282:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1786 00000100:00100000:0.0:1787398061.743293:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681350912:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787398061.743315:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398061.743337:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8864 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398061.743436:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1787398061.743608:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193b5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8864 expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.743625:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:0.0:1787398061.743631:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787398061.743636:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74200/0x274786fe0d193b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8864 expref: 12 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.743651:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74200, rc 0) 00000100:00100000:1.0:1787398061.747572:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:79177:x1874218681350912:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 4228us (4895us total) trans 124554051619 rc 301/301 00000100:00100000:1.0:1787398061.747585:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1786 00000100:00100000:1.0:1787398061.752621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398061.752840:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351168 00000100:00100000:0.0:1787398061.752852:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351168 00000100:00100000:0.0:1787398061.752945:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1787 00000100:00100000:0.0:1787398061.752959:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79177:x1874218681351168:12345-192.168.204.60@tcp:36:lfs.0 00000100:00100000:0.0:1787398061.753148:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297408:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.753219:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398061.753254:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.753295:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297408 00000100:00100000:0.0:1787398061.753299:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297408 00000100:00100000:0.0:1787398061.753332:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787398061.753338:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297408:12345-0@lo:1000:mdt00_002.0 00000100:00080000:2.0:1787398061.753551:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398061.753760:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297408:12345-0@lo:1000:mdt00_002.0 Request processed in 420us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.753769:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787398061.753846:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.753913:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.753958:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398061.753984:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.754783:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297536 00000100:00100000:0.0:1787398061.754791:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297536 00000100:00100000:0.0:1787398061.754841:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787398061.754850:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.754952:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297536:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.754958:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787398061.755045:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83fa10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.755096:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.755125:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398061.755148:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398061.755274:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297664 00000100:00100000:1.0:1787398061.755279:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297664 00000100:00100000:1.0:1787398061.755315:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787398061.755322:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.755430:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297664:12345-0@lo:1000:mdt00_002.0 Request processed in 108us (304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787398061.755436:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787398061.755724:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297664:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787398061.755786:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.755797:0:66178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.755820:0:66178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398061.755835:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297792:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787398061.755862:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398061.755887:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.755982:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701297792 00000100:00100000:0.0:1787398061.755987:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701297792 00000100:00100000:0.0:1787398061.756011:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787398061.756017:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:66178:x1874218701297792:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787398061.756037:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398061.756052:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193b6d expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.756080:0:66189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.756089:0:66189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.756126:0:66189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.756140:0:66189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 10 pid: 77740 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398061.756152:0:66189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66189:1874218701297920:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787398061.756220:0:66189:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820657840 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.762233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398061.762323:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351296 00000100:00100000:1.0:1787398061.762334:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351296 00010000:00010000:1.0:1787398061.762394:0:19657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 5/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 11 pid: 77740 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398061.762440:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2670 00000100:00100000:1.0:1787398061.762451:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:2405:x1874218681351296:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787398061.762468:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787398061.762475:0:19657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 5/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 11 pid: 77740 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.762489:0:19657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 11 pid: 77740 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.762512:0:19657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:1.0:1787398061.762519:0:19657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.762574:0:19657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.762582:0:19657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.762637:0:19657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398061.762652:0:19657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:19657:1874218701298048:0@lo:105: 00000100:00100000:1.0:1787398061.762704:0:19657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.762741:0:19657:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787398061.762980:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298048 00000100:00100000:3.0:1787398061.762985:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298048 00000100:00100000:3.0:1787398061.763037:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1787398061.763045:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1874218701298048:12345-0@lo:105: 00010000:00010000:3.0:1787398061.763057:0:93049:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763067:0:93049:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763075:0:93049:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763083:0:93049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763090:0:93049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763098:0:93049:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398061.763127:0:93049:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a80fe75800) 00000100:00100000:3.0:1787398061.763178:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19657:x1874218701298048:12345-0@lo:105: Request processed in 133us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398061.763185:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00010000:2.0:1787398061.763568:0:66189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193b19 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8848 expref: 11 pid: 77740 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398061.763589:0:66189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66189:1874218701297920:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787398061.763614:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 6 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.763624:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:2.0:1787398061.763627:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398061.763630:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:2.0:1787398061.763674:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:66178:x1874218701297792:12345-0@lo:101:mdt00_002.0 Request processed in 7656us (7811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.763682:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787398061.763815:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701297792:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787398061.763834:0:66178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787398061.763855:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:0.0:1787398061.763894:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.763902:0:66178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.763911:0:66178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398061.763937:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298176:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787398061.763971:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398061.764001:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820657840 going to sleep for 11 seconds 00000100:00100000:1.0:1787398061.764299:0:19657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82f4abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:19657:1874218701298048:0@lo:105: 00010000:00010000:1.0:1787398061.764315:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787398061.764377:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2405:x1874218681351296:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 1927us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398061.764386:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2670 00000100:00100000:2.0:1787398061.765260:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298176 00000100:00100000:2.0:1787398061.765272:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298176 00000100:00100000:2.0:1787398061.765329:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787398061.765339:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:66178:x1874218701298176:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787398061.765372:0:66188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398061.765397:0:66188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d193b82 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193b7b expref: -99 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.765447:0:66188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d193b82 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193b7b expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.765460:0:66188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d193b82 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193b7b expref: 7 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.765469:0:66188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a82df32e00) 00010000:00010000:2.0:1787398061.765472:0:66188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398061.765475:0:66188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00000100:00100000:2.0:1787398061.765564:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298176:12345-0@lo:101:mdt00_002.0 Request processed in 226us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.765571:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787398061.765880:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298176:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787398061.765900:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398061.765914:0:66178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787398061.765949:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00000100:00100000:1.0:1787398061.766001:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298304:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.766060:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.766092:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.766303:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298304 00000100:00100000:0.0:1787398061.766318:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298304 00000100:00100000:0.0:1787398061.766358:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787398061.766367:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.766444:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298304:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.766451:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787398061.767198:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298304:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.767261:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298432:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.767327:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.767360:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.767425:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298432 00000100:00100000:0.0:1787398061.767431:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298432 00000100:00100000:0.0:1787398061.767461:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787398061.767469:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.767598:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298432:12345-0@lo:1000:mdt00_002.0 Request processed in 128us (270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787398061.767620:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787398061.767937:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298432:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.768033:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.768060:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.768075:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.768266:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298560 00000100:00100000:0.0:1787398061.768271:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298560 00000100:00100000:0.0:1787398061.768318:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787398061.768325:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.768406:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298560:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (343us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787398061.768413:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787398061.768564:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.768627:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.768652:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.768676:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398061.768932:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298688 00000100:00100000:2.0:1787398061.768937:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298688 00000100:00100000:2.0:1787398061.768962:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787398061.768969:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.769041:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298688:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.769048:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787398061.769783:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.769844:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.769880:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.769904:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398061.770161:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298816 00000100:00100000:2.0:1787398061.770167:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298816 00000100:00100000:2.0:1787398061.770204:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787398061.770211:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787398061.770308:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298816:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.770315:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787398061.770507:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.770589:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787398061.770615:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398061.770627:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.770744:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701298944 00000100:00100000:0.0:1787398061.770749:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701298944 00000100:00100000:0.0:1787398061.770773:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787398061.770780:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398061.770857:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66178:x1874218701298944:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.770863:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787398061.774660:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701298944:0@lo:1000:mdt00_002.0 00000040:00080000:1.0:1787398061.775849:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].4, 2152 off36632 00000040:00080000:1.0:1787398061.775950:0:66178:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000dec1:0x1:0x0].4, 2352 off37072 00000004:00080000:1.0:1787398061.775958:0:66178:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a704f3de40 with version 10 00000004:00080000:0.0:1787398061.776566:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 10 rpc_version 10 00000020:00100000:0.0:1787398061.776625:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398061.776637:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a8360b4e00 x1874218701299200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398061.776662:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701299200:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398061.776742:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398061.776781:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a820657840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398061.776843:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299200 00000100:00100000:2.0:1787398061.776852:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299200 00000100:00100000:2.0:1787398061.776898:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787398061.776908:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104260:x1874218701299200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398061.777701:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701299200:12345-0@lo:1000:osp_up0-1.0 Request processed in 791us (955us total) trans 124554051620 rc 0/0 00000100:00100000:2.0:1787398061.777711:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787398061.778330:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701299200:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787398061.780117:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780139:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780155:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780178:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: --/PW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780186:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780192:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780234:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780240:0:66178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.780250:0:66178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398061.780305:0:66178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701299328:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1787398061.780582:0:66178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398061.780635:0:66178:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a829b4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398061.780895:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299328 00000100:00100000:0.0:1787398061.780903:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299328 00000100:00100000:0.0:1787398061.780972:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787398061.780981:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66178:x1874218701299328:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787398061.781005:0:66189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398061.781038:0:66189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d193b9e lrc: 2/0,0 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d193b97 expref: -99 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.781063:0:66189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d193b9e lrc: 3/0,0 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193b97 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.781076:0:66189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d193b9e lrc: 3/0,0 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193b97 expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.781084:0:66189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a809a13b00) 00010000:00010000:0.0:1787398061.781087:0:66189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398061.781091:0:66189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00000100:00100000:0.0:1787398061.781143:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83fa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66178:x1874218701299328:12345-0@lo:101:mdt00_002.0 Request processed in 162us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398061.781160:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787398061.781460:0:66178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66178:1874218701299328:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787398061.781478:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 4/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781488:0:66178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 4/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398061.781512:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000786031fa reply state 000000009a02cf78 transno 85899345936 ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781573:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781581:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a82df32c00) 00010000:00010000:2.0:1787398061.781583:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398061.781586:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787398061.781593:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 4/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781600:0:66178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,0 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787398061.781623:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000dec1:0x3:0x0] 00000004:00010000:2.0:1787398061.781630:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000786031fa reply state 000000009a02cf78 transno 85899345936 ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781652:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781658:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a82df32600) 00010000:00010000:2.0:1787398061.781661:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398061.781663:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787398061.781670:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00000004:00080000:2.0:1787398061.781679:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:2.0:1787398061.781688:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781695:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781701:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781715:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787398061.781720:0:66178:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:2.0:1787398061.781724:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.781730:0:66178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398061.781812:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79177:x1874218681351168:12345-192.168.204.60@tcp:36:lfs.0 Request processed in 28856us (29214us total) trans 85899345936 rc 0/0 00000100:00100000:2.0:1787398061.781820:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1787 00010000:00010000:0.0:1787398061.784074:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398061.784097:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.784114:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75800 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:0.0:1787398061.784124:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398061.784137:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.784209:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.784218:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398061.784270:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398061.784278:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75800/0x274786fe0d193b6d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b74 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398061.784585:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701299456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398061.784703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787398061.784827:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398061.784830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398061.784832:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398061.786284:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299456 00000100:00100000:2.0:1787398061.786308:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299456 00000100:00100000:2.0:1787398061.786561:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1787398061.786573:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3649:x1874218701299456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398061.786590:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398061.786613:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74400/0x274786fe0d193b74 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193b6d expref: 9 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398061.786633:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:2.0:1787398061.786646:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398061.786726:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3649:x1874218701299456:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398061.786733:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1787398061.787038:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701299456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398061.797981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398061.798452:0:80567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351552 00000100:00100000:3.0:1787398061.798464:0:80567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351552 00000100:00100000:3.0:1787398061.798566:0:80567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 322 00000100:00100000:3.0:1787398061.798576:0:80567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79177:x1874218681351552:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:3.0:1787398061.798829:0:80567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702043c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:79177:x1874218681351552:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 253us (859us total) trans 124554051621 rc 0/0 00000100:00100000:3.0:1787398061.798837:0:80567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 322 00010000:00010000:0.0:1787398061.928218:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398062.542014:0:104254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398062.542059:0:104254:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.542111:0:104254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.542118:0:104254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398062.542162:0:104254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a828a74200/0x274786fe0d193b7b lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b82 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.542191:0:104254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,0 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398062.542200:0:104254:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 3/0,0 mode: PW/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.542218:0:104254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 2/0,0 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.542225:0:104254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398062.542230:0:104254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a80fe75000/0x274786fe0d193b97 lrc: 0/0,0 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d193b9e expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787398062.542245:0:104254:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345936 is committed 00000020:00080000:0.0:1787398062.542258:0:104254:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 81604378796 batchid updated 00000020:00080000:0.0:1787398062.542262:0:104254:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 81604378795 batchid updated 00000020:00080000:0.0:1787398062.542265:0:104254:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 81604378794 batchid updated 00000100:00100000:1.0:1787398062.542424:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701299712:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787398062.542505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398062.542600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787398062.542607:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701299584:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787398062.542635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787398062.542865:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542876:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542883:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542889:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398062.542893:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542900:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542929:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a82df32600) 00010000:00010000:2.0:1787398062.542938:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398062.542944:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542950:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75600/0x274786fe0d193b89 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787398062.542963:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378796 00010000:00010000:2.0:1787398062.542967:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542972:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 2/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542977:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542981:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398062.542984:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542989:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 4/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.542997:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a82df32c00) 00010000:00010000:2.0:1787398062.542999:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398062.543002:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 2/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.543007:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a80fe75400/0x274786fe0d193b90 lrc: 0/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787398062.543029:0:104274:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a703ddc540 with version 11 00000020:00080000:3.0:1787398062.543047:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378794 cancel update log [0x20000dec1:0x1:0x0].1: rc = 0 00000004:00080000:2.0:1787398062.543084:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 11 rpc_version 11 00000020:00100000:2.0:1787398062.543107:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787398062.543120:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83876c380 x1874218701299968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1787398062.543137:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378794 cancel update log [0x240009870:0x1:0x0].1: rc = 0 00000100:00100000:2.0:1787398062.543141:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701299968:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787398062.543160:0:104274:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a703ddce40 with version 12 00000020:00080000:3.0:1787398062.543163:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378795 cancel update log [0x20000dec1:0x1:0x0].2: rc = 0 00000100:00100000:2.0:1787398062.543177:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787398062.543182:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378795 cancel update log [0x240009870:0x1:0x0].2: rc = 0 00000100:00100000:2.0:1787398062.543204:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787398062.543221:0:104274:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a703d74f00 with version 13 00000020:00080000:3.0:1787398062.543224:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378796 cancel update log [0x20000dec1:0x1:0x0].3: rc = 0 00000020:00080000:3.0:1787398062.543257:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378796 cancel update log [0x240009870:0x1:0x0].3: rc = 0 00000020:00080000:3.0:1787398062.543263:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378796 00000100:00100000:1.0:1787398062.543347:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299968 00000100:00100000:1.0:1787398062.543355:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299968 00000100:00100000:0.0:1787398062.543419:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299712 00000100:00100000:0.0:1787398062.543430:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299712 00000100:00100000:0.0:1787398062.543470:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701299584 00000100:00100000:1.0:1787398062.543472:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787398062.543473:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701299584 00000100:00100000:1.0:1787398062.543480:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:104260:x1874218701299968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398062.543492:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1787398062.543497:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701299712:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1787398062.543507:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787398062.543633:0:19654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1787398062.543642:0:19654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a834539850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701299584:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787398062.543650:0:19654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398062.543696:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d193b9e lrc: 0/0,0 mode: --/PW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193b97 expref: 10 pid: 66189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.543710:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a809a13b00) 00010000:00010000:0.0:1787398062.543719:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398062.543766:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701299712:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 267us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398062.543774:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1787398062.544240:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701299712:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1787398062.544291:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:104260:x1874218701299968:12345-0@lo:1000:osp_up0-1.0 Request processed in 811us (1113us total) trans 124554051622 rc 0/0 00000100:00100000:1.0:1787398062.544296:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701299968:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398062.544299:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000004:00080000:1.0:1787398062.544307:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 12 rpc_version 12 00000020:00100000:1.0:1787398062.544323:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398062.544329:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a701528000 x1874218701300224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398062.544346:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300224:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398062.544377:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398062.544448:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398062.544962:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701300224 00000100:00100000:3.0:1787398062.544968:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701300224 00000100:00100000:3.0:1787398062.545109:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787398062.545118:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:104260:x1874218701300224:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787398062.546107:0:19654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74e00/0x274786fe0d193b82 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193b7b expref: 10 pid: 66188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398062.546128:0:19654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a82df32e00) 00010000:00010000:2.0:1787398062.546140:0:19654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:0.0:1787398062.547791:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051621 is committed 00000001:00080000:0.0:1787398062.547805:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051620 is committed 00010000:00010000:0.0:1787398062.547830:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547841:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547848:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547854:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398062.547860:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547868:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547898:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a81a964700) 00010000:00010000:0.0:1787398062.547918:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398062.547923:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.547930:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193b12 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398062.548651:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701300224:12345-0@lo:1000:osp_up0-1.0 Request processed in 3528us (4267us total) trans 124554051623 rc 0/0 00000100:00100000:3.0:1787398062.548664:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787398062.548762:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300224:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398062.548778:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 13 rpc_version 13 00000020:00100000:0.0:1787398062.548806:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398062.548813:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a704ee4e00 x1874218701300480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398062.548835:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300480:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398062.548881:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398062.548918:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7022faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398062.548938:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701300480 00000100:00100000:1.0:1787398062.548945:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701300480 00000100:00100000:2.0:1787398062.553229:0:19654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a834539850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701299584:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 9572us (10575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398062.553249:0:19654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1787398062.553856:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701299584:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1787398062.554662:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787398062.554682:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104260:x1874218701300480:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398062.554901:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701300480:12345-0@lo:1000:osp_up0-1.0 Request processed in 227us (6021us total) trans 124554051624 rc 0/0 00000100:00100000:1.0:1787398062.555155:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787398062.555655:0:104260:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051620 gen 2 00000004:00080000:0.0:1787398062.555663:0:104260:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051620 committed transno 124554051620 00000020:00080000:0.0:1787398062.555669:0:104260:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a704f3d3c0 refcount 2 committed 0 result 0 batchid 81604378797 00000020:00080000:0.0:1787398062.555674:0:104260:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a83479d300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a704f3de40 00000020:00080000:0.0:1787398062.555677:0:104260:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000dec1:0x1:0x0].4 00000020:00080000:0.0:1787398062.555680:0:104260:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a83479dd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a703506c00 00000020:00080000:0.0:1787398062.555683:0:104260:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].4 00000100:00100000:0.0:1787398062.555730:0:104260:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a83876c380 x1874218701299968/t124554051622(124554051622) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787398078 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398062.555774:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a704ee4e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300480:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1787398062.557886:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 81604378797 committed batchid 81604378796 00000020:00080000:3.0:1787398062.561068:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378796 00000100:00100000:0.0:1787398062.572989:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:2.0:1787398062.578226:0:104254:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 81604378797 batchid updated 00000020:00080000:3.0:1787398062.578276:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378797 00000004:00080000:3.0:1787398062.578343:0:104274:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8206499c0 with version 14 00000020:00080000:3.0:1787398062.578363:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378797 cancel update log [0x20000dec1:0x1:0x0].4: rc = 0 00000004:00080000:1.0:1787398062.578381:0:104260:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a819136480 version 14 rpc_version 14 00000020:00100000:1.0:1787398062.578419:0:104260:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398062.578430:0:104260:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70152aa00 x1874218701300864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1787398062.578450:0:104274:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378797 cancel update log [0x240009870:0x1:0x0].4: rc = 0 00000020:00080000:3.0:1787398062.578458:0:104274:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378797 00000100:00100000:1.0:1787398062.578465:0:104260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398062.578582:0:104260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398062.578621:0:104260:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398062.579388:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701300864 00000100:00100000:3.0:1787398062.579399:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701300864 00000100:00100000:3.0:1787398062.579491:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787398062.579502:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104260:x1874218701300864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398062.579722:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:104260:x1874218701300864:12345-0@lo:1000:osp_up0-1.0 Request processed in 220us (1138us total) trans 124554051625 rc 0/0 00000100:00100000:3.0:1787398062.579731:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787398062.584641:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701300608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398062.584647:0:104260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104260:1874218701300864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398062.584711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1787398062.585018:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051624 is committed 00000100:00100000:2.0:1787398062.585121:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701300608 00000100:00100000:2.0:1787398062.585129:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701300608 00000100:00100000:2.0:1787398062.585198:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787398062.585207:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701300608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787398062.585241:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:2.0:1787398062.585296:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701300608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398062.585304:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787398062.585316:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051624 gen 2 00000004:00080000:1.0:1787398062.585322:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051622 committed transno 124554051624 00000004:00080000:1.0:1787398062.585340:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051623 committed transno 124554051624 00000004:00080000:1.0:1787398062.585349:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051624 committed transno 124554051624 00000100:00100000:1.0:1787398062.585369:0:3649:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89a70152aa00 x1874218701300864/t124554051625(124554051625) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787398078 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398062.585385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701300608:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787398062.622984:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051625 is committed 00000100:00100000:1.0:1787398062.729091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.729427:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351680 00000100:00100000:3.0:1787398062.729437:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351680 00000100:00100000:3.0:1787398062.732708:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1788 00000100:00100000:3.0:1787398062.732723:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79186:x1874218681351680:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:3.0:1787398062.732772:0:66177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1787398062.733087:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79186:x1874218681351680:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 365us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398062.733095:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1788 00000100:00100000:1.0:1787398062.741992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.742380:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351808 00000100:00100000:3.0:1787398062.742391:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351808 00000100:00100000:2.0:1787398062.745766:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1789 00000100:00100000:2.0:1787398062.745790:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79186:x1874218681351808:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787398062.745848:0:67264:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1787398062.745954:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79186:x1874218681351808:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 174us (3974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398062.745962:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1789 00000100:00100000:3.0:1787398062.750273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.751619:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681351936 00000100:00100000:3.0:1787398062.751632:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681351936 00000100:00100000:3.0:1787398062.751698:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00100000:3.0:1787398062.751709:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79186:x1874218681351936:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787398062.751743:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398062.751827:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79186:x1874218681351936:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 121us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398062.751835:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 112 00000100:00080000:3.0:1787398062.754636:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398062.755163:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398062.755324:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352064 00000100:00100000:2.0:1787398062.755334:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352064 00000100:00100000:1.0:1787398062.755509:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00100000:1.0:1787398062.755548:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79186:x1874218681352064:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787398062.755578:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398062.755638:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79186:x1874218681352064:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 119us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398062.755645:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 113 00000100:00080000:3.0:1787398062.755715:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398062.829854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.830161:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352320 00000100:00100000:3.0:1787398062.830174:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352320 00000100:00100000:3.0:1787398062.830260:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1790 00000100:00100000:3.0:1787398062.830273:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79193:x1874218681352320:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:3.0:1787398062.830336:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398062.830377:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d884f expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830394:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:3.0:1787398062.830406:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398062.830468:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830482:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830492:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830503:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830510:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.830794:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832470:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832486:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832494:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832499:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398062.832691:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832700:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832716:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:3.0:1787398062.832719:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398062.832725:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832731:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193ba5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398062.832754:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c076d274 reply state 000000003c6d49f1 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832765:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.832772:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964100) 00010000:00010000:3.0:1787398062.832774:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787398062.832778:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787398062.837120:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79193:x1874218681352320:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 6836us (7261us total) trans 124554051626 rc 0/0 00000100:00100000:3.0:1787398062.837134:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1790 00000100:00100000:1.0:1787398062.852567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.852712:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352448 00000100:00100000:3.0:1787398062.852729:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352448 00000100:00100000:3.0:1787398062.852791:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:3.0:1787398062.852802:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681352448:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398062.852921:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681352448:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398062.852949:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:1.0:1787398062.884626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.884780:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352576 00000100:00100000:3.0:1787398062.884790:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352576 00000100:00100000:3.0:1787398062.884860:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1791 00000100:00100000:3.0:1787398062.884870:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79196:x1874218681352576:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398062.884894:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398062.884926:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d886b expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885001:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885016:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885027:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398062.885073:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787398062.885077:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398062.885095:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885120:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d886b expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885140:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d886b expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.885170:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:3.0:1787398062.885174:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398062.885178:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:3.0:1787398062.885232:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79196:x1874218681352576:12345-192.168.204.60@tcp:101:rm.0 Request processed in 363us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398062.885239:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1791 00000100:00100000:2.0:1787398062.893409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398062.895826:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352704 00000100:00100000:3.0:1787398062.895842:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352704 00000100:00100000:3.0:1787398062.895949:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1792 00000100:00100000:3.0:1787398062.895961:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79196:x1874218681352704:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398062.895983:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398062.896005:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8872 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896068:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896083:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896095:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896106:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896113:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896131:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896219:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896228:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896235:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398062.896285:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x35:0x0]: returning size 0 00000004:00200000:3.0:1787398062.896289:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398062.896306:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896317:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896327:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896334:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896341:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896348:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896363:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398062.896368:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896376:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896389:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:3.0:1787398062.896392:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398062.896396:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896402:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896418:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896424:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896428:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896433:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398062.896435:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896441:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896460:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964100) 00010000:00010000:3.0:1787398062.896463:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398062.896466:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896472:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896501:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8872 expref: 11 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896548:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8872 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398062.896556:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x35:0x0].0x0 (ffff89a81a964900) 00010000:00010000:3.0:1787398062.896558:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787398062.896561:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:3.0:1787398062.896631:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79196:x1874218681352704:12345-192.168.204.60@tcp:101:rm.0 Request processed in 672us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398062.896639:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1792 00000100:00100000:1.0:1787398062.912932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398062.913092:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352960 00000100:00100000:0.0:1787398062.913104:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352960 00000100:00100000:0.0:1787398062.913172:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1793 00000100:00100000:0.0:1787398062.913185:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79196:x1874218681352960:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787398062.913248:0:66178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787398062.913282:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d193bd6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8872 expref: 10 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913303:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x35:0x0].0x0 (ffff89a81a964900) 00010000:00010000:0.0:1787398062.913325:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d193bba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d886b expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913335:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:0.0:1787398062.913342:0:66178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787398062.913370:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913385:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913396:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913409:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913424:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913431:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913551:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913560:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913568:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913777:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913786:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913795:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913803:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913824:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913831:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913862:0:66178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398062.913881:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913887:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913893:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913911:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398062.913916:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913924:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913933:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x35:0x0].0x0 (ffff89a802a4ae00) 00010000:00010000:0.0:1787398062.913936:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787398062.913939:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913945:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d193beb lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913962:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913968:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913973:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913985:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913990:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398062.913993:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.913999:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914006:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a802a4a700) 00010000:00010000:0.0:1787398062.914008:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398062.914011:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914017:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193bdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398062.914031:0:66178:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000454ee6d reply state 000000007b827a4f transno 124554051627 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914042:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914048:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964100) 00010000:00010000:0.0:1787398062.914050:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398062.914053:0:66178:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787398062.914131:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79196:x1874218681352960:12345-192.168.204.60@tcp:36:rm.0 Request processed in 948us (1210us total) trans 124554051627 rc 0/0 00000100:00100000:0.0:1787398062.914141:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1793 00010000:00010000:0.0:1787398062.914179:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398062.914184:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914190:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398062.914194:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914200:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914208:0:56853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x35:0x0].0x0 (ffff89a802a4ae00) 00010000:00010000:0.0:1787398062.914210:0:56853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787398062.914213:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914218:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193bf2 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398062.914229:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398062.914231:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398062.914233:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398062.949715:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398063.076952:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701301376:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.077043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.077083:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701301888:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.077108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.077125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701302400:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.077165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.077450:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301888 00000100:00100000:0.0:1787398063.077460:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301888 00000100:00100000:0.0:1787398063.077544:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302400 00000100:00100000:0.0:1787398063.077548:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302400 00000100:00100000:0.0:1787398063.077575:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787398063.077584:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701301888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077641:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701301888:12345-0@lo:400:kworker.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.077650:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787398063.077681:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787398063.077687:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701302400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077718:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701302400:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.077723:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787398063.077768:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301376 00000100:00100000:0.0:1787398063.077773:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301376 00000100:00100000:0.0:1787398063.077816:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1787398063.077823:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701301376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077853:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701301376:12345-0@lo:400:kworker.0 Request processed in 31us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.077858:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1787398063.077878:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701301248:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077917:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.077938:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701301760:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.077972:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a830379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701302272:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.077988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.078006:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787398063.078011:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701301120:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.078047:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701301632:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.078084:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701302144:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.078128:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a706e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398063.078151:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.078182:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301248 00000100:00100000:0.0:1787398063.078448:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301248 00000100:00100000:0.0:1787398063.078480:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301120 00000100:00100000:0.0:1787398063.078483:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301120 00000100:00100000:0.0:1787398063.078502:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1787398063.078587:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701301248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078630:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701301248:12345-0@lo:400:kworker.0 Request processed in 46us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.078636:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1787398063.078650:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1787398063.078656:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701301120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078688:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701301120:12345-0@lo:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.078693:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1787398063.078717:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301632 00000100:00100000:0.0:1787398063.078721:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301632 00000100:00100000:0.0:1787398063.078741:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302144 00000100:00100000:0.0:1787398063.078745:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302144 00000100:00100000:0.0:1787398063.078757:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787398063.078763:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701301632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.078798:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701301632:12345-0@lo:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398063.078932:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701301376:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.078946:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82984b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701301888:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.078956:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701302400:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.078979:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787398063.078986:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701300992:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.079018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.079051:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701301504:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.079072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.079089:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701302016:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.079107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.079123:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701302528:0@lo:400:kworker.0 00000100:00100000:3.0:1787398063.079141:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787398063.079167:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787398063.079172:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787398063.079175:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398063.079540:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301760 00000100:00100000:1.0:1787398063.079547:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301760 00000100:00100000:1.0:1787398063.079590:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302272 00000100:00100000:1.0:1787398063.079593:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302272 00000100:00100000:1.0:1787398063.079611:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787398063.079618:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701301760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398063.079664:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701301760:12345-0@lo:400:kworker.0 Request processed in 46us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.079670:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787398063.079685:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787398063.079691:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398063.079717:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701302272:12345-0@lo:400:kworker.0 Request processed in 26us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.079723:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787398063.079769:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398063.079775:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398063.079785:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701302784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398063.079827:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398063.079858:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302656 00000100:00100000:1.0:1787398063.079862:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302656 00000100:00100000:1.0:1787398063.079885:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302784 00000100:00100000:1.0:1787398063.079888:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302784 00000100:00100000:1.0:1787398063.079912:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787398063.079919:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701302656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398063.079934:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398063.079966:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701302656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.079971:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787398063.079997:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787398063.080003:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701302784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398063.080015:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398063.080045:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701302784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.080052:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787398063.080075:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701301504 00000100:00100000:1.0:1787398063.080078:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701301504 00000100:00100000:1.0:1787398063.080100:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302016 00000100:00100000:1.0:1787398063.080103:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302016 00000100:00100000:1.0:1787398063.080112:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302528 00000100:00100000:1.0:1787398063.080115:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302528 00000100:00100000:1.0:1787398063.080128:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:1.0:1787398063.080134:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701301504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398063.080169:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701301504:12345-0@lo:400:kworker.0 Request processed in 35us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.080175:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1787398063.080444:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787398063.080464:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787398063.080472:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701302144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080554:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a704ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701302144:12345-0@lo:400:kworker.0 Request processed in 83us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.080561:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787398063.080582:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1787398063.080589:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701302016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080619:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701302016:12345-0@lo:400:kworker.0 Request processed in 30us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.080625:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1787398063.080638:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1787398063.080644:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701302528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080672:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82984b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701302528:12345-0@lo:400:kworker.0 Request processed in 29us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.080677:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1787398063.080718:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701301120:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080732:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701301632:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080741:0:3651:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051625 gen 2 00000004:00080000:0.0:1787398063.080747:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051625 committed transno 124554051625 00000100:00100000:0.0:1787398063.080771:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701302144:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080791:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a706e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701302656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398063.080817:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701301248:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080829:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701301760:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080839:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a830379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701302272:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.080944:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701302784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787398063.080967:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398063.081001:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701300992 00000100:00100000:0.0:1787398063.081006:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701300992 00000100:00100000:0.0:1787398063.081039:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787398063.081046:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.081080:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701300992:12345-0@lo:400:kworker.0 Request processed in 35us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.081085:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787398063.081700:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a828cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701300992:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.081721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701301504:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.081730:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70547b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701302016:0@lo:400:kworker.0 00000100:00100000:0.0:1787398063.081740:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701302528:0@lo:400:kworker.0 00000100:00100000:1.0:1787398063.086094:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398063.086119:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701302912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398063.086198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398063.086248:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701302912 00000100:00100000:1.0:1787398063.086255:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701302912 00000100:00100000:1.0:1787398063.086298:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787398063.086306:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701302912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398063.086338:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1787398063.086382:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701302912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398063.086390:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787398063.086449:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701302912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398063.589036:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701303040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398063.589110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398063.589160:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303040 00000100:00100000:0.0:1787398063.589170:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303040 00000100:00100000:0.0:1787398063.589234:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787398063.589243:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701303040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787398063.589267:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398063.589312:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701303040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398063.589318:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787398063.589360:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701303040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398063.591083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701303168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398063.591167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398063.591341:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303168 00000100:00100000:3.0:1787398063.591349:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303168 00000100:00100000:3.0:1787398063.591401:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787398063.591411:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701303168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398063.591432:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398063.591495:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701303168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398063.591503:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787398063.592072:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701303168:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1787398063.870002:0:105161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc369e3260 00000020:00000080:0.0:1787398063.870021:0:105161:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:0.0:1787398063.870031:0:105161:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0000, dev 13 00010000:00010000:3.0:1787398063.972855:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398064.996697:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398066.020810:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398067.047688:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398067.686278:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398067.686319:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701303296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398067.686423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398067.686546:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303296 00000100:00100000:0.0:1787398067.686556:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303296 00000100:00100000:0.0:1787398067.686628:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787398067.686635:0:66189:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787398067.686642:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701303296:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398067.686650:0:66189:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:0.0:1787398067.686692:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000080:0.0:1787398067.686712:0:66188:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af26680 x1874218701303296/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:508/0 lens 224/368 e 0 to 0 dl 1787398078 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398067.686771:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701303296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.686780:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787398067.686875:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701303296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398067.994868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398067.994921:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353088 00000100:00100000:0.0:1787398067.994935:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353088 00000100:00100000:0.0:1787398067.995008:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00100000:0.0:1787398067.995020:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681353088:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398067.995119:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681353088:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.995146:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 135 00000100:00100000:0.0:1787398067.995208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398067.995235:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353344 00000100:00100000:0.0:1787398067.995239:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353344 00000100:00100000:0.0:1787398067.995286:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1766 00000100:00100000:0.0:1787398067.995293:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681353344:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398067.995330:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681353344:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.995337:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1766 00000100:00080000:0.0:1787398067.995354:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398067.995437:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398067.995566:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398067.995585:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353216 00000100:00100000:0.0:1787398067.995589:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353216 00000100:00100000:0.0:1787398067.995623:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1767 00000100:00100000:0.0:1787398067.995629:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2404:x1874218681353216:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787398067.995652:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af25500 x1874218681353216/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:508/0 lens 224/224 e 0 to 0 dl 1787398078 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398067.995685:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2404:x1874218681353216:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.995691:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1767 00000100:00100000:0.0:1787398067.995732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398067.995764:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353600 00000100:00100000:0.0:1787398067.995768:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353600 00000100:00100000:0.0:1787398067.995813:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353472 00000100:00100000:0.0:1787398067.995824:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353472 00000100:00100000:0.0:1787398067.995855:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:0.0:1787398067.995863:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681353600:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398067.995897:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681353600:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.995905:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 121 00000100:00100000:0.0:1787398067.995918:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:0.0:1787398067.995925:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681353472:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398067.995948:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681353472:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398067.995954:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00080000:0.0:1787398067.995978:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398067.995981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398067.995984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787398068.069208:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398068.197254:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701303424:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.197374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.197664:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701303936:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.197733:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701303808:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.197784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.197831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.197837:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701304448:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.197852:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701304320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.197879:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.197901:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701304832:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.197923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.197955:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787398068.197961:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701303680:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.197985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.198003:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701304192:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.198044:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701304704:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.198053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.198075:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701304960:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.198097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.198116:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303936 00000100:00100000:3.0:1787398068.198118:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787398068.198124:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701303552:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198125:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303936 00000100:00100000:3.0:1787398068.198146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.198161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701304064:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198184:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303808 00000100:00100000:3.0:1787398068.198185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.198187:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303808 00000100:00100000:3.0:1787398068.198203:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701304576:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.198223:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.198227:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303680 00000100:00100000:2.0:1787398068.198230:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303680 00000100:00100000:2.0:1787398068.198249:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304448 00000100:00100000:2.0:1787398068.198252:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304448 00000100:00100000:3.0:1787398068.198257:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303424 00000100:00100000:3.0:1787398068.198259:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303424 00000100:00100000:2.0:1787398068.198263:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304960 00000100:00100000:2.0:1787398068.198265:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304960 00000100:00100000:2.0:1787398068.198276:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701303552 00000100:00100000:2.0:1787398068.198278:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701303552 00000100:00100000:3.0:1787398068.198292:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787398068.198292:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:3.0:1787398068.198301:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701303424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198301:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701303936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.198358:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701303424:12345-0@lo:400:kworker.0 Request processed in 57us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398068.198377:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787398068.198693:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701303936:12345-0@lo:400:kworker.0 Request processed in 392us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.198701:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:2.0:1787398068.198719:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:2.0:1787398068.198726:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701303808:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787398068.198744:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83b522300 x1874218701303808/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:509/0 lens 224/224 e 0 to 0 dl 1787398079 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398068.198782:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701303808:12345-0@lo:400:kworker.0 Request processed in 57us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.198804:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:2.0:1787398068.198818:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1787398068.198825:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701303680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.198853:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a806914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701303680:12345-0@lo:400:kworker.0 Request processed in 30us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.198860:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1787398068.198871:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:2.0:1787398068.198877:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701304448:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787398068.198916:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dce00 x1874218701304448/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:509/0 lens 224/224 e 0 to 0 dl 1787398079 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398068.198943:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701304448:12345-0@lo:400:kworker.0 Request processed in 67us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.198949:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:2.0:1787398068.198964:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:2.0:1787398068.198971:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701304960:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787398068.198983:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dd180 x1874218701304960/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:509/0 lens 224/224 e 0 to 0 dl 1787398079 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398068.199008:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701304960:12345-0@lo:400:kworker.0 Request processed in 39us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199014:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:2.0:1787398068.199024:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1787398068.199030:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701303552:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1787398068.199040:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dc380 x1874218701303552/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:509/0 lens 224/224 e 0 to 0 dl 1787398079 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398068.199134:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304064 00000100:00100000:3.0:1787398068.199141:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304064 00000100:00100000:3.0:1787398068.199175:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304576 00000100:00100000:3.0:1787398068.199178:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304576 00000100:00100000:2.0:1787398068.199178:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701303552:12345-0@lo:400:kworker.0 Request processed in 147us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199184:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1787398068.199204:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304320 00000100:00100000:2.0:1787398068.199208:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304320 00000100:00100000:2.0:1787398068.199239:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304832 00000100:00100000:2.0:1787398068.199243:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304832 00000100:00100000:2.0:1787398068.199258:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304192 00000100:00100000:2.0:1787398068.199261:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304192 00000100:00100000:2.0:1787398068.199272:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701304704 00000100:00100000:2.0:1787398068.199281:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701304704 00000100:00100000:2.0:1787398068.199300:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787398068.199306:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701304320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199335:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701304320:12345-0@lo:400:kworker.0 Request processed in 30us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199341:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787398068.199351:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787398068.199357:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701304832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199380:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701304832:12345-0@lo:400:kworker.0 Request processed in 23us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199385:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787398068.199394:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787398068.199399:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701304192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199424:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a702619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701304192:12345-0@lo:400:kworker.0 Request processed in 25us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199430:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787398068.199439:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398068.199445:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701304704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199471:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701304704:12345-0@lo:400:kworker.0 Request processed in 26us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.199477:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787398068.199491:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787398068.199500:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701304064:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787398068.199513:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398068.199539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398068.199542:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398068.199545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398068.199558:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701304064:12345-0@lo:400:kworker.0 Request processed in 61us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398068.199564:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787398068.199577:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787398068.199583:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701304576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199588:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701303680:0@lo:400:kworker.0 00010000:00000080:3.0:1787398068.199594:0:66188:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178df100 x1874218701304576/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:509/0 lens 224/224 e 0 to 0 dl 1787398079 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398068.199613:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701304192:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.199618:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701304576:12345-0@lo:400:kworker.0 Request processed in 36us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398068.199623:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787398068.199625:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701304704:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199637:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701303808:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199648:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701304320:0@lo:400:kworker.0 00000100:00100000:2.0:1787398068.199658:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701304832:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200803:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701303552:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200827:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701304064:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200841:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701304576:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200855:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701303424:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200869:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701303936:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200883:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701304448:0@lo:400:kworker.0 00000100:00100000:0.0:1787398068.200896:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701304960:0@lo:400:kworker.0 00000100:00100000:3.0:1787398068.200901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701305088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398068.200980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398068.202077:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305088 00000100:00100000:0.0:1787398068.202107:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305088 00000100:00100000:0.0:1787398068.202176:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787398068.202188:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701305088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398068.202234:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398068.202318:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701305088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398068.202327:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787398068.204149:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83af24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701305088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398068.205171:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701305216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398068.205279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.205336:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398068.205347:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305216 00000100:00100000:1.0:1787398068.205356:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305216 00000100:00100000:3.0:1787398068.205373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398068.205412:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787398068.205422:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701305216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398068.205461:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398068.205495:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305344 00000100:00100000:3.0:1787398068.205499:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305344 00000100:00100000:1.0:1787398068.205511:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701305216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398068.205519:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787398068.205546:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787398068.205563:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701305344:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398068.205587:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701305216:0@lo:13:osp-pre-1-0.0 00000004:00000024:3.0:1787398068.205591:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:3.0:1787398068.205627:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701305344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398068.205633:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787398068.205635:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398068.709410:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701305472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398068.709572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398068.709619:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701305600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398068.709659:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398068.709690:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305472 00000100:00100000:2.0:1787398068.709704:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305472 00000100:00100000:2.0:1787398068.709773:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305600 00000100:00100000:2.0:1787398068.709776:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305600 00000100:00100000:2.0:1787398068.709809:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787398068.709820:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701305472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398068.709850:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398068.709910:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701305472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.709918:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787398068.709939:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787398068.709946:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701305600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398068.709957:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398068.709986:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701305600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398068.709993:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787398068.710671:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701305472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398068.710689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701305600:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1787398069.090249:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051627 is committed 00010000:00010000:2.0:1787398069.090669:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090687:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090707:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090714:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398069.090720:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090730:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090756:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964100) 00010000:00010000:2.0:1787398069.090759:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398069.090766:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090773:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d193bac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090813:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090819:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090826:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090831:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398069.090834:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090851:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090860:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964100) 00010000:00010000:2.0:1787398069.090863:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398069.090866:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398069.090872:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193be4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398069.092642:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398070.119892:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787398070.633461:0:105458:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1787398071.145008:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398072.148250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398072.148373:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353728 00000100:00100000:3.0:1787398072.148389:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353728 00000100:00100000:3.0:1787398072.148499:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1794 00000100:00100000:3.0:1787398072.148515:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79272:x1874218681353728:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787398072.148597:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398072.148892:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8879 expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.148991:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.149008:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.149049:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398072.149117:0:67264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787398072.149122:0:67264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398072.149148:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.149180:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8879 expref: 8 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.149203:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8879 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.149213:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964a00) 00010000:00010000:3.0:1787398072.149216:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398072.149220:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00010000:00000080:3.0:1787398072.149229:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83af24700 x1874218681353728/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 576/688 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:0.0:1787398072.149413:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398072.149485:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79272:x1874218681353728:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 972us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398072.149497:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1794 00010000:00010000:0.0:1787398072.166692:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398072.166900:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398072.167276:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353856 00000100:00100000:2.0:1787398072.167290:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353856 00000100:00100000:2.0:1787398072.167380:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1795 00000100:00100000:2.0:1787398072.167394:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79272:x1874218681353856:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787398072.167452:0:77740:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000080:2.0:1787398072.167482:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6ea00 x1874218681353856/t0(0) o41->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 224/368 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398072.167663:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79272:x1874218681353856:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 272us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398072.167672:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1795 00000100:00100000:1.0:1787398072.175090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398072.175194:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681353984 00000100:00100000:2.0:1787398072.175208:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681353984 00000100:00100000:2.0:1787398072.176006:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1796 00000100:00100000:2.0:1787398072.176027:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79272:x1874218681353984:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787398072.176079:0:74374:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:2.0:1787398072.176184:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79272:x1874218681353984:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 165us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398072.176193:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1796 00000100:00080000:0.0:1787398072.183770:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398072.186863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398072.187019:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354112 00000100:00100000:1.0:1787398072.187033:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354112 00000100:00100000:1.0:1787398072.187126:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00100000:1.0:1787398072.187140:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79272:x1874218681354112:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:1.0:1787398072.187185:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398072.187271:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83af24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79272:x1874218681354112:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 134us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398072.187288:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 122 00000100:00080000:0.0:1787398072.187829:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398072.205133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398072.205228:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354240 00000100:00100000:2.0:1787398072.205242:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354240 00000100:00080000:3.0:1787398072.205401:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398072.205431:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:2.0:1787398072.205450:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79272:x1874218681354240:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787398072.205497:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398072.205839:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:79272:x1874218681354240:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 395us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398072.205849:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 123 00000100:00100000:3.0:1787398072.354979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398072.355032:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354496 00000100:00100000:3.0:1787398072.355046:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354496 00000100:00100000:3.0:1787398072.355115:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1797 00000100:00100000:3.0:1787398072.355135:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79279:x1874218681354496:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00010000:3.0:1787398072.355219:0:66176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398072.355259:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8879 expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355281:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964a00) 00010000:00010000:3.0:1787398072.355298:0:66176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398072.355392:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355409:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355422:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355436:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355442:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.355449:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360873:0:66176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360900:0:66176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360908:0:66176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360933:0:66176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360941:0:66176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398072.360947:0:66176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360956:0:66176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360979:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964100) 00010000:00010000:3.0:1787398072.360982:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398072.360988:0:66176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.360996:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398072.361027:0:66176:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a85fbc57 reply state 0000000024c32d6a transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.361056:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.361066:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964900) 00010000:00010000:3.0:1787398072.361068:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787398072.361073:0:66176:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1787398072.361129:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178df480 x1874218681354496/t124554051628(0) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 528/448 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398072.361242:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79279:x1874218681354496:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 6109us (6279us total) trans 124554051628 rc 0/0 00000100:00100000:3.0:1787398072.361260:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1797 00000100:00100000:3.0:1787398072.426142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398072.426195:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354624 00000100:00100000:3.0:1787398072.426209:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354624 00000100:00100000:3.0:1787398072.426283:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1798 00000100:00100000:3.0:1787398072.426297:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79282:x1874218681354624:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398072.426743:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398072.426778:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8880 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.426881:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.426898:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.426912:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398072.426970:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787398072.426974:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398072.427001:0:77740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.427030:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abe00/0x274786fe0d193c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8880 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.427050:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8880 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.427084:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964100) 00010000:00010000:3.0:1787398072.427088:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398072.427092:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00010000:00000080:3.0:1787398072.427101:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dfb80 x1874218681354624/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 576/688 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787398072.427193:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79282:x1874218681354624:12345-192.168.204.60@tcp:101:rm.0 Request processed in 899us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398072.427202:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1798 00000100:00100000:3.0:1787398072.436088:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398072.436149:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354752 00000100:00100000:3.0:1787398072.436162:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354752 00000100:00100000:3.0:1787398072.436950:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1799 00000100:00100000:3.0:1787398072.436967:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79282:x1874218681354752:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398072.436997:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398072.437028:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8887 expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437119:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437138:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437153:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437164:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437192:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437199:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437303:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437311:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437317:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398072.437385:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x36:0x0]: returning size 0 00000004:00200000:3.0:1787398072.437390:0:74374:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398072.437415:0:74374:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437427:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437437:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437443:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437450:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437468:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398072.437474:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437483:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437499:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964100) 00010000:00010000:3.0:1787398072.437502:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398072.437508:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437514:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab200/0x274786fe0d193c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437558:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437564:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437570:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437576:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398072.437578:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437585:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437616:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964900) 00010000:00010000:3.0:1787398072.437618:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398072.437766:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437774:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa000/0x274786fe0d193c31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437811:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8887 expref: 11 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437827:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8887 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.437835:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x36:0x0].0x0 (ffff89a81a964a00) 00010000:00010000:3.0:1787398072.437837:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787398072.437839:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00010000:00000080:3.0:1787398072.437850:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a8178dc700 x1874218681354752/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 600/584 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787398072.437948:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79282:x1874218681354752:12345-192.168.204.60@tcp:101:rm.0 Request processed in 986us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398072.437957:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1799 00000100:00100000:1.0:1787398072.451402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398072.451914:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355008 00000100:00100000:3.0:1787398072.451930:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355008 00000100:00100000:3.0:1787398072.452016:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1800 00000100:00100000:3.0:1787398072.452030:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79282:x1874218681355008:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:3.0:1787398072.452143:0:67264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787398072.452191:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aaa00/0x274786fe0d193c38 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8887 expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452215:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x36:0x0].0x0 (ffff89a81a964a00) 00010000:00010000:3.0:1787398072.452238:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa400/0x274786fe0d193c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8880 expref: 9 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452248:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964100) 00010000:00010000:3.0:1787398072.452255:0:67264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398072.452291:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452308:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452319:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452333:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452341:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452349:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452470:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452479:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.452495:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456017:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456047:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456063:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456073:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456080:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456087:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456124:0:67264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398072.456156:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456162:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456169:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456175:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398072.456197:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456206:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456222:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x36:0x0].0x0 (ffff89a81a964d00) 00010000:00010000:3.0:1787398072.456225:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787398072.456229:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456236:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa200/0x274786fe0d193c4d lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456265:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456274:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456279:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456285:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456291:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398072.456294:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456301:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456319:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964c00) 00010000:00010000:3.0:1787398072.456322:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398072.456326:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456332:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa600/0x274786fe0d193c3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398072.456352:0:67264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f7d2ee3 reply state 0000000016813376 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456364:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398072.456371:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964900) 00010000:00010000:3.0:1787398072.456373:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787398072.456376:0:67264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1787398072.456410:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835b6d180 x1874218681355008/t124554051629(0) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:513/0 lens 512/456 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398072.456554:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79282:x1874218681355008:12345-192.168.204.60@tcp:36:rm.0 Request processed in 4492us (5914us total) trans 124554051629 rc 0/0 00000100:00100000:3.0:1787398072.456565:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1800 00010000:00010000:0.0:1787398072.457239:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398072.457252:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398072.457262:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398072.457267:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398072.457277:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398072.457293:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x36:0x0].0x0 (ffff89a81a964d00) 00010000:00010000:0.0:1787398072.457297:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787398072.457301:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398072.457330:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d193c54 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398072.457353:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398072.457356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398072.457358:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398072.806122:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701305728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398072.806227:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398072.806563:0:105347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305728 00000100:00100000:0.0:1787398072.806575:0:105347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305728 00000100:00100000:0.0:1787398072.806653:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787398072.806664:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701305728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787398072.806729:0:105347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000080:0.0:1787398072.806753:0:105347:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350a680 x1874218701305728/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:513/0 lens 224/368 e 0 to 0 dl 1787398083 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398072.813496:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701305728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6811us (7246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398072.813539:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787398072.818487:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701305728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398073.109952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398073.110122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398073.110158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398073.110175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398073.110266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398073.110309:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355264 00000100:00100000:0.0:1787398073.110325:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355264 00000100:00100000:2.0:1787398073.111076:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355520 00000100:00100000:2.0:1787398073.111087:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355520 00000100:00100000:2.0:1787398073.111141:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355648 00000100:00100000:2.0:1787398073.111145:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355648 00000100:00100000:2.0:1787398073.111169:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:2.0:1787398073.111179:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681355520:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398073.111255:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355392 00000100:00100000:0.0:1787398073.111264:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355392 00000100:00100000:0.0:1787398073.111295:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1774 00000100:00100000:0.0:1787398073.111303:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2402:x1874218681355264:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:0.0:1787398073.111348:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70547b480 x1874218681355264/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:514/0 lens 224/224 e 0 to 0 dl 1787398084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398073.111406:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a706e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681355520:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 225us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398073.111415:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 127 00000100:00100000:2.0:1787398073.111436:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:2.0:1787398073.111445:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a830379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681355648:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398073.111489:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a830379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681355648:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 46us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398073.111496:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 128 00000100:00100000:1.0:1787398073.111803:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355136 00000100:00100000:1.0:1787398073.111809:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355136 00000100:00100000:1.0:1787398073.111849:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:1.0:1787398073.111869:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681355136:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398073.111902:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681355136:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 35us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398073.111909:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:1.0:1787398073.111950:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1775 00000100:00100000:1.0:1787398073.111958:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681355392:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398073.111985:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681355392:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398073.111991:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1775 00000100:00100000:0.0:1787398073.112543:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70547b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2402:x1874218681355264:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1238us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.112552:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1774 00010000:00010000:3.0:1787398073.189198:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398073.316930:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787398073.316966:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398073.317061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.317121:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305856 00000100:00100000:1.0:1787398073.317130:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305856 00000100:00100000:1.0:1787398073.317187:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787398073.317196:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701305856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398073.317241:0:66189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00000100:00100000:1.0:1787398073.317289:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701305856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398073.317296:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787398073.317367:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398073.318211:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701306240:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.318281:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.318319:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701306752:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.318348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.318382:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307264:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.318406:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.318430:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787398073.318436:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701306112:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.318465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.318491:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701306624:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.318509:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.318542:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307136:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.318991:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398073.319052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319081:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701306496:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.319107:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319124:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701307008:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.319147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319165:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701307520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398073.319200:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319226:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787398073.319234:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701306368:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.319259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319278:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701306880:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.319301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319319:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701307392:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.319341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398073.319377:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701305984 00000100:00100000:1.0:1787398073.319386:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701305984 00000100:00100000:1.0:1787398073.319450:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307520 00000100:00100000:1.0:1787398073.319453:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307520 00000100:00100000:1.0:1787398073.319468:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787398073.319477:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701305984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398073.319502:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398073.319977:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306240 00000100:00100000:0.0:1787398073.319983:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306240 00000100:00100000:0.0:1787398073.320018:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306624 00000100:00100000:0.0:1787398073.320022:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306624 00000100:00100000:0.0:1787398073.320037:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306496 00000100:00100000:0.0:1787398073.320040:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306496 00000100:00100000:0.0:1787398073.320059:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307008 00000100:00100000:0.0:1787398073.320061:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307008 00000100:00100000:0.0:1787398073.320072:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306368 00000100:00100000:0.0:1787398073.320074:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306368 00000100:00100000:0.0:1787398073.320086:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307392 00000100:00100000:0.0:1787398073.320088:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307392 00000100:00100000:0.0:1787398073.320103:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1787398073.320110:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701306240:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398073.320132:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70158b800 x1874218701306240/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1787398084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398073.325304:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701306240:12345-0@lo:400:kworker.0 Request processed in 5178us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.325325:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1787398073.325380:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1787398073.325399:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701306624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398073.325493:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701306624:12345-0@lo:400:kworker.0 Request processed in 106us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.325512:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1787398073.325544:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1787398073.325566:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701306496:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398073.325585:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015de300 x1874218701306496/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1787398084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398073.325621:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701306496:12345-0@lo:400:kworker.0 Request processed in 71us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.325628:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1787398073.325641:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1787398073.325648:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701307008:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398073.325663:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015dd180 x1874218701307008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1787398084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398073.325689:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701307008:12345-0@lo:400:kworker.0 Request processed in 42us (6542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.325709:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:0.0:1787398073.325725:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1787398073.325733:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701306368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398073.325778:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701306368:12345-0@lo:400:kworker.0 Request processed in 47us (6519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.325785:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1787398073.325797:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:0.0:1787398073.325805:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701307392:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398073.325965:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015df480 x1874218701307392/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:514/0 lens 224/224 e 0 to 0 dl 1787398084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398073.326101:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701307392:12345-0@lo:400:kworker.0 Request processed in 296us (6758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398073.326108:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:3.0:1787398073.326786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398073.326884:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701306240:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.326924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701306624:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.326953:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306752 00000100:00100000:3.0:1787398073.326962:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306752 00000100:00100000:3.0:1787398073.327015:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307264 00000100:00100000:3.0:1787398073.327019:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307264 00000100:00100000:3.0:1787398073.327044:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306880 00000100:00100000:3.0:1787398073.327047:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306880 00000100:00100000:3.0:1787398073.327058:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307136 00000100:00100000:3.0:1787398073.327060:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307136 00000100:00100000:3.0:1787398073.327078:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787398073.327086:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701306752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327143:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701306752:12345-0@lo:400:kworker.0 Request processed in 57us (8793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398073.327149:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787398073.327165:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787398073.327171:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327212:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307264:12345-0@lo:400:kworker.0 Request processed in 42us (8805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398073.327218:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787398073.327229:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787398073.327236:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701306880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327267:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701306880:12345-0@lo:400:kworker.0 Request processed in 32us (7965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398073.327273:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787398073.327283:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787398073.327288:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327312:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307136:12345-0@lo:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398073.327317:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787398073.327344:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701306112 00000100:00100000:3.0:1787398073.327349:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701306112 00000100:00100000:3.0:1787398073.327376:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787398073.327382:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701306112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327415:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701306112:12345-0@lo:400:kworker.0 Request processed in 33us (8949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398073.327422:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787398073.327731:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701306112:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307136:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327761:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701306752:0@lo:400:kworker.0 00000100:00100000:3.0:1787398073.327774:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307264:0@lo:400:kworker.0 00000100:00100000:2.0:1787398073.332661:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787398073.332716:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701307520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398073.332770:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398073.333108:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701307520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 429us (13905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398073.333118:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1787398073.333631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398073.333640:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787398073.333645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398073.333648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398073.334174:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701305984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14692us (15115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398073.334210:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787398073.334327:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701306368:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.334349:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701306880:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.334363:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701307392:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.334385:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701305984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398073.334400:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701306496:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.334414:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701307008:0@lo:400:kworker.0 00000100:00100000:1.0:1787398073.334430:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701307520:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787398073.676817:0:105558:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffff074d730 00000020:00000080:1.0:1787398073.676843:0:105558:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0001 00000020:00000080:1.0:1787398073.676852:0:105558:0:(class_obd.c:148:class_resolve_dev_name()) device name lustre-MDT0001, dev 6 00000100:00100000:1.0:1787398073.829613:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398073.829650:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398073.829777:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398073.830195:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398073.830209:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701307776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398073.830249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398073.830292:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307648 00000100:00100000:2.0:1787398073.830312:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307648 00000100:00100000:2.0:1787398073.830373:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307776 00000100:00100000:2.0:1787398073.830376:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307776 00000100:00100000:2.0:1787398073.830393:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398073.830402:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398073.830467:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398073.830551:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701307648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398073.830561:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398073.830583:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787398073.830604:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701307776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398073.830626:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398073.830663:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701307776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398073.830678:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787398073.830747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701307776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398073.831209:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701307648:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787398074.216493:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398075.236866:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398076.263517:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398077.285923:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787398077.413570:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051629 is committed 00010000:00010000:0.0:1787398077.413735:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413747:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413755:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413762:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398077.413767:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413775:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413795:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964900) 00010000:00010000:0.0:1787398077.413797:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398077.413803:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413809:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d193c0e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413840:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413847:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413853:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413858:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398077.413861:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413867:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413875:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964900) 00010000:00010000:0.0:1787398077.413877:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398077.413880:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398077.413885:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d193c46 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398077.925079:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787398077.925102:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701307904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398077.925174:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398077.925254:0:105347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701307904 00000100:00100000:1.0:1787398077.925262:0:105347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701307904 00000100:00100000:1.0:1787398077.925326:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787398077.925335:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701307904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398077.925598:0:105347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445072896 avail 1298833408 00010000:00000080:1.0:1787398077.925626:0:105347:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015dce00 x1874218701307904/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:518/0 lens 224/368 e 0 to 0 dl 1787398088 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398077.925754:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701307904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 419us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398077.925762:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787398077.925821:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701307904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398078.218068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398078.218118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398078.218153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398078.218189:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398078.218235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398078.218272:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355776 00000100:00100000:1.0:1787398078.218282:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355776 00000100:00100000:1.0:1787398078.218342:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:1.0:1787398078.218354:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681355776:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398078.218431:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681355776:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 79us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.218443:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:1.0:1787398078.218489:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356032 00000100:00100000:1.0:1787398078.218493:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356032 00000100:00100000:1.0:1787398078.218590:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355904 00000100:00100000:1.0:1787398078.218595:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355904 00000100:00100000:1.0:1787398078.218639:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1782 00000100:00100000:1.0:1787398078.219736:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681356032:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787398078.219768:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015dd880 x1874218681356032/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398078.219822:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681356032:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1174us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.219833:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1782 00000100:00100000:1.0:1787398078.219865:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1783 00000100:00100000:1.0:1787398078.219876:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681355904:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787398078.219892:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015ddc00 x1874218681355904/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398078.219917:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681355904:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 44us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.219925:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1783 00000100:00100000:1.0:1787398078.219960:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356288 00000100:00100000:1.0:1787398078.219967:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356288 00000100:00100000:1.0:1787398078.220019:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356160 00000100:00100000:1.0:1787398078.220023:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356160 00000100:00100000:1.0:1787398078.220163:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:1.0:1787398078.220176:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681356288:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398078.220339:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681356288:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 165us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.220348:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 133 00000100:00100000:1.0:1787398078.220371:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00100000:1.0:1787398078.220381:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681356160:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398078.220411:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681356160:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 33us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.220429:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 134 00000100:00080000:1.0:1787398078.225323:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398078.225334:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398078.225338:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398078.225342:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787398078.313948:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398078.436827:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398078.436995:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701308160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398078.437062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398078.437121:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308160 00000100:00100000:1.0:1787398078.437129:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308160 00000100:00100000:1.0:1787398078.437179:0:66188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787398078.437187:0:66188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701308160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398078.437221:0:66188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445490688 avail 1299251200 00010000:00000080:1.0:1787398078.437236:0:66188:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015df100 x1874218701308160/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:519/0 lens 224/368 e 0 to 0 dl 1787398089 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398078.437279:0:66188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701308160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.437287:0:66188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787398078.437340:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701308160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398078.437578:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398078.437588:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701308288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398078.437634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398078.437676:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308288 00000100:00100000:0.0:1787398078.437690:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308288 00000100:00100000:0.0:1787398078.437730:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787398078.437751:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701308288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398078.437772:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398078.437813:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701308288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398078.437819:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787398078.437851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83037aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701308288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787398078.438928:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398078.440827:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701308416:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.440985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.441043:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701308032:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.441151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398078.441335:0:102323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308032 00000100:00100000:0.0:1787398078.441345:0:102323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308032 00000100:00100000:2.0:1787398078.441459:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398078.441468:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398078.441501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398078.441649:0:102323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787398078.441659:0:102323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701308032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398078.441814:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701308672:0@lo:400:kworker.0 00000100:00100000:3.0:1787398078.441845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398078.441982:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701308800:0@lo:400:kworker.0 00000100:00100000:3.0:1787398078.442010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398078.442041:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308416 00000100:00100000:3.0:1787398078.442046:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308416 00000100:00100000:1.0:1787398078.442173:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308672 00000100:00100000:1.0:1787398078.442177:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308672 00000100:00100000:1.0:1787398078.442292:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308800 00000100:00100000:1.0:1787398078.442297:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308800 00000100:00100000:1.0:1787398078.442321:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1787398078.442328:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701308672:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787398078.442344:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70158b100 x1874218701308672/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398078.442398:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701308672:12345-0@lo:400:kworker.0 Request processed in 69us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.442407:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1787398078.442427:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1787398078.442433:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701308800:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1787398078.442444:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a701588a80 x1874218701308800/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398078.442474:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701308800:12345-0@lo:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.442480:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1787398078.442505:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308544 00000100:00100000:1.0:1787398078.442509:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308544 00000100:00100000:1.0:1787398078.442557:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787398078.442564:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701308544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398078.442585:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398078.442629:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8360b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701308544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.442635:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787398078.442659:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398078.442664:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398078.442666:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787398078.443201:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398078.443347:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701308672:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443402:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8360b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701308928:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.443505:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398078.443512:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701309056:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.443608:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701309184:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443633:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.443662:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309184 00000100:00100000:2.0:1787398078.443666:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309184 00000100:00100000:2.0:1787398078.443709:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787398078.443723:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443758:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701309184:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398078.443765:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787398078.443790:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701309184:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443814:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398078.443819:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701309312:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.443838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398078.444172:0:102323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701308032:12345-0@lo:400:kworker.0 Request processed in 2513us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398078.444181:0:102323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787398078.444313:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701308928 00000100:00100000:0.0:1787398078.444317:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701308928 00000100:00100000:0.0:1787398078.444346:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309056 00000100:00100000:0.0:1787398078.444350:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309056 00000100:00100000:0.0:1787398078.444370:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1787398078.444376:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701308928:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398078.444392:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350a300 x1874218701308928/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398078.444422:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701308928:12345-0@lo:400:kworker.0 Request processed in 46us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398078.444428:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1787398078.444440:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:0.0:1787398078.444446:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701309056:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398078.444466:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d85500 x1874218701309056/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398078.444493:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701309056:12345-0@lo:400:kworker.0 Request processed in 47us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398078.444500:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1787398078.445031:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:3.0:1787398078.445039:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701308416:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1787398078.445064:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a70350ad80 x1874218701308416/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398078.445099:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701308416:12345-0@lo:400:kworker.0 Request processed in 60us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398078.445106:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:3.0:1787398078.445148:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701308800:0@lo:400:kworker.0 00000100:00100000:1.0:1787398078.445395:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309312 00000100:00100000:1.0:1787398078.445402:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309312 00000100:00100000:1.0:1787398078.445443:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787398078.445450:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701309312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398078.445494:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701309312:12345-0@lo:400:kworker.0 Request processed in 45us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398078.445509:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1787398078.445563:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398078.445568:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398078.445570:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398078.445572:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398078.445609:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701309312:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.446028:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701309440:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.446139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.446230:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701309056:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.446243:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8360b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701308928:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.446255:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701308416:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.446265:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70158a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701308032:0@lo:400:kworker.0 00000100:00100000:0.0:1787398078.450579:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309440 00000100:00100000:0.0:1787398078.450605:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309440 00000100:00100000:0.0:1787398078.450673:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1787398078.450684:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701309440:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398078.450712:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d87800 x1874218701309440/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:519/0 lens 224/224 e 0 to 0 dl 1787398089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398078.450862:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701309440:12345-0@lo:400:kworker.0 Request processed in 179us (4721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398078.450871:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1787398078.453386:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701309440:0@lo:400:kworker.0 00000100:00100000:2.0:1787398078.949443:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701309568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398078.949518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.949613:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309568 00000100:00100000:2.0:1787398078.949621:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309568 00000100:00100000:3.0:1787398078.949751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398078.949761:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701309696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398078.949792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398078.949891:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309696 00000100:00100000:2.0:1787398078.949895:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309696 00000100:00100000:2.0:1787398078.949914:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787398078.949922:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701309568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398078.949960:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398078.950004:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701309568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398078.950011:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787398078.950026:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787398078.950033:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701309696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398078.950043:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398078.950073:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701309696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398078.950078:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787398078.950117:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701309568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398078.950150:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701309696:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787398079.338436:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398080.005551:0:105853:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:2.0:1787398080.071184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398080.072051:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356416 00000100:00100000:1.0:1787398080.072063:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356416 00000100:00100000:1.0:1787398080.072137:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1801 00000100:00100000:1.0:1787398080.072148:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79353:x1874218681356416:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398080.072168:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787398080.072251:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787398080.072326:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d888e expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072454:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072571:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072589:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398080.072652:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787398080.072656:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787398080.072685:0:66176:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072714:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63a00/0x274786fe0d193c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d888e expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072742:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d888e expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.072752:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81301cd00) 00010000:00010000:1.0:1787398080.072755:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398080.072761:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63c00, rc 0) 00010000:00000080:1.0:1787398080.072771:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d85180 x1874218681356416/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 576/688 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398080.073169:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79353:x1874218681356416:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1021us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398080.073178:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1801 00000100:00100000:0.0:1787398080.082593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398080.082713:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356544 00000100:00100000:2.0:1787398080.082723:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356544 00000100:00100000:2.0:1787398080.082895:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1802 00000100:00100000:2.0:1787398080.082908:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79353:x1874218681356544:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787398080.082933:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398080.082956:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d193c69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8895 expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083031:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083060:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083071:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083087:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083094:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083101:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083190:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083198:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083205:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398080.083244:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00000004:00200000:2.0:1787398080.083248:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398080.083268:0:66178:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083283:0:66178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083300:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083306:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083313:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083319:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398080.083323:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083331:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083344:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81301cd00) 00010000:00010000:2.0:1787398080.083347:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398080.083351:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083358:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75600/0x274786fe0d193c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083369:0:66178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083376:0:66178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083381:0:66178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083390:0:66178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398080.083394:0:66178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083400:0:66178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083408:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a70242d100) 00010000:00010000:2.0:1787398080.083410:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398080.083413:0:66178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083419:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74400/0x274786fe0d193c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083450:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75400/0x274786fe0d193c69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8895 expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083464:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8895 expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.083471:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a70242d700) 00010000:00010000:2.0:1787398080.083474:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398080.083476:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75200, rc 0) 00010000:00000080:2.0:1787398080.083483:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cfbb80 x1874218681356544/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 592/584 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787398080.083586:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79353:x1874218681356544:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 681us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398080.083602:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1802 00000100:00100000:0.0:1787398080.089231:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398080.089323:0:67264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356672 00000100:00100000:2.0:1787398080.089335:0:67264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356672 00000100:00100000:2.0:1787398080.089413:0:67264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1803 00000100:00100000:2.0:1787398080.089425:0:67264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79353:x1874218681356672:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:2.0:1787398080.089449:0:67264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398080.089473:0:67264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d193c85 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d889c expref: -99 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089589:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089605:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089618:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089632:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089637:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398080.089643:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398080.089778:0:67264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701309824:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787398080.089849:0:67264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398080.089901:0:67264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366853c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398080.090147:0:66189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309824 00000100:00100000:3.0:1787398080.090153:0:66189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309824 00000100:00100000:3.0:1787398080.090201:0:66189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787398080.090211:0:66189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:67264:x1874218701309824:12345-0@lo:1000:mdt00_003.0 00010000:00000080:3.0:1787398080.090254:0:66189:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d87b80 x1874218701309824/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:521/0 lens 304/4320 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398080.090324:0:66189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:67264:x1874218701309824:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398080.090331:0:66189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787398080.090412:0:67264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67264:1874218701309824:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787398080.090462:0:67264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090473:0:67264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090483:0:67264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398080.090505:0:67264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090549:0:67264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090556:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090571:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090578:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090584:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398080.090588:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090596:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090609:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a70242d700) 00010000:00010000:0.0:1787398080.090616:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398080.090621:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090627:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74000/0x274786fe0d193c8c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090638:0:67264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090644:0:67264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090656:0:67264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090660:0:67264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398080.090663:0:67264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090668:0:67264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090677:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a70242d200) 00010000:00010000:0.0:1787398080.090679:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398080.090681:0:67264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090687:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75c00/0x274786fe0d193c93 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090728:0:67264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe74800/0x274786fe0d193c85 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d889c expref: 10 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090742:0:67264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d889c expref: 9 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.090748:0:67264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a817be7500) 00010000:00010000:0.0:1787398080.090750:0:67264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787398080.090752:0:67264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75a00, rc 0) 00010000:00000080:0.0:1787398080.090757:0:67264:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a828cf8380 x1874218681356672/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 584/584 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787398080.093734:0:67264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79353:x1874218681356672:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 4296us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398080.093750:0:67264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1803 00000100:00100000:2.0:1787398080.099216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398080.100662:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356800 00000100:00100000:1.0:1787398080.100678:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356800 00000100:00080000:3.0:1787398080.100751:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787398080.100765:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1804 00000100:00100000:1.0:1787398080.100777:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79353:x1874218681356800:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398080.100800:0:66176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398080.100838:0:66176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193ca1 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88a3 expref: -99 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.100904:0:66176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63200/0x274786fe0d193ca8 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.100919:0:66176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63200/0x274786fe0d193ca8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.100931:0:66176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63200/0x274786fe0d193ca8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66176 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398080.101050:0:66176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1787398080.101055:0:66176:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787398080.101098:0:66176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193ca1 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88a3 expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.101112:0:66176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63200/0x274786fe0d193ca8 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88a3 expref: 7 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.101120:0:66176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a81301c500) 00010000:00010000:1.0:1787398080.101123:0:66176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787398080.101127:0:66176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63200, rc 0) 00010000:00000080:1.0:1787398080.101134:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d87480 x1874218681356800/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 576/672 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398080.101209:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79353:x1874218681356800:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 435us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398080.101217:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1804 00000100:00100000:0.0:1787398080.114442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398080.115774:0:66178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681356928 00000100:00100000:1.0:1787398080.115791:0:66178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681356928 00000100:00100000:1.0:1787398080.115850:0:66178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1805 00000100:00100000:1.0:1787398080.115859:0:66178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79353:x1874218681356928:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398080.115880:0:66178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398080.115904:0:66178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193caf lrc: 2/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88aa expref: -99 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.115973:0:66178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193cb6 lrc: 3/1,0 mode: --/PR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66178 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.115999:0:66178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193cb6 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.116012:0:66178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193cb6 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66178 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398080.116138:0:66178:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240009870:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787398080.116143:0:66178:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787398080.116298:0:66178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63a00/0x274786fe0d193caf lrc: 0/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88aa expref: 9 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.116317:0:66178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193cb6 lrc: 3/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88aa expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.116325:0:66178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81301cf00) 00010000:00010000:1.0:1787398080.116328:0:66178:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787398080.116331:0:66178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62400, rc 0) 00010000:00000080:1.0:1787398080.116339:0:66178:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a83037aa00 x1874218681356928/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 576/640 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398080.116457:0:66178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83037aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79353:x1874218681356928:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 598us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398080.119313:0:66178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1805 00000100:00100000:0.0:1787398080.120793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398080.120909:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357056 00000100:00100000:1.0:1787398080.120921:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357056 00000100:00100000:1.0:1787398080.120977:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1806 00000100:00100000:1.0:1787398080.120986:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:79353:x1874218681357056:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:1.0:1787398080.121008:0:77740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398080.121049:0:77740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193cbd lrc: 2/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88b1 expref: -99 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.121108:0:77740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d193cc4 lrc: 3/1,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.121121:0:77740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d193cc4 lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.121131:0:77740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d193cc4 lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 77740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398080.121192:0:77740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000dec1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787398080.121196:0:77740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787398080.121229:0:77740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63800/0x274786fe0d193cbd lrc: 0/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b1 expref: 11 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.121244:0:77740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d193cc4 lrc: 3/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b1 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398080.121253:0:77740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a81301ca00) 00010000:00010000:1.0:1787398080.121255:0:77740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787398080.121259:0:77740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62e00, rc 0) 00010000:00000080:1.0:1787398080.121267:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a701528a80 x1874218681357056/t0(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 576/640 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787398080.121330:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79353:x1874218681357056:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 346us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398080.121337:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1806 00000100:00100000:3.0:1787398080.126355:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398080.126515:0:66177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357312 00000100:00100000:0.0:1787398080.126573:0:66177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357312 00000100:00100000:0.0:1787398080.126630:0:66177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1807 00000100:00100000:0.0:1787398080.126640:0:66177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79353:x1874218681357312:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:0.0:1787398080.126663:0:66177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398080.126666:0:66177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787398080.126698:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d193cc4 lrc: 0/0,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b1 expref: 10 pid: 77740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126718:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a81301ca00) 00010000:00010000:0.0:1787398080.126730:0:66177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787398080.126749:0:66177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193ccb lrc: 2/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88b8 expref: -99 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126907:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 3/0,1 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126922:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126933:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126957:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126965:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.126973:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398080.127901:0:66177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00010000:00010000:0.0:1787398080.127925:0:66177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75800/0x274786fe0d193ce0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127935:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75800/0x274786fe0d193ce0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127944:0:66177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75800/0x274786fe0d193ce0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127958:0:66177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 4/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127965:0:66177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 4/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127970:0:66177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 3/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127977:0:66177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 4/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.127982:0:66177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398080.127993:0:66177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 4/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128001:0:66177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 5/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128010:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a817be7b00) 00010000:00010000:0.0:1787398080.128013:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398080.128017:0:66177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 3/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128025:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74800/0x274786fe0d193cd2 lrc: 0/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398080.128056:0:66177:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013ff9b9a reply state 00000000eccbb94a transno 124554051630 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128066:0:66177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128072:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a817be7300) 00010000:00010000:0.0:1787398080.128074:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398080.128077:0:66177:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787398080.128111:0:66177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d193ccb lrc: 0/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128130:0:66177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75800/0x274786fe0d193ce0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 11 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398080.128138:0:66177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a817be7900) 00010000:00010000:0.0:1787398080.128140:0:66177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398080.128150:0:66177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00010000:00000080:0.0:1787398080.128164:0:66177:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a701588700 x1874218681357312/t124554051630(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 520/584 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787398080.128607:0:66177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:79353:x1874218681357312:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 1966us (2260us total) trans 124554051630 rc 0/0 00000100:00100000:0.0:1787398080.128616:0:66177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1807 00000100:00100000:3.0:1787398080.159035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398080.159076:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357568 00000100:00100000:3.0:1787398080.159087:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357568 00000100:00100000:3.0:1787398080.159145:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1808 00000100:00100000:3.0:1787398080.159155:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79354:x1874218681357568:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00010000:3.0:1787398080.159268:0:74374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398080.159273:0:74374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787398080.159302:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e62400/0x274786fe0d193cb6 lrc: 0/0,0 mode: --/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88aa expref: 8 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159320:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81301cf00) 00010000:00010000:3.0:1787398080.159333:0:74374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787398080.159351:0:74374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193ce7 lrc: 2/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88bf expref: -99 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159501:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,1 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159513:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159543:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159578:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: --/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159587:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.159594:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398080.160135:0:74374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00010000:00010000:3.0:1787398080.160153:0:74374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193cfc lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74374 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.160162:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193cfc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.160169:0:74374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193cfc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.160180:0:74374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161002:0:74374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 2/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161018:0:74374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161024:0:74374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398080.161028:0:74374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161050:0:74374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 4/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161064:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a807d24500) 00010000:00010000:3.0:1787398080.161067:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398080.161072:0:74374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 2/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161078:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa200/0x274786fe0d193cee lrc: 0/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787398080.161092:0:74374:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000943860c3 reply state 00000000b3ed6408 transno 85899345937 ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161103:0:74374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161110:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a807d24400) 00010000:00010000:3.0:1787398080.161112:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787398080.161115:0:74374:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787398080.161165:0:74374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa600/0x274786fe0d193ce7 lrc: 0/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 10 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161449:0:74374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193cfc lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 9 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398080.161459:0:74374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a807d24c00) 00010000:00010000:3.0:1787398080.161461:0:74374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398080.161464:0:74374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00010000:00000080:3.0:1787398080.161747:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a701589c00 x1874218681357568/t85899345937(0) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:521/0 lens 520/584 e 0 to 0 dl 1787398091 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787398080.161877:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:79354:x1874218681357568:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 2722us (2851us total) trans 85899345937 rc 0/0 00000100:00100000:3.0:1787398080.161887:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1808 00010000:00010000:1.0:1787398080.356803:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398081.381727:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787398081.814076:0:105951:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787398081.814131:0:105951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814145:0:105951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814153:0:105951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814160:0:105951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814184:0:105951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787398081.814200:0:105951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787398081.814226:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398081.814230:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787398081.814238:0:105951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787398081.814261:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a7033bc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787398081.814294:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701309952:0@lo:39:umount.0 00000100:00100000:1.0:1787398081.814364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398081.814418:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701309952 00000100:00100000:1.0:1787398081.814425:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701309952 00000100:00100000:1.0:1787398081.814481:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:1.0:1787398081.814489:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701309952:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787398081.814513:0:77740:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19371b 00000100:00080000:1.0:1787398081.814620:0:77740:0:(import.c:65:import_set_state_nolock()) ffff89a8369ca000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1787398081.814648:0:77740:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7015dc380 x1874218701309952/t0(0) o39->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1787398092 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398081.814705:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+1:3647:x1874218701309952:12345-0@lo:39:umount.0 Request processed in 216us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398081.814712:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000020:00000080:1.0:1787398081.814721:0:77740:0:(genops.c:906:class_export_put()) final put ffff89a8369cc000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1787398081.814743:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398081.814748:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814757:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398081.814760:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814769:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398081.814776:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398081.814781:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787398081.814784:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787398081.814787:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787398081.814811:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814818:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398081.814832:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814838:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23600/0x274786fe0d1936ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193706 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.814855:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398081.814857:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398081.814858:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787398081.814869:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8369cc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787398081.814915:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8369ca000 for lustre-MDT0000 00000100:00080000:1.0:1787398081.814949:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7033bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787398081.814955:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701309952:0@lo:39:umount.0 00000100:00080000:1.0:1787398081.814978:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398081.814980:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787398081.814983:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787398081.815833:0:105951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815847:0:105951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815854:0:105951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815860:0:105951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815874:0:105951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398081.815880:0:105951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815886:0:105951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815902:0:105951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815908:0:105951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815921:0:105951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398081.815928:0:105951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.815933:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398081.815935:0:105951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.815942:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815944:0:105951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815962:0:105951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815974:0:105951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398081.815979:0:105951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815985:0:105951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.815991:0:105951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816007:0:105951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816020:0:105951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787398081.816024:0:105951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1787398081.816052:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787398081.816056:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816062:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398081.816066:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816073:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398081.816080:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398081.816086:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787398081.816088:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787398081.816090:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787398081.816114:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816120:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398081.816136:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816143:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193737 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816161:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398081.816165:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816170:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398081.816173:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816179:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398081.816185:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398081.816190:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787398081.816192:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787398081.816194:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787398081.816206:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.816212:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1466c20) 00010000:00010000:1.0:1787398081.816214:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787398081.816219:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816223:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.816234:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816235:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54c00/0x274786fe0d1936f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d1936f8 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398081.816254:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816255:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398081.816262:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398081.816265:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787398081.816267:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1787398081.816271:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1787398081.816280:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398081.816283:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816291:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.816292:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398081.816298:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398081.816304:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787398081.816306:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787398081.816308:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787398081.816326:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816332:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398081.816339:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816345:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23200/0x274786fe0d193634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d19363b expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398081.816354:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398081.816356:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398081.816357:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787398081.816373:0:105951:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00010000:00010000:0.0:1787398081.816379:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000000:1.0:1787398081.816380:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1787398081.816386:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787398081.816391:0:105951:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:0.0:1787398081.816400:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.816423:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a704d23400/0x274786fe0d193642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193649 expref: -99 pid: 104253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.816433:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398081.816435:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398081.816437:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398081.817001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398081.817023:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.817100:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398081.817151:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.817173:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398081.817201:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398081.817206:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.817227:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787398081.817265:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398081.817274:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398081.817285:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701310208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.817308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398081.817329:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398081.817334:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701310336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.817353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398081.817384:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310080 00000100:00100000:2.0:1787398081.817390:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310080 00000100:00100000:2.0:1787398081.817501:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310464 00000100:00100000:2.0:1787398081.817505:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310464 00000100:00100000:2.0:1787398081.817560:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310592 00000100:00100000:2.0:1787398081.817563:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310592 00000100:00100000:2.0:1787398081.817584:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310208 00000100:00100000:2.0:1787398081.817586:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310208 00000100:00100000:2.0:1787398081.817602:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310336 00000100:00100000:2.0:1787398081.817605:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310336 00000100:00100000:2.0:1787398081.817622:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1787398081.817641:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+28:3649:x1874218701310080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398081.817656:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398081.817676:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62c00/0x274786fe0d193706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1936ff expref: 28 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398081.817691:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398081.817729:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+27:3649:x1874218701310080:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398081.817736:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1787398081.817754:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787398081.817761:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+26:3649:x1874218701310464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398081.817769:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398081.817778:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54e00/0x274786fe0d193649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193642 expref: 26 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398081.817787:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398081.817810:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+25:3649:x1874218701310464:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398081.817817:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787398081.817828:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1787398081.817836:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701310592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398081.817843:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398081.817851:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e63e00/0x274786fe0d19363b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193634 expref: 24 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398081.817860:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398081.817881:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701310592:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398081.817893:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1787398081.817906:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1787398081.817912:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+22:3650:x1874218701310208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398081.817920:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398081.817929:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22c00/0x274786fe0d193737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193730 expref: 22 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398081.817937:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398081.817964:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3650:x1874218701310208:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398081.817970:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1787398081.817982:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1787398081.817988:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+20:3650:x1874218701310336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398081.817995:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398081.818004:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aba00/0x274786fe0d1936f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1936f1 expref: 20 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398081.818012:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398081.818032:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+19:3650:x1874218701310336:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398081.818038:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1787398081.818092:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701310336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.818102:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701310208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.818128:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.818134:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398081.818155:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70152aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701310464:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1787398081.822020:0:105951:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1787398081.823085:0:104254:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345937 is committed 00010000:00010000:0.0:1787398081.823167:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823182:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 2/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823191:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823197:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398081.823203:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823213:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 4/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823235:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a807d24400) 00010000:00010000:0.0:1787398081.823238:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398081.823243:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 2/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.823250:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d193cf5 lrc: 0/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74374 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787398081.823502:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1787398081.823512:0:105951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a8310ae000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398081.823672:0:105951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a8310a9000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398081.823682:0:105951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a8364ed000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 85899345937 stale:0 00000020:00080000:1.0:1787398081.823687:0:105951:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a8364e9800 lustre-MDT0000-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398081.823692:0:105951:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff89a703f58000) has exports, disconnecting them 00000020:00080000:1.0:1787398081.823698:0:105951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a8310ae000), last request at 1787398078 00000020:00000080:1.0:1787398081.823705:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193753 00000100:00080000:1.0:1787398081.823721:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a8310a8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787398081.823814:0:105951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8310ae000): rc 0 00000020:00000080:1.0:1787398081.823817:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8310ae000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787398081.823840:0:105951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a8310a9000), last request at 1787398078 00000020:00000080:1.0:1787398081.823844:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19374c 00000100:00080000:1.0:1787398081.823851:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a8310aa000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787398081.823893:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310ae000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787398081.823946:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8310a8800 for lustre-MDT0001 00010000:00010000:2.0:1787398081.823981:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787398081.824069:0:105951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8310a9000): rc 0 00000020:00000080:1.0:1787398081.824072:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8310a9000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:1.0:1787398081.824087:0:105951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.204.60@tcp (ffff89a8364ed000), last request at 1787398080 00000020:00000080:1.0:1787398081.824097:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193688 00000020:00010000:1.0:1787398081.824109:0:105951:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a8364ed000: total 1 00000100:00080000:1.0:1787398081.824113:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a70374a000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787398081.824149:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310a9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787398081.824183:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8310aa000 for lustre-MDT0001 00000020:00010000:0.0:1787398081.824295:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a8364ed000: total 0 00010000:00010000:0.0:1787398081.824353:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a8364ed000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787398081.824386:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d193cfc lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 6 pid: 74374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.824409:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a835e63200/0x274786fe0d193ca8 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88a3 expref: 5 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398081.824423:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a8364ed000, canceled 2 locks, left on hash table 0. 00000020:00080000:1.0:1787398081.828128:0:105951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a8364ed000): rc 0 00000020:00080000:1.0:1787398081.828258:0:105951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a8364e9800), last request at 1787398031 00000020:00000080:1.0:1787398081.828267:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193681 00000100:00080000:1.0:1787398081.828283:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a83563b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787398081.830260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398081.831339:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787398081.831393:0:105951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a8364e9800): rc 0 00000020:00000080:1.0:1787398081.831398:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8364e9800/lustre-MDT0000-mdtlov_UUID 00000004:00000080:1.0:1787398081.831572:0:105951:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadfe40d4bae0 00000100:00080000:1.0:1787398081.831602:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398081.831607:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051625 gen 3 00000100:00080000:1.0:1787398081.833287:0:105951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787398081.833329:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a835664000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787398081.833406:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310720:0@lo:39:umount.0 00000100:00100000:2.0:1787398081.833495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787398081.835369:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787398081.835426:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83563b800 for lustre-MDT0001 00000100:00100000:3.0:1787398081.835683:0:105347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310720 00000100:00100000:3.0:1787398081.835692:0:105347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310720 00000100:00100000:3.0:1787398081.835761:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787398081.835772:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701310720:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787398081.835808:0:105347:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936a4 00000100:00080000:3.0:1787398081.835818:0:105347:0:(import.c:65:import_set_state_nolock()) ffff89a8310aa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398081.835844:0:105347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051630 00010000:00000080:3.0:1787398081.835961:0:105347:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d85f80 x1874218701310720/t124554051631(0) o39->lustre-MDT0001-mdtlov_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1787398092 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398081.839691:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+3:3647:x1874218701310720:12345-0@lo:39:umount.0 Request processed in 3911us (6186us total) trans 124554051631 rc 0/0 00000100:00100000:3.0:1787398081.839705:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00010000:00010000:3.0:1787398081.839743:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398081.841321:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787398081.841335:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310720:0@lo:39:umount.0 00000100:00080000:1.0:1787398081.841703:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398081.841707:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 3 00000004:00080000:1.0:1787398081.842286:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787398081.842372:0:105951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787398081.842424:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787398081.842515:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398081.842518:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1787398081.842561:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787398081.842624:0:105951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787398081.842634:0:105951:0:(import.c:65:import_set_state_nolock()) ffff89a828852000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787398081.842678:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a703f58000) has no exports 00000100:00100000:3.0:1787398081.842821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310848:0@lo:9:umount.0 00000100:00100000:3.0:1787398081.842881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398081.842912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310976:0@lo:9:umount.0 00000100:00100000:3.0:1787398081.842938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398081.842971:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310848 00000100:00100000:3.0:1787398081.842978:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310848 00000100:00100000:3.0:1787398081.843024:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701310976 00000100:00100000:3.0:1787398081.843027:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701310976 00000100:00100000:3.0:1787398081.843049:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787398081.843059:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701310848:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787398081.843082:0:99640:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936ce 00000100:00080000:3.0:1787398081.843090:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a817eff800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398081.843132:0:99640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00000100:00100000:3.0:1787398081.843287:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701310848:12345-0@lo:9:umount.0 Request processed in 228us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398081.843294:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787398081.843310:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787398081.843317:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701310976:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787398081.843329:0:99640:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936e3 00000100:00080000:3.0:1787398081.843335:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a829b1d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398081.843358:0:99640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787398081.843432:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701310976:12345-0@lo:9:umount.0 Request processed in 115us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398081.843582:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787398081.843604:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398081.843607:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787398081.843621:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398081.843627:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787398081.843652:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000040:00080000:1.0:1787398081.845987:0:105951:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 28, last_idx 30 00000040:00080000:1.0:1787398081.846033:0:105951:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 29, last_idx 30 00000020:00080000:1.0:1787398081.846704:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a703f58000) has no exports 00000004:00080000:3.0:1787398081.846869:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398081.846937:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398081.846946:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310848:0@lo:9:umount.0 00000100:00080000:3.0:1787398081.847009:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a828852000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787398081.847020:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398081.847022:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398081.847024:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701310976:0@lo:9:umount.0 00000020:00000080:0.0:1787398081.852284:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a8364ed000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00010000:00010000:0.0:1787398081.852332:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398081.852336:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398081.852339:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787398081.853312:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364ed000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0001 00000020:00000080:3.0:1787398081.860587:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70374a000 for lustre-MDT0001 00000020:01000000:0.0:1787398081.889424:0:105951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14f00 - data ffff89a827dfa1b0/ffff89a82e238800 00000020:01000000:0.0:1787398081.889978:0:105951:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a81100ede0 - data ffff89a83fc33000/ffff89a835668800 00000100:00080000:1.0:1787398081.936945:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398081.936953:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051625 gen 4 00000100:00100000:1.0:1787398081.936970:0:105951:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a70aa93800 x1874218701310720/t124554051631(124554051631) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398091 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398081.937761:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787398081.940205:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398081.940213:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 4 00000004:00080000:1.0:1787398081.940233:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398081.940236:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787398081.941354:0:104262:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787398081.941359:0:104262:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x50:0x0] index 1 count 1 00000040:00080000:3.0:1787398081.941371:0:104262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 20 count 2 00000100:00080000:1.0:1787398081.943028:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398081.943045:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1787398081.943068:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398081.943070:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787398081.943743:0:104264:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787398081.943749:0:104264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x52:0x0] index 1 count 1 00000040:00080000:2.0:1787398081.943759:0:104264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 20 count 2 00000020:00000080:1.0:1787398081.945058:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193657 00000020:00000080:1.0:1787398081.945069:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a7024b9000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398081.945223:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7024b9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787398081.946247:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19366c 00000020:00000080:1.0:1787398081.946255:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8310ab000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398081.946370:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787398081.946378:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398081.946388:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787398081.946393:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff89a703f5cd40) has no exports 00000004:01000000:1.0:1787398081.946705:0:105951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787398081.946714:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936d5 00000020:00000080:1.0:1787398081.946718:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a829b18800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398081.947380:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310ab000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787398081.947587:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787398081.947593:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398081.947599:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398081.947603:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff89a829b93380) has no exports 00000020:00000080:1.0:1787398081.947610:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936c7 00000020:00000080:1.0:1787398081.947616:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a829b1f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398081.947933:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b18800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787398081.948219:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787398081.948798:0:105951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787398081.948804:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398081.948808:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787398081.948814:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398081.948817:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398081.948870:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.948879:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398081.948886:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936b9 00000020:00000080:1.0:1787398081.948893:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a829b1b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398081.948898:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787398081.948903:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398081.948907:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398081.948910:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff89a82e4fb380) has no exports 00000020:00000080:1.0:1787398081.948929:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d1936b2 00000020:00000080:1.0:1787398081.948933:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a817ec9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398081.949065:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828852000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787398081.949073:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a829b1f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398081.949075:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787398081.949080:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787398081.949184:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b1b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787398081.949189:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ec9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787398081.949776:0:105951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787398081.949780:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398081.949782:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 5 00000004:00080000:1.0:1787398081.949786:0:105951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398081.949788:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398081.949864:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.949872:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787398081.949888:0:105951:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787398081.949895:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19369d 00000020:00000080:1.0:1787398081.949900:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a817ef9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398081.950928:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecb800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787398081.950940:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a803e98000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398081.950943:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a803e98000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787398081.950950:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787398081.951179:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:1.0:1787398081.951186:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398081.951195:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398081.951199:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff89a82e4f99c0) has no exports 00000020:00000080:1.0:1787398081.951206:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193696 00000020:00000080:1.0:1787398081.951211:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a835661000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398081.951404:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817ef9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787398081.951413:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835661000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787398081.976328:0:105951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787398081.976344:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398081.976350:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051625 gen 5 00000100:00100000:1.0:1787398081.976363:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398081.976670:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.976684:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398081.976715:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.976719:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398081.976725:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8369c9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398081.976730:0:105951:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8369c9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787398081.976742:0:105951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398081.976852:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193673 00000020:00000080:1.0:1787398081.976861:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8310ad000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787398081.976977:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a835664000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787398081.977000:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a828857800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398081.977003:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828857800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787398081.977011:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787398081.977938:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787398081.977947:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398081.977956:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787398081.977960:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff89a83b9d3380) has no exports 00000020:00000080:1.0:1787398081.978001:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.978007:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787398081.978014:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19367a 00000020:00000080:1.0:1787398081.978022:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8310ac000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787398081.978030:0:105951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a828850000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787398081.978034:0:105951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a828850000 2 00000020:01000004:1.0:1787398081.978037:0:105951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a828850000 from lustre-MDT0001 00000020:00000080:1.0:1787398081.978061:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398081.978065:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787398081.978068:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a7024ba800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787398081.978071:0:105951:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7024ba800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787398081.978078:0:105951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787398081.978127:0:105951:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1787398081.978132:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787398081.978134:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787398081.978285:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310ad000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787398081.978291:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a7033ba000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787398081.978293:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7033ba000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787398081.978296:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787398081.978343:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310ac000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787398081.978442:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787398081.978450:0:105951:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff89a7033b9800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398081.978455:0:105951:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff89a703c8cd40) has exports, disconnecting them 00000020:00080000:1.0:1787398081.978460:0:105951:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff89a7033b9800), last request at 1787398032 00000020:00000080:1.0:1787398081.978464:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193714 00000020:00080000:1.0:1787398081.978476:0:105951:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7033b9800): rc 0 00000020:00000080:1.0:1787398081.978479:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a7033b9800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787398081.979552:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7033b9800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787398081.987608:0:105951:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787398081.987620:0:105951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787398081.987625:0:105951:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787398081.987633:0:105951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787398081.987773:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398081.987782:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787398081.987791:0:105951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a828850000 1 00000020:00000080:2.0:1787398081.987798:0:105951:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19362d 00000020:00000080:2.0:1787398081.987806:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a8369cd000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787398081.987811:0:105951:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787398081.987816:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398081.987820:0:105951:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787398081.987823:0:105951:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff89a82e4f8000) has no exports 00000020:00000080:3.0:1787398081.989096:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7033bc000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787398081.989109:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a806933800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787398081.989112:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a806933800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787398081.989119:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787398081.989226:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8369cd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787398082.071510:0:105951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398082.071912:0:105951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787398082.071931:0:105951:0:(genops.c:906:class_export_put()) final put ffff89a828855000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787398082.071938:0:105951:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828855000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787398082.071948:0:105951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787398082.072092:0:105951:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a828857000 00000020:02000400:2.0:1787398082.072166:0:105951:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787398082.405452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398083.334448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398083.334520:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398083.334575:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398083.334600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398083.334648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398083.334701:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357952 00000100:00100000:1.0:1787398083.334714:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357952 00000100:00100000:1.0:1787398083.334768:0:66176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357824 00000100:00100000:1.0:1787398083.334771:0:66176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357824 00000100:00100000:1.0:1787398083.334817:0:66176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1790 00000100:00100000:1.0:1787398083.334830:0:66176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2404:x1874218681357824:12345-192.168.204.60@tcp:400:kworker.0 00010000:00000080:1.0:1787398083.334877:0:66176:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a7016fad80 x1874218681357824/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:524/0 lens 224/224 e 0 to 0 dl 1787398094 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398083.335583:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1810 00000100:00100000:0.0:1787398083.335593:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1874218681357952:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:0.0:1787398083.335602:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:2.0:1787398083.335734:0:102321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357696 00000100:00100000:2.0:1787398083.335741:0:102321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357696 00000100:00100000:2.0:1787398083.335910:0:102321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00100000:2.0:1787398083.335920:0:102321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681357696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398083.336047:0:66176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2404:x1874218681357824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1218us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398083.336057:0:66176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1790 00000100:00080000:1.0:1787398083.336091:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398083.339268:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2404:x1874218681357952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3655us (4728us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787398083.339288:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1810 00000100:00100000:0.0:1787398083.339368:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681358208 00000100:00100000:0.0:1787398083.339382:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681358208 00000100:00100000:0.0:1787398083.339468:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681358080 00000100:00100000:0.0:1787398083.339473:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681358080 00000100:00100000:0.0:1787398083.339516:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:0.0:1787398083.339543:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681358208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398083.339606:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681358208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 65us (5030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398083.339614:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 137 00000100:00100000:0.0:1787398083.339630:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:0.0:1787398083.339637:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681358080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398083.339661:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2404:x1874218681358080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (5014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398083.339667:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:2.0:1787398083.339915:0:102321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681357696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3993us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398083.339932:0:102321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00080000:1.0:1787398083.340237:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398083.340243:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787398083.350394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398083.350471:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681358336 00000100:00100000:0.0:1787398083.350485:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681358336 00000100:00100000:0.0:1787398083.350570:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1811 00000100:00100000:0.0:1787398083.350582:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70152aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681358336:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1787398083.350615:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787398083.350698:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70152aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1874218681358336:12345-192.168.204.60@tcp:38:ptlrpcd_01_00.0 Request processed in 117us (325us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398083.350707:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1811 00010000:00010000:3.0:1787398083.431873:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398083.556843:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701311232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398083.556889:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701311104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398083.562372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398083.562601:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701311616:0@lo:400:kworker.0 00000100:00100000:2.0:1787398083.562649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398083.562724:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701311360:0@lo:400:kworker.0 00000100:00100000:2.0:1787398083.562756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398083.562788:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398083.562796:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701311488:0@lo:400:kworker.0 00000100:00100000:2.0:1787398083.562820:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398083.562852:0:102326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311360 00000100:00100000:2.0:1787398083.562861:0:102326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311360 00000100:00100000:2.0:1787398083.562916:0:102326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787398083.562925:0:102326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701311360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398083.562990:0:102326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70339d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701311360:12345-0@lo:400:kworker.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398083.562998:0:102326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787398083.563058:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701311360:0@lo:400:kworker.0 00000100:00100000:2.0:1787398083.563076:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398083.563083:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701311744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398083.563108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398083.563242:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701311872:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.563365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398083.563392:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311616 00000100:00100000:0.0:1787398083.563396:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311616 00000100:00100000:0.0:1787398083.563416:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311488 00000100:00100000:0.0:1787398083.563419:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311488 00000100:00100000:0.0:1787398083.563442:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311872 00000100:00100000:0.0:1787398083.563444:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311872 00000100:00100000:0.0:1787398083.563467:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:0.0:1787398083.563472:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701311488:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398083.563486:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a835d86a00 x1874218701311488/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:524/0 lens 224/224 e 0 to 0 dl 1787398094 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398083.563538:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701311488:12345-0@lo:400:kworker.0 Request processed in 66us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398083.563545:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00100000:0.0:1787398083.563557:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1787398083.563562:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701311872:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398083.563571:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a827b76300 x1874218701311872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:524/0 lens 224/224 e 0 to 0 dl 1787398094 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398083.563605:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701311872:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398083.563610:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1787398083.563619:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1787398083.563623:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701311616:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787398083.563628:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787398083.563646:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3650:x1874218701311616:12345-0@lo:400:kworker.0 Request processed in 22us (997us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787398083.563651:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1787398083.563683:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701311872:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.563692:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701311488:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.563732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701312000:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.563754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398083.563780:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312000 00000100:00100000:0.0:1787398083.563783:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312000 00000100:00100000:0.0:1787398083.563797:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1787398083.563801:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701312000:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787398083.563805:0:74374:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787398083.563825:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1874218701312000:12345-0@lo:400:kworker.0 Request processed in 23us (71us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787398083.563830:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:0.0:1787398083.564163:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787398083.564168:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787398083.564172:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787398083.564178:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398083.564181:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3916 00000100:00080000:0.0:1787398083.564187:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398083.564206:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b75180 x1874218701312128/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398083.564224:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701312000:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.564239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701312128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787398083.564375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398083.564403:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312128 00000100:00100000:0.0:1787398083.564406:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312128 00000100:00100000:0.0:1787398083.564422:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:0.0:1787398083.564426:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701312128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787398083.564443:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787398083.564469:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701312128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 41us (94us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398083.564481:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00080000:0.0:1787398083.564518:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398083.564554:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398083.564557:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701312128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787398083.564654:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701312512:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.564676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398083.564695:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312512 00000100:00100000:0.0:1787398083.564698:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312512 00000100:00100000:0.0:1787398083.564717:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1787398083.564722:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701312512:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1787398083.564734:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a827b77b80 x1874218701312512/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:524/0 lens 224/224 e 0 to 0 dl 1787398094 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398083.564759:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701312512:12345-0@lo:400:kworker.0 Request processed in 36us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398083.564764:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1787398083.564788:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701312512:0@lo:400:kworker.0 00000100:00080000:0.0:1787398083.564840:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398083.565030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398083.565098:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701312384:0@lo:400:kworker.0 00000100:00100000:3.0:1787398083.565123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398083.565140:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398083.565145:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701312256:0@lo:400:kworker.0 00000100:00100000:3.0:1787398083.565166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398083.565231:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312384 00000100:00100000:3.0:1787398083.565236:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312384 00000100:00100000:3.0:1787398083.565285:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787398083.565291:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701312384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398083.565412:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701312384:12345-0@lo:400:kworker.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398083.565419:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787398083.565450:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701312384:0@lo:400:kworker.0 00000100:00100000:0.0:1787398083.568244:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311232 00000100:00100000:0.0:1787398083.568369:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311232 00000100:00100000:0.0:1787398083.568467:0:66188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312256 00000100:00100000:0.0:1787398083.568471:0:66188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312256 00000100:00100000:3.0:1787398083.568544:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787398083.568554:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70158a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1874218701311232:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1787398083.568563:0:105347:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787398083.568666:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70158a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1874218701311232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (3636us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787398083.568674:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787398083.568694:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787398083.568698:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1874218701312256:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787398083.568703:0:105347:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787398083.568724:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1874218701312256:12345-0@lo:400:kworker.0 Request processed in 25us (3558us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787398083.568729:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:3.0:1787398083.568774:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787398083.568779:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787398083.568783:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787398083.568790:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398083.568793:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3916 00000100:00080000:3.0:1787398083.568801:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a819129800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398083.568832:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a701589180 x1874218701312640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398083.568887:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701312256:0@lo:400:kworker.0 00000100:02020000:3.0:1787398083.568900:0:3651:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1787398083.568903:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787398083.568906:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff89a819129800 already not connected (conn 8, was 7): CONNECTING 00000100:00080000:0.0:1787398083.569399:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787398083.569416:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701312640:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787398083.569457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398083.569566:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787398083.569571:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787398083.569582:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787398083.569587:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398083.569590:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3916 00000100:00080000:2.0:1787398083.569596:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398083.569614:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015dc000 x1874218701312768/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398083.569633:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701311616:0@lo:400:kworker.0 00000100:00100000:3.0:1787398083.569666:0:105347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312640 00000100:00100000:3.0:1787398083.569671:0:105347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312640 00000100:00100000:3.0:1787398083.569692:0:105347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787398083.569697:0:105347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1874218701312640:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1787398083.569715:0:105347:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398083.569745:0:105347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1874218701312640:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (288us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398083.569751:0:105347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787398083.569907:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311104 00000100:00100000:1.0:1787398083.569911:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311104 00000100:00100000:1.0:1787398083.569993:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701311744 00000100:00100000:1.0:1787398083.569997:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701311744 00000100:00080000:0.0:1787398083.570032:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398083.570061:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787398083.570069:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701311104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787398083.570093:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398083.570166:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701311104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (7802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398083.570172:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787398083.570186:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787398083.570191:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701311744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398083.570207:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398083.570231:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701311744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398083.570236:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787398083.570502:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701311104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398083.570710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701311744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398083.570773:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701312768:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787398083.570807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787398083.570926:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398083.570931:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398083.570934:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701312640:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787398083.570979:0:77740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312768 00000100:00100000:0.0:1787398083.570983:0:77740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312768 00000100:00100000:0.0:1787398083.571043:0:77740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1787398083.571048:0:77740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701312768:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787398083.571062:0:77740:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787398083.571130:0:77740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1874218701312768:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 80us (321us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398083.571136:0:77740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00080000:3.0:1787398083.571197:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398083.571201:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398083.571204:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701312768:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787398084.452646:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398085.479628:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787398085.604879:0:102316:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1787398085.604902:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051631 is committed 00000020:00000080:0.0:1787398085.604907:0:102316:0:(genops.c:906:class_export_put()) final put ffff89a8310a9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398085.604964:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8310a9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787398085.605026:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a8310aa800 for lustre-MDT0000 00000001:00080000:0.0:1787398085.605089:0:102316:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051630 is committed 00010000:00010000:1.0:1787398085.605586:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605599:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605606:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605612:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398085.605627:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605636:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605655:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a817be7300) 00010000:00010000:1.0:1787398085.605658:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398085.605662:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 2/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398085.605669:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193cd9 lrc: 0/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66177 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787398086.181778:0:106151:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787398086.181842:0:106151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.181858:0:106151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.181865:0:106151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.181872:0:106151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.181894:0:106151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787398086.181900:0:106151:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787398086.181943:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787398086.181948:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787398086.181955:0:106151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787398086.181985:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a817efb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787398086.182188:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398086.182200:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.182208:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398086.182212:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.182222:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398086.182229:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398086.182235:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787398086.182238:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787398086.182240:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787398086.182275:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.182282:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787398086.182335:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787398086.183161:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.183173:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb54800/0x274786fe0d192f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f18 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.183188:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.183190:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.183192:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398086.183268:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701312896:0@lo:39:umount.0 00000100:00100000:3.0:1787398086.183348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398086.183630:0:74374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701312896 00000100:00100000:0.0:1787398086.183639:0:74374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701312896 00000100:00100000:0.0:1787398086.183699:0:74374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1787398086.183708:0:74374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a701589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701312896:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787398086.183737:0:74374:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193030 00000100:00080000:0.0:1787398086.183745:0:74374:0:(import.c:65:import_set_state_nolock()) ffff89a828a5a000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1787398086.183781:0:74374:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff89a701589180 x1874218701312896/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:527/0 lens 224/224 e 0 to 0 dl 1787398097 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398086.183825:0:74374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a701589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1874218701312896:12345-0@lo:39:umount.0 Request processed in 118us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398086.183833:0:74374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000020:00000080:0.0:1787398086.183842:0:74374:0:(genops.c:906:class_export_put()) final put ffff89a828a58000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787398086.183903:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787398086.183916:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a58000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787398086.183972:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5a000 for lustre-MDT0000 00000100:00080000:3.0:1787398086.184008:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817efb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787398086.184018:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701312896:0@lo:39:umount.0 00000100:00080000:0.0:1787398086.184083:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787398086.184086:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787398086.184090:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787398086.184994:0:106151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185010:0:106151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185017:0:106151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185024:0:106151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185056:0:106151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398086.185062:0:106151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185069:0:106151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185074:0:106151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185080:0:106151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185092:0:106151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787398086.185098:0:106151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185104:0:106151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185110:0:106151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185116:0:106151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185125:0:106151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787398086.185130:0:106151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185144:0:106151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185150:0:106151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185156:0:106151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.185169:0:106151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787398086.185172:0:106151:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787398086.185199:0:106151:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787398086.185203:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1787398086.185207:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1787398086.185213:0:106151:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1787398086.187046:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787398086.187071:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187083:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787398086.187087:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187096:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787398086.187118:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398086.187123:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787398086.187126:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787398086.187130:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787398086.187182:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187188:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398086.187220:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187227:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836583e00/0x274786fe0d192e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e3f expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187243:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398086.187247:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187253:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787398086.187255:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187262:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787398086.187268:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398086.187284:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787398086.187287:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787398086.187288:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787398086.187304:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187311:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398086.187317:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187323:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62600/0x274786fe0d19373e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193745 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187338:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398086.187342:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187348:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a70720be00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787398086.187350:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187357:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787398086.187363:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398086.187368:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787398086.187371:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787398086.187378:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787398086.187393:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.187399:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398086.187717:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398086.187724:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.187730:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398086.187733:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.187740:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398086.187747:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398086.187752:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787398086.187755:0:15258:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787398086.187756:0:15258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787398086.187773:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.187790:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787398086.189026:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.189160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398086.189200:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.189221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398086.189237:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398086.189243:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.189279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398086.189317:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313408 00000100:00100000:2.0:1787398086.189325:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313408 00000100:00100000:2.0:1787398086.189378:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313024 00000100:00100000:2.0:1787398086.189381:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313024 00000100:00100000:2.0:1787398086.189401:0:19657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313536 00000100:00100000:2.0:1787398086.189404:0:19657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313536 00000100:00100000:2.0:1787398086.189424:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1787398086.189433:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+21:3648:x1874218701313408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398086.190695:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398086.190726:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee31e00/0x274786fe0d192f0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f03 expref: 21 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398086.190746:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398086.190811:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+20:3648:x1874218701313408:12345-0@lo:103:ldlm_bl.0 Request processed in 1377us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398086.190821:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1787398086.190849:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1787398086.190859:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701313024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398086.190870:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398086.190880:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720b200/0x274786fe0d192f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f11 expref: 19 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398086.190889:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398086.190912:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+18:3648:x1874218701313024:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398086.190918:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1787398086.190957:0:19657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1787398086.190976:0:19657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+17:3648:x1874218701313536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398086.190983:0:19657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398086.190991:0:19657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836583800/0x274786fe0d192e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192e2a expref: 17 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398086.191004:0:19657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398086.191027:0:19657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:99b57a74-e5dc-42df-b087-b10fad741506+16:3648:x1874218701313536:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398086.191032:0:19657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000004:00000080:0.0:1787398086.191151:0:106151:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1787398086.191349:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1787398086.191356:0:106151:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7025d2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398086.191362:0:106151:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a836708000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398086.191369:0:106151:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89a7090fd000 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 124554051630 stale:0 00000020:00080000:0.0:1787398086.191375:0:106151:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff89a702478000) has exports, disconnecting them 00000020:00080000:0.0:1787398086.191379:0:106151:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a7025d2800), last request at 1787398083 00000020:00000080:0.0:1787398086.191386:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193029 00000100:00080000:0.0:1787398086.191395:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a7025d3000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787398086.193912:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.193931:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.193941:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701313024:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787398086.194234:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a7025d2800): rc 0 00000020:00000080:0.0:1787398086.194238:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a7025d2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787398086.194254:0:106151:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89a836708000), last request at 1787398083 00000020:00000080:0.0:1787398086.194287:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193022 00000100:00080000:0.0:1787398086.194298:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a83670a000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787398086.194317:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1787398086.194400:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.194411:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836582c00/0x274786fe0d192e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192e31 expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.194437:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.194450:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.194453:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787398086.194755:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a836708000): rc 0 00000020:00000080:1.0:1787398086.194758:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a836708000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787398086.195242:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.195251:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a70720be00/0x274786fe0d192f03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d192f0a expref: -99 pid: 102315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.195268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.195275:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.195280:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398086.195296:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a701589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398086.195360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398086.195461:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787398086.195469:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398086.195631:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787398086.195976:0:106151:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.60@tcp (ffff89a7090fd000), last request at 1787398083 00000020:00000080:1.0:1787398086.195983:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e85 00000020:00010000:1.0:1787398086.195996:0:106151:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7090fd000: total 1 00000100:00080000:1.0:1787398086.196001:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a706d32000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1787398086.196021:0:15258:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7090fd000: total 1 00010000:00010000:1.0:1787398086.196087:0:15258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7090fd000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1787398086.196121:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63c00/0x274786fe0d193c62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d888e expref: 8 pid: 66176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.196146:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75a00/0x274786fe0d193c9a lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d889c expref: 7 pid: 67264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.196166:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75800/0x274786fe0d193ce0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 6 pid: 66177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.196180:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a80fe75200/0x274786fe0d193c7e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8895 expref: 5 pid: 66178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398086.196202:0:15258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7090fd000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1787398086.202939:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7025d3000 for lustre-MDT0000 00000020:00000080:0.0:1787398086.202961:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836708000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787398086.203007:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83670a000 for lustre-MDT0000 00000100:00100000:2.0:1787398086.203219:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313152 00000100:00100000:2.0:1787398086.203229:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313152 00000100:00100000:2.0:1787398086.203304:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313280 00000100:00100000:2.0:1787398086.203308:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313280 00000100:00100000:2.0:1787398086.203338:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1787398086.203347:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+17:3650:x1874218701313152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398086.203361:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398086.203380:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582800/0x274786fe0d192e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192e38 expref: 17 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398086.203396:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398086.203481:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701313152:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (8119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398086.203489:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1787398086.204393:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1787398086.204408:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+15:3650:x1874218701313280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787398086.204420:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787398086.204434:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23c00/0x274786fe0d193745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d19373e expref: 15 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398086.204456:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787398086.204495:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:99b57a74-e5dc-42df-b087-b10fad741506+14:3650:x1874218701313280:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (8864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398086.204502:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000020:00080000:0.0:1787398086.210250:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a7090fd000): rc 0 00000004:00000080:0.0:1787398086.210265:0:106151:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadfe41657ae0 00000100:00080000:0.0:1787398086.210294:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787398086.210307:0:106151:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff89a7016fb480 x1874218701311232/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398099 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398086.210329:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787398086.211203:0:106151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787398086.211211:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a819129800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1787398086.212265:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398086.212282:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a701589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398086.212321:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398086.212324:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398086.212326:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398086.213878:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701311232:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787398086.229214:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787398086.229222:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 3 00000004:00080000:0.0:1787398086.229237:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787398086.229330:0:106151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787398086.229355:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a702184000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787398086.229380:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787398086.229382:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787398086.229393:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787398086.229472:0:106151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787398086.229482:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a70378a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787398086.229545:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a702478000) has no exports 00000020:00080000:0.0:1787398086.229738:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89a702478000) has no exports 00000100:00100000:3.0:1787398086.230173:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701313664:0@lo:9:umount.0 00000100:00100000:3.0:1787398086.230246:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398086.230282:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701313792:0@lo:9:umount.0 00000100:00100000:3.0:1787398086.230304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398086.230341:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313664 00000100:00100000:3.0:1787398086.230349:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313664 00000100:00100000:3.0:1787398086.230396:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701313792 00000100:00100000:3.0:1787398086.230400:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701313792 00000100:00100000:3.0:1787398086.230418:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398086.230427:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701313664:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787398086.230472:0:99641:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ed2 00000100:00080000:3.0:1787398086.230480:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a827b38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398086.230533:0:99641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00000100:00100000:3.0:1787398086.230654:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701313664:12345-0@lo:9:umount.0 Request processed in 228us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398086.230662:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398086.230677:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787398086.230683:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874218701313792:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787398086.230694:0:99641:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192eee 00000100:00080000:3.0:1787398086.230699:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a70378a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398086.230718:0:99641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787398086.230781:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1874218701313792:12345-0@lo:9:umount.0 Request processed in 98us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398086.230787:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787398086.230807:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398086.230811:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787398086.230823:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.230828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787398086.230853:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702184000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787398086.230863:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398086.230865:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398086.230868:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701313664:0@lo:9:umount.0 00000100:00080000:3.0:1787398086.230879:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a70378a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787398086.230886:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398086.230887:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398086.230890:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701313792:0@lo:9:umount.0 00000020:00000080:1.0:1787398086.232762:0:15258:0:(genops.c:906:class_export_put()) final put ffff89a7090fd000/784819ec-79bc-4534-8fa6-902d7a92d2f8 00010000:00010000:1.0:1787398086.232791:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.232793:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398086.232796:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787398086.232865:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7090fd000/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0000 00000020:00000080:3.0:1787398086.232936:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a706d32000 for lustre-MDT0000 00000020:00000080:0.0:1787398086.301373:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e9a 00000020:00000080:0.0:1787398086.301392:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a827b3b800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787398086.301478:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787398086.301795:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b3b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787398086.302358:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398086.302372:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787398086.302376:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89a83b9d4d40) has no exports 00000020:00000080:2.0:1787398086.302917:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e93 00000020:00000080:2.0:1787398086.302928:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a835707000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787398086.302990:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398086.302997:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787398086.303001:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a837bc0800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787398086.303003:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a837bc0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787398086.303014:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787398086.303265:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835707000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787398086.303325:0:106151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a706d14060 - data ffff89a827d420d8/ffff89a83823c800 00000020:01000000:2.0:1787398086.303490:0:106151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a703368420 - data ffff89a83fc2b870/ffff89a706e39000 00000100:00080000:3.0:1787398086.369098:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787398086.369107:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787398086.369114:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787398086.379107:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787398086.379118:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 4 00000004:00080000:3.0:1787398086.379144:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398086.379148:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787398086.383279:0:102333:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787398086.383289:0:102333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x74:0x0] index 1 count 1 00000040:00080000:3.0:1787398086.383310:0:102333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 29 count 2 00000100:00080000:1.0:1787398086.384160:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398086.384166:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1787398086.384184:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398086.384186:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787398086.384899:0:102335:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787398086.384905:0:102335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x76:0x0] index 1 count 1 00000040:00080000:0.0:1787398086.384916:0:102335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 29 count 2 00000020:00000080:1.0:1787398086.388083:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e4d 00000020:00000080:1.0:1787398086.388095:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702180000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787398086.388264:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702180000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787398086.388739:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e62 00000020:00000080:1.0:1787398086.388745:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a7054c4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787398086.388761:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787398086.388770:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398086.388781:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1787398086.388782:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:1.0:1787398086.388785:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff89a7033a4d40) has no exports 00000004:01000000:1.0:1787398086.390872:0:106151:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787398086.390889:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ee7 00000020:00000080:1.0:1787398086.390899:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a709126800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787398086.390930:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787398086.390937:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398086.390950:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398086.390955:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff89a83549cd40) has no exports 00000020:00000080:1.0:1787398086.390963:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ee0 00000020:00000080:1.0:1787398086.390967:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a70378f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787398086.390984:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709126800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787398086.390998:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70378f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787398086.392465:0:106151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787398086.392490:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398086.392495:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787398086.392503:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398086.392505:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398086.392575:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398086.392588:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787398086.392599:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ecb 00000020:00000080:1.0:1787398086.392609:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a709123800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787398086.392615:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787398086.392620:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398086.392624:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398086.392627:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff89a7020799c0) has no exports 00000020:00000080:1.0:1787398086.392635:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ebd 00000020:00000080:1.0:1787398086.392638:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702184800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787398086.392961:0:106151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787398086.392964:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398086.392966:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 5 00000004:00080000:1.0:1787398086.392970:0:106151:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398086.392971:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398086.392998:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398086.393906:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398086.393923:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70378a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787398086.393933:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a709123000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787398086.393936:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709123000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000004:01000000:1.0:1787398086.393942:0:106151:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:01000000:0.0:1787398086.393944:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787398086.393949:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192eaf 00000020:00000080:1.0:1787398086.393955:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a709121000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787398086.393972:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='F') 00000020:00000080:1.0:1787398086.393976:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398086.393984:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398086.393987:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff89a829b919c0) has no exports 00000020:00000080:1.0:1787398086.393995:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192ea8 00000020:00000080:1.0:1787398086.393998:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a819129000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787398086.394040:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709123800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787398086.394046:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702184800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787398086.394051:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a702184000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787398086.394054:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a709121800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787398086.394057:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709121800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787398086.394071:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398086.394101:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a709121000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787398086.394105:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a819129000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787398086.458726:0:106151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787398086.458737:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787398086.458742:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787398086.458751:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787398086.458818:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398086.458834:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398086.458865:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398086.458868:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398086.458874:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702185800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787398086.458878:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702185800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787398086.458889:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398086.459151:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e69 00000020:00000080:0.0:1787398086.459158:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a7054c1800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787398086.459164:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787398086.459168:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398086.459173:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787398086.459177:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89a70247b380) has no exports 00000020:00000080:0.0:1787398086.459194:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398086.459198:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787398086.459202:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e70 00000020:00000080:0.0:1787398086.459205:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a7054c0000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787398086.459213:0:106151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7024bf000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787398086.459216:0:106151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7024bf000 3 00000020:01000004:0.0:1787398086.459219:0:106151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a7024bf000 from lustre-MDT0000 00000020:00000080:0.0:1787398086.459239:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398086.459243:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787398086.459245:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702187800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787398086.459247:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702187800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787398086.459265:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787398086.459295:0:106151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787398086.459300:0:106151:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787398086.459315:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787398086.459318:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398086.459322:0:106151:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787398086.459331:0:106151:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a7025d0800 e5696550-1ffc-466d-b13d-359d59b5fc5f 192.168.204.60@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398086.459339:0:106151:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89a83fa46800 99b57a74-e5dc-42df-b087-b10fad741506 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398086.459343:0:106151:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff89a838780000) has exports, disconnecting them 00000020:00080000:0.0:1787398086.459348:0:106151:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.60@tcp (ffff89a7025d0800), last request at 1787397970 00000020:00000080:0.0:1787398086.459371:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192f34 00000020:00010000:0.0:1787398086.459376:0:106151:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a7025d0800: total 2 00000100:00080000:0.0:1787398086.459381:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a7025d5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787398086.459393:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a7025d0800): rc 0 00000020:00080000:0.0:1787398086.459396:0:106151:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89a83fa46800), last request at 1787397969 00000020:00000080:0.0:1787398086.459451:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e15 00000020:00010000:0.0:1787398086.459455:0:106151:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89a83fa46800: total 2 00000100:00080000:0.0:1787398086.459457:0:106151:0:(import.c:65:import_set_state_nolock()) ffff89a83ae95800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787398086.459473:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a83fa46800): rc 0 00000020:00080000:0.0:1787398086.459477:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89a838780000) has no exports 00000100:00100000:0.0:1787398086.459558:0:102321:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89a820010200:102321] 0 exiting: rc = 1 00000100:00100000:0.0:1787398086.459658:0:102323:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89a83120aa00:102323] 2 exiting: rc = 0 00000020:00000080:3.0:1787398086.459760:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a819129800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787398086.459768:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a702185000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787398086.459770:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702185000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787398086.459778:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787398086.459899:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787398086.459903:0:65702:0:(genops.c:906:class_export_put()) final put ffff89a702181000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787398086.459905:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702181000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787398086.459908:0:65702:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787398086.460043:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1787398086.460058:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a7025d0800: total 0 00010000:00010000:3.0:1787398086.460062:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.460082:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a7025d0800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1787398086.460116:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55e00/0x274786fe0d19300d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c0 expref: 5 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22a00/0x274786fe0d193014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86c7 expref: 4 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460143:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d23a00/0x274786fe0d193006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d86b9 expref: 3 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460169:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22200/0x274786fe0d193729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d87c3 expref: 2 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460182:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a7025d0800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1787398086.460200:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a7025d0800/e5696550-1ffc-466d-b13d-359d59b5fc5f 00000020:00010000:3.0:1787398086.460220:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89a83fa46800: total 1 00010000:00010000:3.0:1787398086.460238:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89a83fa46800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787398086.460254:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836583c00/0x274786fe0d192f6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f65 expref: 9 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460266:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb54a00/0x274786fe0d192fea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192fe3 expref: 8 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460279:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82eb55200/0x274786fe0d192f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f73 expref: 7 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460289:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582e00/0x274786fe0d192f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f8f expref: 6 pid: 102321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460302:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a704d22600/0x274786fe0d192ff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192ff1 expref: 5 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460313:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836582000/0x274786fe0d192f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f81 expref: 4 pid: 102322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460324:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a82ee30400/0x274786fe0d192f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f49 expref: 3 pid: 102326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460334:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a70720a600/0x274786fe0d192f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d192f57 expref: 2 pid: 102323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398086.460353:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89a83fa46800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787398086.460367:0:6511:0:(genops.c:906:class_export_put()) final put ffff89a83fa46800/99b57a74-e5dc-42df-b087-b10fad741506 00010000:00010000:3.0:1787398086.460371:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.460373:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398086.460375:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398086.460421:0:102322:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89a836508c00:102322] 1 exiting: rc = 0 00010000:00010000:3.0:1787398086.460475:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398086.460516:0:102326:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff89a7022c2c00:102326] 3 exiting: rc = 0 00000020:00000080:0.0:1787398086.461052:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7025d0800/e5696550-1ffc-466d-b13d-359d59b5fc5f for MGS 00000020:00000080:0.0:1787398086.461088:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a83fa46800/99b57a74-e5dc-42df-b087-b10fad741506 for MGS 00000020:00000080:0.0:1787398086.461098:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7025d5800 for MGS 00000020:00000080:0.0:1787398086.461102:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83ae95800 for MGS 00000100:00100000:0.0:1787398086.461135:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461142:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461148:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461267:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461277:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461284:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461290:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461295:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461950:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461963:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461970:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461975:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461982:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461988:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.461995:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462000:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462016:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462024:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462031:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462038:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462043:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462049:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462055:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462061:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462071:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462079:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462085:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462092:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462098:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462104:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462110:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462115:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462121:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462128:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462134:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462141:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462147:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462153:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462177:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462182:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462189:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462195:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462200:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462208:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462214:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462219:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462225:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462230:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462236:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462242:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462248:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462254:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462260:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462265:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462272:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462279:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462285:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462291:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462296:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462302:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462847:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462855:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462861:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.462866:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787398086.466954:0:106151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a70259c600 - data ffff89a827ed1000/ffff89a830a50000 00000020:01000000:0.0:1787398086.467209:0:106151:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a702084000 - data ffff89a83fc30ca8/ffff89a8369bb400 00000020:00000080:0.0:1787398086.467835:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e0e 00000020:00000080:0.0:1787398086.467845:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702025000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787398086.467864:0:106151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7024bf000 from MGS, refs=2 00000020:01000004:0.0:1787398086.467869:0:106151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7024bf000 2 00000020:01000004:0.0:1787398086.467872:0:106151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a7024bf000 from MGS 00000020:00000080:0.0:1787398086.467894:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398086.467914:0:106151:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787398086.467917:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702021800/MGS 00000020:00000080:0.0:1787398086.467920:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702021800/MGS for MGS 00000020:01000000:0.0:1787398086.467939:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787398086.468006:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787398086.468009:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398086.468016:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787398086.468023:0:106151:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89a817efa000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787398086.468029:0:106151:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff89a82e4fcd40) has exports, disconnecting them 00000020:00080000:0.0:1787398086.468034:0:106151:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89a817efa000), last request at 1787397970 00000020:00000080:0.0:1787398086.468038:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192f26 00000020:00080000:0.0:1787398086.468047:0:106151:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a817efa000): rc 0 00000020:00000080:0.0:1787398086.468051:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a817efa000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787398086.468319:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702025000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787398086.468336:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efa000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787398086.476900:0:106151:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787398086.476910:0:106151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398086.476928:0:106151:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787398086.476936:0:106151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398086.477105:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398086.477119:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787398086.477127:0:106151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7024bf000 1 00000020:00000080:1.0:1787398086.477136:0:106151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d192e00 00000020:00000080:1.0:1787398086.477146:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a702022800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787398086.477152:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787398086.477157:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398086.477161:0:106151:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787398086.477165:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89a838783380) has no exports 00000020:00000080:3.0:1787398086.479391:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817efb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787398086.479406:0:83690:0:(genops.c:906:class_export_put()) final put ffff89a817efa800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787398086.479410:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a817efa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787398086.479416:0:83690:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787398086.479515:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a702022800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787398086.501732:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787398086.617486:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787398086.617503:0:106151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787398086.617509:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a7024bc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787398086.617514:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7024bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787398086.617555:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787398086.617674:0:106151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a7024bd000 00000020:01000000:2.0:1787398086.617694:0:106151:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787398086.617698:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787398086.617703:0:106151:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787398086.617707:0:106151:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff89a70247cd40) has no exports 00000100:00100000:2.0:1787398086.619827:0:74374:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff89a828a93800:74374] 4 exiting: rc = 0 00000100:00100000:2.0:1787398086.619994:0:77740:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff89a703d33a00:77740] 5 exiting: rc = 0 00000100:00100000:2.0:1787398086.620092:0:66176:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89a8354b3000:66176] 0 exiting: rc = 1 00000100:00100000:2.0:1787398086.620165:0:66178:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff89a704c59000:66178] 2 exiting: rc = 0 00000100:00100000:2.0:1787398086.636446:0:66177:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff89a704c59600:66177] 1 exiting: rc = 0 00000100:00100000:3.0:1787398086.667646:0:67264:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89a704b68800:67264] 3 exiting: rc = 0 00000100:00100000:2.0:1787398086.667850:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667861:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667868:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667877:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667883:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667891:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667898:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667904:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667910:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667916:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667921:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667926:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667932:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667937:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667943:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667948:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667953:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667958:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667964:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667969:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667975:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667980:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667987:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667992:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.667998:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668004:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668010:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668015:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668021:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668029:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668121:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668128:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668134:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668139:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668146:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668151:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668157:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668163:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668168:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668174:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668179:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668184:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668190:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668195:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668200:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668206:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668212:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668218:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668223:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668228:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668233:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668238:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668243:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668249:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668254:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668259:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668264:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668269:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668273:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668278:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668283:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668289:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668293:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.668298:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.675278:0:66180:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89a704a4b600:66180] 1 exiting: rc = 0 00000100:00100000:1.0:1787398086.675406:0:66179:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89a704a4a200:66179] 0 exiting: rc = 1 00000100:00100000:2.0:1787398086.676708:0:80567:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff89a83b0e6000:80567] 2 exiting: rc = 0 00000100:00100000:0.0:1787398086.676855:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676863:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676869:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676877:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676884:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676890:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676896:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676903:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676908:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676913:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676918:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676924:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676930:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676936:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676942:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676948:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676955:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676960:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676966:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676972:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676986:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.676994:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677000:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677006:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677012:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677018:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677024:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677029:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677035:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677041:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677060:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677067:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677071:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677076:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677081:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677086:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677091:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677096:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677100:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677106:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677111:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677115:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677121:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677125:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677130:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677135:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677140:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677146:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677151:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677156:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677162:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677168:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677174:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677180:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677187:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677200:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677206:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677213:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677219:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677226:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677233:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677238:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677243:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677249:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.677742:0:66189:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89a83b975800:66189] 1 exiting: rc = 0 00000100:00100000:0.0:1787398086.677853:0:66188:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89a706c1aa00:66188] 0 exiting: rc = 1 00000100:00100000:2.0:1787398086.678060:0:105347:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff89a835648800:105347] 2 exiting: rc = 0 00000100:00100000:0.0:1787398086.678195:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678203:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678211:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678219:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678226:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678231:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678246:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678254:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678261:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678273:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678280:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678285:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678291:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678303:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678310:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678316:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678323:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678329:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678337:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678345:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678352:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678360:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678366:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678373:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678390:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678396:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678402:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678408:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678422:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678439:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678447:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678453:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678459:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678465:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678471:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678485:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678493:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678499:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678514:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678549:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678557:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678563:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678576:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678585:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678592:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678606:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678614:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678619:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678625:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678631:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678644:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678652:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678659:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678666:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678671:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678677:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678683:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678688:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678695:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678708:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678714:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678729:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678735:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.678741:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.696166:0:66192:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89a83b975000:66192] 0 exiting: rc = 1 00000100:00100000:3.0:1787398086.696346:0:66193:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89a817826600:66193] 1 exiting: rc = 0 00000100:00100000:2.0:1787398086.697286:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697295:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697300:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697306:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697311:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697316:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697321:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697327:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697333:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697338:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697342:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697348:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697353:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697505:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697510:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697516:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697680:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697690:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697695:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697701:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697706:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697711:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697715:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697721:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697725:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697731:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697735:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697741:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697745:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697751:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697756:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697761:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697780:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697785:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697790:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697796:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697800:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697805:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697809:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697814:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697818:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697823:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697828:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697833:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697838:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697843:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697847:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697852:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697856:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697861:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697866:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697871:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697876:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697882:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697888:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697894:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697899:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697903:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697909:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697914:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697919:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697923:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697928:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.697935:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787398086.698966:0:92448:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0002: service thread [ffff89a8080b9400:92448] 2 exiting: rc = 0 00000100:00100000:3.0:1787398086.699213:0:66195:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89a706c1c800:66195] 0 exiting: rc = 1 00000100:00100000:0.0:1787398086.699305:0:66196:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89a706c1de00:66196] 1 exiting: rc = 0 00000100:00100000:1.0:1787398086.699475:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699483:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699489:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699494:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699499:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699504:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699509:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.699514:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702164:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702192:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702198:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702202:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702208:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702213:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702217:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702223:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702229:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702235:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702241:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702246:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702273:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702279:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702285:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702289:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702294:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702298:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702303:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702308:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702313:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702318:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702322:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702327:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702332:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702337:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702341:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702347:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702353:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702368:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702372:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702377:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702382:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702386:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702391:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702396:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702402:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702406:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702412:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702416:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702421:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702425:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702439:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702447:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702452:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702457:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702462:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702475:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702480:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702484:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702488:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702493:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702498:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702503:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702507:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.702513:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.704759:0:66197:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff89a706c1dc00:66197] 0 exiting: rc = 1 00000100:00100000:3.0:1787398086.705273:0:66198:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff89a706c1c200:66198] 1 exiting: rc = 0 00000100:00100000:1.0:1787398086.705641:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705649:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705655:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705661:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705667:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705672:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705678:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705682:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705688:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705693:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705699:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705703:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705708:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705713:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705718:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705723:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705729:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705733:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705739:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705745:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705750:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705755:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705760:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705764:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705770:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705774:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705795:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705800:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705805:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705811:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705816:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705821:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705826:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705830:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705835:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705840:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705845:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705850:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705854:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705859:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705863:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705868:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705873:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705877:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705882:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705894:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705899:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705904:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705909:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705914:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705919:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705923:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705929:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705933:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705939:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705943:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705948:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705952:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705956:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705961:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705966:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705980:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705985:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787398086.705991:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.706806:0:66202:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff89a81782bc00:66202] 1 exiting: rc = 0 00000100:00100000:2.0:1787398086.707956:0:66203:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff89a81782a800:66203] 2 exiting: rc = 0 00000100:00100000:2.0:1787398086.708274:0:66201:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff89a81782ae00:66201] 0 exiting: rc = 1 00000100:00100000:0.0:1787398086.708861:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708869:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708876:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708883:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708888:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708893:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708899:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708904:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708909:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708915:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708920:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708926:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708932:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708938:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708943:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708948:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708954:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708960:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708977:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708984:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708990:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.708996:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709003:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709009:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709015:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709021:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709027:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709042:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709126:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709131:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709137:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709143:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709148:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709154:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709160:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709166:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709171:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709176:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709181:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709187:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709193:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709198:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709219:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709227:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709233:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709238:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709243:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709249:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709255:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709261:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709266:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709271:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709276:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709282:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709287:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709293:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709298:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709304:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709309:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709314:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709320:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709325:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709338:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787398086.709351:0:106151:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787398086.715372:0:106151:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398086.715386:0:106151:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787398086.715393:0:106151:0:(genops.c:906:class_export_put()) final put ffff89a807df9000/MDS_uuid 00000020:00000080:1.0:1787398086.715397:0:106151:0:(genops.c:865:class_export_destroy()) destroying export ffff89a807df9000/MDS_uuid for MDS 00000020:01000000:1.0:1787398086.715407:0:106151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787398086.715708:0:106151:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787398087.529794:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787398087.658791:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787398087.658802:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a703789000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787398087.658828:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787398087.658832:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a829b18000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398087.658958:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a703789000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787398087.659020:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a829b18000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787398087.659052:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70378a800 for lustre-OST0001 00000020:00000080:3.0:1787398087.659060:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a829b1d000 for lustre-OST0001 00000001:00100000:1.0:1787398087.662430:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787398087.662441:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a827b3e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787398087.662475:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398087.662478:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a828850800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787398087.662556:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b3e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787398087.662631:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828850800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787398087.662653:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a827b38000 for lustre-OST0000 00000020:00000080:2.0:1787398087.662658:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817eff800 for lustre-OST0000 00000400:00000100:2.0:1787398088.455718:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681358720 offset 0 length 520: 4 00000400:00000100:2.0:1787398088.455752:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681358464 offset 0 length 224: 4 00000400:00000100:2.0:1787398088.455763:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681358592 offset 0 length 224: 4 00000100:00100000:2.0:1787398088.455796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398088.455833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398088.456184:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681358976 00000100:00100000:2.0:1787398088.456198:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681358976 00000100:00100000:2.0:1787398088.456267:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681358848 00000100:00100000:2.0:1787398088.456270:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681358848 00000100:00100000:2.0:1787398088.456295:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:2.0:1787398088.456311:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681358976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398088.456418:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681358976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 112us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398088.456427:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:2.0:1787398088.456447:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00100000:2.0:1787398088.456454:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681358848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398088.456482:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681358848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398088.456512:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 141 00000100:00080000:2.0:1787398088.456682:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398088.456688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787398088.550979:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398088.685707:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313920:0@lo:400:kworker.0 00000400:00000100:2.0:1787398088.685773:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701313920 offset 0 length 224: 4 00000100:00080000:2.0:1787398088.686072:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398088.686076:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398088.686079:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398088.686084:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3962 00000100:00080000:2.0:1787398088.686089:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787398088.686097:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398088.686106:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701314048:0@lo:400:kworker.0 00000400:00000100:2.0:1787398088.686129:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314048 offset 0 length 224: 4 00000100:00100000:2.0:1787398088.686175:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015dd880 x1874218701314176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398088.686214:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398088.686218:0:83690:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398088.686219:0:83690:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398088.686223:0:83690:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3962 00000100:00080000:2.0:1787398088.686226:0:83690:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787398088.686230:0:83690:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398088.686237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398088.686245:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701314304:0@lo:400:kworker.0 00000400:00000100:2.0:1787398088.686277:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314304 offset 0 length 224: 4 00000100:00100000:2.0:1787398088.686308:0:83690:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015dc380 x1874218701314432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398088.686454:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701314176:0@lo:38:kworker.0 00000400:00000100:3.0:1787398088.686481:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314176 offset 0 length 520: 4 00000100:00100000:3.0:1787398088.686497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701314432:0@lo:38:kworker.0 00000400:00000100:3.0:1787398088.686537:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314432 offset 0 length 520: 4 00010000:00010000:3.0:1787398089.572715:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398090.596721:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398091.621398:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398092.644884:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398093.572485:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398093.572576:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398093.572641:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681359360 00000100:00100000:3.0:1787398093.572652:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681359360 00000100:00100000:2.0:1787398093.572664:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681359488 00000100:00100000:2.0:1787398093.572671:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681359488 00000100:00100000:3.0:1787398093.572754:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:3.0:1787398093.572766:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681359360:12345-192.168.204.60@tcp:9:kworker.0 00000100:00080000:0.0:1787398093.572767:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398093.572771:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787398093.572796:0:101069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193921 00000100:00080000:3.0:1787398093.572806:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a806901000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398093.572856:0:101069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00010000:00010000:0.0:1787398093.572938:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398093.573031:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681359360:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 268us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398093.573039:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 85 00000100:00100000:3.0:1787398093.573055:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787398093.573062:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681359488:12345-192.168.204.60@tcp:9:kworker.0 00000020:00000080:3.0:1787398093.573085:0:101069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193928 00000100:00080000:3.0:1787398093.573091:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a817ecd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398093.573113:0:101069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1787398093.573193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398093.573607:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681359488:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 542us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398093.573615:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000400:00000100:0.0:1787398093.585110:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681359104 offset 0 length 224: 4 00000400:00000100:0.0:1787398093.585134:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681359232 offset 0 length 224: 4 00010000:00010000:3.0:1787398093.668687:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398093.796750:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398093.796757:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398093.796768:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398093.796771:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787398093.796803:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701314560:0@lo:400:kworker.0 00000100:00100000:2.0:1787398093.796817:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701314688:0@lo:400:kworker.0 00000400:00000100:3.0:1787398093.796856:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701314560 offset 0 length 224: 4 00000100:00100000:1.0:1787398093.796953:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701314816:0@lo:400:kworker.0 00000400:00000100:2.0:1787398093.807416:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314688 offset 0 length 224: 4 00000400:00000100:1.0:1787398093.810241:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701314816 offset 0 length 224: 4 00010000:00010000:1.0:1787398094.693567:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398095.718288:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398096.741253:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398097.765500:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787398098.696925:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681359616 offset 0 length 224: 4 00000400:00000100:0.0:1787398098.696953:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681359744 offset 0 length 224: 4 00010000:00010000:3.0:1787398098.788879:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398098.917017:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701315072:0@lo:400:kworker.0 00000400:00000100:3.0:1787398098.917091:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315072 offset 0 length 224: 4 00000100:00100000:3.0:1787398098.917128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398098.917136:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701314944:0@lo:400:kworker.0 00000400:00000100:3.0:1787398098.917156:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701314944 offset 0 length 224: 4 00000100:00080000:2.0:1787398098.917680:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398098.917687:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398098.917724:0:83690:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398098.917728:0:83690:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787398098.917809:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701315200:0@lo:400:kworker.0 00000400:00000100:0.0:1787398098.917837:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315200 offset 0 length 224: 4 00000001:00100000:3.0:1787398099.447602:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787398099.447612:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a8364e1800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787398099.447690:0:83690:0:(genops.c:865:class_export_destroy()) destroying export ffff89a8364e1800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:0.0:1787398099.447753:0:83690:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a817ecd000 for lustre-OST0001 00000001:00100000:2.0:1787398099.458801:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787398099.458813:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a806907800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787398099.458889:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a806907800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:2.0:1787398099.466012:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a806901000 for lustre-OST0000 00010000:00010000:1.0:1787398099.812804:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398100.838722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398101.864173:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398102.885973:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398103.014177:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398088/real 1787398088] req@ffff89a7015dd880 x1874218701314176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398103.014347:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a7015dd880 x1874218701314176/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398103.014358:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398088/real 1787398088] req@ffff89a7015dc380 x1874218701314432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398103.014368:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a7015dc380 x1874218701314432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787398103.014386:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398103.014401:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787398103.014404:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701314176:0@lo:38:kworker.0 00000100:00080000:3.0:1787398103.014409:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398103.014414:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787398103.014416:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701314432:0@lo:38:kworker.0 00000100:00080000:2.0:1787398103.014615:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398103.014620:0:106322:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398103.014623:0:106322:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398103.014628:0:106322:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3967 00000100:00080000:2.0:1787398103.014634:0:106322:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398103.014648:0:106322:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398103.014669:0:106322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4000 x1874218701315584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398103.014691:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398103.014694:0:106322:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398103.014696:0:106322:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398103.014699:0:106322:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3967 00000100:00080000:2.0:1787398103.014702:0:106322:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398103.014705:0:106322:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398103.014714:0:106322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4700 x1874218701315840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398103.014814:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701315328:0@lo:400:kworker.0 00000400:00000100:2.0:1787398103.014868:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701315328 offset 0 length 224: 4 00000100:00100000:2.0:1787398103.014911:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701315456:0@lo:400:kworker.0 00000400:00000100:2.0:1787398103.014933:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315456 offset 0 length 224: 4 00000100:00100000:2.0:1787398103.014947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398103.014952:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701315712:0@lo:400:kworker.0 00000400:00000100:2.0:1787398103.014966:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315712 offset 0 length 224: 4 00000100:00100000:2.0:1787398103.014988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701315584:0@lo:38:kworker.0 00000400:00000100:2.0:1787398103.015005:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315584 offset 0 length 520: 4 00000100:00100000:2.0:1787398103.015015:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701315840:0@lo:38:kworker.0 00000400:00000100:2.0:1787398103.015934:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701315840 offset 0 length 520: 4 00000400:00000100:0.0:1787398103.817801:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681360000 offset 0 length 224: 4 00000400:00000100:0.0:1787398103.817832:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681359872 offset 0 length 224: 4 00000400:00000100:0.0:1787398103.817842:0:3643:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681360128 offset 0 length 520: 4 00010000:00010000:1.0:1787398103.916024:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1787398104.044546:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398088/real 1787398088] req@ffff89a7015ded80 x1874218701313920/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:0.0:1787398104.048267:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398088/real 1787398088] req@ffff89a7015ddc00 x1874218701314304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398104.048320:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a7015ddc00 x1874218701314304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398104.048331:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787398104.048336:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787398104.048341:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1787398104.048380:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701314304:0@lo:400:kworker.0 00000100:00000400:3.0:1787398104.059760:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398088/real 1787398088] req@ffff89a7015df480 x1874218701314048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398104.059788:0:3651:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a7015df480 x1874218701314048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787398104.059796:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787398104.059800:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787398104.059804:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1787398104.059827:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701314048:0@lo:400:kworker.0 00000100:00080000:0.0:1787398104.077892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.077900:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787398104.077904:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398104.077914:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3854 00000100:00080000:0.0:1787398104.077924:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398104.077947:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b74700 x1874218701316096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398104.077967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.077972:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787398104.077975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.077978:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787398104.077980:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398104.077983:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3854 00000100:00080000:0.0:1787398104.077987:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398104.077999:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b75c00 x1874218701316224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398104.078024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787398104.078232:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398104.078251:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701315968:0@lo:400:kworker.0 00000400:00000100:3.0:1787398104.078305:0:3651:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701315968 offset 0 length 224: 4 00000100:00080000:0.0:1787398104.078713:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787398104.078733:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701316096:0@lo:38:kworker.0 00000400:00000100:0.0:1787398104.078760:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701316096 offset 0 length 520: 4 00000100:00100000:0.0:1787398104.078775:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701316224:0@lo:38:kworker.0 00000400:00000100:0.0:1787398104.078796:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874218701316224 offset 0 length 520: 4 00000100:00100000:2.0:1787398104.091655:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a7015ded80 x1874218701313920/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398104.091671:0:3650:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787398104.091676:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787398104.114888:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787398104.114894:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787398104.114905:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a7015ded80 x1874218701313920/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1787398104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398104.115166:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a7015dea00 x1874218701314560/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787398109 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398104.115190:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a82ebd6680 x1874218701314944/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787398114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398104.115199:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a82ebd7100 x1874218701315328/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787398119 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398104.115216:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89a827b74e00 x1874218701315968/t0(0) o400->MGC192.168.204.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787398120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787398104.115225:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787398104.115228:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787398104.115230:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787398104.115232:0:3650:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1787398104.115296:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701315968:0@lo:400:kworker.0 00000100:00100000:2.0:1787398104.115305:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701315328:0@lo:400:kworker.0 00000100:00100000:0.0:1787398104.115382:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701314944:0@lo:400:kworker.0 00000100:00100000:0.0:1787398104.115391:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701314560:0@lo:400:kworker.0 00000100:00080000:0.0:1787398104.115416:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.115420:0:106322:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787398104.115423:0:106322:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398104.115428:0:106322:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3849 00000100:00080000:0.0:1787398104.115437:0:106322:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398104.115468:0:106322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b75f80 x1874218701316352/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398104.115494:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.115499:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787398104.115502:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398104.115505:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787398104.115614:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701316352:0@lo:250:kworker.0 00000400:00000100:2.0:1787398104.115662:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874218701316352 offset 0 length 520: 4 00000100:00100000:3.0:1787398104.116785:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701313920:0@lo:400:kworker.0 00000400:00000100:2.0:1787398104.839635:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 26 match 1874218681360256 offset 0 length 520: 4 00000400:00000100:2.0:1787398104.839665:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.60@tcp portal 12 match 1874218681360384 offset 0 length 520: 4 00010000:00010000:1.0:1787398104.935013:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398105.958032:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398106.987392:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398108.005587:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787398108.133380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398108.133391:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398108.133394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398108.133397:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398108.133400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398108.133403:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398108.133406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398108.133417:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398108.133420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398108.133423:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787398109.028795:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398109.168204:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398109.168213:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398109.168216:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398109.168219:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398109.168222:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398109.168225:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398109.168227:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398109.168230:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398109.168232:0:106322:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398109.168235:0:106322:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00000400:0.0:1787398109.220680:0:3651:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398093/real 1787398093] req@ffff89a7015df100 x1874218701314816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398109.220717:0:3651:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a7015df100 x1874218701314816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398109.220727:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff89a835664800 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:0.0:1787398109.220746:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701314816:0@lo:400:kworker.0 00000100:00000400:2.0:1787398109.221159:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398093/real 1787398093] req@ffff89a7015dce00 x1874218701314688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398109.221180:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a7015dce00 x1874218701314688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787398109.221187:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff89a817ecb000 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:2.0:1787398109.221197:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701314688:0@lo:400:kworker.0 00010000:00010000:0.0:1787398110.054626:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398111.076713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787398111.612627:0:107234:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787398111.612631:0:107234:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787398111.612633:0:107234:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787398111.612875:0:107234:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a827b3e000 00000020:01000004:0.0:1787398111.612894:0:107234:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787398111.612982:0:107234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787398111.612997:0:107234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff89a82e4fcd40) 00000020:00000080:0.0:1787398111.613014:0:107234:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000020:01000004:0.0:1787398111.802916:0:107259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787398111.802921:0:107259:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787398111.802923:0:107259:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787398111.803047:0:107259:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a829b29000 00000020:01000004:0.0:1787398111.803062:0:107259:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787398111.803074:0:107259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787398111.803088:0:107259:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89a82e4f8000) 00000020:00000080:0.0:1787398111.803104:0:107259:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787398111.831500:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787398111.832715:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.840704:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.841234:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.841688:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.841950:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.842137:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.842798:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.843113:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.843498:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.843801:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.844071:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.844334:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.844595:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.844841:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.845158:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.845409:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.845654:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.845898:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.846199:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.846865:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.847223:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.847424:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.848424:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.849003:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.849329:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.849761:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.850344:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.851619:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.851875:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.852695:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.853464:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.854686:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787398111.855659:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787398111.856558:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787398111.856957:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.857859:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.858151:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787398111.858411:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787398111.858679:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.858951:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787398111.859199:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.859408:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787398111.859713:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.859926:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787398111.860265:0:107234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787398111.863470:0:107234:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787398111.863747:0:107234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787398111.863757:0:107234:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787398111.863770:0:107234:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193d11 00000020:01000004:3.0:1787398111.863777:0:107234:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787398111.863802:0:107234:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787398111.863805:0:107234:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i1:r0:or0:CONNECTING 00000020:01000004:3.0:1787398111.863812:0:107234:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787398111.863816:0:107234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787398111.863826:0:107234:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89a703f5b380) 00000020:00000080:3.0:1787398111.863837:0:107234:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787398111.878918:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787398111.879133:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787398111.879140:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787398111.884960:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787398111.884974:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787398111.886486:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787398111.886497:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787398111.889368:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787398111.889582:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787398111.889590:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787398111.891380:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787398111.891393:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787398111.947625:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787398111.947803:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787398111.947818:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787398111.956198:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787398111.956215:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787398111.956863:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787398111.957025:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787398111.957029:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787398111.957435:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787398111.957442:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00100000:10000000:0.0:1787398111.959370:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787398111.959741:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00000100:00100000:2.0:1787398111.966969:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787398111.967148:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787398111.967154:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787398111.968926:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787398111.968947:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787398111.970236:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787398111.970387:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787398111.970392:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00100000:10000000:2.0:1787398111.971956:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1787398111.972182:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787398111.972192:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00100000:10000000:2.0:1787398111.972402:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.972989:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.973222:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.973436:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.973754:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.973981:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.974200:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.974409:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.975047:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.975289:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.975486:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787398111.977746:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787398111.979655:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.980751:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.981161:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.981371:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.981645:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.981899:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.982678:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.982998:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.983216:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.983657:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.983924:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.984730:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.984974:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.985672:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.986195:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.986669:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.986952:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.989548:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.990239:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.990513:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.990823:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.991020:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.991218:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.991394:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.991625:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.991816:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.992000:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.992167:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787398111.992452:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.995082:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.995511:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787398111.995917:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787398112.000512:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787398112.003241:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787398112.003503:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787398112.004028:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787398112.004311:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787398112.004673:0:107259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1787398112.005233:0:107259:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787398112.005435:0:107259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787398112.005443:0:107259:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787398112.005453:0:107259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193d1f 00000020:01000004:0.0:1787398112.005459:0:107259:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787398112.005469:0:107259:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787398112.005474:0:107259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a829b29000 from MGS 00000020:01000004:0.0:1787398112.005478:0:107259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787398112.005487:0:107259:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89a82e4f99c0) 00000020:00000080:0.0:1787398112.005499:0:107259:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:0.0:1787398112.005887:0:107259:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b29000 from MGS, refs=2 00080000:01000000:0.0:1787398112.005893:0:107259:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787398112.005901:0:107259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193d2d 00010000:00010000:0.0:1787398112.006033:0:107259:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000100:00100000:2.0:1787398112.007924:0:107234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787398112.008093:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787398112.008099:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787398112.009314:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787398112.009325:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000040:01000000:1.0:1787398112.012409:0:107259:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787398112.013841:0:107278:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00100000:0.0:1787398112.013890:0:107234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787398112.013900:0:107234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 20000000:01000000:0.0:1787398112.013950:0:107259:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787398112.013997:0:107259:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787398112.014670:0:107259:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787398112.014916:0:107259:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787398112.015094:0:107259:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787398112.015099:0:107259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787398112.016272:0:107259:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787398112.016282:0:107259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000020:00000080:1.0:1787398112.016569:0:107234:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787398112.016595:0:107234:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787398112.016601:0:107234:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787398112.026473:0:107234:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787398112.026513:0:107234:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787398112.026518:0:107234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787398112.026535:0:107234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787398112.026536:0:107234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398112.026537:0:107234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398112.026538:0:107234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398112.026540:0:107234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398112.026541:0:107234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398112.026543:0:107234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398112.026544:0:107234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398112.026561:0:107234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787398112.026563:0:107234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787398112.026564:0:107234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787398112.026566:0:107234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398112.026566:0:107234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398112.026567:0:107234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398112.026569:0:107234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398112.026570:0:107234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398112.026571:0:107234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398112.026572:0:107234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398112.026599:0:107234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787398112.026615:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f300 going to sleep for 0 seconds 00000100:00100000:1.0:1787398112.026623:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701316480:0@lo:253:mount.lustre.0 00000020:00080000:1.0:1787398112.026651:0:107234:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0001: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:1.0:1787398112.026658:0:107234:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a827b3e000 from lustre-MDT0001 10000000:01000000:1.0:1787398112.026680:0:107234:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787398112.026682:0:107234:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787398112.026690:0:107234:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:1.0:1787398112.026702:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398112.026776:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7ff00 going to sleep for 0 seconds 00000100:00100000:1.0:1787398112.026781:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701316608:0@lo:501:mount.lustre.0 00000040:00020000:1.0:1787398112.026791:0:107234:0:(llog.c:1655:llog_backup()) MGC192.168.204.160@tcp: failed to open log lustre-sptlrpc: rc = -108 00000100:00100000:2.0:1787398112.031756:0:107259:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787398112.031801:0:107259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787398112.032414:0:107259:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787398112.032442:0:107259:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1787398112.032444:0:107259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1787398112.032448:0:107259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1787398112.032454:0:107259:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 74, was 0): CONNECTING 00000100:00100000:0.0:1787398112.032461:0:107259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 10000000:00000400:1.0:1787398112.035710:0:107234:0:(mgc_request_server.c:770:mgc_llog_local_copy()) MGC192.168.204.160@tcp: failed to copy new config lustre-sptlrpc: rc = -108 10000000:01000000:1.0:1787398112.043061:0:107234:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -108. 00010000:00010000:1.0:1787398112.043079:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043092:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398112.043131:0:107234:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a827b3e000 10000000:01000000:1.0:1787398112.043137:0:107234:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787398112.043143:0:107234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a827b3e000 10000000:01000000:1.0:1787398112.043146:0:107234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787398112.043150:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a827b3e000 from 1 10000000:01000000:1.0:1787398112.043153:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787398112.043195:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043204:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043226:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398112.043247:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7ff00 going to sleep for 0 seconds 00000100:00100000:1.0:1787398112.043257:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701316736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398112.043285:0:107234:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043295:0:107234:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043301:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043308:0:107234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043316:0:107234:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043323:0:107234:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398112.043327:0:107234:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043336:0:107234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398112.043343:0:107234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398112.043356:0:107234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398112.043360:0:107234:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398112.043366:0:107234:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398112.043373:0:107234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398112.043396:0:107234:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:1.0:1787398112.043400:0:107234:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:CONNECTING 00010000:00010000:0.0:1787398112.101310:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398113.125453:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398113.993736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398113.993781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398113.994881:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681360512 00000100:00100000:1.0:1787398113.994905:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681360512 00000100:00100000:1.0:1787398113.994961:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787398113.994979:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1874218681360512:12345-192.168.204.60@tcp:250:kworker.0 00010000:00080000:1.0:1787398113.995013:0:107280:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from e5696550-1ffc-466d-b13d-359d59b5fc5f@192.168.204.60@tcp t0 exp 0000000000000000 cur 3993 last 0 00000020:00000080:1.0:1787398113.995040:0:107280:0:(genops.c:1406:class_connect()) connect: client e5696550-1ffc-466d-b13d-359d59b5fc5f, cookie 0x274786fe0d193d3b 00000100:00080000:1.0:1787398113.995210:0:107280:0:(import.c:65:import_set_state_nolock()) ffff89a828784000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398113.995298:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:2401:x1874218681360512:12345-192.168.204.60@tcp:250:kworker.0 Request processed in 326us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398113.995307:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:2.0:1787398113.998324:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681360640 00000100:00100000:2.0:1787398113.998342:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681360640 00000100:00100000:2.0:1787398113.998403:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:2.0:1787398113.998413:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681360640:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:2.0:1787398113.998438:0:107263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787398113.998633:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681360640:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 219us (4848us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398113.998642:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00020000:0.0:1787398114.086500:0:107259:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:0.0:1787398114.095167:0:107259:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff89a827b75f80 x1874218701316352/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787398114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:0.0:1787398114.123422:0:107259:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:0.0:1787398114.132236:0:107259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787398114.149629:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787398114.212932:0:3649:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398098/real 1787398098] req@ffff89a82ebd4e00 x1874218701315072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398114.213038:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a82ebd4e00 x1874218701315072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787398114.213048:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff89a817ecb000 already not connected (conn 9, was 8): CONNECTING 00000100:00100000:3.0:1787398114.213067:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701315072:0@lo:400:kworker.0 00000100:00080000:2.0:1787398114.276742:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.276753:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) 99b57a74-e5dc-42df-b087-b10fad741506->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.276756:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.276759:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.276762:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.276765:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.276768:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.276771:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.276774:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.276776:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787398114.277283:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398104/real 1787398104] req@ffff89a827b75f80 x1874218701316352/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.277314:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a827b75f80 x1874218701316352/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.277322:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398104/real 1787398104] req@ffff89a827b74700 x1874218701316096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.277334:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a827b74700 x1874218701316096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.277342:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398104/real 1787398104] req@ffff89a827b75c00 x1874218701316224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.277370:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a827b75c00 x1874218701316224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398114.277389:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.277410:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787398114.277427:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701316352:0@lo:250:kworker.0 00000100:00080000:0.0:1787398114.277433:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.277437:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787398114.277440:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701316096:0@lo:38:kworker.0 00000100:00080000:0.0:1787398114.277444:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.277448:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787398114.277450:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701316224:0@lo:38:kworker.0 10000000:01000000:1.0:1787398114.277606:0:107259:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1787398114.277626:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277637:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277643:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1787398114.277665:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277677:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee30000/0x274786fe0d192fe3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192fea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277719:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277726:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277732:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398114.277740:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277743:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836583000/0x274786fe0d192f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277753:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277759:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277765:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398114.277780:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277784:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55400/0x274786fe0d192f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f5e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277793:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277798:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277812:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398114.277826:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277831:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55c00/0x274786fe0d192f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f7a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277841:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277847:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277852:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398114.277865:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277869:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836582a00/0x274786fe0d192f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f88 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277879:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277886:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277901:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398114.277916:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277920:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82ee31600/0x274786fe0d192ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192ff8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277941:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277957:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.277973:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787398114.277980:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.277984:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a82eb55800/0x274786fe0d192f65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.277993:0:107259:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398114.277998:0:107259:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.278004:0:107259:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787398114.278018:0:107259:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787398114.278022:0:107259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a836583200/0x274786fe0d192f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x274786fe0d192f96 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787398114.278048:0:107259:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89a8310ac800 already not connected (conn 74, was 0): DISCONN 00000100:00080000:1.0:1787398114.278054:0:107259:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398114.278060:0:107259:0:(import.c:510:import_select_connection()) MGC192.168.204.160@tcp: connect to NID 0@lo last attempt 3983 00000100:00080000:1.0:1787398114.278066:0:107259:0:(import.c:589:import_select_connection()) MGC192.168.204.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787398114.278071:0:107259:0:(import.c:624:import_select_connection()) MGC192.168.204.160@tcp: import ffff89a8310ac800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398114.278102:0:107259:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8e00 x1874218701316864/t0(0) o250->MGC192.168.204.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398114.278119:0:107259:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1787398114.278315:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701316864:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787398114.278394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.278493:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701316864 00000100:00100000:2.0:1787398114.278510:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701316864 00000100:00100000:2.0:1787398114.278578:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787398114.278586:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3647:x1874218701316864:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787398114.278621:0:107283:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 99b57a74-e5dc-42df-b087-b10fad741506@0@lo t0 exp 0000000000000000 cur 3993 last 0 00000020:00000080:2.0:1787398114.278653:0:107283:0:(genops.c:1406:class_connect()) connect: client 99b57a74-e5dc-42df-b087-b10fad741506, cookie 0x274786fe0d193d42 00000100:00080000:2.0:1787398114.278803:0:107283:0:(import.c:65:import_set_state_nolock()) ffff89a705576800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398114.278883:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+5:3647:x1874218701316864:12345-0@lo:250:mount.lustre.0 Request processed in 297us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.278902:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787398114.279883:0:3647:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.160@tcp: committing for last_committed 0 gen 30 00000100:00080000:0.0:1787398114.279913:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.160@tcp: connect to target with instance 0 00000100:00080000:0.0:1787398114.279929:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787398114.279935:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787398114.279941:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8310ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787398114.279944:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787398114.279987:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787398114.280004:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99b57a74-e5dc-42df-b087-b10fad741506:3647:1874218701316864:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1787398114.280250:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.280254:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787398114.280257:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398114.280263:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3983 00000100:00080000:3.0:1787398114.280267:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787398114.280273:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398114.280297:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82e4eb480 x1874218701317120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398114.280313:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.280317:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787398114.280320:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.280323:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787398114.280324:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398114.280327:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3983 00000100:00080000:3.0:1787398114.280330:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787398114.280348:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398114.280361:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82e4e9880 x1874218701317248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398114.280370:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.280372:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787398114.280413:0:65702:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.160@tcp 10000000:01000000:3.0:1787398114.280431:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1787398114.280434:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787398114.280436:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787398114.280437:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.280438:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.280439:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.280441:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.280442:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787398114.280445:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.280446:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1787398114.280474:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1787398114.280480:0:65702:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1787398114.280482:0:65702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1787398114.280483:0:65702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787398114.280484:0:65702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.280485:0:65702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.280486:0:65702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.280487:0:65702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.280489:0:65702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787398114.280490:0:65702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.280491:0:65702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787398114.280696:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a827b3e000 from 1 10000000:01000000:1.0:1787398114.280708:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787398114.280743:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.280754:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.280764:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398114.280781:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787398114.280840:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.280872:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f840 going to sleep for 11 seconds 00000100:00080000:1.0:1787398114.280898:0:107259:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1787398114.280909:0:107259:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787398114.280946:0:107259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787398114.281650:0:65702:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1787398114.281694:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701316992:0@lo:400:kworker.0 00000100:00100000:3.0:1787398114.281742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.281790:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701317376:0@lo:253:kworker.0 00000100:00100000:3.0:1787398114.281822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.281853:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398114.281859:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701317632:0@lo:253:kworker.0 00000100:00100000:3.0:1787398114.281883:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.281922:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317504 00000100:00100000:3.0:1787398114.281930:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317504 00000100:00100000:0.0:1787398114.282265:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701316992 00000100:00100000:0.0:1787398114.282271:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701316992 00000100:00100000:0.0:1787398114.282291:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317376 00000100:00100000:0.0:1787398114.282304:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317376 00000100:00100000:0.0:1787398114.282318:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317632 00000100:00100000:0.0:1787398114.282321:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317632 00000100:00100000:0.0:1787398114.282335:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787398114.282343:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701317504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398114.282357:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398114.282378:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75200/0x274786fe0d193d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193d49 expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.282470:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75200/0x274786fe0d193d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193d49 expref: 9 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.282481:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75200/0x274786fe0d193d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193d49 expref: 9 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.282491:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75200, rc 0) 00000100:00100000:2.0:1787398114.282629:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787398114.282640:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:3651:x1874218701316992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398114.284897:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701317504:12345-0@lo:101:mount.lustre.0 Request processed in 2530us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398114.284910:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787398114.285039:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.285063:0:107234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.285075:0:107234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.285109:0:107234:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787398114.285121:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.285130:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.285156:0:107234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787398114.285162:0:107234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787398114.285169:0:107234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a827b3e000 10000000:01000000:1.0:1787398114.285172:0:107234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787398114.285176:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1787398114.285178:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787398114.285218:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.285227:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.285237:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398114.285258:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787398114.285300:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.285333:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.285382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701317120:0@lo:38:kworker.0 00000100:00100000:1.0:1787398114.285415:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.285435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701317248:0@lo:38:kworker.0 00000100:00100000:1.0:1787398114.285458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.286496:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317120 00000100:00100000:3.0:1787398114.286518:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317120 00000100:00100000:3.0:1787398114.286584:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317248 00000100:00100000:3.0:1787398114.286589:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317248 00000100:00100000:3.0:1787398114.286603:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787398114.286611:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701317120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787398114.286633:0:107265:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398114.286699:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701317120:12345-0@lo:38:kworker.0 Request processed in 87us (1282us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398114.286707:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787398114.286728:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787398114.286732:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701317248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787398114.286741:0:107265:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398114.286765:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701317248:12345-0@lo:38:kworker.0 Request processed in 31us (1306us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398114.286772:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787398114.286801:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317760 00000100:00100000:3.0:1787398114.286805:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317760 00000100:00080000:1.0:1787398114.286909:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398114.286916:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398114.286920:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701317120:0@lo:38:kworker.0 00000100:00080000:1.0:1787398114.286935:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398114.286957:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398114.286975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701317248:0@lo:38:kworker.0 00000100:00100000:2.0:1787398114.289194:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:3651:x1874218701316992:12345-0@lo:400:kworker.0 Request processed in 6544us (7437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.289210:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787398114.289279:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787398114.289292:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:3648:x1874218701317376:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1787398114.289350:0:107283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1787398114.289461:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701316992:0@lo:400:kworker.0 10000000:01000000:2.0:1787398114.289975:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787398114.290124:0:107283:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 133 00000100:00100000:0.0:1787398114.295790:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787398114.295807:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218701317632:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1787398114.295855:0:107281:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787398114.296412:0:107286:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787398114.296417:0:107286:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787398114.296420:0:107286:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787398114.296423:0:107286:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787398114.296754:0:107286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:2.0:1787398114.296991:0:107283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787398114.297019:0:107283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787398114.298999:0:107283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787398114.299017:0:107283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787398114.299133:0:107285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787398114.299138:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787398114.299164:0:107285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299181:0:107285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787398114.299192:0:107285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054325s 00010000:00010000:1.0:1787398114.299197:0:107285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299204:0:107285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299211:0:107285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299218:0:107285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299224:0:107285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398114.299229:0:107285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299258:0:107285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299273:0:107285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299281:0:107285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.299287:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62200/0x274786fe0d193d5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787398114.299439:0:107281:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787398114.299978:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:3648:x1874218701317376:12345-0@lo:253:kworker.0 Request processed in 10685us (18149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.299992:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787398114.300036:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787398114.300049:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+7:107234:x1874218701317760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.300074:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398114.300093:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75600/0x274786fe0d193d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193d57 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.300114:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75600/0x274786fe0d193d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193d57 expref: 8 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.300125:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75600/0x274786fe0d193d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193d57 expref: 8 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.300131:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75600, rc 0) 00000100:00100000:2.0:1787398114.300183:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701317760:12345-0@lo:101:mount.lustre.0 Request processed in 138us (14882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.300190:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787398114.300350:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398114.300369:0:107234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.300378:0:107234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787398114.300655:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 59 count 58 00000040:00080000:0.0:1787398114.301160:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:3.0:1787398114.303219:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1787398114.303226:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787398114.303227:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.303228:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.303230:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.303232:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.303234:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787398114.303248:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.303250:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787398114.303258:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701317376:0@lo:253:kworker.0 00000040:00080000:0.0:1787398114.304819:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].1, 224 off8416 00000040:00080000:0.0:1787398114.304905:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].2, 136 off8552 00000040:00080000:0.0:1787398114.304926:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].3, 176 off8728 00000040:00080000:0.0:1787398114.304945:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].4, 224 off8952 00000040:00080000:0.0:1787398114.304960:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].5, 224 off9176 00000040:00080000:0.0:1787398114.304975:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].6, 120 off9296 00000040:00080000:0.0:1787398114.304990:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].7, 112 off9408 00000040:00080000:0.0:1787398114.305005:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].8, 160 off9568 00000040:00080000:0.0:1787398114.305021:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].9, 224 off9792 00000040:00080000:0.0:1787398114.305038:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].10, 224 off10016 00000040:00080000:0.0:1787398114.305054:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].11, 88 off10104 00000040:00080000:0.0:1787398114.305070:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].12, 144 off10248 00000040:00080000:0.0:1787398114.305085:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].13, 152 off10400 00000040:00080000:0.0:1787398114.305102:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].14, 168 off10568 00000040:00080000:0.0:1787398114.305117:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].15, 224 off10792 00000040:00080000:0.0:1787398114.305133:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].16, 224 off11016 00000040:00080000:0.0:1787398114.305149:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].17, 80 off11096 00000040:00080000:0.0:1787398114.305166:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].18, 224 off11320 00000040:00080000:0.0:1787398114.305183:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].19, 224 off11544 00000040:00080000:0.0:1787398114.305200:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].20, 160 off11704 00000040:00080000:0.0:1787398114.305215:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].21, 224 off11928 00000040:00080000:0.0:1787398114.305230:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].22, 224 off12152 00000040:00080000:0.0:1787398114.305245:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].23, 80 off12232 00000040:00080000:0.0:1787398114.305263:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].24, 224 off12456 00000040:00080000:0.0:1787398114.305279:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].25, 224 off12680 00000040:00080000:0.0:1787398114.305295:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].26, 88 off12768 00000040:00080000:0.0:1787398114.305311:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].27, 144 off12912 00000040:00080000:0.0:1787398114.305327:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].28, 152 off13064 00000040:00080000:0.0:1787398114.305360:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].29, 136 off13200 00000040:00080000:0.0:1787398114.305377:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].30, 224 off13424 00000040:00080000:0.0:1787398114.305393:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].31, 224 off13648 00000040:00080000:0.0:1787398114.305407:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].32, 80 off13728 00000040:00080000:0.0:1787398114.305421:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].33, 224 off13952 00000040:00080000:0.0:1787398114.305435:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].34, 224 off14176 00000040:00080000:0.0:1787398114.305450:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].35, 88 off14264 00000040:00080000:0.0:1787398114.305465:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].36, 144 off14408 00000040:00080000:0.0:1787398114.305479:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].37, 152 off14560 00000040:00080000:0.0:1787398114.305493:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].38, 136 off14696 00000040:00080000:0.0:1787398114.305508:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].39, 224 off14920 00000040:00080000:0.0:1787398114.305545:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].40, 224 off15144 00000040:00080000:0.0:1787398114.305562:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].41, 80 off15224 00000040:00080000:0.0:1787398114.305575:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].42, 224 off15448 00000040:00080000:0.0:1787398114.305587:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].43, 224 off15672 00000040:00080000:0.0:1787398114.305599:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].44, 120 off15792 00000040:00080000:0.0:1787398114.305613:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].45, 224 off16016 00000040:00080000:0.0:1787398114.305627:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].46, 224 off16240 00000040:00080000:0.0:1787398114.305642:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].47, 120 off16360 00000040:00080000:0.0:1787398114.305655:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].48, 24 off16384 00000040:00080000:0.0:1787398114.305840:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].49, 224 off16608 00000040:00080000:0.0:1787398114.305862:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].50, 224 off16832 00000040:00080000:0.0:1787398114.305875:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].51, 144 off16976 00000040:00080000:0.0:1787398114.305901:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].52, 224 off17200 00000040:00080000:0.0:1787398114.305918:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].53, 224 off17424 00000040:00080000:0.0:1787398114.305932:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].54, 144 off17568 00000040:00080000:0.0:1787398114.305946:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].55, 224 off17792 00000040:00080000:0.0:1787398114.305959:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].56, 224 off18016 00000040:00080000:0.0:1787398114.305970:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].57, 120 off18136 00000040:00080000:0.0:1787398114.305988:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].58, 224 off18360 00000040:00080000:0.0:1787398114.305994:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 58 count 58 00000100:00100000:0.0:1787398114.306129:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398114.306206:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.306261:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.306686:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701317888 00000100:00100000:3.0:1787398114.306697:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701317888 00000100:00100000:3.0:1787398114.306948:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787398114.306958:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701317888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398114.307135:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701317888:12345-0@lo:501:mount.lustre.0 Request processed in 177us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.307142:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787398114.309746:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701317888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398114.309812:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787398114.309901:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.310047:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.312863:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318016 00000100:00100000:2.0:1787398114.312879:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318016 00000100:00100000:2.0:1787398114.312952:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787398114.312976:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701318016:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1787398114.313760:0:107281:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787398114.313770:0:107281:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787398114.314019:0:107285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787398114.314025:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787398114.314053:0:107285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314075:0:107285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787398114.314085:0:107285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000061587s 00010000:00010000:2.0:1787398114.314090:0:107285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314111:0:107285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314118:0:107285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314125:0:107285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314132:0:107285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398114.314136:0:107285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314145:0:107285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314158:0:107285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314167:0:107285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.314174:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74c00/0x274786fe0d193d6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398114.314407:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:3648:x1874218701317632:12345-0@lo:253:kworker.0 Request processed in 18599us (32516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.314416:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1787398114.314819:0:3648:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1787398114.314822:0:3648:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787398114.314824:0:3648:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398114.314825:0:3648:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398114.314826:0:3648:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398114.314828:0:3648:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398114.314839:0:3648:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787398114.314841:0:3648:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398114.314843:0:3648:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787398114.314847:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701317632:0@lo:253:kworker.0 00000100:00100000:3.0:1787398114.318008:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318016:12345-0@lo:503:mount.lustre.0 Request processed in 5036us (8095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.318029:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787398114.318139:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787398114.318708:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398114.318792:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398114.318847:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.318885:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830c886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.319002:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318144 00000100:00100000:1.0:1787398114.319009:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318144 00000100:00100000:1.0:1787398114.319060:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787398114.319070:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318144:12345-0@lo:502:mount.lustre.0 00000100:00000400:3.0:1787398114.319621:0:3650:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398098/real 1787398098] req@ffff89a82ebd5c00 x1874218701315200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398114.319643:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a82ebd5c00 x1874218701315200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398114 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398114.319667:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701315200:0@lo:400:kworker.0 00000100:00100000:1.0:1787398114.320045:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318144:12345-0@lo:502:mount.lustre.0 Request processed in 974us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.320053:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787398114.320151:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398114.320337:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].1, 224 off8416 00000040:00080000:0.0:1787398114.320364:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].2, 136 off8552 00000040:00080000:0.0:1787398114.320379:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].3, 176 off8728 00000040:00080000:0.0:1787398114.320392:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].4, 224 off8952 00000040:00080000:0.0:1787398114.320405:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].5, 224 off9176 00000040:00080000:0.0:1787398114.320418:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].6, 120 off9296 00000040:00080000:0.0:1787398114.320445:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].7, 112 off9408 00000040:00080000:0.0:1787398114.320462:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].8, 160 off9568 00000040:00080000:0.0:1787398114.320476:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].9, 224 off9792 00000040:00080000:0.0:1787398114.320490:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].10, 224 off10016 00000040:00080000:0.0:1787398114.320514:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].11, 88 off10104 00000040:00080000:0.0:1787398114.320566:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].12, 144 off10248 00000040:00080000:0.0:1787398114.320582:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].13, 152 off10400 00000040:00080000:0.0:1787398114.320597:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].14, 168 off10568 00000040:00080000:0.0:1787398114.320611:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].15, 224 off10792 00000040:00080000:0.0:1787398114.320636:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].16, 224 off11016 00000040:00080000:0.0:1787398114.320648:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].17, 80 off11096 00000040:00080000:0.0:1787398114.320662:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].18, 224 off11320 00000040:00080000:0.0:1787398114.320676:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].19, 224 off11544 00000040:00080000:0.0:1787398114.320689:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].20, 160 off11704 00000040:00080000:0.0:1787398114.320700:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].21, 224 off11928 00000040:00080000:0.0:1787398114.320714:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].22, 224 off12152 00000040:00080000:0.0:1787398114.320728:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].23, 80 off12232 00000040:00080000:0.0:1787398114.320741:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].24, 224 off12456 00000040:00080000:0.0:1787398114.320753:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].25, 224 off12680 00000040:00080000:0.0:1787398114.320767:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].26, 88 off12768 00000040:00080000:0.0:1787398114.320781:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].27, 144 off12912 00000040:00080000:0.0:1787398114.320795:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].28, 152 off13064 00000040:00080000:0.0:1787398114.320809:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].29, 136 off13200 00000040:00080000:0.0:1787398114.320822:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].30, 224 off13424 00000040:00080000:0.0:1787398114.320834:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].31, 224 off13648 00000040:00080000:0.0:1787398114.320847:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].32, 80 off13728 00000040:00080000:0.0:1787398114.320860:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].33, 224 off13952 00000040:00080000:0.0:1787398114.320874:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].34, 224 off14176 00000040:00080000:0.0:1787398114.320898:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].35, 88 off14264 00000040:00080000:0.0:1787398114.320916:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].36, 144 off14408 00000040:00080000:0.0:1787398114.320929:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].37, 152 off14560 00000040:00080000:0.0:1787398114.320941:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].38, 136 off14696 00000040:00080000:0.0:1787398114.320952:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].39, 224 off14920 00000040:00080000:0.0:1787398114.321396:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].40, 224 off15144 00000040:00080000:0.0:1787398114.321420:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].41, 80 off15224 00000040:00080000:0.0:1787398114.321434:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].42, 224 off15448 00000040:00080000:0.0:1787398114.321448:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].43, 224 off15672 00000040:00080000:0.0:1787398114.321462:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].44, 120 off15792 00000040:00080000:0.0:1787398114.321476:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].45, 224 off16016 00000040:00080000:0.0:1787398114.321489:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].46, 224 off16240 00000040:00080000:0.0:1787398114.321514:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].47, 120 off16360 00000040:00080000:1.0:1787398114.327297:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].48, 24 off16384 00000100:00100000:1.0:1787398114.327392:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398114.327491:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.327583:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.327666:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318272 00000100:00100000:3.0:1787398114.327674:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318272 00000100:00100000:3.0:1787398114.327732:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787398114.327741:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398114.330035:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318272:12345-0@lo:502:mount.lustre.0 Request processed in 2286us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.330049:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787398114.331204:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787398114.331542:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].49, 224 off16608 00000040:00080000:1.0:1787398114.331575:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].50, 224 off16832 00000040:00080000:1.0:1787398114.331590:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].51, 144 off16976 00000040:00080000:1.0:1787398114.331601:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].52, 224 off17200 00000040:00080000:1.0:1787398114.331613:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].53, 224 off17424 00000040:00080000:1.0:1787398114.331626:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].54, 144 off17568 00000040:00080000:1.0:1787398114.331638:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].55, 224 off17792 00000040:00080000:1.0:1787398114.331651:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].56, 224 off18016 00000040:00080000:1.0:1787398114.331667:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].57, 120 off18136 00000100:00100000:1.0:1787398114.331705:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398114.331771:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.331811:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a830f90000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.332216:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318400 00000100:00100000:3.0:1787398114.332234:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318400 00000100:00100000:3.0:1787398114.332293:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787398114.332303:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398114.332423:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318400:12345-0@lo:502:mount.lustre.0 Request processed in 121us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.332430:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787398114.333289:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787398114.333367:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].58, 224 off18360 00000040:00080000:1.0:1787398114.333379:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:1.0:1787398114.334357:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787398114.334371:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.334374:0:107287:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787398114.334380:0:107287:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787398114.334383:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.334397:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff89a829b90000) 00000020:00000080:1.0:1787398114.334420:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1787398114.334426:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787398114.334695:0:107287:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787398114.334708:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193d7a 00000020:00000080:1.0:1787398114.334927:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787398114.334932:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.334937:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.334947:0:107287:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787398114.334951:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787398114.334955:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.334956:0:107287:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787398114.335169:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.335180:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff89a829b94d40) 00000020:00000080:1.0:1787398114.335193:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1787398114.335199:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787398114.335201:0:107287:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787398114.335204:0:107287:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787398114.335210:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787398114.335396:0:107287:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a827b3e000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787398114.335410:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff89a829b919c0) 00000020:00000080:1.0:1787398114.335420:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1787398114.335488:0:107287:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787398114.335495:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193d8f 00000020:00000080:1.0:1787398114.335772:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787398114.335779:0:107287:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787398114.335784:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x274786fe0d193d96 00080000:01000000:1.0:1787398114.335789:0:107287:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787398114.335793:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193d9d 00010000:00010000:3.0:1787398114.433149:0:107287:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-3 is initialized 00000001:00080000:3.0:1787398114.433284:0:107287:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 85899345920 lx: 0 gen 28 00000001:00080000:3.0:1787398114.433327:0:107287:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 81604378794 srv lr: 85899345920 lx: 0 gen 25 00000001:00000004:3.0:1787398114.433352:0:107287:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 21, last_transno is 85899345920 00000001:00080000:3.0:1787398114.433789:0:107287:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1787398114.433849:0:107287:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a82f60ec00: xid 1874218681348608, transno 85899345935, client gen 25, slot idx 0 00000001:00080000:3.0:1787398114.433860:0:107287:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a82f60e000: xid 1874218681351168, transno 85899345936, client gen 25, slot idx 1 00000020:00000080:1.0:1787398114.435154:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787398114.435171:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.435178:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.435181:0:107287:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787398114.435184:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787398114.435189:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.435191:0:107287:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787398114.435194:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398114.435199:0:107287:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:1.0:1787398114.435230:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.435244:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff89a829b93380) 00000020:00000080:1.0:1787398114.435266:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787398114.435272:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398114.435349:0:107287:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787398114.435355:0:107287:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787398114.435362:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193db9 00010000:00080000:1.0:1787398114.435409:0:107287:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a836713800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398114.440192:0:107287:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787398114.450095:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398114.450114:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787398114.450158:0:107287:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787398114.450179:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193dc0 00000100:00080000:1.0:1787398114.450190:0:107287:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398114.450196:0:107287:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a836713800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398114.450235:0:107287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8000 x1874218701318528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398114.450310:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787398114.450789:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398114.450940:0:107287:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787398114.451002:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.451008:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451010:0:107287:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787398114.451013:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398114.451016:0:107287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787398114.451017:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.451019:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.451020:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398114.451022:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451024:0:107287:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398114.451026:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787398114.451030:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451032:0:107287:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787398114.451035:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787398114.451067:0:107287:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787398114.451081:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.451084:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451097:0:107287:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787398114.451101:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398114.451102:0:107287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787398114.451104:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.451105:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.451106:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398114.451109:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451110:0:107287:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398114.451113:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787398114.451116:0:107287:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787398114.451119:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.451120:0:107287:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787398114.451123:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398114.451127:0:107287:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787398114.451147:0:107287:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787398114.451150:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.451165:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89a70247cd40) 00000020:00000080:1.0:1787398114.451181:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787398114.451186:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398114.451251:0:107287:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787398114.451258:0:107287:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787398114.451264:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193dce 00010000:00080000:1.0:1787398114.451298:0:107287:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7054c6000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398114.451558:0:107287:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787398114.451703:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318528 00000100:00100000:0.0:1787398114.451906:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318528 00000100:00100000:0.0:1787398114.451959:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787398114.451970:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701318528:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787398114.451994:0:99649:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787398114.453897:0:107287:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398114.453933:0:107287:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787398114.454359:0:107287:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 19, last_idx 20 00000100:00100000:0.0:1787398114.455011:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701318528:12345-0@lo:38:llog_process_th.0 Request processed in 3037us (4347us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398114.455024:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787398114.455065:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.455070:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787398114.455073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.455076:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787398114.455836:0:107287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398114.455867:0:107287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].21, 64 off9536 00000040:00080000:1.0:1787398114.455997:0:107287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x54:0x0].1, 64 off8256 00000040:00080000:1.0:1787398114.458455:0:107292:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 21 synced_idx: 0 lgh_last_idx: 21 00000040:00080000:1.0:1787398114.458464:0:107292:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787398114.458944:0:107292:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 20, last_idx 21 00000040:00080000:1.0:1787398114.458967:0:107292:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1787398114.459095:0:107292:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:1.0:1787398114.459098:0:107292:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x54:0x0] at index 21 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1787398114.459980:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398114.459991:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398114.459997:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318528:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787398114.461347:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398114.461363:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787398114.461410:0:107287:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787398114.461432:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193dd5 00000100:00080000:1.0:1787398114.461446:0:107287:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398114.461454:0:107287:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a7054c6000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398114.461815:0:107287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016fb100 x1874218701318656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398114.461909:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318656:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787398114.462002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398114.462066:0:107287:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787398114.462141:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.462147:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.462149:0:107287:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787398114.462152:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398114.462155:0:107287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787398114.462156:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.462158:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.462159:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398114.462161:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.462163:0:107287:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398114.462165:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787398114.462170:0:107287:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787398114.462174:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.462175:0:107287:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787398114.462177:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398114.462181:0:107287:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787398114.462203:0:107287:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787398114.462206:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.462252:0:107287:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89a70247b380) 00000020:00000080:1.0:1787398114.462268:0:107287:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787398114.462274:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398114.462340:0:107287:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787398114.462347:0:107287:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787398114.462355:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d193de3 00010000:00080000:1.0:1787398114.462405:0:107287:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a70a903000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398114.462681:0:107287:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00080000:0.0:1787398114.462842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.462848:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787398114.462852:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.462855:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:1.0:1787398114.463115:0:107287:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398114.463132:0:107287:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787398114.464075:0:107287:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1787398114.465078:0:107287:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398114.465115:0:107287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].21, 64 off9536 00000040:00080000:1.0:1787398114.465266:0:107287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x56:0x0].1, 64 off8256 00000100:00100000:2.0:1787398114.466482:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318656 00000100:00100000:2.0:1787398114.466513:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318656 00000100:00100000:2.0:1787398114.466599:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787398114.466610:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1874218701318656:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1787398114.466645:0:99640:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3993 last 0 00000020:00000080:2.0:1787398114.466688:0:99640:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193dea 00002000:00100000:2.0:1787398114.466704:0:99640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a705572800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787398114.466921:0:99640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787398114.466926:0:99640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787398114.466998:0:99640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787398114.467024:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a705573800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398114.467170:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701318656:12345-0@lo:8:llog_process_th.0 Request processed in 560us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.467179:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000040:00080000:3.0:1787398114.470301:0:107294:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 21 synced_idx: 0 lgh_last_idx: 21 00000040:00080000:3.0:1787398114.470313:0:107294:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787398114.471921:0:107287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398114.471940:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787398114.471981:0:107287:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787398114.472001:0:107287:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193df1 00000100:00080000:0.0:1787398114.472012:0:107287:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398114.472018:0:107287:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a70a903000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398114.472055:0:107287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b75c00 x1874218701318784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398114.472072:0:107287:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000040:00080000:3.0:1787398114.472256:0:107294:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 20, last_idx 21 00000040:00080000:3.0:1787398114.472291:0:107294:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1787398114.472468:0:107294:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:3.0:1787398114.472474:0:107294:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x56:0x0] at index 21 of catalog [0x1:0x5:0x0] 00000020:01000000:0.0:1787398114.472645:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.472662:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472664:0:107287:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787398114.472669:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.472674:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472675:0:107287:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787398114.472679:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787398114.472680:0:107287:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787398114.472683:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.472685:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472687:0:107287:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787398114.472689:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.472692:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472693:0:107287:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787398114.472697:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787398114.472703:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.472706:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472788:0:107287:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000020:01000000:0.0:1787398114.472795:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398114.472798:0:107287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #42 00000020:01000000:0.0:1787398114.472799:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.472801:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.472817:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398114.472820:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472822:0:107287:0:(obd_config.c:1561:class_process_config()) marker 42 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:0.0:1787398114.472824:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398114.472826:0:107287:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #45 00000020:01000000:0.0:1787398114.472828:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.472829:0:107287:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.472831:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398114.472833:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472834:0:107287:0:(obd_config.c:1561:class_process_config()) marker 45 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1787398114.472837:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.472839:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472841:0:107287:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1787398114.472853:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:0.0:1787398114.472862:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.472865:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472866:0:107287:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1787398114.472868:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.472872:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472873:0:107287:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:0.0:1787398114.472876:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000020:01000000:0.0:1787398114.472899:0:107287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.472902:0:107287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.472904:0:107287:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:0.0:1787398114.472907:0:107287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7a:0x0] index 59 count 58 00000020:01000000:0.0:1787398114.472966:0:107234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 10000000:01000000:0.0:1787398114.473007:0:107234:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787398114.473027:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.473039:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398114.473047:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a827b3e000 from 1 10000000:01000000:0.0:1787398114.473050:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787398114.473091:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.473099:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.473111:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398114.473139:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787398114.473229:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.473267:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.473425:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318912 00000100:00100000:3.0:1787398114.473438:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318912 00000100:00100000:3.0:1787398114.473492:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787398114.473501:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+8:107234:x1874218701318912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398114.473515:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398114.473563:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193df8 expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.473588:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193df8 expref: 9 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.473599:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193df8 expref: 9 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.473607:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:3.0:1787398114.473649:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701318912:12345-0@lo:101:mount.lustre.0 Request processed in 149us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.473657:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787398114.474099:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701318912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398114.474115:0:107234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398114.474126:0:107234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398114.474674:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319040:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787398114.475035:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.475067:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398114.475092:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319040 00000100:00100000:0.0:1787398114.475097:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319040 00000100:00100000:0.0:1787398114.475134:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787398114.475141:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701319040:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787398114.475160:0:107281:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787398114.475181:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787398114.475186:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787398114.475189:0:107281:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 135 00000100:00100000:1.0:1787398114.475706:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787398114.475728:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:1.0:1787398114.475737:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787398114.475744:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787398114.475748:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787398114.476057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.476062:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.476065:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.476068:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:1.0:1787398114.476324:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787398114.476334:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318656:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787398114.476977:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701319168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398114.477034:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787398114.477133:0:107292:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787398114.477216:0:107292:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3993767693235ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787398114.477235:0:107292:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787398114.477706:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319168 00000100:00100000:3.0:1787398114.477881:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319168 00000100:00100000:3.0:1787398114.477973:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787398114.477984:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701319168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398114.478020:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398114.478084:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701319168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.478091:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787398114.478177:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701319168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787398114.478238:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787398114.481194:0:107244:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787398114.481623:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701319040:12345-0@lo:256:mount.lustre.0 Request processed in 6475us (6581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398114.481636:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787398114.481927:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319040:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787398114.482642:0:107234:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787398114.482684:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398114.482848:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318784:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787398114.482918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.482955:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701318784 00000100:00100000:0.0:1787398114.482962:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701318784 00000100:00100000:0.0:1787398114.483004:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398114.483012:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1874218701318784:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1787398114.483043:0:99641:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3993 last 0 00000020:00000080:0.0:1787398114.483072:0:99641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d193e06 00002000:00100000:0.0:1787398114.483088:0:99641:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89a836496000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787398114.483092:0:99641:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787398114.483095:0:99641:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787398114.483181:0:99641:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787398114.483206:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a836493000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398114.483251:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701318784:12345-0@lo:8:llog_process_th.0 Request processed in 238us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398114.483258:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398114.483304:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787398114.483312:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787398114.483320:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787398114.483326:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787398114.483328:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a70a903000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787398114.483343:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787398114.483348:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701318784:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1787398114.483416:0:107294:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787398114.483470:0:107294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3993773946793ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787398114.483477:0:107294:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787398114.483576:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398114.483588:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701319296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398114.483625:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787398114.483879:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398114.483902:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a827b3e000 from 1 10000000:01000000:3.0:1787398114.483905:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787398114.483934:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.483942:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.483951:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398114.483966:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787398114.483998:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.484023:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398114.484347:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319296 00000100:00100000:0.0:1787398114.484354:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319296 00000100:00100000:0.0:1787398114.484410:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787398114.484419:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701319296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787398114.484441:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398114.484502:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701319296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398114.484509:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787398114.484852:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319424 00000100:00100000:1.0:1787398114.484858:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319424 00000100:00100000:1.0:1787398114.484899:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787398114.484907:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+9:107234:x1874218701319424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.484918:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398114.484939:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62200/0x274786fe0d193e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193e0d expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.484962:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62200/0x274786fe0d193e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193e0d expref: 10 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.484971:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62200/0x274786fe0d193e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193e0d expref: 10 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.484981:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62200, rc 0) 00000100:00100000:1.0:1787398114.485020:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319424:12345-0@lo:101:mount.lustre.0 Request processed in 114us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.485026:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787398114.485090:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701319296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398114.485129:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.485143:0:107234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.485153:0:107234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787398114.485396:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 7 count 7 00000100:00080000:3.0:1787398114.485839:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787398114.486090:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398114.486290:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].1, 224 off8416 00000040:00080000:1.0:1787398114.486317:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].2, 112 off8528 00000040:00080000:1.0:1787398114.486331:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].3, 224 off8752 00000040:00080000:1.0:1787398114.486345:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].4, 224 off8976 00000040:00080000:1.0:1787398114.486358:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].5, 112 off9088 00000040:00080000:1.0:1787398114.486376:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].6, 224 off9312 00000040:00080000:1.0:1787398114.486382:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 6 count 7 00000100:00100000:1.0:1787398114.486447:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398114.486514:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.486578:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74480 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.486899:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319552 00000100:00100000:3.0:1787398114.486906:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319552 00000100:00100000:3.0:1787398114.486950:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787398114.486958:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398114.487099:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319552:12345-0@lo:501:mount.lustre.0 Request processed in 141us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.487108:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787398114.487443:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398114.487483:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787398114.487565:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.487588:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d600 going to sleep for 11 seconds 00000004:00080000:0.0:1787398114.488426:0:107244:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787398114.488906:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319680 00000100:00100000:2.0:1787398114.488915:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319680 00000100:00100000:2.0:1787398114.488996:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787398114.489005:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.489163:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319680:12345-0@lo:503:mount.lustre.0 Request processed in 158us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.489171:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787398114.489257:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319680:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787398114.489804:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398114.489882:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398114.489948:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.490409:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.490448:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319808 00000100:00100000:3.0:1787398114.490453:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319808 00000100:00100000:3.0:1787398114.490638:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787398114.490670:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398114.491235:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319808:12345-0@lo:502:mount.lustre.0 Request processed in 566us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.491243:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787398114.491379:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398114.491956:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].1, 224 off8416 00000040:00080000:0.0:1787398114.491993:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].2, 112 off8528 00000040:00080000:0.0:1787398114.492009:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].3, 224 off8752 00000040:00080000:0.0:1787398114.492025:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].4, 224 off8976 00000040:00080000:0.0:1787398114.492040:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].5, 112 off9088 00000100:00100000:0.0:1787398114.492073:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398114.492128:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.492209:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.492271:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701319936 00000100:00100000:1.0:1787398114.492277:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701319936 00000100:00100000:1.0:1787398114.492323:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787398114.492333:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398114.492480:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701319936:12345-0@lo:502:mount.lustre.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.492819:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787398114.493055:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701319936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398114.493118:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].6, 224 off9312 00000040:00080000:0.0:1787398114.493131:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1787398114.494332:0:107296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.494346:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.494348:0:107296:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787398114.494355:0:107296:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a827b3e000 00000020:00000080:2.0:1787398114.494358:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787398114.494367:0:107296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.494369:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.494370:0:107296:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787398114.494372:0:107296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.494375:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.494376:0:107296:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787398114.494380:0:107296:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a827b3e000 00000020:00000080:2.0:1787398114.494382:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787398114.494502:0:107296:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.494507:0:107296:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.494509:0:107296:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787398114.494513:0:107296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7c:0x0] index 7 count 7 00000020:01000000:1.0:1787398114.494863:0:107234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1787398114.494901:0:107234:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787398114.494923:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.494935:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.494996:0:107234:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787398114.495000:0:107234:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a827b3e000 10000000:01000000:1.0:1787398114.495003:0:107234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a827b3e000 10000000:01000000:1.0:1787398114.495008:0:107234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787398114.495025:0:107234:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a827b3e000 from 1 10000000:01000000:1.0:1787398114.495028:0:107234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787398114.495066:0:107234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.495074:0:107234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.495084:0:107234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398114.495106:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787398114.495169:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.495207:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.495272:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320064 00000100:00100000:3.0:1787398114.495278:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320064 00000100:00100000:3.0:1787398114.495331:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787398114.495342:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107234:x1874218701320064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398114.495355:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398114.495369:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa200/0x274786fe0d193e22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193e1b expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.495392:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa200/0x274786fe0d193e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193e1b expref: 11 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.495403:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa200/0x274786fe0d193e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193e1b expref: 11 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.495411:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa200, rc 0) 00000100:00100000:3.0:1787398114.495450:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320064:12345-0@lo:101:mount.lustre.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.495458:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787398114.495571:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.495585:0:107234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.495594:0:107234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787398114.496019:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 64 count 63 00000040:00080000:1.0:1787398114.496259:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398114.496441:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].1, 224 off8416 00000040:00080000:1.0:1787398114.496466:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].2, 120 off8536 00000040:00080000:1.0:1787398114.496482:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].3, 168 off8704 00000040:00080000:1.0:1787398114.496507:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].4, 224 off8928 00000040:00080000:1.0:1787398114.496641:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].5, 224 off9152 00000040:00080000:1.0:1787398114.496672:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].6, 120 off9272 00000040:00080000:1.0:1787398114.496685:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].7, 168 off9440 00000040:00080000:1.0:1787398114.496775:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].8, 224 off9664 00000040:00080000:1.0:1787398114.496798:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].9, 224 off9888 00000040:00080000:1.0:1787398114.496811:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].10, 120 off10008 00000040:00080000:1.0:1787398114.496824:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].11, 224 off10232 00000040:00080000:1.0:1787398114.496835:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].12, 224 off10456 00000040:00080000:1.0:1787398114.496848:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].13, 88 off10544 00000040:00080000:1.0:1787398114.496863:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].14, 128 off10672 00000040:00080000:1.0:1787398114.496877:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].15, 144 off10816 00000040:00080000:1.0:1787398114.496904:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].16, 160 off10976 00000040:00080000:1.0:1787398114.496918:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].17, 224 off11200 00000040:00080000:1.0:1787398114.496930:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].18, 224 off11424 00000040:00080000:1.0:1787398114.496941:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].19, 80 off11504 00000040:00080000:1.0:1787398114.496953:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].20, 224 off11728 00000040:00080000:1.0:1787398114.496966:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].21, 224 off11952 00000040:00080000:1.0:1787398114.496980:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].22, 88 off12040 00000040:00080000:1.0:1787398114.496994:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].23, 128 off12168 00000040:00080000:1.0:1787398114.497009:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].24, 144 off12312 00000040:00080000:1.0:1787398114.497023:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].25, 160 off12472 00000040:00080000:1.0:1787398114.497038:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].26, 224 off12696 00000040:00080000:1.0:1787398114.497051:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].27, 224 off12920 00000040:00080000:1.0:1787398114.497065:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].28, 80 off13000 00000040:00080000:1.0:1787398114.497078:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].29, 224 off13224 00000040:00080000:1.0:1787398114.497091:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].30, 224 off13448 00000040:00080000:1.0:1787398114.497103:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].31, 88 off13536 00000040:00080000:1.0:1787398114.497116:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].32, 128 off13664 00000040:00080000:1.0:1787398114.497129:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].33, 144 off13808 00000040:00080000:1.0:1787398114.497141:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].34, 128 off13936 00000040:00080000:1.0:1787398114.497156:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].35, 224 off14160 00000040:00080000:1.0:1787398114.497169:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].36, 224 off14384 00000040:00080000:1.0:1787398114.497183:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].37, 80 off14464 00000040:00080000:1.0:1787398114.497197:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].38, 224 off14688 00000040:00080000:1.0:1787398114.497208:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].39, 224 off14912 00000040:00080000:1.0:1787398114.497220:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].40, 88 off15000 00000040:00080000:1.0:1787398114.497246:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].41, 128 off15128 00000040:00080000:1.0:1787398114.497261:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].42, 144 off15272 00000040:00080000:1.0:1787398114.497272:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].43, 128 off15400 00000040:00080000:1.0:1787398114.497282:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].44, 224 off15624 00000040:00080000:1.0:1787398114.497294:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].45, 224 off15848 00000040:00080000:1.0:1787398114.497306:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].46, 80 off15928 00000040:00080000:1.0:1787398114.497320:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].47, 224 off16152 00000040:00080000:1.0:1787398114.497334:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].48, 232 off16384 00000040:00080000:1.0:1787398114.497458:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].49, 224 off16608 00000040:00080000:1.0:1787398114.497480:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].50, 120 off16728 00000040:00080000:1.0:1787398114.497493:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].51, 224 off16952 00000040:00080000:1.0:1787398114.497873:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].52, 224 off17176 00000040:00080000:1.0:1787398114.497900:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].53, 112 off17288 00000040:00080000:1.0:1787398114.497919:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].54, 224 off17512 00000040:00080000:1.0:1787398114.497933:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].55, 224 off17736 00000040:00080000:1.0:1787398114.497947:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].56, 136 off17872 00000040:00080000:1.0:1787398114.497961:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].57, 224 off18096 00000040:00080000:1.0:1787398114.497975:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].58, 224 off18320 00000040:00080000:1.0:1787398114.497990:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].59, 136 off18456 00000040:00080000:1.0:1787398114.498003:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].60, 224 off18680 00000040:00080000:1.0:1787398114.498018:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].61, 224 off18904 00000040:00080000:1.0:1787398114.498032:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].62, 112 off19016 00000040:00080000:1.0:1787398114.498053:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].63, 224 off19240 00000040:00080000:1.0:1787398114.498059:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 63 count 63 00000100:00100000:1.0:1787398114.498151:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398114.498211:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.498287:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.500969:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320192 00000100:00100000:3.0:1787398114.500985:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320192 00000100:00100000:3.0:1787398114.501079:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787398114.501090:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398114.501302:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320192:12345-0@lo:501:mount.lustre.0 Request processed in 213us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.501320:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787398114.502162:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398114.502216:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787398114.502275:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.507109:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320320 00000100:00100000:2.0:1787398114.507126:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320320 00000100:00100000:2.0:1787398114.507181:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787398114.507190:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.507361:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320320:12345-0@lo:503:mount.lustre.0 Request processed in 171us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.507377:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787398114.507729:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787398114.507763:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787398114.508251:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398114.508339:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398114.508401:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.508435:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.508860:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320448 00000100:00100000:2.0:1787398114.508868:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320448 00000100:00100000:2.0:1787398114.508912:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787398114.508921:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398114.509088:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320448:12345-0@lo:502:mount.lustre.0 Request processed in 167us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.509096:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787398114.512393:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398114.514005:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].1, 224 off8416 00000040:00080000:0.0:1787398114.514046:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].2, 120 off8536 00000040:00080000:0.0:1787398114.514063:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].3, 168 off8704 00000040:00080000:0.0:1787398114.514077:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].4, 224 off8928 00000040:00080000:0.0:1787398114.514089:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].5, 224 off9152 00000040:00080000:0.0:1787398114.514102:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].6, 120 off9272 00000040:00080000:0.0:1787398114.514115:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].7, 168 off9440 00000040:00080000:0.0:1787398114.514129:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].8, 224 off9664 00000040:00080000:0.0:1787398114.514142:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].9, 224 off9888 00000040:00080000:0.0:1787398114.514155:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].10, 120 off10008 00000040:00080000:0.0:1787398114.514167:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].11, 224 off10232 00000040:00080000:0.0:1787398114.514178:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].12, 224 off10456 00000040:00080000:0.0:1787398114.514189:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].13, 88 off10544 00000040:00080000:0.0:1787398114.514201:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].14, 128 off10672 00000040:00080000:0.0:1787398114.514214:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].15, 144 off10816 00000040:00080000:0.0:1787398114.514225:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].16, 160 off10976 00000040:00080000:0.0:1787398114.514236:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].17, 224 off11200 00000040:00080000:0.0:1787398114.514249:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].18, 224 off11424 00000040:00080000:0.0:1787398114.514264:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].19, 80 off11504 00000040:00080000:0.0:1787398114.514276:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].20, 224 off11728 00000040:00080000:0.0:1787398114.514289:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].21, 224 off11952 00000040:00080000:0.0:1787398114.514299:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].22, 88 off12040 00000040:00080000:0.0:1787398114.514308:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].23, 128 off12168 00000040:00080000:0.0:1787398114.514330:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].24, 144 off12312 00000040:00080000:0.0:1787398114.514341:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].25, 160 off12472 00000040:00080000:0.0:1787398114.514353:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].26, 224 off12696 00000040:00080000:0.0:1787398114.514364:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].27, 224 off12920 00000040:00080000:0.0:1787398114.514375:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].28, 80 off13000 00000040:00080000:0.0:1787398114.514388:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].29, 224 off13224 00000040:00080000:0.0:1787398114.514402:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].30, 224 off13448 00000040:00080000:0.0:1787398114.514415:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].31, 88 off13536 00000040:00080000:0.0:1787398114.514428:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].32, 128 off13664 00000040:00080000:0.0:1787398114.514441:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].33, 144 off13808 00000040:00080000:0.0:1787398114.514456:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].34, 128 off13936 00000040:00080000:0.0:1787398114.514470:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].35, 224 off14160 00000040:00080000:0.0:1787398114.514482:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].36, 224 off14384 00000040:00080000:0.0:1787398114.514494:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].37, 80 off14464 00000040:00080000:0.0:1787398114.515214:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].38, 224 off14688 00000040:00080000:0.0:1787398114.515234:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].39, 224 off14912 00000040:00080000:0.0:1787398114.515248:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].40, 88 off15000 00000040:00080000:0.0:1787398114.515261:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].41, 128 off15128 00000040:00080000:0.0:1787398114.515274:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].42, 144 off15272 00000040:00080000:0.0:1787398114.515287:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].43, 128 off15400 00000040:00080000:0.0:1787398114.515302:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].44, 224 off15624 00000040:00080000:0.0:1787398114.515316:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].45, 224 off15848 00000040:00080000:0.0:1787398114.515328:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].46, 80 off15928 00000040:00080000:0.0:1787398114.515342:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].47, 224 off16152 00000040:00080000:0.0:1787398114.515356:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].48, 232 off16384 00000100:00100000:0.0:1787398114.515423:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398114.515561:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.515605:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8346a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.515707:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320576 00000100:00100000:2.0:1787398114.515724:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320576 00000100:00100000:2.0:1787398114.515783:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787398114.515793:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398114.515937:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320576:12345-0@lo:502:mount.lustre.0 Request processed in 144us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.515946:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787398114.516024:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398114.516253:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].49, 224 off16608 00000040:00080000:2.0:1787398114.516278:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].50, 120 off16728 00000040:00080000:2.0:1787398114.516292:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].51, 224 off16952 00000040:00080000:2.0:1787398114.516305:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].52, 224 off17176 00000040:00080000:2.0:1787398114.516318:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].53, 112 off17288 00000040:00080000:2.0:1787398114.516332:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].54, 224 off17512 00000040:00080000:2.0:1787398114.516346:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].55, 224 off17736 00000040:00080000:2.0:1787398114.516360:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].56, 136 off17872 00000040:00080000:2.0:1787398114.516374:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].57, 224 off18096 00000040:00080000:2.0:1787398114.516386:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].58, 224 off18320 00000040:00080000:2.0:1787398114.516400:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].59, 136 off18456 00000040:00080000:2.0:1787398114.516427:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].60, 224 off18680 00000040:00080000:2.0:1787398114.516441:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].61, 224 off18904 00000040:00080000:2.0:1787398114.516455:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].62, 112 off19016 00000100:00100000:2.0:1787398114.516483:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398114.516551:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.516578:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.516860:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320704 00000100:00100000:1.0:1787398114.516866:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320704 00000100:00100000:1.0:1787398114.516917:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787398114.516926:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398114.517030:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320704:12345-0@lo:502:mount.lustre.0 Request processed in 105us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.517037:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787398114.517301:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398114.517361:0:107234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].63, 224 off19240 00000040:00080000:2.0:1787398114.517371:0:107234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:1.0:1787398114.522991:0:107299:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787398114.523008:0:107299:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff89a702478000) 00000020:00000080:1.0:1787398114.523032:0:107299:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787398114.523839:0:107299:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a827b3e000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787398114.523846:0:107299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a827b3e000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787398114.523849:0:107299:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a827b3e000 3 00010000:00080000:1.0:1787398114.523881:0:107299:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a83879d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398114.531245:0:107299:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787398114.531360:0:107299:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787398114.531408:0:107299:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787398114.531424:0:107299:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x274786fe0d193e30 00000100:00080000:1.0:1787398114.531436:0:107299:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398114.531443:0:107299:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a83879d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398114.531484:0:107299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016fb100 x1874218701320832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398114.531537:0:107299:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787398114.533444:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701320832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787398114.533566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.534695:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320832 00000100:00100000:3.0:1787398114.534831:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320832 00000100:00100000:3.0:1787398114.534876:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787398114.534896:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701320832:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787398114.534920:0:107265:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398114.534989:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701320832:12345-0@lo:38:llog_process_th.0 Request processed in 104us (1423us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398114.534996:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1787398114.535220:0:107299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7e:0x0] index 64 count 63 00000100:00080000:0.0:1787398114.536995:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.537025:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398114.537031:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701320832:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787398114.539848:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.539856:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.539859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.539863:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787398114.541769:0:107234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1787398114.546752:0:107234:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787398114.546780:0:107234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.546794:0:107234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787398114.546850:0:107234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787398114.546853:0:107234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398114.546854:0:107234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.546855:0:107234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.546856:0:107234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.546858:0:107234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.546859:0:107234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398114.546861:0:107234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.546863:0:107234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787398114.546867:0:107234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787398114.546870:0:107234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787398114.546872:0:107234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398114.546873:0:107234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.546875:0:107234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.546881:0:107234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.546891:0:107234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.546893:0:107234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398114.546894:0:107234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.546895:0:107234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787398114.546925:0:107234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787398114.546949:0:107234:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787398114.547026:0:107234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.547069:0:107234:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83fa54e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.547640:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701320960 00000100:00100000:1.0:1787398114.547659:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701320960 00000100:00100000:1.0:1787398114.547757:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787398114.547767:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787398114.547809:0:107280:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787398114.547824:0:107280:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787398114.558265:0:107280:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787398114.558313:0:107280:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787398114.558816:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:107234:x1874218701320960:12345-0@lo:253:mount.lustre.0 Request processed in 11042us (11781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.558831:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787398114.559014:0:107234:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107234:1874218701320960:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787398114.559029:0:107234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787398114.559032:0:107234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787398114.559034:0:107234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787398114.559035:0:107234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787398114.559036:0:107234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787398114.559037:0:107234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787398114.559039:0:107234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787398114.559040:0:107234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787398114.559042:0:107234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787398114.559044:0:107234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787398114.559063:0:107234:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1787398114.562266:0:107234:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 81604378797 00000040:01000000:3.0:1787398114.562951:0:107234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787398114.563410:0:107304:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 81604378797 00000020:00080000:0.0:1787398114.563416:0:107304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378797 20000000:01000000:2.0:1787398114.563978:0:107285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787398114.563985:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787398114.564071:0:107285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.564094:0:107285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193df8 expref: 10 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.564105:0:107285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.564150:0:107285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 10 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.564179:0:107285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 10 pid: 107280 timeout: 4093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398114.564195:0:107285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701321088:0@lo:104: 00000100:00100000:3.0:1787398114.564259:0:107285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.564307:0:107285:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7027f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.564369:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321088 00000100:00100000:2.0:1787398114.564377:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321088 00000100:00100000:2.0:1787398114.564428:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787398114.564438:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701321088:12345-0@lo:104: 00010000:00010000:2.0:1787398114.564451:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564556:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787398114.564563:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701321088:12345-0@lo:104: Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.564571:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:2.0:1787398114.564599:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398114.564605:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564612:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398114.564617:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564626:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398114.564633:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398114.564638:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787398114.564905:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564912:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398114.564932:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564938:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a828a74c00/0x274786fe0d193df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193dff expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.564956:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398114.564958:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398114.564960:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398114.564990:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701321216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398114.565023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.565085:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321216 00000100:00100000:2.0:1787398114.565090:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321216 00010000:00010000:2.0:1787398114.565105:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 11 pid: 107280 timeout: 4093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.565128:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1787398114.565135:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218701321216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398114.565146:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398114.565151:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 11 pid: 107280 timeout: 4093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565161:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 11 pid: 107280 timeout: 4093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565177:0:19660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565186:0:19660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787398114.565200:0:19660:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001215748s 00010000:00010000:2.0:1787398114.565204:0:19660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565211:0:19660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565219:0:19660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565225:0:19660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565238:0:19660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398114.565243:0:19660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565250:0:19660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565259:0:19660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565270:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398114.565305:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+11:3648:x1874218701321216:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.565313:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1787398114.565351:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701321216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398114.565379:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa600/0x274786fe0d193dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d193df8 expref: 10 pid: 107280 timeout: 4093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.565388:0:107285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701321088:0@lo:104: 00010000:00010000:2.0:1787398114.565399:0:107285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565408:0:107285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565413:0:107285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.565430:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050ab200/0x274786fe0d193e37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1787398114.566109:0:107305:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787398114.568320:0:107305:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x240002340:0x1:0x0] first idx 14, last_idx 15 00000040:00080000:2.0:1787398114.568438:0:107305:0:(llog.c:805:llog_process_thread()) index: 15, lh_last_idx: 15 synced_idx: 15 lgh_last_idx: 15 00000040:00080000:2.0:1787398114.568443:0:107305:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x240009870:0x1:0x0] at index 15 of catalog [0x240002340:0x1:0x0] 00000040:00080000:2.0:1787398114.568984:0:107305:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x240009870:0x1:0x0] at index 15 of catalog [0x240002340:0x1:0x0] 00000040:00080000:2.0:1787398114.569012:0:107305:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240002340:0x1:0x0] index 15 count 1 00000004:00080000:2.0:1787398114.569085:0:107305:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1787398114.569685:0:107234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00080000:2.0:1787398114.570199:0:107306:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff89a82ebd5500 x1874218701321344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398114.570213:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 00000040:01000000:3.0:1787398114.570365:0:107234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787398114.570400:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787398114.571192:0:107234:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787398114.571257:0:107234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787398114.571324:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398114.572514:0:107234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787398114.573370:0:107234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787398114.573407:0:107234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787398114.574222:0:107234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787398114.575974:0:107234:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x42:0x0] (8/32) registered 00010000:00080000:2.0:1787398114.579013:0:107234:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 85899345936 00010000:00080000:1.0:1787398114.580160:0:107307:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 107307 00010000:02000000:1.0:1787398114.580215:0:107307:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1787398114.580220:0:107307:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787398114.580224:0:107307:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1787398114.580309:0:107234:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787398114.580344:0:107234:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 10000000:01000000:1.0:1787398114.580386:0:107259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787398114.580516:0:107259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787398114.581015:0:107234:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787398114.581059:0:107234:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:01000004:1.0:1787398114.581800:0:107259:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.160@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787398114.581805:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787398114.581807:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787398114.581808:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398114.581809:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398114.581810:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398114.581812:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398114.581813:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398114.581815:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787398114.581817:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398114.581818:0:107259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398114.581822:0:107259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787398114.581824:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787398114.581825:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787398114.581826:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398114.581828:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398114.581829:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398114.581830:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398114.581831:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398114.581832:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787398114.581833:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398114.581841:0:107259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398114.581868:0:107259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787398114.581901:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321472:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787398114.581987:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.582029:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d74d80 going to sleep for 11 seconds 00000020:00000004:2.0:1787398114.589080:0:107234:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787398114.589446:0:107234:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787398114.603054:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321472 00000100:00100000:1.0:1787398114.603067:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321472 00000100:00100000:1.0:1787398114.603128:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787398114.603138:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107259:x1874218701321472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787398114.603208:0:107283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787398114.603212:0:107283:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787398114.603215:0:107283:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1787398114.603223:0:107283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787398114.607787:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+10:107259:x1874218701321472:12345-0@lo:253:mount.lustre.0 Request processed in 4639us (25787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.607812:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787398114.607895:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787398114.607910:0:107259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787398114.607913:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787398114.607915:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787398114.607916:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398114.607917:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398114.607919:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398114.607920:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398114.607921:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398114.607922:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787398114.607924:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398114.607925:0:107259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787398114.607948:0:107259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a829b29000 from lustre-MDT0000 10000000:01000000:2.0:1787398114.607983:0:107259:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787398114.607987:0:107259:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787398114.607997:0:107259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a829b29000 10000000:01000000:2.0:1787398114.608003:0:107259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787398114.608010:0:107259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a829b29000 10000000:01000000:2.0:1787398114.608013:0:107259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787398114.608017:0:107259:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a829b29000 from 1 10000000:01000000:2.0:1787398114.608019:0:107259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787398114.608057:0:107259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.608068:0:107259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.608077:0:107259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.608097:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398114.608145:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.608191:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8356a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398114.608617:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321600 00000100:00100000:1.0:1787398114.608625:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321600 00000100:00100000:1.0:1787398114.608892:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787398114.608903:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+10:107259:x1874218701321600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.608916:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398114.608931:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62000/0x274786fe0d193e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193e3e expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.608955:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62000/0x274786fe0d193e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193e3e expref: 11 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.608966:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62000/0x274786fe0d193e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193e3e expref: 11 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.608975:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62000, rc 0) 00000100:00100000:1.0:1787398114.609020:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+11:107259:x1874218701321600:12345-0@lo:101:mount.lustre.0 Request processed in 120us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.609039:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787398114.609087:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398114.609101:0:107259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e45 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.609111:0:107259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e45 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.609126:0:107259:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787398114.609138:0:107259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e45 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.609145:0:107259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74c00/0x274786fe0d193e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e45 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398114.609152:0:107259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787398114.609155:0:107259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787398114.609161:0:107259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a829b29000 10000000:01000000:1.0:1787398114.609164:0:107259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787398114.609167:0:107259:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787398114.609169:0:107259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787398114.609187:0:107259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.609195:0:107259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398114.609201:0:107259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398114.609223:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787398114.609255:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.609269:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a9af540 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.611150:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321728 00000100:00100000:2.0:1787398114.611165:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321728 00000100:00100000:2.0:1787398114.611220:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787398114.611230:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+11:107259:x1874218701321728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.611247:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398114.611262:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75e00/0x274786fe0d193e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193e4c expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.611288:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75e00/0x274786fe0d193e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193e4c expref: 12 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.611299:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75e00/0x274786fe0d193e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193e4c expref: 12 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.611308:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75e00, rc 0) 00000100:00100000:2.0:1787398114.611390:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701321728:12345-0@lo:101:mount.lustre.0 Request processed in 161us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.611397:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787398114.611473:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.611642:0:107259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e53 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.611780:0:107259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e53 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.611872:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.611933:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.611970:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8356a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.611986:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321856 00000100:00100000:2.0:1787398114.611991:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321856 00000100:00100000:2.0:1787398114.612015:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787398114.612021:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701321856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.612189:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701321856:12345-0@lo:501:mount.lustre.0 Request processed in 167us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.612199:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787398114.612234:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.612263:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.612304:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.612321:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8356a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.612336:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321984 00000100:00100000:2.0:1787398114.612339:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321984 00000100:00100000:2.0:1787398114.612364:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787398114.612370:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701321984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787398114.615542:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701321984:12345-0@lo:503:mount.lustre.0 Request processed in 3140us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.615558:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787398114.615802:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701321984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.616469:0:107308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701322112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.616582:0:107308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.616632:0:107308:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8356a3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.616879:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322112 00000100:00100000:3.0:1787398114.616897:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322112 00000100:00100000:3.0:1787398114.616944:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787398114.616953:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701322112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787398114.617955:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701322112:12345-0@lo:502:llog_process_th.0 Request processed in 998us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.617966:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787398114.618068:0:107308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701322112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787398114.618106:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.618118:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.618126:0:107308:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787398114.618133:0:107308:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787398114.618135:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787398114.618148:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89a703c8b380) 00000020:00000080:2.0:1787398114.618169:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1787398114.618176:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787398114.618275:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787398114.618284:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193e61 00000020:00000080:2.0:1787398114.618851:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787398114.618857:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.618861:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.618863:0:107308:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787398114.618866:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.618869:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.618871:0:107308:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787398114.618874:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787398114.618899:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89a703c88000) 00000020:00000080:2.0:1787398114.618915:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1787398114.618920:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787398114.618921:0:107308:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787398114.618924:0:107308:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787398114.618930:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787398114.618976:0:107308:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b29000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787398114.618988:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89a703c899c0) 00000020:00000080:2.0:1787398114.618999:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1787398114.619055:0:107308:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787398114.619061:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193e76 00000020:00000080:2.0:1787398114.619178:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787398114.619185:0:107308:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787398114.619190:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x274786fe0d193e7d 00080000:01000000:2.0:1787398114.619196:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787398114.619200:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193e84 00010000:00010000:0.0:1787398114.729342:0:107308:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1787398114.729488:0:107308:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 124554051602 lx: 0 gen 24 00000001:00080000:0.0:1787398114.729794:0:107308:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 120259084474 srv lr: 124554051602 lx: 0 gen 23 00000001:00000004:0.0:1787398114.730814:0:107308:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 124554051602 00000001:00080000:0.0:1787398114.730963:0:107308:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1787398114.731022:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8030c8540: xid 1874218681351552, transno 124554051621, client gen 23, slot idx 0 00000001:00080000:0.0:1787398114.731034:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8030c8e40: xid 1874218681350912, transno 124554051619, client gen 23, slot idx 1 00000001:00080000:0.0:1787398114.731039:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8030c8840: xid 1874218701300480, transno 124554051624, client gen 24, slot idx 2 00000001:00080000:0.0:1787398114.731044:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8030c8780: xid 1874218701300864, transno 124554051625, client gen 24, slot idx 3 00000001:00080000:0.0:1787398114.731048:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a8030c8180: xid 1874218701300224, transno 124554051623, client gen 24, slot idx 4 00000001:00080000:0.0:1787398114.731053:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a81147e840: xid 1874218681263744, transno 120259084425, client gen 23, slot idx 5 00000001:00080000:0.0:1787398114.731057:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a81147ef00: xid 1874218681259008, transno 120259084409, client gen 23, slot idx 6 00000001:00080000:0.0:1787398114.731062:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a81147ec00: xid 1874218681260160, transno 120259084412, client gen 23, slot idx 7 00000001:00080000:0.0:1787398114.731067:0:107308:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff89a81147e780: xid 1874218681254912, transno 120259084393, client gen 23, slot idx 8 00000020:00000080:0.0:1787398114.731813:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89a82e4fb380) 00000020:00000080:0.0:1787398114.731839:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1787398114.731929:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787398114.731937:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193ea0 00000020:00000080:0.0:1787398114.735048:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787398114.744186:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x274786fe0d193ea7 00000020:00000080:0.0:1787398114.744842:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787398114.744855:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.744861:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.744864:0:107308:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787398114.744867:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398114.744869:0:107308:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787398114.744870:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.744872:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.744873:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398114.744875:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.744877:0:107308:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398114.744890:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.744895:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.744896:0:107308:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787398114.744901:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787398114.744941:0:107308:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787398114.744958:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.744961:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.744962:0:107308:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787398114.744964:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398114.744967:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.744968:0:107308:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787398114.744970:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787398114.744976:0:107308:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:0.0:1787398114.745003:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398114.745021:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89a838783380) 00000020:00000080:0.0:1787398114.745039:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1787398114.745044:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787398114.745095:0:107308:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787398114.745100:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787398114.745106:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193eb5 00010000:00080000:0.0:1787398114.745146:0:107308:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a806931000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787398114.747122:0:107308:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1787398114.753011:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787398114.753029:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787398114.753081:0:107308:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787398114.753107:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193ebc 00000100:00080000:0.0:1787398114.753119:0:107308:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398114.753126:0:107308:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398114.753166:0:107308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b74e00 x1874218701322240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398114.753202:0:107308:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787398114.753293:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398114.753298:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.753300:0:107308:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787398114.753303:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398114.753307:0:107308:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787398114.753309:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398114.753311:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00080000:2.0:1787398114.754115:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.754128:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787398114.754132:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398114.754137:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3993 00000100:00080000:2.0:1787398114.754142:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398114.754148:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398114.754168:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd7480 x1874218701322496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398114.754179:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.754183:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.754186:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.754190:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787398114.754191:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398114.754195:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3993 00000100:00080000:2.0:1787398114.754198:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787398114.754202:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398114.754215:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd6d80 x1874218701322624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398114.754225:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.754229:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.754232:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787398114.754236:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787398114.754237:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398114.754241:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3993 00000100:00080000:2.0:1787398114.754251:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787398114.754256:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a836713800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398114.754272:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4a80 x1874218701322752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398114.754315:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787398114.754318:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787398114.754320:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398114.754324:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3993 00000100:00080000:2.0:1787398114.754326:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787398114.754330:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a83879d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398114.754343:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4380 x1874218701323136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398114.754399:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701322368:0@lo:400:kworker.0 00000020:01000000:0.0:1787398114.754437:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398114.754443:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.754445:0:107308:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398114.754449:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787398114.754455:0:107308:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787398114.754460:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398114.754462:0:107308:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787398114.754466:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787398114.754471:0:107308:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000100:00100000:2.0:1787398114.754485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787398114.754499:0:107308:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787398114.754502:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398114.754518:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89a838780000) 00000020:00000080:0.0:1787398114.754555:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787398114.754569:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1787398114.754616:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701323008:0@lo:400:kworker.0 00000004:00080000:0.0:1787398114.754662:0:107308:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787398114.754669:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787398114.754677:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193eca 00010000:00080000:0.0:1787398114.754715:0:107308:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7024b9000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.160@tcp at head 00000100:00100000:2.0:1787398114.754829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.754860:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398114.754867:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701322880:0@lo:400:kworker.0 00000100:00100000:2.0:1787398114.754911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787398114.754982:0:107308:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1787398114.755022:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322368 00000100:00100000:2.0:1787398114.755031:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322368 00000100:00100000:2.0:1787398114.755077:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787398114.755087:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:3649:x1874218701322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398114.755150:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+12:3649:x1874218701322368:12345-0@lo:400:kworker.0 Request processed in 64us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.755169:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787398114.755212:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323008 00000100:00100000:2.0:1787398114.755216:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323008 00000100:00100000:2.0:1787398114.755245:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322880 00000100:00100000:2.0:1787398114.755248:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322880 00000100:00100000:0.0:1787398114.755257:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701322240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787398114.755274:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787398114.755283:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701323008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398114.755300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.755338:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701322496:0@lo:38:kworker.0 00000100:00100000:2.0:1787398114.755340:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701323008:12345-0@lo:400:kworker.0 Request processed in 56us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.755344:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322240 00000100:00100000:3.0:1787398114.755351:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322240 00000100:00100000:2.0:1787398114.755355:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787398114.755375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.755376:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787398114.755383:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787398114.755388:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701322880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398114.755395:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701322240:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787398114.755401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701322624:0@lo:38:kworker.0 00000100:00100000:2.0:1787398114.755434:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701322880:12345-0@lo:400:kworker.0 Request processed in 49us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398114.755437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.755446:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787398114.755461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701322752:0@lo:38:kworker.0 00010000:00080000:3.0:1787398114.755497:0:99650:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a706d32000, cookie 0x274786fe0d193da4 00000100:00100000:0.0:1787398114.755971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.755985:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701323136:0@lo:38:kworker.0 00000100:00100000:0.0:1787398114.756008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.756056:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322496 00000100:00100000:0.0:1787398114.756061:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322496 00000100:00100000:0.0:1787398114.756078:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322624 00000100:00100000:0.0:1787398114.756081:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322624 00000100:00100000:0.0:1787398114.756089:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323136 00000100:00100000:0.0:1787398114.756091:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323136 00000100:00100000:0.0:1787398114.756102:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787398114.756107:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701322496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787398114.756151:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701322496:12345-0@lo:38:kworker.0 Request processed in 43us (779us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787398114.756158:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787398114.756172:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787398114.756186:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701322624:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787398114.756222:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701322624:12345-0@lo:38:kworker.0 Request processed in 36us (786us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787398114.756229:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787398114.756243:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787398114.756248:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701323136:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787398114.756279:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701323136:12345-0@lo:38:kworker.0 Request processed in 31us (270us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787398114.756285:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787398114.756337:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.756342:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787398114.756346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701322496:0@lo:38:kworker.0 00000100:00080000:0.0:1787398114.756359:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.756363:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787398114.756366:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701322624:0@lo:38:kworker.0 00000100:00100000:0.0:1787398114.756376:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787398114.756380:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398114.756383:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787398114.756386:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701323136:0@lo:38:kworker.0 00000100:00100000:2.0:1787398114.756869:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701322880:0@lo:400:kworker.0 00000100:00100000:2.0:1787398114.756901:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701323008:0@lo:400:kworker.0 00000100:00100000:2.0:1787398114.756950:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701322368:0@lo:400:kworker.0 00000040:01000000:0.0:1787398114.756965:0:107308:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787398114.756993:0:107308:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787398114.757324:0:107308:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:0.0:1787398114.758065:0:107308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787398114.758094:0:107308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].30, 64 off10112 00000100:00100000:1.0:1787398114.761546:0:99649:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 2 min 2 max 16 00000100:00100000:1.0:1787398114.761561:0:99649:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_002' 00000100:00100000:3.0:1787398114.762256:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701322240:12345-0@lo:38:llog_process_th.0 Request processed in 6858us (6950us total) trans 0 rc -114/-114 00000100:00100000:3.0:1787398114.762278:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787398114.762303:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701322752 00000100:00100000:3.0:1787398114.762310:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701322752 00000100:00100000:3.0:1787398114.762330:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787398114.762336:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701322752:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787398114.762383:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701322752:12345-0@lo:38:kworker.0 Request processed in 47us (6414us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787398114.762389:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:02020000:3.0:1787398114.762689:0:3647:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_connect to node 0@lo failed: rc = -114 00000100:00100000:3.0:1787398114.762694:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398114.762702:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398114.762707:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-114) 00000100:00100000:3.0:1787398114.762710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701322240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787398114.762720:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398114.762723:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398114.762726:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787398114.762728:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701322752:0@lo:38:kworker.0 00000040:00080000:0.0:1787398114.764236:0:107308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x78:0x0].1, 64 off8256 00000040:00080000:2.0:1787398114.766294:0:107322:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:2.0:1787398114.766301:0:107322:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787398114.766812:0:107322:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 29, last_idx 30 00000040:00080000:2.0:1787398114.766839:0:107322:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1787398114.766990:0:107322:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:2.0:1787398114.766994:0:107322:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x78:0x0] at index 30 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787398114.771104:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787398114.771121:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787398114.771182:0:107308:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787398114.771212:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193ed1 00000100:00080000:1.0:1787398114.771222:0:107308:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398114.771228:0:107308:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89a7024b9000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398114.771265:0:107308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8e00 x1874218701323264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398114.771296:0:107308:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787398114.771355:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398114.771360:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.771362:0:107308:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787398114.771365:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398114.771367:0:107308:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787398114.771369:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.771370:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398114.771372:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398114.771374:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.771376:0:107308:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398114.771378:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787398114.771382:0:107308:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787398114.771385:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398114.771386:0:107308:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787398114.771388:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398114.771398:0:107308:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787398114.771422:0:107308:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787398114.771425:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398114.771435:0:107308:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89a7024799c0) 00000020:00000080:1.0:1787398114.771451:0:107308:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787398114.771455:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787398114.771514:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701323264:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787398114.771563:0:107308:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787398114.771571:0:107308:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787398114.771578:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x274786fe0d193edf 00000100:00100000:3.0:1787398114.771608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787398114.771610:0:107308:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a829b1b000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398114.771969:0:107308:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1787398114.772041:0:107308:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398114.772057:0:107308:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787398114.772901:0:107308:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000100:00080000:3.0:1787398114.772955:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.772961:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787398114.772965:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398114.772968:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787398114.773561:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323264 00000100:00100000:3.0:1787398114.773577:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323264 00000100:00100000:3.0:1787398114.773615:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787398114.773624:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218701323264:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787398114.773655:0:101069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1787398114.773681:0:101069:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193ee6 00002000:00100000:3.0:1787398114.773696:0:101069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89a817eff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787398114.773700:0:101069:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787398114.773703:0:101069:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787398114.773748:0:101069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787398114.773772:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a817efd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398114.773850:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701323264:12345-0@lo:8:llog_process_th.0 Request processed in 225us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.773858:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787398114.773918:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398114.773929:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1787398114.773937:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787398114.773943:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787398114.773946:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7024b9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787398114.773970:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787398114.773977:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701323264:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787398114.774066:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701323392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398114.774104:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.774149:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323392 00000100:00100000:3.0:1787398114.774153:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323392 00000004:00080000:0.0:1787398114.774156:0:107322:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787398114.774199:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787398114.774208:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701323392:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787398114.774228:0:107322:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3994064704745ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787398114.774235:0:107322:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00000024:3.0:1787398114.774239:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398114.774279:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701323392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.774286:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1787398114.774307:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398114.774334:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701323392:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787398114.776309:0:107308:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398114.776346:0:107308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].30, 64 off10112 00000040:00080000:1.0:1787398114.778057:0:107308:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7a:0x0].1, 64 off8256 00000004:00080000:0.0:1787398114.779148:0:107260:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1787398114.788386:0:107326:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:0.0:1787398114.788396:0:107326:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787398114.789268:0:107308:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787398114.789287:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787398114.789334:0:107308:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787398114.789364:0:107308:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193eed 00000100:00080000:2.0:1787398114.789375:0:107308:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787398114.789380:0:107308:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89a829b1b000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398114.789419:0:107308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5880 x1874218701323520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398114.789444:0:107308:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787398114.789468:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.789472:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787398114.789475:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398114.789478:0:65702:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1787398114.789569:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.789574:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.789576:0:107308:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787398114.789579:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.789583:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.789584:0:107308:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787398114.789587:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787398114.789589:0:107308:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787398114.789591:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.789593:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.789594:0:107308:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787398114.789597:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.789599:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.789600:0:107308:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787398114.789604:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787398114.789609:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.789612:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.789619:0:107308:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1787398114.789623:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787398114.789626:0:107308:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #41 00000020:01000000:2.0:1787398114.789628:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398114.789629:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1787398114.789669:0:107308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701323648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787398114.790207:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701323520:0@lo:8:llog_process_th.0 00000040:00080000:1.0:1787398114.792059:0:107326:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 29, last_idx 30 00000040:00080000:1.0:1787398114.792089:0:107326:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1787398114.792254:0:107326:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:1.0:1787398114.792259:0:107326:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x7a:0x0] at index 30 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1787398114.793938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398114.794613:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323520 00000100:00100000:1.0:1787398114.794624:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323520 00000100:00100000:1.0:1787398114.794682:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787398114.794693:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1874218701323520:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787398114.794753:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:1.0:1787398114.794785:0:100418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x274786fe0d193ef4 00002000:00100000:1.0:1787398114.794799:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89a829b1e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787398114.794803:0:100418:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787398114.794812:0:100418:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787398114.794895:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787398114.794926:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a829b1c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398114.795003:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701323520:12345-0@lo:8:llog_process_th.0 Request processed in 310us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398114.795011:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787398114.795862:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398114.795874:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787398114.795895:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787398114.795901:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787398114.795905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a829b1b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787398114.795962:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787398114.795970:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701323520:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787398114.797516:0:107308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.797626:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323648 00000100:00100000:2.0:1787398114.797635:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323648 00000100:00100000:2.0:1787398114.797681:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787398114.797689:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701323648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.798017:0:107308:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398114.800272:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701323776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398114.800381:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701323648:12345-0@lo:502:llog_process_th.0 Request processed in 2689us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.800394:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787398114.800472:0:107308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701323648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787398114.800556:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787398114.800567:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.800569:0:107308:0:(obd_config.c:1561:class_process_config()) marker 41 (0x6) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1787398114.800575:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787398114.800580:0:107308:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:2.0:1787398114.800582:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398114.800584:0:107308:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398114.800585:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787398114.800588:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.800590:0:107308:0:(obd_config.c:1561:class_process_config()) marker 44 (0x6) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1787398114.800593:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.800596:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.800597:0:107308:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1787398114.800605:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:2.0:1787398114.800627:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.800629:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.800631:0:107308:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1787398114.800633:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.800636:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.800637:0:107308:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1787398114.800640:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1787398114.800673:0:107308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701323904:0@lo:502:llog_process_th.0 00000004:00080000:1.0:1787398114.800690:0:107326:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787398114.800806:0:107326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3994091283458ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787398114.800814:0:107326:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787398114.803416:0:107260:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787398114.807844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.807942:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323776 00000100:00100000:3.0:1787398114.807956:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323776 00000100:00100000:3.0:1787398114.808043:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787398114.808055:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a705a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701323776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398114.808099:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398114.808188:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a705a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701323776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398114.808195:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787398114.808903:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398114.809663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701323776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398114.812480:0:107308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.812567:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701323904 00000100:00100000:2.0:1787398114.812576:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701323904 00000100:00100000:2.0:1787398114.812620:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787398114.812630:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701323904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.812972:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+12:107308:x1874218701323904:12345-0@lo:502:llog_process_th.0 Request processed in 342us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.812980:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787398114.813062:0:107308:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.813089:0:107308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107308:1874218701323904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787398114.813123:0:107308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.813132:0:107308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.813135:0:107308:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1787398114.813140:0:107308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:3.0:1787398114.816006:0:107259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:3.0:1787398114.816045:0:107259:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787398114.816075:0:107259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e53 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.816090:0:107259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63200/0x274786fe0d193e4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e53 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398114.816100:0:107259:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a829b29000 from 1 10000000:01000000:3.0:1787398114.816103:0:107259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787398114.816144:0:107259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.816153:0:107259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.816163:0:107259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398114.816189:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787398114.816264:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398114.816313:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.816581:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324032 00000100:00100000:2.0:1787398114.816590:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324032 00000100:00100000:2.0:1787398114.816637:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787398114.816647:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+12:107259:x1874218701324032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.816663:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398114.816677:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193efb expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.816713:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193efb expref: 13 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.816724:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193efb expref: 13 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.816732:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74600, rc 0) 00000100:00100000:2.0:1787398114.816809:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+13:107259:x1874218701324032:12345-0@lo:101:mount.lustre.0 Request processed in 163us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.816817:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787398114.817949:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398114.817973:0:107259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398114.817984:0:107259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398114.818603:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324160:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787398114.818668:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.818780:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324160 00000100:00100000:3.0:1787398114.818845:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704f3da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.818963:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324160 00000100:00100000:2.0:1787398114.819019:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787398114.819029:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:107259:x1874218701324160:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787398114.819050:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787398114.819070:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787398114.819074:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787398114.819078:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787398114.819080:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 136 00000100:00100000:2.0:1787398114.819209:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+13:107259:x1874218701324160:12345-0@lo:256:mount.lustre.0 Request processed in 181us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.819217:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787398114.819380:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324160:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787398114.821726:0:107259:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787398114.821765:0:107259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822011:0:107259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398114.822024:0:107259:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a829b29000 from 1 10000000:01000000:2.0:1787398114.822027:0:107259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787398114.822074:0:107259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822082:0:107259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822094:0:107259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.822262:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398114.822339:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.822473:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.822498:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324288 00000100:00100000:2.0:1787398114.822507:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324288 00000100:00100000:2.0:1787398114.822599:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787398114.822611:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+13:107259:x1874218701324288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.822706:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398114.822721:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75400/0x274786fe0d193f10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f09 expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822744:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75400/0x274786fe0d193f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f09 expref: 14 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822765:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75400/0x274786fe0d193f10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f09 expref: 14 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.822774:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75400, rc 0) 00000100:00100000:2.0:1787398114.823082:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324288:12345-0@lo:101:mount.lustre.0 Request processed in 471us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.823090:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787398114.824607:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.824697:0:107259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f10 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.824709:0:107259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f10 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.825172:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.825228:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.825275:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.825296:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324416 00000100:00100000:2.0:1787398114.825302:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324416 00000100:00100000:2.0:1787398114.825339:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787398114.825347:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.825899:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324416:12345-0@lo:501:mount.lustre.0 Request processed in 549us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.825909:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787398114.826108:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.826162:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.826292:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.826320:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.826336:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324544 00000100:00100000:2.0:1787398114.826339:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324544 00000100:00100000:2.0:1787398114.826365:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787398114.826372:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.826597:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324544:12345-0@lo:503:mount.lustre.0 Request processed in 224us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.826605:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787398114.826724:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.827678:0:107330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107330:1874218701324672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.827732:0:107330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.827770:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324672 00000100:00100000:2.0:1787398114.827775:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324672 00000100:00100000:2.0:1787398114.828074:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787398114.828085:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:107330:x1874218701324672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.828229:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+14:107330:x1874218701324672:12345-0@lo:502:llog_process_th.0 Request processed in 145us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.828237:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787398114.829084:0:107330:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.829115:0:107330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107330:1874218701324672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787398114.829240:0:107330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.829251:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.829261:0:107330:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787398114.829270:0:107330:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a829b29000 00000020:00000080:2.0:1787398114.829274:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787398114.829283:0:107330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.829286:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.829288:0:107330:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787398114.829291:0:107330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398114.829294:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.829296:0:107330:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787398114.829301:0:107330:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a829b29000 00000020:00000080:2.0:1787398114.829304:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787398114.829405:0:107330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107330:1874218701324800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.829464:0:107330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.829503:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324800 00000100:00100000:2.0:1787398114.829508:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324800 00000100:00100000:2.0:1787398114.829708:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787398114.829719:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:107330:x1874218701324800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.830111:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:107330:x1874218701324800:12345-0@lo:502:llog_process_th.0 Request processed in 392us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.830120:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787398114.830459:0:107330:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.830479:0:107330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107330:1874218701324800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787398114.830512:0:107330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398114.830556:0:107330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398114.830559:0:107330:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787398114.830563:0:107330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787398114.830633:0:107259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1787398114.830653:0:107259:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787398114.830677:0:107259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f10 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.830696:0:107259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74a00/0x274786fe0d193f09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f10 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398114.830742:0:107259:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787398114.830745:0:107259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a829b29000 10000000:01000000:2.0:1787398114.830748:0:107259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a829b29000 10000000:01000000:2.0:1787398114.830752:0:107259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787398114.830759:0:107259:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a829b29000 from 1 10000000:01000000:2.0:1787398114.830762:0:107259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787398114.830791:0:107259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.830800:0:107259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.830808:0:107259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.830839:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398114.830872:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.830912:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.830927:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701324928 00000100:00100000:2.0:1787398114.830931:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701324928 00000100:00100000:2.0:1787398114.830958:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787398114.830967:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+14:107259:x1874218701324928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.830977:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398114.830989:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74800/0x274786fe0d193f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f17 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.831028:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74800/0x274786fe0d193f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f17 expref: 15 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.831041:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74800/0x274786fe0d193f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f17 expref: 15 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.831052:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74800, rc 0) 00000100:00100000:2.0:1787398114.831088:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701324928:12345-0@lo:101:mount.lustre.0 Request processed in 122us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.831096:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787398114.831135:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701324928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398114.831148:0:107259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f1e expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.831159:0:107259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f1e expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.831204:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.831231:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.831252:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70367f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.831266:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325056 00000100:00100000:2.0:1787398114.831270:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325056 00000100:00100000:2.0:1787398114.831294:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787398114.831300:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.831429:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325056:12345-0@lo:501:mount.lustre.0 Request processed in 129us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.831444:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787398114.831479:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398114.831505:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.831570:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.831591:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.831603:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325184 00000100:00100000:2.0:1787398114.831607:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325184 00000100:00100000:2.0:1787398114.831628:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787398114.831633:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398114.831702:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325184:12345-0@lo:503:mount.lustre.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.831709:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787398114.831744:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787398114.833854:0:107331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787398114.833938:0:107331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.833985:0:107331:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80819c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.834195:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325312 00000100:00100000:2.0:1787398114.834204:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325312 00000100:00100000:2.0:1787398114.834253:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787398114.834264:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.834425:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325312:12345-0@lo:502:llog_process_th.0 Request processed in 163us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.834435:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787398114.834843:0:107331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325312:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787398114.834915:0:107331:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787398114.834932:0:107331:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89a7069219c0) 00000020:00000080:0.0:1787398114.834958:0:107331:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787398114.835147:0:107331:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a829b29000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787398114.835152:0:107331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a829b29000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787398114.835154:0:107331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a829b29000 4 00010000:00080000:0.0:1787398114.835185:0:107331:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a838262800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787398114.843913:0:107331:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1787398114.844083:0:107331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787398114.844132:0:107331:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787398114.844148:0:107331:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x274786fe0d193f2c 00000100:00080000:0.0:1787398114.844160:0:107331:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398114.844166:0:107331:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a838262800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398114.844208:0:107331:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827b77480 x1874218701325440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398114.844242:0:107331:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787398114.844271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.844284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787398114.844287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398114.844290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787398114.844564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701325440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787398114.844640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.844686:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325440 00000100:00100000:0.0:1787398114.844694:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325440 00000100:00100000:0.0:1787398114.844902:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787398114.844910:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701325440:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787398114.844980:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701325440:12345-0@lo:38:llog_process_th.0 Request processed in 68us (339us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787398114.844988:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787398114.844998:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398114.845007:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a838262800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398114.845011:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787398114.845016:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701325440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787398114.864359:0:107331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787398114.864451:0:107331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398114.864510:0:107331:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80819c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.864806:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325568 00000100:00100000:2.0:1787398114.864815:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325568 00000100:00100000:2.0:1787398114.864866:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787398114.864884:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.865050:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325568:12345-0@lo:502:llog_process_th.0 Request processed in 174us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.865058:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787398114.865130:0:107331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.865265:0:107331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.865310:0:107331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.865339:0:107331:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.865425:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325696 00000100:00100000:2.0:1787398114.865430:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325696 00000100:00100000:2.0:1787398114.865457:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787398114.865465:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787398114.865641:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:107331:x1874218701325696:12345-0@lo:502:llog_process_th.0 Request processed in 177us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.865648:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787398114.865686:0:107331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99b57a74-e5dc-42df-b087-b10fad741506:107331:1874218701325696:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787398114.865706:0:107331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1787398114.865861:0:107259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1787398114.865896:0:107259:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787398114.865913:0:107259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f1e expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.865925:0:107259:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75c00/0x274786fe0d193f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f1e expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787398114.865987:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787398114.865995:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787398114.865997:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398114.865998:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398114.866000:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398114.866002:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398114.866003:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398114.866005:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787398114.866007:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398114.866009:0:107259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787398114.866014:0:107259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787398114.866017:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787398114.866018:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787398114.866020:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398114.866022:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398114.866023:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398114.866024:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398114.866026:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398114.866027:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787398114.866028:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398114.866029:0:107259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787398114.866043:0:107259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787398114.866052:0:107259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787398114.866096:0:107259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.866133:0:107259:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82ee16a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.866307:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325824 00000100:00100000:2.0:1787398114.866313:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325824 00000100:00100000:2.0:1787398114.866421:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787398114.866433:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787398114.866455:0:107283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787398114.866472:0:107283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787398114.877831:0:107283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787398114.877847:0:107283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787398114.879663:0:107285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787398114.879673:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787398114.879698:0:107285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.879728:0:107285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193efb expref: 15 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.879737:0:107285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.879778:0:107285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 15 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.879792:0:107285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 15 pid: 107280 timeout: 4094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.879806:0:107285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701325952:0@lo:104: 00000100:00100000:2.0:1787398114.879902:0:107285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.879960:0:107285:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a81a9af540 going to sleep for 11 seconds 00000100:00100000:2.0:1787398114.879991:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787398114.880022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701325952 00000100:00100000:2.0:1787398114.880030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701325952 00000100:00100000:2.0:1787398114.880079:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1787398114.880089:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701325952:12345-0@lo:104: 00010000:00010000:2.0:1787398114.880104:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880160:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787398114.880167:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703765450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701325952:12345-0@lo:104: Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.880174:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:2.0:1787398114.880249:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398114.880262:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880270:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abe00 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398114.880274:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880283:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398114.880291:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398114.880297:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787398114.880326:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880333:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398114.880353:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880359:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050abe00/0x274786fe0d193efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f02 expref: -99 pid: 107259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880372:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398114.880374:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398114.880376:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398114.880397:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701326080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398114.880428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398114.880479:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326080 00000100:00100000:2.0:1787398114.880489:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326080 00010000:00010000:2.0:1787398114.880509:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 16 pid: 107280 timeout: 4094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.880561:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1787398114.880569:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701326080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398114.880580:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398114.880586:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 16 pid: 107280 timeout: 4094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880597:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 16 pid: 107280 timeout: 4094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880616:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880625:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787398114.880640:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001215748s 00010000:00010000:2.0:1787398114.880644:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880652:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880658:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880665:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880682:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398114.880687:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880694:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880702:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.880712:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398114.880744:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+16:3650:x1874218701326080:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.880750:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1787398114.880791:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701326080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398114.881351:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:107259:x1874218701325824:12345-0@lo:253:mount.lustre.0 Request processed in 14920us (15255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398114.881364:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787398114.881426:0:107259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:107259:1874218701325824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787398114.881440:0:107259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787398114.881444:0:107259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787398114.881446:0:107259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787398114.881447:0:107259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787398114.881448:0:107259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787398114.881449:0:107259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787398114.881451:0:107259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787398114.881452:0:107259:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787398114.881454:0:107259:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787398114.881456:0:107259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787398114.881463:0:107259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787398114.881476:0:107259:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787398114.882464:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74600/0x274786fe0d193f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d193efb expref: 14 pid: 107280 timeout: 4094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398114.882482:0:107285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701325952:0@lo:104: 00010000:00010000:2.0:1787398114.882725:0:107285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.882737:0:107285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.882743:0:107285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398114.882749:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74000/0x274786fe0d193f33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787398114.904231:0:107259:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444068 00000040:01000000:0.0:1787398114.904666:0:107259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787398114.904698:0:107344:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444068 00000020:00080000:1.0:1787398114.904702:0:107344:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444068 00000040:01000000:1.0:1787398114.904960:0:107345:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787398114.905064:0:107259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787398114.905318:0:107345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1787398114.905968:0:107346:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff89a827b76a00 x1874218701326208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398114.905983:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00000040:01000000:3.0:1787398114.906423:0:107259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787398114.906463:0:107259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787398114.907267:0:107259:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787398114.907280:0:107259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787398114.907328:0:107259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398114.908734:0:107259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787398114.909832:0:107259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:1.0:1787398114.913613:0:107345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787398114.913686:0:107345:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787398114.916726:0:107259:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787398114.920732:0:107259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787398114.922009:0:107259:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/32) registered 00010000:00080000:0.0:1787398114.924257:0:107259:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 124554051625 00010000:00080000:0.0:1787398114.925446:0:107348:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 107348 00010000:02000000:0.0:1787398114.925463:0:107348:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1787398114.925467:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787398114.925470:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1787398114.926606:0:107259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787398114.926629:0:107259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787398114.926654:0:107259:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787398114.926686:0:107259:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787398114.927666:0:107259:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787398114.927866:0:107259:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787398115.177448:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398115.403831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398115.404025:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681360768 00000100:00100000:2.0:1787398115.404036:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681360768 00000100:00100000:2.0:1787398115.404103:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:2.0:1787398115.404112:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+5:70888:x1874218681360768:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.404128:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398115.404147:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88c6 expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.404176:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 6 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.404186:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 6 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.404203:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74200, rc 0) 00000100:00100000:2.0:1787398115.404260:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681360768:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 149us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.404268:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 49 00000100:00100000:1.0:1787398115.407485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398115.409150:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681360896 00000100:00100000:2.0:1787398115.409163:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681360896 00000100:00100000:2.0:1787398115.409217:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787398115.409226:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681360896:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787398115.409252:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1787398115.409267:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787398115.409270:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1787398115.409273:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1787398115.409276:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1787398115.409279:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 137 00000100:00100000:3.0:1787398115.413492:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681360896:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 4247us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.413509:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:3.0:1787398115.416327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398115.416369:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361024 00000100:00100000:3.0:1787398115.416385:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361024 00000100:00100000:3.0:1787398115.416438:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787398115.416446:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681361024:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1787398115.416477:0:107265:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a836495800, cookie 0x274786fe0d193e92 00010000:00080000:3.0:1787398115.416483:0:107265:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t124554051626 exp ffff89a836495800 cur 3994 last 1787398114 00010000:02000400:3.0:1787398115.416504:0:107265:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1787398115.416510:0:107265:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1787398115.416545:0:107265:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787398115.416686:0:107265:0:(import.c:65:import_set_state_nolock()) ffff89a817efd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398115.416757:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681361024:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 Request processed in 309us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.416765:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787398115.420095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398115.420180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398115.420442:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361152 00000100:00100000:0.0:1787398115.420454:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361152 00000100:00100000:0.0:1787398115.420505:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:0.0:1787398115.420514:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+6:70888:x1874218681361152:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.420552:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398115.420571:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74400/0x274786fe0d193f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88cd expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.420601:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74400/0x274786fe0d193f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88cd expref: 7 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.420613:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74400/0x274786fe0d193f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88cd expref: 7 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.420622:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74400, rc 0) 00000100:00100000:0.0:1787398115.420674:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681361152:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 161us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.420682:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:1.0:1787398115.422287:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352320 00000100:00100000:1.0:1787398115.422298:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352320 00000100:00100000:1.0:1787398115.422351:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787398115.422361:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681352320:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:1.0:1787398115.422384:0:107264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 124554051626, current: 124554051626, replaying 00000100:00100000:1.0:1787398115.422405:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681352320:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 46us (2225us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398115.422412:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00010000:00080000:0.0:1787398115.422570:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1787398115.427824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398115.427879:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361280 00000100:00100000:1.0:1787398115.427888:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361280 00000100:00100000:1.0:1787398115.427952:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:1.0:1787398115.427962:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+7:70888:x1874218681361280:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.428127:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681361280:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 166us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.428135:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 52 00000100:00100000:0.0:1787398115.431191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398115.431790:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361408 00000100:00100000:1.0:1787398115.431803:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361408 00000100:00100000:1.0:1787398115.432133:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:1.0:1787398115.432145:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681361408:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.432323:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681361408:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 179us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.432332:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 53 00000100:00100000:3.0:1787398115.448201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398115.448682:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361536 00000100:00100000:0.0:1787398115.448698:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361536 00000100:00100000:0.0:1787398115.448761:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:0.0:1787398115.448771:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+8:70888:x1874218681361536:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.448796:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398115.448824:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75c00/0x274786fe0d193f48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88d4 expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.448888:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75c00/0x274786fe0d193f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88d4 expref: 9 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.448900:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75c00/0x274786fe0d193f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88d4 expref: 9 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.448909:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75c00, rc 0) 00000100:00100000:0.0:1787398115.448980:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361536:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 210us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.448986:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:0.0:1787398115.457048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398115.457301:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361664 00000100:00100000:1.0:1787398115.457311:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361664 00000100:00100000:1.0:1787398115.457370:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:1.0:1787398115.457381:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361664:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.457576:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361664:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 195us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.457584:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:0.0:1787398115.466364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398115.466408:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361792 00000100:00100000:0.0:1787398115.466422:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361792 00000100:00100000:0.0:1787398115.466473:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:0.0:1787398115.466482:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361792:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.466645:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361792:12345-192.168.204.60@tcp:503:ll_cfg_requeue.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.466653:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:3.0:1787398115.474040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398115.474134:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681361920 00000100:00100000:2.0:1787398115.474145:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681361920 00000100:00100000:2.0:1787398115.474196:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:2.0:1787398115.474207:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681361920:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.474223:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398115.474241:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75800/0x274786fe0d193f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88db expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.474268:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75800/0x274786fe0d193f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88db expref: 10 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.474280:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75800/0x274786fe0d193f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88db expref: 10 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.474295:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75800, rc 0) 00000100:00100000:2.0:1787398115.474350:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681361920:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.474358:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 57 00000100:00100000:3.0:1787398115.476595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398115.477187:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362048 00000100:00100000:0.0:1787398115.477205:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362048 00000100:00100000:0.0:1787398115.477267:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:0.0:1787398115.477278:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681362048:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.477426:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681362048:12345-192.168.204.60@tcp:501:ll_cfg_requeue.0 Request processed in 148us (840us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787398115.477449:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 58 00000100:00100000:2.0:1787398115.621667:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 10000000:01000000:2.0:1787398115.877618:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787398115.877636:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a829b29000 from 137 10000000:01000000:2.0:1787398115.877641:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787398115.877689:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.877701:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.877712:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.877737:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.877800:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.877850:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787398115.878356:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326336 00000100:00100000:0.0:1787398115.878365:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326336 00000100:00100000:0.0:1787398115.878461:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787398115.878480:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+14:6519:x1874218701326336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.878494:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398115.878509:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f56 expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.878558:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f56 expref: 15 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.878569:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f56 expref: 15 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.878577:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75a00, rc 0) 00000100:00100000:0.0:1787398115.878636:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701326336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.878642:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787398115.878734:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.878750:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.878759:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.878826:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.878874:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.879171:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.879252:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326464 00000100:00100000:1.0:1787398115.879258:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326464 00000100:00100000:1.0:1787398115.879283:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787398115.879290:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701326464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787398115.879306:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787398115.879322:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787398115.879330:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 137 00000100:00100000:1.0:1787398115.879408:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701326464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.879415:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787398115.879460:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787398115.879549:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787398115.879556:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879566:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398115.879575:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787398115.879577:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a827b3e000 from 136 10000000:01000000:1.0:1787398115.879580:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787398115.879600:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879608:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879617:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398115.879729:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.879755:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.879773:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.879783:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326592 00000100:00100000:1.0:1787398115.879786:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326592 00000100:00100000:1.0:1787398115.879808:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787398115.879813:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+15:6519:x1874218701326592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398115.879819:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398115.879828:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e62600/0x274786fe0d193f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f64 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879842:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e62600/0x274786fe0d193f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f64 expref: 16 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879851:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e62600/0x274786fe0d193f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f64 expref: 16 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.879868:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e62600, rc 0) 00000100:00100000:1.0:1787398115.879897:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701326592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.879902:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787398115.880004:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398115.880015:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880024:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398115.880061:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.880090:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.880102:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a83642d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.880113:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326720 00000100:00100000:1.0:1787398115.880117:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326720 00000100:00100000:1.0:1787398115.880140:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787398115.880158:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701326720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787398115.880169:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787398115.880181:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787398115.880184:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787398115.880186:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 137 00000100:00100000:1.0:1787398115.880247:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701326720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.880254:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787398115.880282:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787398115.880319:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787398115.880325:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880333:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398115.880340:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787398115.880342:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a83ae93000 from 64 10000000:01000000:1.0:1787398115.880344:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787398115.880359:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880366:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880372:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398115.880384:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.880414:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.880426:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8346a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.880437:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326848 00000100:00100000:1.0:1787398115.880441:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326848 00000100:00100000:1.0:1787398115.880456:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787398115.880462:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+16:6519:x1874218701326848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398115.880710:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398115.880722:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a835e63a00/0x274786fe0d193f79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f72 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880737:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a835e63a00/0x274786fe0d193f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f72 expref: 17 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880745:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a835e63a00/0x274786fe0d193f79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f72 expref: 17 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880752:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63a00, rc 0) 00000100:00100000:1.0:1787398115.880785:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701326848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.880791:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787398115.880818:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398115.880827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.880835:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398115.880995:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.881028:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.881050:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8346a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.881062:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326976 00000100:00100000:1.0:1787398115.881065:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326976 00000100:00100000:1.0:1787398115.881084:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398115.881090:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701326976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.881313:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701326976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.881320:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398115.881348:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701326976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.881377:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.881417:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.881430:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8346a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.881442:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327104 00000100:00100000:1.0:1787398115.881445:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327104 00000100:00100000:1.0:1787398115.881462:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787398115.881468:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701327104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.881843:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701327104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 373us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.881850:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787398115.882040:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787398115.885285:0:107436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1787398115.885736:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1787398115.885766:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787398115.885779:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.885792:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63c00/0x274786fe0d193f72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398115.885867:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787398115.885871:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787398115.885875:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787398115.885938:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.885948:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.885959:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.885987:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.886061:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.886105:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398115.889555:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327232 00000100:00100000:0.0:1787398115.889570:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327232 00000100:00100000:2.0:1787398115.889779:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787398115.889793:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+17:6519:x1874218701327232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.889810:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398115.889828:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe75a00/0x274786fe0d193f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f80 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.889866:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe75a00/0x274786fe0d193f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f80 expref: 18 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.889878:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe75a00/0x274786fe0d193f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f80 expref: 18 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.889894:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe75a00, rc 0) 00000100:00100000:2.0:1787398115.890058:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.890065:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787398115.890318:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.890336:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.890346:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398115.890421:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.890453:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398115.890504:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702661a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787398115.890742:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327360 00000100:00100000:0.0:1787398115.890748:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327360 00000100:00100000:0.0:1787398115.890779:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787398115.890786:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.891156:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.891165:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787398115.891979:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.892573:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.896118:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.896173:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787398115.896321:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327488 00000100:00100000:1.0:1787398115.896329:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327488 00000100:00100000:1.0:1787398115.896377:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787398115.896385:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.898292:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1900us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398115.898310:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787398115.898421:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787398115.899491:0:107438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1787398115.904271:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1787398115.904332:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787398115.904345:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904356:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe74000/0x274786fe0d193f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398115.904365:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787398115.904368:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a83ae93000 from 7 10000000:01000000:2.0:1787398115.904370:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787398115.904411:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904419:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904430:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.904456:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.904584:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.904651:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327616 00000100:00100000:2.0:1787398115.904658:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327616 00000100:00100000:2.0:1787398115.904703:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787398115.904713:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+18:6519:x1874218701327616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.904726:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398115.904740:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a80fe74e00/0x274786fe0d193f95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f8e expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904763:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a80fe74e00/0x274786fe0d193f95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f8e expref: 19 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904772:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a80fe74e00/0x274786fe0d193f95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f8e expref: 19 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.904780:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a80fe74e00, rc 0) 00000100:00100000:2.0:1787398115.904812:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701327616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.904818:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787398115.904871:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398115.904891:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.904904:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.905085:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.905163:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.905200:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.905228:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327744 00000100:00100000:2.0:1787398115.905231:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327744 00000100:00100000:2.0:1787398115.905255:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398115.905261:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701327744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.905371:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701327744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.905383:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787398115.905406:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398115.905418:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.905441:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.905566:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.905587:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701327872 00000100:00100000:2.0:1787398115.905591:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701327872 00000100:00100000:2.0:1787398115.905613:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787398115.905765:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701327872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.905837:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701327872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.905844:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787398115.905884:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398115.905895:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701327872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787398115.907150:0:107439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787398115.907360:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787398115.907380:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787398115.907389:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.907417:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75200/0x274786fe0d193f8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f95 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398115.907426:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787398115.907429:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a8364e2000 from 64 10000000:01000000:2.0:1787398115.907431:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787398115.907462:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.907480:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.907490:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.907513:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.907593:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.907640:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787398115.907804:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328000 00000100:00100000:0.0:1787398115.907811:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328000 00000100:00100000:0.0:1787398115.907868:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787398115.907878:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:6519:x1874218701328000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.907891:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398115.907904:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75800/0x274786fe0d193fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193f9c expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.908040:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75800/0x274786fe0d193fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193f9c expref: 20 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.908050:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75800/0x274786fe0d193fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f9c expref: 20 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.908058:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75800, rc 0) 00000100:00100000:0.0:1787398115.908105:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.908112:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787398115.908250:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787398115.908266:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fa3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.908274:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193fa3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.908326:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.908351:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.908383:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787398115.909037:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328128 00000100:00100000:0.0:1787398115.909044:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328128 00000100:00100000:0.0:1787398115.909084:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787398115.909093:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.909224:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398115.909232:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787398115.909298:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.909333:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.909377:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398115.909401:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a702661a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787398115.909443:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328256 00000100:00100000:2.0:1787398115.909448:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328256 00000100:00100000:2.0:1787398115.909486:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787398115.909494:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.910002:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.910059:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 566us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.910067:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:2.0:1787398115.911227:0:107440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1787398115.913430:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1787398115.913478:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787398115.913491:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fa3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.913502:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a80fe75000/0x274786fe0d193f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fa3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398115.913638:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787398115.913642:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1787398115.913646:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787398115.913687:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.913696:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398115.913706:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.913732:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.913801:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398115.913851:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a705d0b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.914063:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328384 00000100:00100000:3.0:1787398115.914070:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328384 00000100:00100000:3.0:1787398115.914125:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787398115.914134:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:6519:x1874218701328384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.914150:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398115.914166:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab600/0x274786fe0d193fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193faa expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.914189:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab600/0x274786fe0d193fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193faa expref: 21 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.914201:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab600/0x274786fe0d193fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193faa expref: 21 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.914220:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab600, rc 0) 00000100:00100000:3.0:1787398115.914277:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.914285:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787398115.914371:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.914387:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.914396:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193fb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398115.914455:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.914497:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398115.914543:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.915002:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328512 00000100:00100000:3.0:1787398115.915010:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328512 00000100:00100000:3.0:1787398115.915047:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787398115.915054:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.915214:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.915221:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787398115.915256:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.915287:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.915326:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398115.915344:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328640 00000100:00100000:3.0:1787398115.915347:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328640 00000100:00100000:3.0:1787398115.915362:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787398115.915367:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.916218:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ae1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.916403:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1032us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.916411:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787398115.916498:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787398115.917580:0:107442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1787398115.917817:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1787398115.917841:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787398115.917850:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.917873:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a704d22600/0x274786fe0d193faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398115.917893:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787398115.917896:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a8364e2000 from 7 10000000:01000000:0.0:1787398115.917899:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787398115.918012:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.918020:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.918030:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398115.918052:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.918105:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398115.918134:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.918180:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328768 00000100:00100000:3.0:1787398115.918192:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328768 00000100:00100000:3.0:1787398115.918266:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787398115.918275:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:6519:x1874218701328768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.918288:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398115.918300:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050abe00/0x274786fe0d193fbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193fb8 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.918322:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050abe00/0x274786fe0d193fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193fb8 expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.918332:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050abe00/0x274786fe0d193fbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193fb8 expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.918341:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abe00, rc 0) 00000100:00100000:3.0:1787398115.918382:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701328768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.918388:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787398115.918449:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398115.918462:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.918482:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193fbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398115.918550:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.918573:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398115.920434:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787398115.920594:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701328896 00000100:00100000:2.0:1787398115.920603:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701328896 00000100:00100000:2.0:1787398115.920664:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787398115.920673:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701328896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787398115.920822:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701328896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398115.920838:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787398115.920955:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701328896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.921002:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.921051:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398115.921077:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.922495:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329024 00000100:00100000:3.0:1787398115.922509:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329024 00000100:00100000:3.0:1787398115.922573:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787398115.922583:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701329024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.922810:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701329024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.922819:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787398115.922925:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787398115.931207:0:107444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787398115.931710:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787398115.931739:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787398115.931750:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.931763:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74200/0x274786fe0d193fb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fbf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398115.931772:0:6519:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1787398115.931775:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89a828c1b380 from 1 10000000:01000000:0.0:1787398115.931778:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787398115.931816:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.931824:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398115.931834:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398115.931869:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787398115.932749:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398115.932795:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.932830:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329152 00000100:00100000:3.0:1787398115.932838:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329152 00000100:00100000:3.0:1787398115.932907:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787398115.932917:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701329152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.932943:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398115.932975:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050ab200/0x274786fe0d193fcd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193fc6 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.933307:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050ab200/0x274786fe0d193fcd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193fc6 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.933320:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050ab200/0x274786fe0d193fcd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193fc6 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.933330:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab200, rc 0) 00000100:00100000:3.0:1787398115.933397:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701329152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 481us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.933405:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787398115.933812:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398115.933831:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.933841:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193fcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398115.933872:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787398115.933878:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.933886:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a74800/0x274786fe0d193fc6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fcd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398115.933894:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787398115.933897:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89a828c1b380 from 1 10000000:01000000:1.0:1787398115.933899:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787398115.933997:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.934005:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398115.934013:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398115.934031:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787398115.934080:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398115.934115:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80998d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.934118:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329280 00000100:00100000:3.0:1787398115.934123:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329280 00000100:00100000:3.0:1787398115.934162:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787398115.934171:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701329280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.934180:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398115.934190:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a7050aa600/0x274786fe0d193fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d193fd4 expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.934204:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a7050aa600/0x274786fe0d193fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d193fd4 expref: 24 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.934212:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a7050aa600/0x274786fe0d193fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193fd4 expref: 24 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.934219:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa600, rc 0) 00000100:00100000:3.0:1787398115.934255:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701329280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398115.934262:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787398115.934293:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398115.934303:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.934310:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398115.934359:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.934382:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398115.934398:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329408 00000100:00100000:3.0:1787398115.934402:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329408 00000100:00100000:3.0:1787398115.934419:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398115.934424:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701329408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787398115.934487:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701329408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (104us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787398115.934494:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398115.934513:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703d749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398115.938978:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701329408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787398115.939048:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787398115.939060:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398115.939071:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398115.951565:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00010000:00010000:0.0:1787398116.197737:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398116.647439:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787398116.964643:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00010000:00010000:3.0:1787398117.222608:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398117.669962:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787398117.988878:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00010000:00010000:2.0:1787398118.247357:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398118.693976:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 00000100:00100000:2.0:1787398119.012581:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00000100:00100000:3.0:1787398119.180446:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398119.180518:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362176 00000100:00100000:3.0:1787398119.180676:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362176 00000100:00100000:3.0:1787398119.180737:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 84 00000100:00100000:3.0:1787398119.180748:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681362176:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398119.180831:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681362176:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 84us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398119.180840:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 84 00000001:02000400:0.0:1787398119.260003:0:107781:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787398119.269697:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398119.641163:0:107841:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787398119.719665:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 0 seconds 00000100:00080000:1.0:1787398119.912844:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398119.912852:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787398119.912855:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.912867:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89a817ecb000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.912890:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f9880 x1874218701329664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398119.912909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398119.912913:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398119.912916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398119.912919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787398119.912921:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.912926:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89a835664800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.912938:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8a80 x1874218701329792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398119.912947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787398119.912951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787398119.912953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787398119.912957:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787398119.912966:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.912971:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a836713800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.912985:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016fa300 x1874218701329920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398119.913022:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787398119.913025:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787398119.913027:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.913032:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a83879d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.913044:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016fad80 x1874218701330304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398119.913053:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787398119.913056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787398119.913057:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.913061:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3994 00000100:00080000:1.0:1787398119.913066:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787398119.913070:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.913082:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8380 x1874218701330432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398119.913102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787398119.913106:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787398119.913107:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a838262800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398119.913113:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89a838262800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398119.913123:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7016f8700 x1874218701330816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398119.913167:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913279:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701330688:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913344:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787398119.913350:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701330560:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913378:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913417:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701329664:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913464:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701329792:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913498:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701329920:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913559:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701330304:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701330432:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913631:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913645:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701330816:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.913664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000400:1.0:1787398119.913688:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398103/real 1787398103] req@ffff89a82ebd7b80 x1874218701315712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398119.913706:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a82ebd7b80 x1874218701315712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000400:1.0:1787398119.913727:0:3648:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398103/real 1787398103] req@ffff89a82ebd5180 x1874218701315456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398119.913740:0:3648:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89a82ebd5180 x1874218701315456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787398119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398119.913753:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701330048:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913805:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701315712:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913811:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701315456:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913827:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398119.913832:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701330176:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.913877:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329536 00000100:00100000:1.0:1787398119.913884:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329536 00000100:00100000:1.0:1787398119.913926:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787398119.913935:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701329536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.913976:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701329536:12345-0@lo:400:kworker.0 Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.913983:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787398119.914014:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330688 00000100:00100000:1.0:1787398119.914018:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330688 00000100:00100000:1.0:1787398119.914048:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330560 00000100:00100000:1.0:1787398119.914050:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330560 00000100:00100000:1.0:1787398119.914062:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330048 00000100:00100000:1.0:1787398119.914064:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330048 00000100:00100000:1.0:1787398119.914075:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330176 00000100:00100000:1.0:1787398119.914082:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330176 00000100:00100000:1.0:1787398119.914100:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787398119.914105:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701330688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.914137:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701330688:12345-0@lo:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914143:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787398119.914155:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787398119.914161:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.914187:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701330560:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914193:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787398119.914204:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787398119.914210:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.914234:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701330048:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914240:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787398119.914250:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787398119.914256:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.914277:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701330176:12345-0@lo:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914283:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787398119.914301:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329664 00000100:00100000:1.0:1787398119.914304:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329664 00000100:00100000:1.0:1787398119.914319:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329792 00000100:00100000:1.0:1787398119.914321:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329792 00000100:00100000:1.0:1787398119.914330:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330304 00000100:00100000:1.0:1787398119.914332:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330304 00000100:00100000:1.0:1787398119.914350:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330816 00000100:00100000:1.0:1787398119.914352:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330816 00000100:00100000:1.0:1787398119.914364:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787398119.914368:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701329664:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.914389:0:107263:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3999 last 0 00000020:00000080:1.0:1787398119.914430:0:107263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x274786fe0d193fe2 00000004:00100000:1.0:1787398119.914447:0:107263:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.914624:0:107263:0:(import.c:65:import_set_state_nolock()) ffff89a70374e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.914669:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874218701329664:12345-0@lo:38:kworker.0 Request processed in 299us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914675:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787398119.914689:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787398119.914693:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701329792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.914708:0:107263:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3999 last 0 00000020:00000080:1.0:1787398119.914729:0:107263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x274786fe0d193fe9 00000004:00100000:1.0:1787398119.914735:0:107263:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.914750:0:107263:0:(import.c:65:import_set_state_nolock()) ffff89a703748000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.914789:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874218701329792:12345-0@lo:38:kworker.0 Request processed in 82us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914795:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787398119.914807:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787398119.914812:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701330304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.914823:0:107263:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3999 last 0 00000020:00000080:1.0:1787398119.914842:0:107263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d193ff0 00000004:00100000:1.0:1787398119.914848:0:107263:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.914859:0:107263:0:(import.c:65:import_set_state_nolock()) ffff89a70374c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.914889:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701330304:12345-0@lo:38:kworker.0 Request processed in 76us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914895:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787398119.914905:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787398119.914909:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701330816:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.914919:0:107263:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3999 last 0 00000020:00000080:1.0:1787398119.914938:0:107263:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x274786fe0d193ff7 00000004:00100000:1.0:1787398119.914943:0:107263:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.914954:0:107263:0:(import.c:65:import_set_state_nolock()) ffff89a703749000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.914976:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874218701330816:12345-0@lo:38:kworker.0 Request processed in 66us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.914981:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787398119.915004:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701329920 00000100:00100000:1.0:1787398119.915008:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701329920 00000100:00100000:1.0:1787398119.915026:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330432 00000100:00100000:1.0:1787398119.915029:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330432 00000100:00100000:1.0:1787398119.915038:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787398119.915042:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701329920:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.915055:0:99650:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff89a836496800, cookie 0x274786fe0d193e8b 00010000:00080000:1.0:1787398119.915059:0:99650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff89a836496800 cur 3999 last 1787398114 00000004:00100000:1.0:1787398119.915068:0:99650:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.915081:0:99650:0:(import.c:65:import_set_state_nolock()) ffff89a70374b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.915116:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701329920:12345-0@lo:38:kworker.0 Request processed in 73us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.915122:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787398119.915133:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787398119.915137:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701330432:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.915155:0:99650:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a706d32000, cookie 0x274786fe0d193da4 00010000:00080000:1.0:1787398119.915159:0:99650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff89a706d32000 cur 3999 last 1787398114 00010000:02000400:1.0:1787398119.915166:0:99650:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1787398119.915172:0:99650:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1787398119.915179:0:99650:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398119.915266:0:99650:0:(import.c:65:import_set_state_nolock()) ffff89a70374d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398119.915296:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701330432:12345-0@lo:38:kworker.0 Request processed in 157us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398119.915303:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787398119.915410:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398119.915415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787398119.915508:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787398119.915517:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00080000:1.0:1787398119.915518:0:107348:0:(ldlm_lib.c:2550:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 75 00000100:00100000:1.0:1787398119.923823:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701330176:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.923842:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701330048:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.923902:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701330560:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.923917:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701329536:0@lo:400:kworker.0 00000100:00100000:1.0:1787398119.923929:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701330688:0@lo:400:kworker.0 00010000:00080000:1.0:1787398119.923969:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a7016f9880 x1874218701329664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.923987:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 30 00000100:00080000:1.0:1787398119.924807:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff89a7016f9880 x1874218701329664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398139 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.924828:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787398119.924834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a817ecb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398119.924838:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398119.924843:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1874218701329664:0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.924868:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a7016f8a80 x1874218701329792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.924880:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 30 00000100:00080000:1.0:1787398119.925657:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff89a7016f8a80 x1874218701329792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398139 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.925665:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787398119.925668:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a835664800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398119.925673:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398119.925677:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1874218701329792:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.925698:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051625 gen 2 00000100:00080000:1.0:1787398119.925705:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 30 00000100:00080000:1.0:1787398119.925712:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787398119.925717:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787398119.925720:0:3647:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-MDT0000_UUID during recovery 00000100:00080000:1.0:1787398119.925721:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:1.0:1787398119.925724:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787398119.925762:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701329920:0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.925793:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a7016fad80 x1874218701330304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.925820:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 30 00000100:00080000:1.0:1787398119.925827:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787398119.925830:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787398119.925832:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787398119.925836:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701330304:0@lo:38:kworker.0 00000100:00080000:1.0:1787398119.925852:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 21 00000100:00080000:1.0:1787398119.925857:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787398119.925861:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787398119.925862:0:3647:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-MDT0001_UUID during recovery 00000100:00080000:1.0:1787398119.925864:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:1.0:1787398119.925866:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1787398119.925877:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701330432:0@lo:38:kworker.0 00010000:00080000:1.0:1787398119.925891:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a7016f8700 x1874218701330816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398119.925899:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 30 00000100:00080000:1.0:1787398119.925904:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787398119.925906:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787398119.925908:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a838262800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787398119.925912:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874218701330816:0@lo:38:kworker.0 00000100:00100000:1.0:1787398119.925952:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701330944:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1787398119.926013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.926050:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701331072:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1787398119.926069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398119.926123:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701330944 00000100:00100000:1.0:1787398119.926132:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701330944 00000100:00100000:1.0:1787398119.926174:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331072 00000100:00100000:1.0:1787398119.926178:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331072 00000100:00100000:1.0:1787398119.926193:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787398119.926201:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701330944:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787398119.926224:0:99649:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70aa90700 x1874218701330944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1787398130 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398119.926239:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701330944:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 39us (227us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398119.926246:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787398119.926254:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787398119.926260:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701331072:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1787398119.926267:0:99649:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a70aa93100 x1874218701331072/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1787398130 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398119.926280:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701331072:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 22us (211us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398119.926286:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787398119.926299:0:107307:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787398119.926314:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787398119.926321:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 75 seconds 00010000:00080000:1.0:1787398119.926323:0:107348:0:(ldlm_lib.c:2550:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 80 00000100:00100000:3.0:1787398120.045807:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 0 seconds 00000100:00080000:3.0:1787398120.045833:0:107346:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff89a827b76a00 x1874218701326208/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398120.045925:0:107346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.045975:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7026a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787398120.046131:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701326208 00000100:00100000:2.0:1787398120.046141:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701326208 00000100:00100000:2.0:1787398120.046203:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787398120.046214:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701326208:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:2.0:1787398120.046288:0:99649:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff89a82e4e9f80 x1874218701326208/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 304/0 e 0 to 0 dl 1787398131 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398120.046393:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701326208:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 181us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398120.046401:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787398120.046518:0:107346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107346:1874218701326208:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787398120.046586:0:107346:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1787398120.046627:0:107346:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff89a82e4e9c00 x1874218701331200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 336/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398120.046637:0:107346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107346:1874218701331200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787398120.046670:0:107346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.046689:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80819c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787398120.046755:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331200 00000100:00100000:2.0:1787398120.046759:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331200 00000100:00100000:2.0:1787398120.046799:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787398120.046807:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701331200:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:2.0:1787398120.046817:0:99650:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff89a82e4e8700 x1874218701331200/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 336/0 e 0 to 0 dl 1787398131 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398120.046934:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701331200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 127us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398120.046940:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787398120.046969:0:107346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107346:1874218701331200:0@lo:1000:lod0000_rec0001.0 00000100:00080000:2.0:1787398120.047040:0:107346:0:(client.c:1417:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff89a82ebd4380 x1874218701331328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398120.047061:0:107346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107346:1874218701331328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787398120.047090:0:107346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398120.047106:0:107346:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398120.047119:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331328 00000100:00100000:2.0:1787398120.047122:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331328 00000100:00100000:2.0:1787398120.047144:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787398120.047150:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701331328:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:2.0:1787398120.047159:0:99649:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff89a82ebd6d80 x1874218701331328/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 304/0 e 0 to 0 dl 1787398131 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787398120.047225:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107346:x1874218701331328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398120.047232:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787398120.047257:0:107346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107346:1874218701331328:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787398120.047726:0:107346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398120.053692:0:107346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787398120.054280:0:107346:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:2.0:1787398120.054286:0:107346:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1787398120.054683:0:107348:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787398120.054691:0:107348:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 124554051626 00000020:00080000:0.0:1787398120.054699:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.054704:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051626, next_transno: 124554051626 00010000:00080000:0.0:1787398120.054708:0:107348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (124554051626) 00000020:00080000:0.0:1787398120.054710:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.055368:0:107348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681352320 t124554051626 from 192.168.204.60@tcp req@ffff89a82e4ea300 x1874218681352320/t0(124554051626) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:556/0 lens 528/0 e 0 to 0 dl 1787398126 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787398120.059263:0:107348:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3823us 00010000:00010000:0.0:1787398120.085204:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085226:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085241:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085255:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085263:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085270:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085750:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085770:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085786:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085792:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398120.085796:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085804:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085818:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:0.0:1787398120.085821:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398120.085825:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085831:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d193ffe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398120.085850:0:107348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb8711be reply state 000000007c4f62ab transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085862:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.085870:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964700) 00010000:00010000:0.0:1787398120.085872:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398120.085875:0:107348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787398120.085990:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787398120.086014:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.086017:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051627 00000020:00080000:0.0:1787398120.086021:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.086023:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051627 00000100:00100000:2.0:1787398120.092289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398120.092426:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681352960 00000100:00100000:0.0:1787398120.092438:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681352960 00000100:00100000:0.0:1787398120.092507:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787398120.092577:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681352960:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:0.0:1787398120.092599:0:107263:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 124554051627, current: 124554051627, replaying 00000100:00100000:0.0:1787398120.092619:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681352960:12345-192.168.204.60@tcp:36:rm.0 Request processed in 104us (341us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787398120.092626:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000020:00080000:2.0:1787398120.092643:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787398120.092649:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051627, next_transno: 124554051627 00010000:00080000:2.0:1787398120.092653:0:107348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (124554051627) 00000020:00080000:2.0:1787398120.092657:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787398120.092666:0:107348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681352960 t124554051627 from 192.168.204.60@tcp req@ffff89a82ebd4380 x1874218681352960/t0(124554051627) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 512/0 e 0 to 0 dl 1787398131 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787398120.092768:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092806:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092819:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092832:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092840:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092846:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092933:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092940:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.092946:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093154:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093161:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093169:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093184:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.093188:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093196:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093209:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x35:0x0].0x0 (ffff89a70242d600) 00010000:00010000:2.0:1787398120.093211:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398120.093215:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093221:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22e00/0x274786fe0d19401a lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093240:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093245:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093252:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093256:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.093259:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093264:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093283:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70242da00) 00010000:00010000:2.0:1787398120.093285:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398120.093289:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093427:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d23400/0x274786fe0d19400c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398120.093441:0:107348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7d23230 reply state 00000000c13eed2e transno 124554051627 ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093453:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.093459:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964700) 00010000:00010000:2.0:1787398120.093461:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398120.093464:0:107348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1787398120.093566:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1787398120.093583:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787398120.093586:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051628 00000020:00080000:2.0:1787398120.093590:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1787398120.093591:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051628 00000001:00080000:3.0:1787398120.094705:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051626 is committed 00010000:00010000:0.0:1787398120.094802:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094814:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094822:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094829:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398120.094834:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094842:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094856:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964700) 00010000:00010000:0.0:1787398120.094868:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398120.094872:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.094879:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194005 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398120.106054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398120.106150:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681354496 00000100:00100000:1.0:1787398120.106161:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681354496 00000100:00100000:1.0:1787398120.106231:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:1.0:1787398120.106242:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681354496:12345-192.168.204.60@tcp:36:mcreate.0 00010000:00080000:1.0:1787398120.106264:0:107265:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 124554051628, current: 124554051628, replaying 00000100:00100000:1.0:1787398120.106299:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2401:x1874218681354496:12345-192.168.204.60@tcp:36:mcreate.0 Request processed in 59us (255us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398120.106316:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000020:00080000:0.0:1787398120.107494:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.107505:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051628, next_transno: 124554051628 00010000:00080000:0.0:1787398120.107511:0:107348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (124554051628) 00000020:00080000:0.0:1787398120.107514:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.107548:0:107348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681354496 t124554051628 from 192.168.204.60@tcp req@ffff89a82e4e8e00 x1874218681354496/t0(124554051628) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 528/0 e 0 to 0 dl 1787398131 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787398120.107709:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.107726:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.107739:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.107750:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.107758:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.107764:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108161:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108169:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108175:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108181:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398120.108185:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108191:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108203:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964900) 00010000:00010000:0.0:1787398120.108206:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398120.108210:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108215:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194021 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398120.108245:0:107348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005c7636c6 reply state 00000000532d80be transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108256:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.108261:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964700) 00010000:00010000:0.0:1787398120.108297:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398120.108300:0:107348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787398120.108395:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787398120.108415:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.108418:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051629 00000020:00080000:0.0:1787398120.108422:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.108423:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051629 00000100:00100000:0.0:1787398120.113328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398120.113456:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681355008 00000100:00100000:2.0:1787398120.113467:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681355008 00000100:00100000:2.0:1787398120.113567:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:2.0:1787398120.113577:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681355008:12345-192.168.204.60@tcp:36:rm.0 00010000:00080000:2.0:1787398120.113596:0:107263:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 124554051629, current: 124554051629, replaying 00000100:00100000:2.0:1787398120.113610:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:2401:x1874218681355008:12345-192.168.204.60@tcp:36:rm.0 Request processed in 36us (292us total) trans 0 rc 0/-999 00000100:00100000:2.0:1787398120.113632:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000020:00080000:0.0:1787398120.113753:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.113758:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051629, next_transno: 124554051629 00010000:00080000:0.0:1787398120.113763:0:107348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (124554051629) 00000020:00080000:0.0:1787398120.113767:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.113786:0:107348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681355008 t124554051629 from 192.168.204.60@tcp req@ffff89a827b74380 x1874218681355008/t0(124554051629) o36->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 512/0 e 0 to 0 dl 1787398131 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787398120.113875:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.113891:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.113903:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.113914:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.113923:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.113929:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114020:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114028:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114034:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114227:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114235:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114242:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114247:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398120.114252:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114258:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114269:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x36:0x0].0x0 (ffff89a81a964600) 00010000:00010000:0.0:1787398120.114272:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787398120.114276:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114282:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d19403d lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114312:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114319:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114324:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114329:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398120.114332:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114337:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114346:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a964d00) 00010000:00010000:0.0:1787398120.114349:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398120.114351:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114358:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19402f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398120.114368:0:107348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f76726cc reply state 00000000d3b8c610 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114379:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.114386:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf4a4993 (ffff89a81a964700) 00010000:00010000:0.0:1787398120.114394:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398120.114397:0:107348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1787398120.114469:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1787398120.114482:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.114484:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051630 00000020:00080000:0.0:1787398120.114488:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.114490:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051630 00000100:00100000:2.0:1787398120.137676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398120.137769:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357312 00000100:00100000:1.0:1787398120.137790:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357312 00000100:00100000:1.0:1787398120.137921:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 17 00000100:00100000:1.0:1787398120.137932:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681357312:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00080000:1.0:1787398120.137956:0:107264:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 124554051630, current: 124554051630, replaying 00000100:00100000:1.0:1787398120.137973:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2401:x1874218681357312:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 44us (308us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398120.137981:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 17 00000020:00080000:1.0:1787398120.137999:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787398120.138003:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051630, next_transno: 124554051630 00010000:00080000:1.0:1787398120.138007:0:107348:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (124554051630) 00000020:00080000:1.0:1787398120.138016:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787398120.138025:0:107348:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681357312 t124554051630 from 192.168.204.60@tcp req@ffff89a82ebd7480 x1874218681357312/t0(124554051630) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 520/0 e 0 to 0 dl 1787398131 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787398120.138045:0:107348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398120.138069:0:107348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d194044 lrc: 2/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88b8 expref: -99 pid: 107348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139111:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,1 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139132:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139145:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139176:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139184:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139190:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398120.139675:0:107348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1787398120.139693:0:107348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139702:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139710:0:107348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139722:0:107348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139729:0:107348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 2/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139736:0:107348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139741:0:107348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398120.139745:0:107348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 3/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139763:0:107348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 4/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139789:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a81a867800) 00010000:00010000:1.0:1787398120.139792:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398120.139797:0:107348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 2/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.139804:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62400/0x274786fe0d19404b lrc: 0/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787398120.139817:0:107348:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ce1b988 reply state 00000000e2d6fa3f transno 124554051630 ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.141003:0:107348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.141013:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a81a867b00) 00010000:00010000:1.0:1787398120.141016:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787398120.141021:0:107348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787398120.141091:0:107348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62a00/0x274786fe0d194044 lrc: 0/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 15 pid: 107348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.141116:0:107348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 14 pid: 107348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.141124:0:107348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:1.0:1787398120.141126:0:107348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398120.141128:0:107348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a835e63e00, rc 0) 00010000:00080000:1.0:1787398120.141214:0:107348:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1787398120.141712:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787398120.141717:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051631 00000020:00080000:1.0:1787398120.141721:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1787398120.141723:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051631 00000100:00100000:3.0:1787398120.146577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398120.146857:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362304 00000100:00100000:1.0:1787398120.146868:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362304 00000100:00100000:1.0:1787398120.146932:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787398120.146941:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2401:x1874218681362304:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787398120.146966:0:107265:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a82e4ebb80 x1874218681362304/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 224/0 e 0 to 0 dl 1787398131 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398120.146990:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:2401:x1874218681362304:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 50us (423us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398120.146998:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000020:00080000:0.0:1787398120.147465:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.147470:0:107348:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 124554051631 00010000:00080000:0.0:1787398120.147473:0:107348:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1787398120.147476:0:107348:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1787398120.147482:0:107348:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1787398120.147484:0:107348:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787398120.147635:0:107348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 128849018880 00000001:00100000:2.0:1787398120.162178:0:107260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:2.0:1787398120.162191:0:107260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1787398120.162218:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051630 is committed 00010000:00010000:2.0:1787398120.162419:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162434:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162442:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162448:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.162453:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162460:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162477:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162484:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a704d22400/0x274786fe0d194013 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162500:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162517:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162549:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162554:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.162557:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162563:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162573:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162579:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194028 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162591:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162597:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162603:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162608:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.162611:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162624:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162633:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162638:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194036 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf4a4993 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162658:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162665:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 2/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162670:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162674:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398120.162677:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162682:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 4/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162690:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 2/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.162696:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e62e00/0x274786fe0d194052 lrc: 0/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787398120.162748:0:107348:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1787398120.162796:0:107348:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1787398120.162811:0:107348:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a70aa90700 x1874218701330944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1787398130 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787398120.162947:0:107348:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a82e4ebb80 x1874218681362304/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:561/0 lens 224/0 e 0 to 0 dl 1787398131 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787398120.162989:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1787398120.162998:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a70aa91c00 x1874218701330944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398135 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1787398120.163005:0:107348:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1787398120.163007:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a70aa91c00 x1874218701330944/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398135 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787398120.163013:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1787398120.163031:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1787398120.163037:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000065d602fb): req@ffff89a82ebd5500 x1874218701321344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398120.163070:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701330944:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1787398120.165534:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.165573:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.165601:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701331456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398120.165639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.165691:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701321344 00000100:00100000:3.0:1787398120.165700:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701321344 00000100:00100000:3.0:1787398120.165739:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331456 00000100:00100000:3.0:1787398120.165742:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331456 00000100:00100000:3.0:1787398120.165756:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787398120.165763:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107306:x1874218701321344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.165861:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107306:x1874218701321344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.165869:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787398120.165890:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787398120.165897:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701331456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398120.165921:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445068800 avail 1298829312 00000100:00100000:3.0:1787398120.165971:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701331456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.165978:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787398120.166104:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701331456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398120.166140:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701321344:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787398120.166173:0:107306:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787398120.166209:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.166239:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.166254:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8030c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.166267:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331584 00000100:00100000:3.0:1787398120.166270:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331584 00000100:00100000:3.0:1787398120.166291:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787398120.167902:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331584:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.168084:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331584:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 194us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398120.168166:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e9880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.168924:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:107306:1874218701331712:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.168971:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.168998:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398120.176957:0:107274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331712 00000100:00100000:0.0:1787398120.176975:0:107274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331712 00000100:00100000:0.0:1787398120.177040:0:107274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787398120.177050:0:107274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107306:x1874218701331712:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787398120.177159:0:107274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107306:x1874218701331712:12345-0@lo:900:lod0001_rec0000.0 Request processed in 109us (8186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398120.177167:0:107274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787398120.178950:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787398120.179398:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:107306:1874218701331712:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.179484:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331840:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.179582:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.179617:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398120.183536:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331840 00000100:00100000:0.0:1787398120.183554:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331840 00000100:00100000:0.0:1787398120.183611:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787398120.183621:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331840:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398120.183746:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331840:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 125us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398120.183754:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787398120.188755:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331840:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.188945:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.189039:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.189080:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.189132:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701331968 00000100:00100000:3.0:1787398120.189140:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701331968 00000100:00100000:3.0:1787398120.189189:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787398120.189197:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.191373:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701331968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2166us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398120.191397:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701331968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.191402:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:1.0:1787398120.191460:0:107306:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 28, last_idx 30 00000100:00100000:1.0:1787398120.195675:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332096:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398120.196614:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.196653:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.196993:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332096 00000100:00100000:3.0:1787398120.197003:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332096 00000100:00100000:3.0:1787398120.197198:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787398120.197217:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332096:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.197403:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332096:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 190us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.197410:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787398120.199557:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332096:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787398120.199943:0:107306:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:3.0:1787398120.199948:0:107306:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x20000dec1:0x1:0x0] at index 29 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:3.0:1787398120.200053:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.200117:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.200144:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8030c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.200194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398120.200268:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332224 00000100:00100000:3.0:1787398120.200275:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332224 00000100:00100000:3.0:1787398120.202323:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787398120.202337:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332224:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.202471:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332224:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 136us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.202480:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787398120.202514:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362432 00000100:00100000:3.0:1787398120.202537:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362432 00000100:00100000:3.0:1787398120.202588:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787398120.202597:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681362432:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398120.202650:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681362432:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.202657:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787398120.203142:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.203259:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.203336:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.203366:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8030c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.203397:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332352 00000100:00100000:3.0:1787398120.203402:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332352 00000100:00100000:3.0:1787398120.203440:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787398120.203446:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.203854:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 406us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.203864:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787398120.203903:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.203994:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.204024:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.204042:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.204054:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332480 00000100:00100000:3.0:1787398120.204058:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332480 00000100:00100000:3.0:1787398120.204083:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787398120.204090:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.204140:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107306:x1874218701332480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 51us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.204147:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787398120.204172:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701332480:0@lo:1000:lod0001_rec0000.0 00000004:00080000:3.0:1787398120.204214:0:107306:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8030c8540 with version 1 00000040:00080000:3.0:1787398120.204235:0:107306:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 29, last_idx 30 00000004:00080000:3.0:1787398120.204256:0:107306:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8346a8900 with version 2 00000040:00080000:3.0:1787398120.204260:0:107306:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x20000dec1:0x1:0x0] at index 29 of catalog [0x200000bd3:0x1:0x0] 00000004:00080000:1.0:1787398120.205884:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 1 rpc_version 1 00000020:00100000:1.0:1787398120.205918:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398120.205929:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70aa92680 x1874218701332736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398120.205950:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701332736:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398120.206007:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.206038:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.206073:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332736 00000100:00100000:3.0:1787398120.206080:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332736 00000100:00100000:3.0:1787398120.206125:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787398120.206134:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701332736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398120.206397:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107290:x1874218701332736:12345-0@lo:1000:osp_up0-1.0 Request processed in 264us (389us total) trans 128849018881 rc 0/0 00000100:00100000:3.0:1787398120.206406:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787398120.206499:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701332736:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398120.206510:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 2 rpc_version 2 00000020:00100000:1.0:1787398120.206540:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398120.206546:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70aa91f80 x1874218701332992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398120.206559:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701332992:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398120.206597:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.206616:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.209693:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701332992 00000100:00100000:3.0:1787398120.209706:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701332992 00000100:00100000:3.0:1787398120.209760:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787398120.209769:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107290:x1874218701332992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398120.210027:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107290:x1874218701332992:12345-0@lo:1000:osp_up0-1.0 Request processed in 256us (3428us total) trans 128849018882 rc 0/0 00000100:00100000:3.0:1787398120.210035:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787398120.210340:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa91f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701332992:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398120.211577:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701333120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787398120.211677:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1787398120.211916:0:107348:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadfe41657e10 00000100:00100000:3.0:1787398120.211919:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a807d36e40 going to sleep for 11 seconds 00100000:10000000:2.0:1787398120.211939:0:107348:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1787398120.217192:0:107324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x776:0x0] 00000100:00100000:3.0:1787398120.217250:0:107324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107324:1874218701333248:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787398120.217319:0:107324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.217350:0:107324:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3780 going to sleep for 11 seconds 00000004:00080000:3.0:1787398120.217366:0:107328:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:3.0:1787398120.217382:0:107328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107328:1874218701333376:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787398120.217408:0:107328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.217448:0:107328:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.217469:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701333248 00000100:00100000:3.0:1787398120.217476:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701333248 00000100:00100000:3.0:1787398120.217545:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701333376 00000100:00100000:3.0:1787398120.217548:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701333376 00000100:00100000:3.0:1787398120.217572:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787398120.217580:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:107324:x1874218701333248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787398120.217607:0:101069:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1985 -> diff = -75 00002000:02000040:3.0:1787398120.217612:0:101069:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1911 to 0x280000401:1985) 00000100:00100000:0.0:1787398120.219286:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701333120 00000100:00100000:0.0:1787398120.219301:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701333120 00000100:00100000:1.0:1787398120.219312:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787398120.219329:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:107328:x1874218701333376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787398120.219374:0:99641:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1953 -> diff = -159 00002000:02000040:1.0:1787398120.219378:0:99641:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1953) 00000100:00100000:0.0:1787398120.221664:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787398120.221678:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107306:x1874218701333120:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398120.222174:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107306:x1874218701333120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 498us (10497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398120.222183:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787398120.222233:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701333120:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398120.222285:0:107306:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:0.0:1787398120.222291:0:107306:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x20000dec1:0x2:0x0] at index 30 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:0.0:1787398120.222368:0:107306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701333504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398120.222425:0:107306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398120.222448:0:107306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8187accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787398120.222465:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701333504 00000100:00100000:0.0:1787398120.222470:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701333504 00000100:00100000:0.0:1787398120.222496:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787398120.222502:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107306:x1874218701333504:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398120.223021:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107306:x1874218701333504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 516us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398120.223029:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787398120.223062:0:107306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107306:1874218701333504:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398120.223104:0:107306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787398120.223146:0:107306:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8187ac6c0 with version 3 00000004:00080000:0.0:1787398120.223183:0:107306:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8187ac900 with version 4 00000040:00080000:0.0:1787398120.223189:0:107306:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x20000dec1:0x2:0x0] at index 30 of catalog [0x200000bd3:0x1:0x0] 00000040:00080000:0.0:1787398120.223210:0:107306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd3:0x1:0x0] index 30 count 1 00000004:00080000:0.0:1787398120.223267:0:107306:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 6, retries 0 00000004:00080000:0.0:1787398120.223271:0:107306:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00080000:0.0:1787398120.223353:0:107307:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000004:00080000:0.0:1787398120.223362:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 3 rpc_version 3 00000020:00100000:0.0:1787398120.223381:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398120.223388:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a827b76a00 x1874218701333760/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398120.223402:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701333760:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398120.223432:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398120.223447:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8187acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787398120.223458:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701333760 00000100:00100000:0.0:1787398120.223461:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701333760 00000100:00100000:0.0:1787398120.223483:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787398120.223489:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107290:x1874218701333760:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398120.223945:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107290:x1874218701333760:12345-0@lo:1000:osp_up0-1.0 Request processed in 453us (510us total) trans 128849018883 rc 0/0 00000100:00100000:0.0:1787398120.223954:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787398120.223991:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b76a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701333760:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398120.223999:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 4 rpc_version 4 00000020:00100000:0.0:1787398120.224010:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398120.224015:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a827b77100 x1874218701334016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398120.224029:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701334016:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398120.224052:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398120.224065:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8187acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787398120.224084:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334016 00000100:00100000:0.0:1787398120.224087:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334016 00000100:00100000:0.0:1787398120.224105:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787398120.224111:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107290:x1874218701334016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398120.224195:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:107290:x1874218701334016:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (141us total) trans 128849018884 rc 0/0 00000100:00100000:0.0:1787398120.224202:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787398120.224228:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701334016:0@lo:1000:osp_up0-1.0 00002000:00010000:3.0:1787398120.225959:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.225973:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.225991:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c1:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.225995:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.226003:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226020:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226030:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226037:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226066:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787398120.226171:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.226177:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226185:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c0:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.226187:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.226191:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226200:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226208:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226215:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.226232:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398120.226505:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398120.226537:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226556:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aaa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.226562:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226573:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226592:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226600:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537f5f65/0x274786fe0d194060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226635:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398120.226639:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226646:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.226650:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226658:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226669:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226677:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194067 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.226689:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.226691:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.226693:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.227350:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.228397:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.228407:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.228421:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bf:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.230341:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.230359:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230394:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230406:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230414:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230451:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787398120.230582:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.230588:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230597:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7be:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.230600:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.230605:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230614:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230622:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230641:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230660:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787398120.230674:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398120.230680:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230689:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.230694:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230703:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230721:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230730:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d19406e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230752:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.230755:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230786:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.230790:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230798:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230809:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230816:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d194075 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230829:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.230831:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.230832:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.230880:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.230886:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230894:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bd:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.230897:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.230902:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230911:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230926:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230934:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230952:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.230962:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.230967:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230973:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.230977:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230984:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.230995:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231001:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb589abd/0x274786fe0d19407c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231014:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231025:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.231076:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.231083:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231092:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bc:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.231096:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.231101:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231112:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231121:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231129:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231145:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.231151:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.231156:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231165:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.231168:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231192:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231206:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231216:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194083 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231233:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231236:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231253:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.231303:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.231309:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231317:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bb:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.231319:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.231323:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231331:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231338:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231351:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231365:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.231374:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.231378:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231385:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.231404:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231413:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231425:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231432:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6a6032/0x274786fe0d19408a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231446:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231447:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231449:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.231496:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.231508:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231517:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ba:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.231540:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.231545:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231556:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231564:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231571:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231585:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.231592:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.231596:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231603:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.231606:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231614:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231632:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231640:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d194091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231654:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231656:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231658:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.231701:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.231707:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231715:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b9:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.231718:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.231723:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231731:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231739:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231746:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231764:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.231781:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.231785:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231792:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.231795:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231802:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231812:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231819:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194098 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231832:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231834:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.231836:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.231882:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.231887:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231895:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b8:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.231904:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.231908:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231917:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231924:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231932:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231944:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.231951:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.231955:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231962:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.231965:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231972:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.231983:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232002:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adcc2fa1/0x274786fe0d19409f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232017:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.232019:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.232020:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.232067:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.232073:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232081:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b7:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.232084:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.232088:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232097:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232104:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232111:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232124:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.232138:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.232141:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232149:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.232152:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232160:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232171:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232178:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87d79c/0x274786fe0d1940a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232191:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.232193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.232194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.232235:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.232240:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.232247:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b6:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.232251:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398120.232280:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.236914:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.236966:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.236980:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.236989:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237026:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.237040:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.237046:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237055:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.237060:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237071:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237089:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237096:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e908847a/0x274786fe0d1940ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237128:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.237130:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.237133:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.237929:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.237938:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237950:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b5:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.237955:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.237961:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237973:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237982:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.237990:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238009:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.238020:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.238026:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238048:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.238053:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238061:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238073:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238081:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3c6267/0x274786fe0d1940b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.238098:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.238099:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.238157:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.238163:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238171:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b4:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.238173:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.238177:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238185:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238202:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238209:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238225:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.238233:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.238924:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238936:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.238941:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238949:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238962:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238969:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea86f9bc/0x274786fe0d1940bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.238987:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.238997:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.238999:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.239073:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.239079:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239087:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b3:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.239090:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.239095:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239103:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239110:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239117:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239136:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.239143:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.239148:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239154:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.239157:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239174:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239184:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.239191:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e406a2e/0x274786fe0d1940c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787398120.239351:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787398120.239359:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1787398120.241884:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.241890:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.241893:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.242015:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.242025:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242042:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b2:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.242046:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.242053:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242066:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242076:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242090:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242114:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.242124:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.242129:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242137:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.242142:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242151:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242167:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242175:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37540bd/0x274786fe0d1940c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242365:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242368:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242369:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.242417:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.242504:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242514:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b1:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.242517:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.242541:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242551:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242560:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242568:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242584:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.242591:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.242596:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242603:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.242606:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242614:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242631:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242640:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82e8b21/0x274786fe0d1940d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242653:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242655:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242657:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.242704:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.242710:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242718:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b0:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.242722:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.242726:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242736:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242744:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242751:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242791:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.242800:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.242805:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242812:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.242816:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242824:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242836:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242842:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8e7fe3/0x274786fe0d1940d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242858:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.242862:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.242915:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.242921:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242929:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7af:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.242939:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.242944:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242954:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242963:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242970:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.242985:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.242993:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.242998:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243005:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.243009:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243017:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243028:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243047:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c1316bb/0x274786fe0d1940de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243062:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.243065:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.243067:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.243112:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.243118:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243127:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ae:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.243131:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.243135:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243143:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243152:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243160:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243175:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.243191:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.243195:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243202:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.243205:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243212:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243222:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243229:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be243241/0x274786fe0d1940e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243257:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.243260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.243262:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.243304:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.243310:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243317:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ad:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.243320:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.243324:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243343:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243352:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243359:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.243382:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.245291:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.245303:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.245315:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.245320:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.245329:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.245348:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.245355:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf713eb/0x274786fe0d1940ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.245410:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.245412:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.245415:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.246960:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.246979:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.246996:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ac:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.247002:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.247009:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247026:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247038:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247063:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247087:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.247104:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.247110:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247118:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.247124:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247136:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247151:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247158:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310b1da0/0x274786fe0d1940f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247183:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247185:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247187:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.247325:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.247337:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247346:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ab:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.247349:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.247353:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247362:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247369:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247375:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247594:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.247603:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.247608:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247617:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb55a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.247620:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247629:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247647:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247654:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064d43af/0x274786fe0d1940fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247669:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247671:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247672:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.247722:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.247728:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247735:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7aa:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.247739:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.247742:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247750:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247757:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247763:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247797:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.247804:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.247808:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247815:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.247818:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247825:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247835:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247843:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3141683/0x274786fe0d194101 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247857:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247860:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.247861:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.247903:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.247908:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247915:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a9:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.247924:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.247928:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247937:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247944:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247950:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247964:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.247973:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.247976:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247983:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82eb54200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.247987:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.247995:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248005:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248024:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77ffe02/0x274786fe0d194108 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248038:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.248039:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.248041:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.248083:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.248089:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248097:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a8:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.248100:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.248105:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248114:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248122:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248130:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248146:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.248160:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.248164:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248171:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.248174:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248182:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248194:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248202:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201887ae/0x274786fe0d19410f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248215:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.248217:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.248219:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.248258:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.248263:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248271:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a7:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.248274:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.248278:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248298:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248306:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248313:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248326:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.248333:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.248337:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248343:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.248346:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248355:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248364:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.248371:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000256e39c4/0x274786fe0d194116 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398120.248871:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.248881:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.248889:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a1:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.248893:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.248897:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.248909:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.248917:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.248923:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.248950:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.249023:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.249028:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249036:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a0:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.249047:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.249051:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249060:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249067:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249075:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249091:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787398120.249135:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.249141:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249149:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79f:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.249152:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.249155:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249164:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249172:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249185:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.249198:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787398120.249942:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787398120.249952:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.249963:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.249968:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.249978:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.249993:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250001:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d19411d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250023:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398120.250026:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250033:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.250044:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250052:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250063:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250070:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d194124 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250082:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.250085:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250091:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.250095:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250103:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250114:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250118:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.250122:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250125:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d19412b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250126:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250147:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250149:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250151:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.250340:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.250346:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.250423:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.250442:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250453:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a6:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.250456:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.250461:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250472:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250481:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250489:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250503:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398120.250511:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398120.250516:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250543:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.250547:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250556:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250569:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250577:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b939e7e/0x274786fe0d194139 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250593:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.250595:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.250597:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787398120.250638:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.250644:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250652:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a5:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.250656:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.250660:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250669:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250683:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250692:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250714:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787398120.250757:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.250762:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250780:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a4:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.250783:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.250787:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250797:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250798:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.250806:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250809:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250827:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398120.250829:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250832:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250846:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250871:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250875:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.250880:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9271dcf/0x274786fe0d194140 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250897:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.250901:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250908:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.250918:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787398120.250922:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.250932:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250933:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250953:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a3:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:3.0:1787398120.250958:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398120.250959:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250965:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250974:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8c35a3/0x274786fe0d194147 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250981:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.250990:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.250992:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250995:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.250998:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.251000:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.251021:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.251027:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.251033:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251042:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.251046:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251055:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787398120.251060:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787398120.251068:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.251090:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a2:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:0.0:1787398120.251096:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251105:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e762bb7/0x274786fe0d19414e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.251116:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787398120.251123:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251126:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.251130:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.251134:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398120.251135:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.251145:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.251153:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398120.251175:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.251214:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.251219:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251228:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.251232:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251241:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251255:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251263:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d2b674/0x274786fe0d194155 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.251294:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.251297:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.251299:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787398120.251491:0:101069:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1910 00002000:00010000:1.0:1787398120.251652:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.251660:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251670:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79e:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.251673:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.251678:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251687:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251696:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251704:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251719:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.251727:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.251732:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251745:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.251749:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251758:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251786:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251795:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d194132 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.251817:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.251820:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.251823:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398120.252322:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:107324:x1874218701333248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 34737us (34998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.252335:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787398120.252566:0:107324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107324:1874218701333248:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787398120.252581:0:107324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x7c1:0x0] from OST, last_created [0x280000401:0x7c1:0x0]last_used is [0x280000401:0x776:0x0] 00000100:00100000:1.0:1787398120.252652:0:107324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107324:1874218701334272:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787398120.252693:0:107324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.252717:0:107324:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a80607d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398120.252730:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398120.252739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701334144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398120.252765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398120.252816:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334272 00000100:00100000:1.0:1787398120.252822:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334272 00000100:00100000:1.0:1787398120.252859:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787398120.252867:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:107324:x1874218701334272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787398120.252906:0:99640:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1986 00000100:00100000:2.0:1787398120.255683:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334144 00000100:00100000:2.0:1787398120.255698:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334144 00000100:00100000:2.0:1787398120.255755:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787398120.255765:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874218701334144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398120.255802:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398120.255830:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:107324:x1874218701334272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2960us (3132us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787398120.255840:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787398120.255867:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701334144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398120.255875:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787398120.255902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701334144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398120.255942:0:107324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107324:1874218701334272:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787398120.255954:0:107324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x7c1:0x0]-[0x280000401:0x7e1:0x0] 00002000:00010000:1.0:1787398120.256031:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.256039:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256055:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79d:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.256060:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.256067:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256081:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256092:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256111:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256142:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.256201:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.256207:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256215:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79c:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.256218:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.256223:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.256232:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787398120.256574:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787398120.256581:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1787398120.259651:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398120.259664:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.259678:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.259683:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.259695:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.259719:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.259727:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e18a75d/0x274786fe0d19415c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.259752:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.259755:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.259756:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.261389:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261400:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261462:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.261605:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.261613:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261633:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79b:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.261637:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.261643:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261657:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261664:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261671:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261691:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398120.261700:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398120.261706:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261713:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.261717:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261726:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261752:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261759:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e323688/0x274786fe0d194163 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261788:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.261791:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261797:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.261800:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261807:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261815:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261821:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a86a08c4/0x274786fe0d19416a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261830:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.261832:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.261838:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.261885:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x79a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.261891:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261899:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79a:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.261902:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x79a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.261906:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261915:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261922:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261928:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261943:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.261950:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.261954:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261961:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.261964:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261981:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261992:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.261998:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12e8872/0x274786fe0d194171 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262010:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262013:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.262050:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x799:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262055:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262064:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x799:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262067:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x799:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262071:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262080:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262087:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262100:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262114:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.262122:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.262126:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262132:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.262135:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262143:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262154:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262161:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52c1856/0x274786fe0d194178 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x799:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262174:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262176:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262178:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.262218:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x798:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262229:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262236:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x798:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262245:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x798:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262249:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262258:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262266:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262272:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262287:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.262295:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.262298:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262305:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.262309:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262315:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262332:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262338:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b639685/0x274786fe0d19417f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x798:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262350:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262351:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262353:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.262395:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x797:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262400:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262407:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x797:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262410:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x797:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262414:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262422:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262430:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262437:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262460:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.262468:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.262472:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262479:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.262482:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262491:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262503:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262510:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8ae64b/0x274786fe0d194186 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x797:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262550:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262552:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262555:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.262594:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x796:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262599:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262607:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x796:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262615:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x796:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262619:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262629:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262637:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262643:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262657:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.262663:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.262665:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.262671:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398120.262705:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x795:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262710:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262718:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x795:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262721:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x795:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262725:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262733:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.262749:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.262753:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.262755:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262780:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.262783:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262804:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.262806:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262814:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.262816:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dae13d71/0x274786fe0d19418d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x796:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262819:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262832:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.262836:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.262840:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.262844:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262847:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.262848:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262861:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262868:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505db92b/0x274786fe0d194194 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x795:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262883:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262891:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.262893:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.262941:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x794:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.262947:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262954:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x794:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.262957:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x794:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.262961:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262969:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262977:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262983:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.262997:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.263004:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.263007:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263014:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.263017:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263034:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263045:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263052:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ae7fcd/0x274786fe0d19419b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x794:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263066:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.263068:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.263070:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.263110:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x793:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.263117:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263124:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x793:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.263127:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x793:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.263131:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263140:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263148:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263161:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263174:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.263181:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.263185:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263192:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.263195:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263203:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263215:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263223:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000873bbb73/0x274786fe0d1941a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x793:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.263240:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.263243:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.263244:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.267400:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x792:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.267420:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267516:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x792:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.267534:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x792:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.267540:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267555:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267566:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267575:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267594:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.267606:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.267612:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267619:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.267624:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267633:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267656:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267664:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab07c561/0x274786fe0d1941a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x792:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267681:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.267683:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.267685:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.267792:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x791:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.267799:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.267807:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x791:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.267810:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x791:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.267813:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268337:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268349:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268356:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268388:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.268450:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x790:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.268456:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268473:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x790:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.268477:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x790:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.268481:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268488:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268495:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268502:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268515:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398120.268536:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398120.268541:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268548:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.268556:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268565:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268576:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268582:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006133693f/0x274786fe0d1941b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x791:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268598:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.268601:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268607:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.268611:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268618:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268626:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268632:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5aae436/0x274786fe0d1941b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x790:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268650:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.268651:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.268653:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.268696:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.268701:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268709:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78f:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.268711:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.268716:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.268724:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271011:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271020:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271049:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.271170:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.271177:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271201:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78e:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.271205:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.271211:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271223:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271231:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271250:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271269:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398120.271283:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398120.271289:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271296:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.271301:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271310:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271337:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271345:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a914bb47/0x274786fe0d1941be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271367:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.271371:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271378:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.271381:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271389:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271399:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271405:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc2314a/0x274786fe0d1941c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.271418:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.271419:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.271439:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.272068:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.272952:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.273100:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.273109:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273123:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78d:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.273127:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.273133:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273145:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273155:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273162:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273186:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.273238:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.273243:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273252:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78c:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.273256:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.273260:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273283:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273290:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.273292:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273298:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273301:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273320:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.273325:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273326:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398120.273338:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.273339:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273345:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273355:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.273356:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273359:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273372:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1941cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273376:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273395:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273399:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.273402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273405:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1941d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273406:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273426:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273428:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273430:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.273474:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.273480:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273489:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78b:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.273492:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.273496:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273505:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273512:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273544:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273560:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.273600:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x78a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398120.273604:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.273607:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273611:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273624:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.273630:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273636:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78a:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.273643:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x78a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398120.273645:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273649:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273669:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273675:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273680:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273689:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1941da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273694:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273709:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.273714:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787398120.273714:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273725:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.273729:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273738:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273750:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273757:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1941e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398120.273763:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x789:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398120.273779:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273780:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273782:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273791:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x789:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:0.0:1787398120.273791:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273796:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x789:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398120.273799:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.273801:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273811:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273830:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273837:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273859:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.273898:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x788:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.273904:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273912:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x788:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.273915:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x788:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.273919:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273929:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273937:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.273945:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.273961:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398120.273971:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398120.280080:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.280103:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.280110:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.280123:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.280150:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281539:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d1941e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x789:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281575:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398120.281580:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281588:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398120.281593:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281616:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281631:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281639:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d1941ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x788:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398120.281652:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.281654:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.281657:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.282554:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.282684:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x787:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.282692:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282707:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x787:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.282711:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x787:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.282717:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282730:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282739:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282746:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282781:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398120.282837:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x786:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.282843:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282850:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x786:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.282864:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x786:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.282869:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282878:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282887:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282894:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282910:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787398120.282952:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x785:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.282957:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282965:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x785:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.282968:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x785:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.282972:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282981:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.282988:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283002:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283015:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787398120.283054:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x784:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.283059:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283067:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x784:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.283070:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x784:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.283074:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283084:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283092:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283099:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283111:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787398120.283144:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x783:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.283149:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283163:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x783:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.283165:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x783:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.283169:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283178:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283185:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283192:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283208:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1787398120.283217:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787398120.283222:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283229:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398120.283234:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283348:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787398120.283355:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283374:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.283377:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283536:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283553:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283560:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d1941fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x786:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283581:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398120.283585:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283592:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096be00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.283595:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283603:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283612:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283625:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d194204 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x785:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283638:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398120.283641:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283648:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.283651:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283659:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283669:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283676:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d19420b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x784:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283686:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398120.283690:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283696:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.283705:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283712:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283722:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283729:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194212 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x783:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.283741:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.283743:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.283745:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.283889:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283911:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283918:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d1941f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x787:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.283932:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.283934:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398120.283936:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398120.283998:0:99641:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x782:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398120.284004:0:99641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.284014:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x782:0x0].0x0 since=3999s v=(0 0) 00010000:00010000:1.0:1787398120.284017:0:99641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x782:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398120.284021:0:99641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.284031:0:99641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.284039:0:99641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.284047:0:99641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398120.284079:0:99641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398120.284983:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398120.284993:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.285003:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096bc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398120.285007:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.285016:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.285031:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.285047:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194219 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x782:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398120.285064:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.285066:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398120.285067:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.286185:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.286194:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398120.286201:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787398120.287078:0:99641:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00000100:00100000:1.0:1787398120.290721:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:107328:x1874218701333376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71388us (73301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398120.290736:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787398120.294269:0:107328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107328:1874218701333376:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787398120.294291:0:107328:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x7a1:0x0] from OST, last_created [0x2c0000401:0x7a1:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:2.0:1787398120.294398:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701334400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398120.294481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.294598:0:107328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107328:1874218701334528:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787398120.294628:0:107328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398120.294645:0:107328:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701be3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787398120.294668:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334400 00000100:00100000:3.0:1787398120.294680:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334400 00000100:00100000:3.0:1787398120.294735:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787398120.294744:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701334400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398120.294787:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398120.297805:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701334400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3054us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398120.297820:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787398120.297871:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334528 00000100:00100000:3.0:1787398120.297880:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334528 00000100:00100000:3.0:1787398120.297920:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787398120.297928:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:107328:x1874218701334528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787398120.297968:0:100418:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1954 00000100:00100000:3.0:1787398120.301296:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:107328:x1874218701334528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3363us (6662us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787398120.301310:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:1.0:1787398120.301458:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398120.301500:0:107328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107328:1874218701334528:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787398120.301515:0:107328:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x7a1:0x0]-[0x2c0000401:0x7c1:0x0] 00000100:00100000:2.0:1787398120.302598:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701334400:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1787398120.377458:0:107900:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787398120.377742:0:107900:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787398120.853337:0:107943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787398120.853798:0:107943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787398121.324482:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787398121.739362:0:108010:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787398121.743855:0:108010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1787398121.866365:0:108032:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787398121.866794:0:108032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787398122.341954:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398123.208855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398123.208925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398123.209192:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362688 00000100:00100000:2.0:1787398123.209228:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362688 00000100:00100000:2.0:1787398123.209343:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:2.0:1787398123.209355:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681362688:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398123.209452:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2403:x1874218681362688:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 99us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.209460:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00080000:3.0:1787398123.209953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398123.214624:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362560 00000100:00100000:1.0:1787398123.214649:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362560 00000100:00100000:1.0:1787398123.214774:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:1.0:1787398123.214788:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681362560:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398123.214924:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82df3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681362560:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 138us (5997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398123.214934:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:2.0:1787398123.218879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398123.222332:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362816 00000100:00100000:3.0:1787398123.222350:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362816 00000100:00100000:3.0:1787398123.222413:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 18 00000100:00100000:3.0:1787398123.222422:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681362816:12345-192.168.204.60@tcp:38:kworker.0 00010000:00080000:3.0:1787398123.222455:0:107264:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a706d31800, cookie 0x274786fe0d193dab 00010000:00080000:3.0:1787398123.222461:0:107264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t85899345937 exp ffff89a706d31800 cur 4002 last 1787398114 00000004:00100000:3.0:1787398123.222494:0:107264:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787398123.222677:0:107264:0:(import.c:65:import_set_state_nolock()) ffff89a838264800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398123.222784:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681362816:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 361us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398123.222791:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 18 00010000:00080000:0.0:1787398123.224395:0:107307:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1787398123.224409:0:107307:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 85899345937 00000020:00080000:0.0:1787398123.224416:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398123.224420:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345937 00000020:00080000:0.0:1787398123.224424:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398123.224426:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345937 00000100:00100000:0.0:1787398123.230973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398123.231518:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681357568 00000100:00100000:1.0:1787398123.231583:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681357568 00000100:00100000:1.0:1787398123.231678:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 19 00000100:00100000:1.0:1787398123.231692:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681357568:12345-192.168.204.60@tcp:101:mkdir.0 00010000:00080000:1.0:1787398123.231730:0:107265:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 85899345937, current: 85899345937, replaying 00000100:00100000:1.0:1787398123.231745:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681357568:12345-192.168.204.60@tcp:101:mkdir.0 Request processed in 58us (794us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398123.231753:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 19 00000020:00080000:0.0:1787398123.231887:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398123.231895:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 85899345937, next_transno: 85899345937 00010000:00080000:0.0:1787398123.231901:0:107307:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (85899345937) 00000020:00080000:0.0:1787398123.231906:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1787398123.231923:0:107307:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1874218681357568 t85899345937 from 192.168.204.60@tcp req@ffff89a827b74e00 x1874218681357568/t0(85899345937) o101->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:564/0 lens 520/0 e 0 to 0 dl 1787398134 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787398123.231963:0:107307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398123.232009:0:107307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d194220 lrc: 2/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88bf expref: -99 pid: 107307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787398123.236459:0:107307:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4364us 00010000:00010000:1.0:1787398123.273468:0:107307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,1 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.273499:0:107307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.273517:0:107307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.273562:0:107307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: --/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.273570:0:107307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.273577:0:107307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398123.282433:0:107307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00010000:00010000:0.0:1787398123.285618:0:107307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107307 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.285648:0:107307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287800:0:107307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287830:0:107307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287836:0:107307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 2/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287843:0:107307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287849:0:107307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398123.287854:0:107307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287878:0:107307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 4/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287895:0:107307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a818432600) 00010000:00010000:0.0:1787398123.287899:0:107307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398123.287904:0:107307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 2/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.287910:0:107307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096a200/0x274786fe0d194227 lrc: 0/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398123.288332:0:107307:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a2cfa8a reply state 000000002aab5f7a transno 85899345937 ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.288349:0:107307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.288356:0:107307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a809376b00) 00010000:00010000:0.0:1787398123.288358:0:107307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398123.288362:0:107307:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787398123.288916:0:107307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d194220 lrc: 0/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 9 pid: 107307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.288977:0:107307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 8 pid: 107307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.289009:0:107307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:2.0:1787398123.289013:0:107307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398123.289016:0:107307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74600, rc 0) 00010000:00080000:2.0:1787398123.289176:0:107307:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1787398123.289217:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1787398123.289221:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345938 00000020:00080000:2.0:1787398123.289226:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1787398123.289228:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345938 00000100:00100000:1.0:1787398123.308469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398123.311993:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681362944 00000100:00100000:0.0:1787398123.312022:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681362944 00000100:00100000:0.0:1787398123.312158:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787398123.312173:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681362944:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1787398123.312214:0:107263:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a7016f8700 x1874218681362944/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:564/0 lens 224/0 e 0 to 0 dl 1787398134 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398123.312259:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:2401:x1874218681362944:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 90us (3798us total) trans 0 rc 0/-999 00000100:00100000:0.0:1787398123.312299:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000020:00080000:3.0:1787398123.314877:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1787398123.314890:0:107307:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 85899345938 00010000:00080000:3.0:1787398123.314895:0:107307:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1787398123.314899:0:107307:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1787398123.314906:0:107307:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1787398123.314910:0:107307:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1787398123.315130:0:107307:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 21, last_transno is 90194313216 00000001:00100000:1.0:1787398123.317843:0:107244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00100000:1.0:1787398123.317855:0:107244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787398123.317983:0:107244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345937 is committed 00000001:00080000:3.0:1787398123.318098:0:107307:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1787398123.318143:0:107307:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:3.0:1787398123.318158:0:107307:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a70aa93100 x1874218701331072/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1787398130 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787398123.318280:0:107307:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a7016f8700 x1874218681362944/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:564/0 lens 224/0 e 0 to 0 dl 1787398134 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398123.318427:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1787398123.318435:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a70aa93480 x1874218701331072/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398135 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398123.318444:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a70aa93480 x1874218701331072/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398135 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398123.318451:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398123.318462:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398123.318466:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701331072:0@lo:400:ptlrpcd_rcv.0 00010000:00010000:0.0:1787398123.318671:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318683:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 2/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318690:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318697:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ba00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398123.318701:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318723:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 4/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318740:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a809376b00) 00010000:00010000:0.0:1787398123.318742:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398123.318748:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 2/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.318754:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a83096ba00/0x274786fe0d19422e lrc: 0/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107307 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398123.318884:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701334656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398123.319057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398123.319439:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334656 00000100:00100000:0.0:1787398123.319448:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334656 00010000:02000000:3.0:1787398123.325021:0:107307:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:0.0:1787398123.325433:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787398123.325452:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701334656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787398123.325513:0:107321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:2.0:1787398123.326965:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701334656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398123.327171:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701334656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1722us (8113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398123.327184:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00000080:2.0:1787398123.363181:0:107307:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadfe45843e10 00100000:10000000:2.0:1787398123.363199:0:107307:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:0.0:1787398123.364830:0:107295:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x243:0x0] 00000100:00100000:0.0:1787398123.364886:0:107295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107295:1874218701334784:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787398123.364959:0:107295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398123.365002:0:107295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568780 going to sleep for 11 seconds 00000100:00100000:1.0:1787398123.365062:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334784 00000100:00100000:1.0:1787398123.365070:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334784 00000100:00100000:1.0:1787398123.365141:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787398123.365151:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:107295:x1874218701334784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787398123.365179:0:99639:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -62 00002000:02000040:1.0:1787398123.365184:0:99639:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:580 to 0x2c0000400:641) 00000004:00080000:3.0:1787398123.366330:0:107293:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x242:0x0] 00000100:00100000:3.0:1787398123.366402:0:107293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107293:1874218701334912:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787398123.366489:0:107293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398123.366552:0:107293:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a703ddc240 going to sleep for 11 seconds 00010000:00010000:3.0:1787398123.366646:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787398123.368164:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787398123.368673:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701334912 00000100:00100000:0.0:1787398123.368687:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701334912 00000100:00100000:0.0:1787398123.368774:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787398123.368790:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:107293:x1874218701334912:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787398123.368824:0:99640:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -63 00002000:02000040:0.0:1787398123.368828:0:99640:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:579 to 0x280000400:641) 00000100:00080000:3.0:1787398123.368906:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787398123.387272:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.387288:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.387306:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x281:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.387311:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.387318:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.387338:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.387348:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.387356:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.387445:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.387991:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.388013:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388024:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x280:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.388027:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.388032:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388041:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388049:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388056:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388332:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398123.388341:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388364:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.388368:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388377:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388395:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388402:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d19423c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388423:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.388426:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388433:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.388435:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388441:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388450:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388463:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.388465:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.388466:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.388581:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787398123.388588:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d194243 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.388655:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.388662:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388670:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27f:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.388673:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.388684:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388696:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388704:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.388720:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388752:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.388758:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388765:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.388769:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388777:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388789:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.388796:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.388798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.388799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.389049:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787398123.389055:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d19424a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.389113:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.389119:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.389126:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27e:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.389129:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.389132:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.389140:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.389158:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.389164:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.390421:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.390541:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.390549:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.390562:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27d:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.390566:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.390571:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.390583:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.390591:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.390598:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400296:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787398123.400485:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.400497:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400517:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27c:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.400538:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.400546:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400563:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400574:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400583:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400603:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787398123.400643:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.400648:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400657:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27b:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.400679:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.400684:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400693:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400702:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.400721:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403180:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398123.403365:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403381:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.403387:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403416:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403438:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403445:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d194251 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403690:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398123.403697:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403704:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.403717:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403727:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403738:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403745:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d194258 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403771:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.403775:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403781:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.403785:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403793:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403802:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403808:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d19425f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403821:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403823:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403826:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403834:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.403848:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398123.403856:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.403861:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403868:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.403878:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403886:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403897:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403904:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d194266 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.403917:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403920:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403925:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403926:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.403928:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.404012:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.404610:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.404619:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.404634:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27a:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.404639:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.404645:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.404659:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.404669:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.404685:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398123.404958:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.404966:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.404977:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x281:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.404981:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.404985:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.404998:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.405017:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.405024:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.405189:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787398123.405256:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.405261:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.405270:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x279:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.405273:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.405278:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.405287:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.405295:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.405304:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.406865:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787398123.406994:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.407002:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407018:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x280:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.407022:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.407028:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407041:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407051:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407058:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.407112:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787398123.407173:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787398123.407184:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398123.407201:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407210:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.407215:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407226:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407244:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407252:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ee1aa5/0x274786fe0d194274 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407271:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.407275:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407281:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.407285:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407304:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407316:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407323:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19427b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407338:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.407342:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407348:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.407352:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407359:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407369:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407377:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e66a0c/0x274786fe0d194282 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.407402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.407404:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.407455:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.407460:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407469:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:3.0:1787398123.407565:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787398123.407573:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.407581:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.407584:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.407592:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.407616:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.407623:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d19426d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.407639:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.407641:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.407643:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.407726:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.407733:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407744:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407752:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407760:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407772:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.407817:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.407823:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407842:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27e:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.407845:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.407850:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407860:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407868:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407875:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407889:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398123.407897:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.407901:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407909:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.407912:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407920:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407945:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607c7812/0x274786fe0d194289 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407965:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.407968:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407974:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.407977:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407984:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.407993:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408000:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3084a9/0x274786fe0d194290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408013:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408020:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.408065:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.408071:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408078:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27d:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.408082:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.408086:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408095:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408103:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408109:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408123:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.408129:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.408133:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408140:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.408142:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408161:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408172:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408179:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd933652/0x274786fe0d194297 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408192:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408194:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408196:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.408239:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.408244:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408252:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.408255:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.408259:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408267:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408274:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408289:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408301:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.408308:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.408312:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408318:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.408322:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408330:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408341:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408347:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c690d69e/0x274786fe0d19429e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408362:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408363:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.408404:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.408415:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408422:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27b:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.408425:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.408429:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408437:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408445:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408453:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408466:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787398123.408787:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.408794:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.408802:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.408806:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.408814:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.408826:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.408834:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8c902f/0x274786fe0d1942a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.408860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.408862:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.408864:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.408914:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.408978:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.408984:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.408993:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.408996:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.409001:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409023:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409032:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409040:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409067:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.409110:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.409115:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409124:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x279:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.409127:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.409131:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409140:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409147:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409165:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409178:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787398123.409220:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.409225:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409234:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x278:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.409236:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.409241:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409249:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409257:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409264:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409285:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787398123.409291:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398123.409295:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409308:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.409312:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409320:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409331:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409338:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cb71bfc/0x274786fe0d1942ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409352:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.409355:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409361:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.409364:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409371:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409380:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409393:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091290fd3/0x274786fe0d1942b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409406:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.409409:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409416:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.409419:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409426:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409437:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409444:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2f6a2d/0x274786fe0d1942ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409455:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.409457:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.409459:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.409791:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.409798:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.409893:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.409899:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409915:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.409919:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.409923:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409934:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409942:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.409950:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410008:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.410052:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.410057:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410065:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x276:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.410068:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.410072:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410081:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410103:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410110:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410125:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398123.410133:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.410137:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410144:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.410148:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410155:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410167:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005020b452/0x274786fe0d1942c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410203:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.410213:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.410224:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410232:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410243:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410250:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f05e35/0x274786fe0d1942c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.410266:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.410268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.410311:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.410317:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410324:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x275:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.410327:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.410332:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410351:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410359:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410366:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410381:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.410421:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.410427:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410435:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.410438:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.410442:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410451:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410459:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410490:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410504:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398123.410511:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.410515:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410546:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.410550:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410558:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410569:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c075ba29/0x274786fe0d1942cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410590:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.410593:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410611:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d23800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.410614:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410622:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410633:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410642:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010e9c323/0x274786fe0d1942d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.410656:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.410657:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.410659:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.411126:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.411133:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411141:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x273:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.411144:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.411149:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411157:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411171:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411177:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411347:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.411358:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.411364:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411371:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a704d22000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.411374:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411383:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411395:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411402:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c3e949/0x274786fe0d1942dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411425:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411427:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.411583:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.411588:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411596:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x272:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.411599:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.411603:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411613:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411621:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411627:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411639:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.411646:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.411650:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411656:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.411659:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411680:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411692:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411700:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fc2314a/0x274786fe0d1942e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411724:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411726:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411728:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.411770:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.411776:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411784:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x271:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.411787:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.411791:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411799:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411807:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411820:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411834:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.411841:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.411844:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411851:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.411855:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411863:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411873:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a914bb47/0x274786fe0d1942eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411892:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411894:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.411895:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.411936:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.411946:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411954:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x270:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.411956:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.411961:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411970:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411978:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411985:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.411997:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.412003:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.412006:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412012:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.412015:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412022:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412041:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412047:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5aae436/0x274786fe0d1942f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412060:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412062:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412063:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.412109:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.412114:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412122:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26f:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.412125:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.412129:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412137:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412145:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412152:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412175:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.412183:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.412630:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412638:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.412642:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412650:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412662:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412669:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006133693f/0x274786fe0d1942f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412684:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412686:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.412751:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.412757:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412764:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.412773:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.412778:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412786:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412794:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412801:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412816:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.412824:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.412828:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.412834:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412835:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.412841:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412850:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412861:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab07c561/0x274786fe0d194300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412893:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412894:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.412896:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.412938:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.412943:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412949:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26d:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.412952:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.412955:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412962:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412969:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412976:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.412987:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.413001:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.413004:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413010:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.413013:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413020:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413029:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413036:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000873bbb73/0x274786fe0d194307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413048:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.413049:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.413051:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.413085:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.413090:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413097:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26c:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.413100:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.413103:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413122:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413130:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413137:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413148:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.413154:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.413157:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413163:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.413167:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413174:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413183:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413257:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ae7fcd/0x274786fe0d19430e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413275:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.413276:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.413277:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.413315:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.413319:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413326:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26b:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.413329:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.413335:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413343:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413351:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413359:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.413370:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.413373:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.413379:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.413385:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413386:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413408:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x278:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.413412:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.413421:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413425:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.413430:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413437:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413440:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413458:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413462:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413469:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413487:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398123.413495:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.413499:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413507:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398123.413512:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413519:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413573:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413580:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000980ec48d/0x274786fe0d19431c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413598:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.413601:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.413604:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.413609:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.413619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.413652:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.413658:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413665:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x277:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.413668:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.413673:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413681:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413688:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.413695:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413942:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505db92b/0x274786fe0d194315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413958:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.413961:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413968:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096aa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.413971:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413980:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.413991:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414006:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.414007:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.414009:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.414056:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.414062:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414070:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26a:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.414073:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.414077:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414085:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414093:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414101:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414125:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.414168:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.414173:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414274:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398123.414281:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414288:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398123.414292:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414299:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414310:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414317:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc8ae64b/0x274786fe0d19432a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.414333:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.414334:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.414342:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.414377:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x269:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.414380:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.414385:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414394:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414403:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414410:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414462:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.414512:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.414516:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414545:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x268:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.414548:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.414552:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414560:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414579:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414585:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414598:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787398123.414632:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.414637:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414645:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.414648:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.414652:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414660:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414668:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414675:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414698:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787398123.414705:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398123.414726:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414733:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.414736:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414744:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414754:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414761:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b639685/0x274786fe0d194331 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414775:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.414778:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414784:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.414787:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414804:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414817:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414823:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d52c1856/0x274786fe0d194338 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414834:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.414837:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414843:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.414846:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414852:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414861:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414866:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12e8872/0x274786fe0d19433f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414889:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.414890:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.414892:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.414933:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.414937:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414945:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x266:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.414948:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.414952:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414960:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414967:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414974:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.414989:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.414995:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.414998:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415014:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.415018:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415026:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415036:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415044:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a86a08c4/0x274786fe0d194346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415056:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.415058:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.415060:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.415101:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.415106:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415113:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x265:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.415116:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.415120:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415128:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415142:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415149:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415162:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.415169:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.415173:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415179:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee30000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.415182:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415290:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.415388:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.415425:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415432:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e323688/0x274786fe0d19434d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415446:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.415454:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.415456:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.415619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.415700:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.415705:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415726:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x264:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.415729:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.415733:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415742:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415749:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415756:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415778:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398123.415816:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.415822:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.415829:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.415831:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x263:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.415837:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.415839:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013af30b8/0x274786fe0d194323 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415842:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415862:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415871:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415878:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415894:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398123.415902:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.415906:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415912:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.415915:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415924:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415934:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415942:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dae13d71/0x274786fe0d194354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415965:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.415968:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415975:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a82ee31600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.415978:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415986:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.415996:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416003:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e18a75d/0x274786fe0d19435b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416015:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.416017:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.416018:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398123.416064:0:99640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.416069:0:99640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416078:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.416086:0:99640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.416090:0:99640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416099:0:99640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416108:0:99640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416115:0:99640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.416129:0:99640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398123.416268:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398123.416274:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416282:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398123.416285:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416293:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416317:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416324:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416339:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.416341:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.416342:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.416348:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.416504:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.416510:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416539:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x276:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.416543:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.416547:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416558:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416566:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416574:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416597:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398123.416617:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398123.416623:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416631:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096bc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398123.416634:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.416636:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.416647:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416649:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416661:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416666:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x275:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:0.0:1787398123.416673:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff25c8b2/0x274786fe0d194369 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416674:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.416682:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416694:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.416706:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.416721:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.416725:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.416727:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787398123.416872:0:99640:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:578 00000100:00100000:2.0:1787398123.417031:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:107293:x1874218701334912:12345-0@lo:5:osp-pre-0-1.0 Request processed in 48243us (50537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.417041:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:2.0:1787398123.417079:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.417152:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398123.417317:0:107293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107293:1874218701334912:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787398123.417334:0:107293:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x281:0x0] from OST, last_created [0x280000400:0x281:0x0]last_used is [0x280000400:0x242:0x0] 00000100:00100000:2.0:1787398123.417410:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701335040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398123.417450:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398123.417576:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335040 00000100:00100000:3.0:1787398123.417583:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335040 00000100:00100000:3.0:1787398123.417624:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787398123.417632:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701335040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398123.417654:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398123.417750:0:107293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107293:1874218701335168:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787398123.417777:0:107293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398123.417796:0:107293:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568840 going to sleep for 11 seconds 00010000:00010000:1.0:1787398123.417843:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398123.417894:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701335040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 261us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398123.417902:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787398123.417927:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335168 00000100:00100000:3.0:1787398123.417930:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335168 00000100:00100000:3.0:1787398123.417989:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00010000:00010000:1.0:1787398123.417997:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787398123.417998:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:107293:x1874218701335168:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787398123.418024:0:101069:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 642 00002000:00010000:1.0:1787398123.418091:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.418098:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.418108:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x274:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.418113:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.418117:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.418130:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.418155:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.418164:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.418181:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398123.418191:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398123.419299:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419310:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398123.419315:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419325:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419346:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419353:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e21109e/0x274786fe0d194370 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419374:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.419384:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419391:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398123.419395:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419402:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419413:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398123.419416:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:107293:x1874218701335168:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1416us (1633us total) trans 12884901913 rc 0/0 00010000:00010000:1.0:1787398123.419426:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b43870f/0x274786fe0d194377 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398123.419434:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:1.0:1787398123.419445:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.419449:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.419451:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.419545:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.419552:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419562:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x273:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.419566:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.419570:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398123.419578:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701335040:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787398123.419596:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419608:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419618:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419652:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.419694:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.419700:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.419717:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x272:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.419720:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.419852:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.419858:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.419867:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.419878:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.419888:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.419900:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.419907:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e9daf7/0x274786fe0d19437e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.419922:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.419923:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.419925:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.420029:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398123.420053:0:107293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107293:1874218701335168:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787398123.420066:0:107293:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x281:0x0]-[0x280000400:0x2a1:0x0] 00000100:00100000:0.0:1787398123.420106:0:107293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d85f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:107293:1874218701335296:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787398123.420148:0:107293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398123.420169:0:107293:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a809568840 going to sleep for 11 seconds 00000100:00100000:0.0:1787398123.420199:0:107274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335296 00000100:00100000:0.0:1787398123.420204:0:107274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335296 00000100:00100000:0.0:1787398123.420246:0:107274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787398123.420254:0:107274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107293:x1874218701335296:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787398123.420295:0:107274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107293:x1874218701335296:12345-0@lo:900:osp-pre-0-1.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398123.420302:0:107274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787398123.420323:0:107293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d85f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:107293:1874218701335296:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787398123.421452:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.421478:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.421489:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.421516:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.421552:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.421640:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.421649:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.421658:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.421663:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.421673:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.421676:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.421689:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.421696:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.421701:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x271:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.421706:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.421729:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045aed72a/0x274786fe0d194385 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.421753:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.421755:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.421756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.422394:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422409:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422418:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422427:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422451:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.422552:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.422558:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422579:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x270:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.422582:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.422586:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422595:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422603:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422609:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422634:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787398123.422660:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398123.422676:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422685:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096be00 already unused, calling callback (ffffffffc0e6de90) 00002000:00010000:1.0:1787398123.422687:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398123.422691:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422694:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.422719:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26f:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.422721:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398123.422724:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422741:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422749:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093145dbd/0x274786fe0d19438c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422768:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398123.422771:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422778:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398123.422782:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422790:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422813:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422821:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b27a8ed/0x274786fe0d194393 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398123.422834:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.422836:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.422838:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.423035:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423048:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423067:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423074:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423093:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.423134:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1787398123.423140:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.423141:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423150:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423154:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.423160:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423163:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26e:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.423171:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.423178:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423179:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423204:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423209:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423222:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423224:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bedad44/0x274786fe0d19439a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423242:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423251:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.423255:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.423266:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.423326:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398123.423368:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.423368:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.423377:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423381:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.423387:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423391:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26d:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.423399:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.423402:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423405:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423427:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423430:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423444:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423446:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f334e5/0x274786fe0d1943a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423466:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423489:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.423491:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398123.423494:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423503:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096b000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.423507:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423514:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423570:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423578:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080fc5301/0x274786fe0d1943a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423591:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.423593:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.423594:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.423804:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.423810:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423818:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26c:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.423827:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.423831:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423840:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423849:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423856:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423886:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.423926:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.423932:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423940:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26b:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.423943:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.423947:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423957:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423958:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398123.423965:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.423981:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.423984:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424007:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398123.424011:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.424013:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424025:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424039:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424047:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c7d39c6/0x274786fe0d1943af lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.424055:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.424062:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424083:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.424088:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424090:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26a:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.424098:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.424102:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398123.424106:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424108:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424127:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424128:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424152:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424155:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424167:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424171:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8f5b9b6/0x274786fe0d1943b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424185:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.424315:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.424320:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424327:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096a600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.424331:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424351:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424361:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424369:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025c35636/0x274786fe0d1943bd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.424383:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.424384:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.424386:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.424392:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398123.424703:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.424718:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.424733:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x269:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.424736:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.424741:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425358:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425368:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425376:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425402:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.425435:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.425441:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425450:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83096ae00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.425456:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425465:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.425469:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.425476:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425491:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x268:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.425494:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425495:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.425499:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425508:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425547:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2046c1/0x274786fe0d1943c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425561:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425570:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425574:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.425578:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.425586:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398123.425587:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.425593:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425601:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.425604:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425613:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425626:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787398123.425631:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398123.425635:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c10fab/0x274786fe0d1943cb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425639:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425651:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x267:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:2.0:1787398123.425652:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.425654:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398123.425657:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.425660:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425661:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.425673:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.425680:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.425681:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.425690:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.426910:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398123.427009:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.427017:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427029:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x266:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.427032:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.427037:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427049:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427058:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427066:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427077:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787398123.427114:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.427119:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427127:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x265:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.427145:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.427149:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427159:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427167:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427173:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.427181:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787398123.428378:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.428389:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428403:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x264:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.428406:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.428410:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428420:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428428:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428448:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428458:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787398123.428504:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.428509:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428518:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x263:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.428538:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.428543:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428553:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428561:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428568:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428576:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787398123.428617:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398123.428623:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428636:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x262:0x0].0x0 since=4002s v=(0 0) 00010000:00010000:1.0:1787398123.428639:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398123.428643:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428652:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428660:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428666:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398123.428674:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1787398123.429279:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787398123.429288:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429299:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429304:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429315:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429334:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429343:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440e12e1/0x274786fe0d1943d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429370:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787398123.429375:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429382:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429386:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429395:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429417:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429425:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b44d7d3/0x274786fe0d1943d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429441:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787398123.429445:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429453:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429457:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429467:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429491:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429500:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaabe1a0/0x274786fe0d1943e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429516:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398123.429538:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787398123.429547:0:99639:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:579 00010000:00010000:2.0:1787398123.429556:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429560:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429569:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429582:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429589:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d1943e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429603:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398123.429606:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429613:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429616:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429623:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429635:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398123.429647:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:107295:x1874218701334784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64493us (64682us total) trans 0 rc 0/0 00010000:00010000:2.0:1787398123.429652:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d1943ee lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398123.429661:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:2.0:1787398123.429670:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398123.429675:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429682:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398123.429685:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429693:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429704:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429724:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d1943f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398123.429738:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.429740:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.429742:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398123.429764:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398123.430011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398123.430221:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398123.430321:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398123.430363:0:107295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107295:1874218701334784:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787398123.430388:0:107295:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x281:0x0] from OST, last_created [0x2c0000400:0x281:0x0]last_used is [0x2c0000400:0x243:0x0] 00000100:00100000:2.0:1787398123.430486:0:107295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107295:1874218701335552:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787398123.430566:0:107295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398123.430596:0:107295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398123.430773:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398123.430811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398123.431572:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335424 00000100:00100000:2.0:1787398123.431581:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335424 00000100:00100000:2.0:1787398123.431629:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787398123.431639:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701335424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398123.431669:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398123.431729:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701335424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.431737:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787398123.431829:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398123.432232:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335552 00000100:00100000:1.0:1787398123.432238:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335552 00000100:00100000:1.0:1787398123.432278:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787398123.432287:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:107295:x1874218701335552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787398123.432325:0:99641:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 642 00000100:00100000:1.0:1787398123.435827:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:107295:x1874218701335552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3532us (5252us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787398123.435850:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787398123.435905:0:107295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107295:1874218701335552:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787398123.435927:0:107295:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x281:0x0]-[0x2c0000400:0x2a1:0x0] 00000100:00100000:2.0:1787398123.435993:0:107295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:107295:1874218701335680:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787398123.436044:0:107295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398123.436084:0:107295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787398123.436144:0:107274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335680 00000100:00100000:0.0:1787398123.436154:0:107274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335680 00000100:00100000:0.0:1787398123.436217:0:107274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787398123.436229:0:107274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107295:x1874218701335680:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787398123.436297:0:107274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107295:x1874218701335680:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398123.436304:0:107274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787398123.436492:0:107295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:107295:1874218701335680:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787398123.832257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398123.832389:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363072 00000100:00100000:3.0:1787398123.832405:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363072 00000100:00100000:3.0:1787398123.832510:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:3.0:1787398123.832569:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79961:x1874218681363072:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:3.0:1787398123.832609:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398123.832953:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d1943fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88e2 expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833059:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833080:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833100:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398123.833186:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787398123.833191:0:107264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398123.833240:0:107264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833274:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d1943fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e2 expref: 9 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833303:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e2 expref: 8 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398123.833315:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70526ec00) 00010000:00010000:3.0:1787398123.833318:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398123.833324:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836582a00, rc 0) 00000100:00100000:3.0:1787398123.833974:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79961:x1874218681363072:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 1446us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398123.833989:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 20 00000100:00100000:1.0:1787398123.844169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398123.844304:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363200 00000100:00100000:2.0:1787398123.845239:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363200 00000100:00100000:2.0:1787398123.845891:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:2.0:1787398123.845908:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79961:x1874218681363200:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:2.0:1787398123.845963:0:107265:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:2.0:1787398123.846256:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:79961:x1874218681363200:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 352us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.846287:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 21 00000100:00100000:1.0:1787398123.850066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398123.854984:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363328 00000100:00100000:0.0:1787398123.855007:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363328 00000100:00100000:0.0:1787398123.855295:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787398123.855308:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79961:x1874218681363328:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:0.0:1787398123.855386:0:107263:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1787398123.855549:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:79961:x1874218681363328:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 243us (5508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398123.855582:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 22 00000100:00100000:0.0:1787398123.862996:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398123.864823:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363456 00000100:00100000:2.0:1787398123.864839:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363456 00000100:00100000:2.0:1787398123.864967:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:2.0:1787398123.864976:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874218681363456:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:2.0:1787398123.865014:0:100418:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t8589934593 exp 0000000000000000 cur 4003 last 0 00000020:00000080:2.0:1787398123.865047:0:100418:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d19440a 00002000:00100000:2.0:1787398123.865059:0:100418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a828a59800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787398123.865071:0:100418:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787398123.865154:0:100418:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787398123.865193:0:100418:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398123.865271:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681363456:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 295us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.865279:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:1.0:1787398123.871933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398123.872054:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363584 00000100:00100000:3.0:1787398123.872100:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363584 00000100:00100000:3.0:1787398123.872213:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 142 00000100:00100000:3.0:1787398123.872225:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79961:x1874218681363584:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787398123.872265:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398123.872370:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79961:x1874218681363584:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398123.872389:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 142 00000100:00080000:0.0:1787398123.872634:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398123.881590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398123.881890:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363712 00000100:00100000:2.0:1787398123.881905:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363712 00000100:00100000:2.0:1787398123.881967:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:2.0:1787398123.881978:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874218681363712:12345-192.168.204.60@tcp:8:lfs.0 00010000:00080000:2.0:1787398123.882033:0:99639:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp t0 exp 0000000000000000 cur 4003 last 0 00000020:00000080:2.0:1787398123.882074:0:99639:0:(genops.c:1406:class_connect()) connect: client 784819ec-79bc-4534-8fa6-902d7a92d2f8, cookie 0x274786fe0d194411 00002000:00100000:2.0:1787398123.882090:0:99639:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 784819ec-79bc-4534-8fa6-902d7a92d2f8/ffff89a828a5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366b ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787398123.882105:0:99639:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787398123.882208:0:99639:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787398123.882249:0:99639:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398123.882382:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681363712:12345-192.168.204.60@tcp:8:lfs.0 Request processed in 395us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398123.882393:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 100 00000100:00100000:1.0:1787398123.892727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398123.898753:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363840 00000100:00100000:3.0:1787398123.898780:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363840 00000100:00100000:3.0:1787398123.898942:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 143 00000100:00100000:3.0:1787398123.898957:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79961:x1874218681363840:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787398123.899008:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398123.899149:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:79961:x1874218681363840:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 195us (6436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398123.899159:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 143 00000100:00080000:0.0:1787398123.899650:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398124.004919:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398103/real 1787398103] req@ffff89a82ebd4000 x1874218701315584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398124.004973:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a82ebd4000 x1874218701315584/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398124.004988:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787398103/real 1787398103] req@ffff89a82ebd4700 x1874218701315840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398124.005001:0:3647:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89a82ebd4700 x1874218701315840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787398123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398124.005028:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398124.005065:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787398124.005070:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701315584:0@lo:38:kworker.0 00000100:00080000:1.0:1787398124.005078:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398124.005085:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787398124.005088:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701315840:0@lo:38:kworker.0 00000100:00080000:2.0:1787398124.005339:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398124.005346:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398124.005349:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398124.005355:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 3982 00000100:00080000:2.0:1787398124.005362:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398124.005373:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398124.005398:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd5c00 x1874218701336064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398124.005444:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398124.005448:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398124.005450:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398124.005455:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 3982 00000100:00080000:2.0:1787398124.005458:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398124.005462:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398124.005474:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a82ebd4000 x1874218701336320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398124.005605:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701336192:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.005731:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701335808:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.005861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.005917:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701336576:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.005954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.005978:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337088:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.006038:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787398124.006045:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701335936:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006074:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.006095:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701336704:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.006136:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337216:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006165:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.006201:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335808 00000100:00100000:0.0:1787398124.006212:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335808 00000100:00100000:0.0:1787398124.006284:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398124.006297:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006363:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701335808:12345-0@lo:400:kworker.0 Request processed in 68us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006372:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787398124.006415:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701335936 00000100:00100000:0.0:1787398124.006439:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701335936 00000100:00100000:0.0:1787398124.006483:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787398124.006490:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701335936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006560:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701335936:12345-0@lo:400:kworker.0 Request processed in 70us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006567:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787398124.006588:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336576 00000100:00100000:0.0:1787398124.006591:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336576 00000100:00100000:0.0:1787398124.006688:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337088 00000100:00100000:0.0:1787398124.006692:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337088 00000100:00100000:0.0:1787398124.006720:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336704 00000100:00100000:0.0:1787398124.006723:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336704 00000100:00100000:0.0:1787398124.006735:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337216 00000100:00100000:0.0:1787398124.006738:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337216 00000100:00100000:0.0:1787398124.006754:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787398124.006761:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701336576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006800:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701336576:12345-0@lo:400:kworker.0 Request processed in 39us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006806:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787398124.006817:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787398124.006823:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006850:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337088:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006857:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787398124.006867:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787398124.006873:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701336704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006902:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701336704:12345-0@lo:400:kworker.0 Request processed in 30us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006919:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787398124.006930:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787398124.006937:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.006966:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337216:12345-0@lo:400:kworker.0 Request processed in 31us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.006972:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1787398124.006996:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398124.007001:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398124.007004:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398124.007042:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701335936:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007056:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701336704:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007066:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337216:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007078:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701335808:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007089:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701336576:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007100:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337088:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007175:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701336448:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.007244:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701336960:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007267:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398124.007300:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336448 00000100:00100000:0.0:1787398124.007305:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336448 00000100:00100000:0.0:1787398124.007332:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336960 00000100:00100000:0.0:1787398124.007335:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336960 00000100:00100000:0.0:1787398124.007359:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787398124.007364:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3649:x1874218701336448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007412:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3649:x1874218701336448:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.007419:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787398124.007432:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787398124.007438:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701336960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007466:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701336960:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398124.007471:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787398124.007501:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701336448:0@lo:400:kworker.0 00000100:00100000:0.0:1787398124.007511:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701336960:0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.007775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398124.007828:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701336832:0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.007856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398124.007880:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701337344:0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.007924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398124.007957:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336192 00000100:00100000:2.0:1787398124.007961:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336192 00000100:00100000:2.0:1787398124.008000:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336832 00000100:00100000:2.0:1787398124.008004:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336832 00000100:00100000:2.0:1787398124.008016:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337344 00000100:00100000:2.0:1787398124.008019:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337344 00000100:00100000:2.0:1787398124.008032:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787398124.008038:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701336192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.008083:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701336192:12345-0@lo:400:kworker.0 Request processed in 44us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398124.008091:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787398124.008105:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787398124.008111:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701336832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.008141:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701336832:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398124.008147:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787398124.008157:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787398124.008162:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.008190:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701337344:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398124.008196:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787398124.008211:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398124.008233:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701336192:0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.008243:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701336832:0@lo:400:kworker.0 00000100:00100000:2.0:1787398124.008253:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701337344:0@lo:400:kworker.0 00000100:00100000:1.0:1787398124.011170:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701336064:0@lo:38:kworker.0 00000100:00100000:1.0:1787398124.011300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398124.011374:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701336320:0@lo:38:kworker.0 00000100:00100000:1.0:1787398124.011423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398124.011572:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336064 00000100:00100000:2.0:1787398124.011583:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336064 00000100:00100000:3.0:1787398124.011739:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701336320 00000100:00100000:3.0:1787398124.011745:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701336320 00000100:00100000:3.0:1787398124.011774:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787398124.011784:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701336320:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787398124.011823:0:107264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 4003 last 0 00000020:00000080:3.0:1787398124.011876:0:107264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x274786fe0d194418 00000004:00100000:3.0:1787398124.011898:0:107264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787398124.011953:0:107264:0:(import.c:65:import_set_state_nolock()) ffff89a838267000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398124.012045:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874218701336320:12345-0@lo:38:kworker.0 Request processed in 262us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398124.012054:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787398124.012772:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787398124.012782:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701336064:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787398124.012809:0:107265:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4003 last 0 00000020:00000080:2.0:1787398124.012850:0:107265:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d19441f 00000004:00100000:2.0:1787398124.012862:0:107265:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787398124.012890:0:107265:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787398124.012955:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701336064:12345-0@lo:38:kworker.0 Request processed in 172us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398124.012962:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787398124.013252:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 21 00000100:00080000:1.0:1787398124.014312:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff89a82ebd5c00 x1874218701336064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398149 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398124.014330:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787398124.014335:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398124.014341:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398124.014349:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701336064:0@lo:38:kworker.0 00000100:00080000:1.0:1787398124.014399:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 21 00000100:00080000:1.0:1787398124.022344:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff89a82ebd4000 x1874218701336320/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398149 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787398124.022365:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1787398124.022374:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1787398124.022380:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1787398124.022389:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701336320:0@lo:38:kworker.0 00010000:00010000:2.0:1787398124.390212:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398125.419141:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398125.540981:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398125.541082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398125.541162:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337472 00000100:00100000:1.0:1787398125.541172:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337472 00000100:00100000:1.0:1787398125.541234:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787398125.541246:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701337472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398125.541298:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398125.541351:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874218701337472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398125.541379:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787398125.541441:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398125.542388:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398125.542448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398125.542956:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337600 00000100:00100000:1.0:1787398125.542966:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337600 00000100:00100000:1.0:1787398125.543018:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787398125.543027:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398125.543058:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398125.551694:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701337600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8633us (9211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398125.551715:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787398125.556727:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701337728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398125.558065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398125.558182:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337728 00000100:00100000:1.0:1787398125.558193:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337728 00000100:00100000:1.0:1787398125.558261:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787398125.558271:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701337728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398125.558322:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:1.0:1787398125.558394:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3651:x1874218701337728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398125.558401:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787398125.558465:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701337728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398125.564609:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701337600:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787398125.567226:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:0.0:1787398125.567245:0:100452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1787398125.567308:0:100452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00100000:1.0:1787398125.578014:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:1.0:1787398125.578031:0:99635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901913 is committed 00000001:00080000:1.0:1787398125.578064:0:99635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901912 is committed 00000001:00080000:2.0:1787398125.582928:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018884 is committed 00010000:00010000:1.0:1787398126.437407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398127.465669:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398128.396044:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398128.396145:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398128.396178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398128.396199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398128.396228:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398128.396266:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364224 00000100:00100000:0.0:1787398128.396279:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364224 00000100:00100000:0.0:1787398128.396360:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364096 00000100:00100000:0.0:1787398128.396364:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364096 00000100:00100000:0.0:1787398128.396383:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787398128.396394:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681364224:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398128.396511:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681364224:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398128.396540:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:0.0:1787398128.396559:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787398128.396565:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2402:x1874218681364096:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398128.397325:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364480 00000100:00100000:1.0:1787398128.397338:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364480 00000100:00100000:1.0:1787398128.397401:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364352 00000100:00100000:1.0:1787398128.397404:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364352 00000100:00100000:1.0:1787398128.397430:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00100000:1.0:1787398128.397440:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364480:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398128.397495:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364480:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 57us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398128.397504:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 152 00000100:00100000:1.0:1787398128.397548:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 153 00000100:00100000:1.0:1787398128.397558:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364352:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398128.397747:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364352:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398128.397755:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 153 00000100:00080000:1.0:1787398128.397900:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398128.397908:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398128.397911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398128.397914:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398128.400281:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2402:x1874218681364096:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3690us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398128.400304:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:3.0:1787398128.405254:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681363968 00000100:00100000:3.0:1787398128.405279:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681363968 00000100:00100000:3.0:1787398128.405378:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 89 00000100:00100000:3.0:1787398128.405391:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681363968:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398128.405512:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681363968:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 124us (9485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398128.405548:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 89 00010000:00010000:2.0:1787398128.486324:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398128.620330:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701338112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398128.620443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398128.623019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398128.623123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398128.624361:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398128.624388:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701337984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398128.624481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398128.624691:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338112 00000100:00100000:1.0:1787398128.624706:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338112 00000100:00100000:1.0:1787398128.624802:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337984 00000100:00100000:1.0:1787398128.624806:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337984 00000100:00100000:1.0:1787398128.624861:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787398128.624873:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701338112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787398128.624931:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398128.624949:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787398128.624963:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701337984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398128.624988:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398128.625047:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701337984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398128.625057:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787398128.625129:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 2 00000100:00100000:3.0:1787398128.625167:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701337984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398128.628927:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701338112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4034us (8461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398128.628952:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787398128.629051:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701337856 00000100:00100000:1.0:1787398128.629064:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701337856 00000100:00100000:1.0:1787398128.629147:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787398128.629160:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701337856:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398128.629413:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 2 00000100:00100000:2.0:1787398128.629459:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701338112:0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1787398128.629838:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1787398128.630009:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701337856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 850us (6885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398128.630019:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787398128.630044:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398128.630051:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398128.631037:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701337856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398129.127897:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701338496:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.127912:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701338368:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.127983:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701338624:0@lo:400:kworker.0 00000100:00100000:1.0:1787398129.128061:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701338240:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.132628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.133359:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701338880:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.133429:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.133456:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701339392:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.133480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.133833:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338880 00000100:00100000:0.0:1787398129.133847:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338880 00000100:00100000:0.0:1787398129.134440:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339392 00000100:00100000:0.0:1787398129.134448:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339392 00000100:00100000:0.0:1787398129.134472:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787398129.134483:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.135314:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701338880:12345-0@lo:400:kworker.0 Request processed in 825us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.135329:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787398129.135368:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787398129.135378:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701339392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.135449:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701339392:12345-0@lo:400:kworker.0 Request processed in 73us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.135456:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787398129.135555:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018884 gen 2 00000004:00080000:0.0:1787398129.135582:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018881 committed transno 128849018884 00000004:00080000:0.0:1787398129.135623:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018882 committed transno 128849018884 00000004:00080000:0.0:1787398129.135648:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018883 committed transno 128849018884 00000004:00080000:0.0:1787398129.135663:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018884 committed transno 128849018884 00000100:00100000:0.0:1787398129.135679:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701338880:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.135697:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701339392:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.135763:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338368 00000100:00100000:0.0:1787398129.135771:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338368 00000100:00100000:0.0:1787398129.135836:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787398129.135844:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.135891:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701338368:12345-0@lo:400:kworker.0 Request processed in 49us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.135899:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787398129.135915:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398129.136243:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701338368:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398129.153322:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701339136:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398129.153429:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701339648:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398129.153548:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339136 00000100:00100000:2.0:1787398129.153559:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339136 00000100:00100000:2.0:1787398129.153647:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339648 00000100:00100000:2.0:1787398129.153651:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339648 00000100:00100000:2.0:1787398129.153693:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787398129.153703:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701339136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153779:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701339136:12345-0@lo:400:kworker.0 Request processed in 76us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398129.153787:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787398129.153809:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787398129.153815:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701339648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153846:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701339648:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398129.153852:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787398129.153880:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398129.153925:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701339136:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.153946:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000100:00100000:2.0:1787398129.153974:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701339648:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.154346:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338624 00000100:00100000:0.0:1787398129.154354:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338624 00000100:00100000:0.0:1787398129.154420:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787398129.154427:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701338624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.154477:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701338624:12345-0@lo:400:kworker.0 Request processed in 51us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.154500:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787398129.157701:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398129.157812:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701338624:0@lo:400:kworker.0 00000100:00100000:3.0:1787398129.163998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398129.164066:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701339008:0@lo:400:kworker.0 00000100:00100000:3.0:1787398129.164122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398129.164172:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701339520:0@lo:400:kworker.0 00000100:00100000:3.0:1787398129.164198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.164339:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338496 00000100:00100000:0.0:1787398129.164351:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338496 00000100:00100000:0.0:1787398129.164435:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787398129.164452:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.164562:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339008 00000100:00100000:2.0:1787398129.164568:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339008 00000100:00100000:2.0:1787398129.164622:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339520 00000100:00100000:2.0:1787398129.164646:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339520 00000100:00100000:2.0:1787398129.164677:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787398129.164684:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701339008:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787398129.164854:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398129.164866:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398129.164883:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787398129.164893:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.173131:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701338496:12345-0@lo:400:kworker.0 Request processed in 8671us (9129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.173153:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787398129.177111:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701339008:12345-0@lo:400:kworker.0 Request processed in 12409us (12969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398129.177134:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787398129.177299:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701338496:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.177316:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701339008:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.188806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.188890:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701338752:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.188969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398129.188982:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338240 00000100:00100000:1.0:1787398129.188996:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338240 00000100:00100000:0.0:1787398129.189011:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701339264:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.189037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.189063:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701338752 00000100:00100000:1.0:1787398129.189067:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787398129.189068:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701338752 00000100:00100000:1.0:1787398129.189076:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.189112:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339264 00000100:00100000:0.0:1787398129.189115:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339264 00000100:00100000:0.0:1787398129.189129:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787398129.189134:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398129.189141:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701338240:12345-0@lo:400:kworker.0 Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398129.189168:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787398129.189168:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701338752:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.189174:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787398129.189187:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787398129.189192:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701339264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398129.189224:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701339776:0@lo:400:kworker.0 00000100:00080000:2.0:1787398129.189322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398129.189547:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701339264:12345-0@lo:400:kworker.0 Request processed in 328us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.189580:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787398129.201718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398129.201858:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701338240:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.201887:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701338752:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.201904:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701339264:0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.206069:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339776 00000100:00100000:2.0:1787398129.206096:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339776 00000100:00100000:2.0:1787398129.206235:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787398129.206251:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398129.206439:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701339776:12345-0@lo:400:kworker.0 Request processed in 192us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398129.206448:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787398129.206840:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701339776:0@lo:400:kworker.0 00000100:00100000:0.0:1787398129.208710:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701339520:12345-0@lo:400:kworker.0 Request processed in 43802us (44493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398129.208732:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787398129.209118:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 2 00000100:00100000:3.0:1787398129.209149:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701339520:0@lo:400:kworker.0 00010000:00010000:2.0:1787398129.510456:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398130.533991:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398130.661236:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701340160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398130.661840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398130.662004:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340160 00000100:00100000:1.0:1787398130.662035:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340160 00000100:00100000:1.0:1787398130.662110:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787398130.662122:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701340160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398130.662165:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398130.662252:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701340160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398130.662261:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787398130.662644:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701340160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398130.664187:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701339904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398130.664376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398130.664604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398130.664614:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701340032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398130.664650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398130.665258:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340032 00000100:00100000:2.0:1787398130.665730:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340032 00000100:00100000:2.0:1787398130.665816:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787398130.665828:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701340032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398130.665873:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398130.665977:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701340032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398130.666004:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787398130.667933:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701339904 00000100:00100000:0.0:1787398130.667954:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701339904 00000100:00100000:0.0:1787398130.668027:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787398130.668038:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701339904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787398130.668086:0:107321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787398130.668180:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701339904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398130.668188:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787398130.672668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701340032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398130.672699:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701339904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787398131.558720:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787398131.845434:0:108233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00010000:00010000:3.0:1787398132.580697:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398133.516341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398133.516373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398133.516407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398133.516423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398133.516467:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364736 00000100:00100000:3.0:1787398133.516479:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364736 00000100:00100000:1.0:1787398133.516496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398133.516549:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364864 00000100:00100000:1.0:1787398133.516554:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364864 00000100:00100000:3.0:1787398133.516590:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787398133.516604:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2403:x1874218681364736:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398133.516651:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364608 00000100:00100000:0.0:1787398133.516657:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364608 00000100:00100000:0.0:1787398133.516694:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:0.0:1787398133.516702:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681364608:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398133.516716:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:2403:x1874218681364736:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 114us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398133.516743:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681364608:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398133.516769:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 91 00000100:00100000:0.0:1787398133.516809:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681364992 00000100:00100000:0.0:1787398133.516814:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681364992 00000100:00100000:0.0:1787398133.516840:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365120 00000100:00100000:0.0:1787398133.516843:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365120 00000100:00100000:0.0:1787398133.516864:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:0.0:1787398133.516872:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364992:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398133.516899:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681364992:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398133.516906:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 158 00000100:00100000:0.0:1787398133.516918:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 159 00000100:00100000:0.0:1787398133.516923:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681365120:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398133.516945:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2402:x1874218681365120:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398133.516951:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 159 00000100:00100000:0.0:1787398133.517009:0:107263:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787398133.517016:0:107263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1787398133.517031:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398133.517035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398133.517037:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398133.517040:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398133.519763:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:1.0:1787398133.519789:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681364864:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398133.519884:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:2402:x1874218681364864:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 108us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398133.519893:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:3.0:1787398133.521928:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00010000:00010000:0.0:1787398133.605614:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787398133.639333:0:108282:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1787398133.736514:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701340288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398133.736616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398133.736768:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340288 00000100:00100000:0.0:1787398133.736776:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340288 00000100:00100000:0.0:1787398133.736939:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787398133.736951:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701340288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787398133.736991:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:0.0:1787398133.737050:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701340288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398133.737057:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787398133.737161:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701340288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398133.737831:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701340416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398133.737877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398133.737936:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340416 00000100:00100000:2.0:1787398133.737941:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340416 00000100:00100000:2.0:1787398133.737987:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787398133.737995:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701340416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398133.738020:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398133.738058:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701340416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398133.738066:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787398133.738084:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398133.738114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701340416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398133.738462:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701340544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398133.738493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398133.738629:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340544 00000100:00100000:3.0:1787398133.738634:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340544 00000100:00100000:3.0:1787398133.738680:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787398133.738688:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701340544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398133.738706:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398133.738740:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701340544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398133.738747:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1787398133.739421:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398133.739462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701340544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398134.245989:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701340672:0@lo:400:kworker.0 00000100:00100000:3.0:1787398134.246081:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398134.246284:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340672 00000100:00100000:2.0:1787398134.246294:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340672 00000100:00100000:2.0:1787398134.246353:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787398134.246363:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701340672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.246504:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701340800:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.246565:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.246605:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340800 00000100:00100000:1.0:1787398134.246609:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340800 00000100:00100000:1.0:1787398134.246648:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787398134.246670:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701340800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.246710:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701340800:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398134.246718:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787398134.246742:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398134.246790:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701340800:0@lo:400:kworker.0 00000100:00100000:2.0:1787398134.248844:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701340672:12345-0@lo:400:kworker.0 Request processed in 2473us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398134.248858:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787398134.249347:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701341056:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249405:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.249431:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701341568:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.249486:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787398134.249492:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701340928:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.249567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701341440:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.249621:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341056 00000100:00100000:1.0:1787398134.249628:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341056 00000100:00100000:1.0:1787398134.249683:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701340928 00000100:00100000:1.0:1787398134.249687:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701340928 00000100:00100000:1.0:1787398134.249702:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341440 00000100:00100000:1.0:1787398134.249705:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341440 00000100:00100000:1.0:1787398134.249719:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787398134.249728:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701341056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249797:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874218701341056:12345-0@lo:400:kworker.0 Request processed in 70us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398134.249804:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787398134.249835:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787398134.249841:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701340928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249877:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701340928:12345-0@lo:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398134.249883:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787398134.249894:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787398134.249901:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701341440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.249936:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874218701341440:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398134.249942:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787398134.249963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398134.249968:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398134.250002:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701340928:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.250013:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874218701341440:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.250026:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1874218701341056:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.250074:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701341312:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.250104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398134.250320:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341568 00000100:00100000:2.0:1787398134.250332:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341568 00000100:00100000:2.0:1787398134.250373:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787398134.250379:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701341568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398134.250427:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701341568:12345-0@lo:400:kworker.0 Request processed in 48us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398134.250433:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1787398134.250447:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398134.250468:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701341568:0@lo:400:kworker.0 00000100:00100000:2.0:1787398134.250493:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341312 00000100:00100000:2.0:1787398134.250508:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341312 00000100:00100000:2.0:1787398134.250552:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787398134.250559:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701341312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398134.250593:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701341312:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398134.250599:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787398134.250877:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787398134.250890:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701341824:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.250918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.250992:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701341184:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.251016:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398134.251093:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701340672:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.251187:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701341696:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.251231:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398134.251280:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701341312:0@lo:400:kworker.0 00000100:00100000:3.0:1787398134.251402:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341696 00000100:00100000:3.0:1787398134.251407:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341696 00000100:00100000:3.0:1787398134.251463:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787398134.251474:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701341696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398134.251554:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701341696:12345-0@lo:400:kworker.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398134.251561:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1787398134.251662:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398134.251689:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701341696:0@lo:400:kworker.0 00000100:00100000:0.0:1787398134.251874:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341824 00000100:00100000:0.0:1787398134.251879:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341824 00000100:00100000:0.0:1787398134.251919:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341184 00000100:00100000:0.0:1787398134.251922:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341184 00000100:00100000:0.0:1787398134.252004:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787398134.252011:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701341824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398134.252050:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701341824:12345-0@lo:400:kworker.0 Request processed in 39us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398134.252055:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787398134.252067:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787398134.252073:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398134.252099:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701341184:12345-0@lo:400:kworker.0 Request processed in 27us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398134.252105:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787398134.252209:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701341824:0@lo:400:kworker.0 00000100:00100000:1.0:1787398134.252223:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701341184:0@lo:400:kworker.0 00000100:00080000:3.0:1787398134.252474:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787398134.630185:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787398135.165237:0:108330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1787398135.653281:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398135.781937:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701341952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398135.782018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398135.782167:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701341952 00000100:00100000:0.0:1787398135.782179:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701341952 00000100:00100000:0.0:1787398135.782244:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787398135.782254:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701341952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787398135.782290:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398135.782360:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701341952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398135.782374:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787398135.782584:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701341952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398135.782929:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787398135.782944:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701342208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398135.782984:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398135.783106:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398135.783115:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701342080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398135.783162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398135.783238:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342080 00000100:00100000:2.0:1787398135.783244:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342080 00000100:00100000:2.0:1787398135.783282:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787398135.783291:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701342080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398135.783316:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398135.783360:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701342080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398135.783373:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787398135.783410:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701342080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398135.783737:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342208 00000100:00100000:3.0:1787398135.783742:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342208 00000100:00100000:3.0:1787398135.783782:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787398135.783789:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701342208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398135.783813:0:107321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:3.0:1787398135.783859:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701342208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398135.783875:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787398135.783953:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701342208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787398136.677870:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398137.039700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.040084:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365248 00000100:00100000:0.0:1787398137.040095:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365248 00000100:00100000:0.0:1787398137.040181:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:0.0:1787398137.040397:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80586:x1874218681365248:12345-192.168.204.60@tcp:41:lfs.0 00000100:00080000:3.0:1787398137.040623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787398137.041762:0:107265:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445109760 avail 1298870272 00000100:00100000:0.0:1787398137.041924:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80586:x1874218681365248:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 1730us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.041935:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 25 00000100:00100000:3.0:1787398137.051914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.052021:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365376 00000100:00100000:1.0:1787398137.052034:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365376 00000100:00100000:1.0:1787398137.052115:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00100000:1.0:1787398137.052127:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:80586:x1874218681365376:12345-192.168.204.60@tcp:41:lfs.0 00000004:00000024:1.0:1787398137.052170:0:107263:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445535744 avail 1299296256 00000100:00100000:1.0:1787398137.052254:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:80586:x1874218681365376:12345-192.168.204.60@tcp:41:lfs.0 Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398137.052263:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 26 00000100:00080000:3.0:1787398137.053470:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787398137.058667:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.058740:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365504 00000100:00100000:3.0:1787398137.058753:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365504 00000100:00100000:3.0:1787398137.058898:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 154 00000100:00100000:3.0:1787398137.058918:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:80586:x1874218681365504:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:3.0:1787398137.058947:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398137.059032:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:80586:x1874218681365504:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.059041:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 154 00000100:00080000:1.0:1787398137.062692:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398137.067500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.067719:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365632 00000100:00100000:2.0:1787398137.067729:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365632 00000100:00100000:2.0:1787398137.067803:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00100000:2.0:1787398137.067814:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:80586:x1874218681365632:12345-192.168.204.60@tcp:13:lfs.0 00002000:00000024:2.0:1787398137.067841:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398137.067927:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:80586:x1874218681365632:12345-192.168.204.60@tcp:13:lfs.0 Request processed in 114us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.067934:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 155 00000100:00080000:1.0:1787398137.069092:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787398137.134643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.134748:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365760 00000100:00100000:2.0:1787398137.134758:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365760 00000100:00100000:2.0:1787398137.134820:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 734 00000100:00100000:2.0:1787398137.134831:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:70886:x1874218681365760:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787398137.134846:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398137.134871:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582a00/0x274786fe0d194403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e2 expref: 8 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.134891:0:19662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a70526ec00) 00010000:00010000:2.0:1787398137.134913:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398137.134978:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:70886:x1874218681365760:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.134986:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 734 00000100:00100000:0.0:1787398137.205845:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.211793:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681365888 00000100:00100000:2.0:1787398137.211808:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681365888 00000100:00100000:2.0:1787398137.211911:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:2.0:1787398137.211923:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:80610:x1874218681365888:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398137.211946:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.211969:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88e9 expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212039:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212065:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212078:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.212125:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787398137.212128:0:107264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398137.212163:0:107264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212429:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e9 expref: 9 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212462:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e9 expref: 8 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.212471:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453b00) 00010000:00010000:2.0:1787398137.212474:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398137.212478:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aac00, rc 0) 00000100:00100000:2.0:1787398137.212802:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80610:x1874218681365888:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 880us (6966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.212819:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 27 00000100:00100000:1.0:1787398137.219640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.220783:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366016 00000100:00100000:0.0:1787398137.220800:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366016 00000100:00100000:0.0:1787398137.220872:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:0.0:1787398137.220882:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80610:x1874218681366016:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:0.0:1787398137.221008:0:107263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.221032:0:107263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88f0 expref: -99 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221179:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221311:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221324:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221481:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221491:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221498:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221712:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221722:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221729:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398137.221766:0:107263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00000004:00200000:0.0:1787398137.221771:0:107263:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787398137.221795:0:107263:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221808:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221815:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221822:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221840:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398137.221845:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221852:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221866:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453b00) 00010000:00010000:0.0:1787398137.221869:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398137.221873:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221880:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d19443b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221894:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221901:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221921:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221927:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398137.221930:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221935:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221955:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a807d24f00) 00010000:00010000:0.0:1787398137.221958:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398137.221961:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.221967:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d194442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.222003:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 10 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.222018:0:107263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 9 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.222026:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:0.0:1787398137.222028:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787398137.222031:0:107263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74a00, rc 0) 00000100:00100000:0.0:1787398137.222596:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:80610:x1874218681366016:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 1713us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.222606:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 28 00000100:00100000:1.0:1787398137.225864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.226561:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366144 00000100:00100000:2.0:1787398137.226577:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366144 00000100:00100000:2.0:1787398137.226652:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:2.0:1787398137.226665:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:80610:x1874218681366144:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398137.226691:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.226714:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d194450 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88f7 expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226791:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226808:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226820:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226835:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226841:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.226847:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398137.227062:0:107264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:107264:1874218701342336:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787398137.227126:0:107264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398137.227175:0:107264:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7049bb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.227422:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342336 00000100:00100000:3.0:1787398137.227427:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342336 00000100:00100000:3.0:1787398137.227489:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787398137.227498:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:107264:x1874218701342336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787398137.227692:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:107264:x1874218701342336:12345-0@lo:1000:mdt00_001.0 Request processed in 195us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.227702:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787398137.228425:0:107264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:107264:1874218701342336:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787398137.228495:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228510:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228551:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398137.228578:0:107264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228592:0:107264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228598:0:107264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228605:0:107264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228611:0:107264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.228615:0:107264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228623:0:107264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228635:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:2.0:1787398137.228637:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398137.228654:0:107264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228661:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d194457 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228674:0:107264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228680:0:107264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228686:0:107264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228691:0:107264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.228694:0:107264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228700:0:107264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228708:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a702453400) 00010000:00010000:2.0:1787398137.228711:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398137.228714:0:107264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228719:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d19445e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228758:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d194450 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f7 expref: 11 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228785:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f7 expref: 10 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.228793:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453f00) 00010000:00010000:2.0:1787398137.228795:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398137.228797:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab000, rc 0) 00000100:00100000:2.0:1787398137.228852:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80610:x1874218681366144:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 2190us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.228860:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 29 00000100:00100000:1.0:1787398137.232984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.233250:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366272 00000100:00100000:2.0:1787398137.233260:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366272 00000100:00100000:2.0:1787398137.233320:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:2.0:1787398137.233331:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+7:80610:x1874218681366272:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398137.233364:0:108265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.233387:0:108265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050abc00/0x274786fe0d19446c lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d88fe expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.233464:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d194473 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.233478:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d194473 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.233494:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d194473 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.233632:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1787398137.233648:0:108265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787398137.233709:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050abc00/0x274786fe0d19446c lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88fe expref: 9 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.233727:0:108265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d194473 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88fe expref: 8 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.233735:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453700) 00010000:00010000:2.0:1787398137.233738:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787398137.233741:0:108265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:2.0:1787398137.233858:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80610:x1874218681366272:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 529us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.233864:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 30 00000100:00100000:0.0:1787398137.242074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.242263:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366400 00000100:00100000:1.0:1787398137.242287:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366400 00000100:00100000:1.0:1787398137.242391:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:1.0:1787398137.242402:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80610:x1874218681366400:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:1.0:1787398137.242423:0:107265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398137.242485:0:107265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe200/0x274786fe0d19447a lrc: 2/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8905 expref: -99 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242581:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/1,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242595:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/1,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242607:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/1,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242619:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/1,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242627:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242632:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242714:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242723:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242730:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.242783:0:107265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00000004:00200000:1.0:1787398137.242787:0:107265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787398137.242809:0:107265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242822:0:107265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/1,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242829:0:107265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 2/0,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242835:0:107265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/0,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242841:0:107265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff200 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.242845:0:107265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 3/0,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242852:0:107265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 4/0,0 mode: CR/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242864:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a81a964f00) 00010000:00010000:1.0:1787398137.242867:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398137.242871:0:107265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 2/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242877:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff200/0x274786fe0d194481 lrc: 0/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242888:0:107265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242903:0:107265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 2/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242909:0:107265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242914:0:107265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff600 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.242917:0:107265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 3/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242922:0:107265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 4/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242930:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a81a964e00) 00010000:00010000:1.0:1787398137.242932:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398137.242935:0:107265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 2/0,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242941:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ff600/0x274786fe0d194488 lrc: 0/0,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242969:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe200/0x274786fe0d19447a lrc: 0/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8905 expref: 12 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242985:0:107265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8905 expref: 11 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.242992:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:1.0:1787398137.242994:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787398137.243002:0:107265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345fea00, rc 0) 00000100:00100000:1.0:1787398137.244013:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:80610:x1874218681366400:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 1607us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398137.244024:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:1.0:1787398137.263664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.263763:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366656 00000100:00100000:2.0:1787398137.263776:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366656 00000100:00100000:2.0:1787398137.263843:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:2.0:1787398137.263854:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:80614:x1874218681366656:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398137.263875:0:108265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.263898:0:108265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194496 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d890c expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.264004:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1787398137.264132:0:108265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194496 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d890c expref: 13 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.264147:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:2.0:1787398137.264151:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398137.264168:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194496 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d890c expref: 13 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.264182:0:108265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050abc00, rc 0) 00000100:00100000:2.0:1787398137.264246:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80614:x1874218681366656:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 394us (592us total) trans 128849018885 rc 301/301 00000100:00100000:2.0:1787398137.264253:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:0.0:1787398137.271986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.272103:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681366784 00000100:00100000:3.0:1787398137.272116:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681366784 00000100:00100000:3.0:1787398137.272170:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:3.0:1787398137.272181:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80614:x1874218681366784:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:3.0:1787398137.272294:0:107266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00000004:00200000:3.0:1787398137.272299:0:107266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1787398137.272587:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80614:x1874218681366784:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 405us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.272611:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 0 00000100:00100000:1.0:1787398137.278991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.279114:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367040 00000100:00100000:0.0:1787398137.279126:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367040 00000100:00100000:0.0:1787398137.279191:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:0.0:1787398137.279202:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80614:x1874218681367040:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787398137.279828:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80614:x1874218681367040:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 624us (846us total) trans 128849018886 rc 0/0 00000100:00100000:0.0:1787398137.279852:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 1 00000100:00100000:1.0:1787398137.307406:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.307575:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367296 00000100:00100000:2.0:1787398137.307586:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367296 00000100:00100000:2.0:1787398137.307649:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:2.0:1787398137.307659:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80617:x1874218681367296:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398137.307685:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.307706:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1944a4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8913 expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.307814:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1944ab lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.307831:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1944ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.307844:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1944ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.307855:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1787398137.307964:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d1944a4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8913 expref: 16 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.307984:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1944ab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8913 expref: 15 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.308008:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:2.0:1787398137.308011:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787398137.308015:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aae00, rc 0) 00000100:00100000:2.0:1787398137.308627:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80617:x1874218681367296:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 964us (1227us total) trans 128849018887 rc 0/0 00000100:00100000:2.0:1787398137.308637:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 33 00000100:00100000:1.0:1787398137.320917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.322160:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367424 00000100:00100000:0.0:1787398137.322177:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367424 00000100:00100000:0.0:1787398137.322262:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787398137.322273:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80617:x1874218681367424:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398137.322383:0:107267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00000004:00200000:0.0:1787398137.322388:0:107267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398137.322479:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80617:x1874218681367424:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 207us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.322488:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2 00000100:00100000:0.0:1787398137.357605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.357697:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367552 00000100:00100000:2.0:1787398137.357707:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367552 00000100:00100000:2.0:1787398137.357764:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:2.0:1787398137.357773:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+8:80620:x1874218681367552:12345-192.168.204.60@tcp:101:checkstat.0 00010000:00010000:2.0:1787398137.357793:0:108265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.357816:0:108265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050abc00/0x274786fe0d1944b9 lrc: 2/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d891a expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357887:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/1,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357901:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/1,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357913:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/1,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357925:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/1,0 mode: --/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357933:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.357953:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358028:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358038:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358045:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.358167:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1787398137.358170:0:108265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787398137.358188:0:108265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358199:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/1,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358206:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 2/0,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358212:0:108265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/0,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358218:0:108265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.358221:0:108265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 3/0,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358229:0:108265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 4/0,0 mode: CR/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358248:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a702453400) 00010000:00010000:2.0:1787398137.358251:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398137.358255:0:108265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 2/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358262:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944c0 lrc: 0/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358275:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358282:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 2/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358288:0:108265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358293:0:108265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.358296:0:108265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 3/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358302:0:108265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 4/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358308:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a702453000) 00010000:00010000:2.0:1787398137.358311:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398137.358314:0:108265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 2/0,0 mode: --/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358320:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa800/0x274786fe0d1944c7 lrc: 0/0,0 mode: --/PR res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358446:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050abc00/0x274786fe0d1944b9 lrc: 0/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d891a expref: 10 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358464:0:108265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d891a expref: 9 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.358472:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:2.0:1787398137.358474:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787398137.358477:0:108265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa400, rc 0) 00000100:00100000:2.0:1787398137.358606:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:80620:x1874218681367552:12345-192.168.204.60@tcp:101:checkstat.0 Request processed in 833us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.358614:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 34 00000100:00100000:1.0:1787398137.388889:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.388995:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367808 00000100:00100000:0.0:1787398137.389006:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367808 00000100:00100000:0.0:1787398137.389080:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:0.0:1787398137.389092:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+9:80621:x1874218681367808:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:0.0:1787398137.389115:0:107265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.389139:0:107265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d1944d5 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8921 expref: -99 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398137.389280:0:107265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00010000:00010000:0.0:1787398137.389424:0:107265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d1944d5 lrc: 1/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8921 expref: 11 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.389450:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:0.0:1787398137.389454:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787398137.389460:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74000/0x274786fe0d1944d5 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8921 expref: 11 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.389494:0:107265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74000, rc 0) 00000100:00100000:0.0:1787398137.389887:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80621:x1874218681367808:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 795us (1006us total) trans 90194313217 rc 301/301 00000100:00100000:0.0:1787398137.389897:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 35 00000100:00100000:3.0:1787398137.393129:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.393351:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681367936 00000100:00100000:0.0:1787398137.393376:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681367936 00000100:00100000:0.0:1787398137.393448:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:0.0:1787398137.393460:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80621:x1874218681367936:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398137.393609:0:107267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00000004:00200000:0.0:1787398137.393614:0:107267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398137.393682:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80621:x1874218681367936:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 224us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.393689:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 3 00000100:00100000:2.0:1787398137.397759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.397854:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681368192 00000100:00100000:0.0:1787398137.397865:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681368192 00000100:00100000:0.0:1787398137.397939:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:0.0:1787398137.397950:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+10:80621:x1874218681368192:12345-192.168.204.60@tcp:35:lfs.0 00000100:00100000:0.0:1787398137.398192:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:80621:x1874218681368192:12345-192.168.204.60@tcp:35:lfs.0 Request processed in 243us (445us total) trans 90194313218 rc 0/0 00000100:00100000:0.0:1787398137.398201:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 4 00000100:00100000:1.0:1787398137.427378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.427479:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681368448 00000100:00100000:2.0:1787398137.427492:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681368448 00000100:00100000:2.0:1787398137.427598:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:2.0:1787398137.427609:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:80622:x1874218681368448:12345-192.168.204.60@tcp:101:lfs.0 00010000:00010000:2.0:1787398137.427637:0:108265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.427658:0:108265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944e3 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8928 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.427776:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1944ea lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.427792:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1944ea lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.427827:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1944ea lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.427842:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1787398137.427963:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050ab800/0x274786fe0d1944e3 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8928 expref: 14 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.427983:0:108265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1944ea lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8928 expref: 13 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.427993:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:2.0:1787398137.427996:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787398137.427999:0:108265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aaa00, rc 0) 00000100:00100000:2.0:1787398137.428430:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80622:x1874218681368448:12345-192.168.204.60@tcp:101:lfs.0 Request processed in 820us (1060us total) trans 90194313219 rc 0/0 00000100:00100000:2.0:1787398137.428450:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 36 00000100:00100000:2.0:1787398137.438642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.440497:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681368576 00000100:00100000:0.0:1787398137.440512:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681368576 00000100:00100000:0.0:1787398137.440627:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:0.0:1787398137.440639:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80622:x1874218681368576:12345-192.168.204.60@tcp:33:lfs.0 00000004:00200000:0.0:1787398137.440751:0:107267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00000004:00200000:0.0:1787398137.440755:0:107267:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1787398137.440832:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80622:x1874218681368576:12345-192.168.204.60@tcp:33:lfs.0 Request processed in 194us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.440840:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 5 00000100:00100000:0.0:1787398137.460785:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.460940:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681368832 00000100:00100000:2.0:1787398137.460953:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681368832 00000100:00100000:2.0:1787398137.461018:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:2.0:1787398137.461027:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80623:x1874218681368832:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398137.461057:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.461080:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d1944f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d892f expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.461343:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00010000:00010000:2.0:1787398137.461496:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d1944f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d892f expref: 17 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.461766:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453b00) 00010000:00010000:2.0:1787398137.461769:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398137.461776:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab800/0x274786fe0d1944f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d892f expref: 17 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.461793:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050ab800, rc 0) 00000100:00100000:2.0:1787398137.461869:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681368832:12345-192.168.204.60@tcp:101:rm.0 Request processed in 842us (1097us total) trans 128849018888 rc 301/301 00000100:00100000:2.0:1787398137.461876:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 37 00000100:00100000:1.0:1787398137.467219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.467315:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681368960 00000100:00100000:0.0:1787398137.467328:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681368960 00000100:00100000:0.0:1787398137.467405:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:0.0:1787398137.467417:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681368960:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:0.0:1787398137.472204:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681368960:12345-192.168.204.60@tcp:37:rm.0 Request processed in 4756us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.472221:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 6 00000100:00100000:2.0:1787398137.475773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.475934:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681369216 00000100:00100000:3.0:1787398137.475945:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681369216 00000100:00100000:3.0:1787398137.476057:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:3.0:1787398137.476069:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681369216:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:3.0:1787398137.476832:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:80623:x1874218681369216:12345-192.168.204.60@tcp:35:rm.0 Request processed in 763us (1068us total) trans 128849018889 rc 0/0 00000100:00100000:3.0:1787398137.476842:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 7 00000100:00100000:1.0:1787398137.479904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.479983:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681369472 00000100:00100000:0.0:1787398137.479994:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681369472 00000100:00100000:0.0:1787398137.480064:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:0.0:1787398137.480074:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:80623:x1874218681369472:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787398137.480099:0:107263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.480119:0:107263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d194506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8936 expref: -99 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.480241:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19450d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.480256:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19450d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.480269:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19450d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398137.480292:0:107263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1787398137.480398:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74c00/0x274786fe0d194506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8936 expref: 20 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.480415:0:107263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19450d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8936 expref: 19 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.480424:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:0.0:1787398137.480427:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787398137.480439:0:107263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74000, rc 0) 00000100:00100000:0.0:1787398137.480500:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681369472:12345-192.168.204.60@tcp:101:rm.0 Request processed in 428us (606us total) trans 128849018890 rc 0/0 00000100:00100000:0.0:1787398137.480508:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 38 00000100:00100000:2.0:1787398137.484474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.484575:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681369600 00000100:00100000:0.0:1787398137.484585:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681369600 00000100:00100000:0.0:1787398137.484646:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787398137.484657:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80623:x1874218681369600:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:0.0:1787398137.484677:0:107265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.484699:0:107265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d19451b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d893d expref: -99 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398137.484792:0:107265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:107265:1874218701342464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787398137.484845:0:107265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398137.484886:0:107265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e4deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.485012:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342464 00000100:00100000:3.0:1787398137.485018:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342464 00000100:00100000:3.0:1787398137.485067:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787398137.485076:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107265:x1874218701342464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787398137.485200:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107265:x1874218701342464:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.485209:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787398137.485811:0:107265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:107265:1874218701342464:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787398137.485895:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.485911:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.485925:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.486027:0:107265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1787398137.486033:0:107265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787398137.486135:0:107265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.486168:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a75e00/0x274786fe0d19451b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d893d expref: 15 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.486308:0:107265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d893d expref: 14 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.486317:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453700) 00010000:00010000:1.0:1787398137.486320:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787398137.486324:0:107265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345ff400, rc 0) 00000100:00100000:1.0:1787398137.486560:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:80623:x1874218681369600:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1867us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398137.486568:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:3.0:1787398137.496413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.496758:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681369728 00000100:00100000:0.0:1787398137.496769:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681369728 00000100:00100000:1.0:1787398137.496939:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:1.0:1787398137.496951:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:80623:x1874218681369728:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787398137.496974:0:107263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398137.497000:0:107263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d194529 lrc: 2/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8944 expref: -99 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.497185:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe800/0x274786fe0d194530 lrc: 3/1,0 mode: --/PR res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.497200:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe800/0x274786fe0d194530 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.497213:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe800/0x274786fe0d194530 lrc: 3/1,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.497273:0:107263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240009870:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787398137.497279:0:107263:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787398137.497321:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d194529 lrc: 0/0,0 mode: --/CR res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8944 expref: 16 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.497444:0:107263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe800/0x274786fe0d194530 lrc: 3/0,0 mode: PR/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8944 expref: 15 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.497454:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81a964f00) 00010000:00010000:1.0:1787398137.497458:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787398137.497462:0:107263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345fe800, rc 0) 00000100:00100000:1.0:1787398137.497731:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80623:x1874218681369728:12345-192.168.204.60@tcp:101:rm.0 Request processed in 781us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398137.497739:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:0.0:1787398137.500749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.500841:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681369856 00000100:00100000:2.0:1787398137.500852:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681369856 00000100:00100000:2.0:1787398137.500944:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:2.0:1787398137.500955:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681369856:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:2.0:1787398137.500980:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.501004:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194537 lrc: 2/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d894b expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.501075:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d19453e lrc: 3/1,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.501089:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d19453e lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.501101:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d19453e lrc: 3/1,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.501160:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000dec1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787398137.501165:0:107264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787398137.501203:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050abc00/0x274786fe0d194537 lrc: 0/0,0 mode: --/CR res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d894b expref: 21 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.501222:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d19453e lrc: 3/0,0 mode: PR/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d894b expref: 20 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.501232:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a702453400) 00010000:00010000:2.0:1787398137.501235:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787398137.501238:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aa800, rc 0) 00000100:00100000:2.0:1787398137.501309:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:80623:x1874218681369856:12345-192.168.204.60@tcp:101:rm.0 Request processed in 355us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.501317:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 41 00000100:00100000:2.0:1787398137.504450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.504563:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681370112 00000100:00100000:1.0:1787398137.504577:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681370112 00000100:00100000:1.0:1787398137.504635:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:1.0:1787398137.504645:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80623:x1874218681370112:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787398137.504667:0:108265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398137.504691:0:108265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d194545 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8952 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.504834:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1787398137.504930:0:108265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d194545 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8952 expref: 17 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.504944:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a964e00) 00010000:00010000:1.0:1787398137.504947:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787398137.504951:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d194545 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8952 expref: 17 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.504989:0:108265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345ff800, rc 0) 00000100:00100000:1.0:1787398137.505035:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681370112:12345-192.168.204.60@tcp:101:rm.0 Request processed in 392us (609us total) trans 90194313220 rc 301/301 00000100:00100000:1.0:1787398137.505043:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 42 00000100:00100000:3.0:1787398137.509377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.509478:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681370240 00000100:00100000:0.0:1787398137.509489:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681370240 00000100:00100000:0.0:1787398137.509580:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:0.0:1787398137.509591:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681370240:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787398137.513621:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681370240:12345-192.168.204.60@tcp:37:rm.0 Request processed in 4021us (4244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.513638:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 8 00000100:00100000:2.0:1787398137.518103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.518198:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681370368 00000100:00100000:3.0:1787398137.518210:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681370368 00000100:00100000:3.0:1787398137.518269:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:3.0:1787398137.518278:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:80623:x1874218681370368:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787398137.522201:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:80623:x1874218681370368:12345-192.168.204.60@tcp:37:rm.0 Request processed in 3911us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.522215:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 9 00000100:00100000:1.0:1787398137.525906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.526003:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681370624 00000100:00100000:0.0:1787398137.526014:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681370624 00000100:00100000:0.0:1787398137.526073:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:0.0:1787398137.526083:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+16:80623:x1874218681370624:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787398137.526335:0:107267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107267:1874218701342592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787398137.526405:0:107267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398137.526450:0:107267:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82e4deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.526579:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342592 00000100:00100000:2.0:1787398137.526584:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342592 00000100:00100000:2.0:1787398137.526621:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787398137.526628:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107267:x1874218701342592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787398137.526717:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107267:x1874218701342592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.526725:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787398137.526809:0:107267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107267:1874218701342592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787398137.526890:0:107267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107267:1874218701342720:0@lo:700:mdt_rdpg00_001.0 00000100:00100000:0.0:1787398137.526919:0:107267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398137.526943:0:107267:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.527091:0:107272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342720 00000100:00100000:2.0:1787398137.527096:0:107272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342720 00000100:00100000:2.0:1787398137.527141:0:107272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787398137.527164:0:107272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:107267:x1874218701342720:12345-0@lo:700:mdt_rdpg00_001.0 00000100:00100000:2.0:1787398137.527224:0:107272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:107267:x1874218701342720:12345-0@lo:700:mdt_rdpg00_001.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.527231:0:107272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787398137.527304:0:107267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107267:1874218701342720:0@lo:700:mdt_rdpg00_001.0 00000040:00080000:3.0:1787398137.527390:0:107267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398137.527409:0:107267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].31, 64 off34752 00000004:00080000:3.0:1787398137.527417:0:107267:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a810ca1e40 with version 5 00000040:00080000:3.0:1787398137.527493:0:107267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398137.527503:0:107267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].32, 64 off34816 00000004:00080000:3.0:1787398137.527509:0:107267:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8356a3540 with version 6 00000040:00080000:3.0:1787398137.527838:0:107267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398137.527872:0:107267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].16, 64 off33792 00000040:00080000:3.0:1787398137.528160:0:107267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x24000a040:0x1:0x0].1, 344 off33112 00000040:00080000:3.0:1787398137.528242:0:107267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].1, 424 off33192 00000004:00080000:3.0:1787398137.528248:0:107267:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a82e4ded80 with version 7 00000004:00080000:1.0:1787398137.528327:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 5 rpc_version 5 00000020:00100000:1.0:1787398137.528354:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398137.528363:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70350a300 x1874218701342976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398137.528380:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701342976:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.528424:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.528465:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.528766:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701342976 00000100:00100000:3.0:1787398137.528775:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701342976 00000100:00100000:3.0:1787398137.528870:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787398137.528881:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701342976:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787398137.530881:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018891 is committed 00000001:00080000:2.0:1787398137.530895:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018890 is committed 00000100:00100000:3.0:1787398137.531193:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701342976:12345-0@lo:1000:osp_up0-1.0 Request processed in 2309us (2762us total) trans 128849018891 rc 0/0 00000100:00100000:3.0:1787398137.531205:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:1.0:1787398137.531283:0:107290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018891 committed transno 128849018891 00000100:00100000:1.0:1787398137.531288:0:107290:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018891 gen 2 00000100:00100000:1.0:1787398137.531307:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701342976:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398137.531338:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 6 rpc_version 6 00000020:00100000:1.0:1787398137.531365:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398137.531373:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70350a300 x1874218701343232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398137.531394:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701343232:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.531429:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.531509:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.531654:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701343232 00000100:00100000:3.0:1787398137.531661:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701343232 00000100:00100000:0.0:1787398137.531851:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787398137.531862:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701343232:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787398137.552501:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018892 is committed 00000100:00100000:0.0:1787398137.556769:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701343232:12345-0@lo:1000:osp_up0-1.0 Request processed in 24893us (25323us total) trans 128849018892 rc 0/0 00000100:00100000:0.0:1787398137.556789:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787398137.557969:0:107290:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018892 committed transno 128849018892 00000100:00100000:1.0:1787398137.557979:0:107290:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018892 gen 2 00000100:00100000:1.0:1787398137.558025:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701343232:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398137.558057:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 7 rpc_version 7 00000020:00100000:1.0:1787398137.558098:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398137.558106:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70350a300 x1874218701343488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398137.558130:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701343488:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.558191:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.558287:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.558841:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701343488 00000100:00100000:3.0:1787398137.558851:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701343488 00000100:00100000:1.0:1787398137.561014:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787398137.561028:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701343488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.562987:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107290:x1874218701343488:12345-0@lo:1000:osp_up0-1.0 Request processed in 1953us (4788us total) trans 128849018893 rc 0/0 00000100:00100000:0.0:1787398137.562990:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701343488:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.563001:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787398137.563202:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:80623:x1874218681370624:12345-192.168.204.60@tcp:35:rm.0 Request processed in 37117us (37301us total) trans 90194313221 rc 0/0 00000100:00100000:3.0:1787398137.563224:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 10 00000100:00100000:2.0:1787398137.566743:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.567200:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681370880 00000100:00100000:1.0:1787398137.567213:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681370880 00000100:00100000:1.0:1787398137.567284:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:1.0:1787398137.567294:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:80623:x1874218681370880:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:1.0:1787398137.567324:0:107265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398137.567350:0:107265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe600/0x274786fe0d194553 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8959 expref: -99 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.567612:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d19455a lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.567631:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d19455a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.567668:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d19455a lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.567683:0:107265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1787398137.567865:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe600/0x274786fe0d194553 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8959 expref: 20 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.567906:0:107265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d19455a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8959 expref: 19 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.567915:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453700) 00010000:00010000:1.0:1787398137.567918:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787398137.567922:0:107265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345ffe00, rc 0) 00000100:00100000:1.0:1787398137.567992:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681370880:12345-192.168.204.60@tcp:101:rm.0 Request processed in 699us (1263us total) trans 90194313222 rc 0/0 00000100:00100000:1.0:1787398137.568000:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 43 00000100:00100000:2.0:1787398137.576160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.576327:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681371008 00000100:00100000:3.0:1787398137.576338:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681371008 00000100:00100000:3.0:1787398137.576417:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:3.0:1787398137.576439:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:80623:x1874218681371008:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:3.0:1787398137.583389:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:80623:x1874218681371008:12345-192.168.204.60@tcp:37:rm.0 Request processed in 6943us (7220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.583410:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 11 00000100:00100000:2.0:1787398137.588877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.589001:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681371264 00000100:00100000:0.0:1787398137.589018:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681371264 00000100:00100000:0.0:1787398137.589203:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:0.0:1787398137.589234:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+14:80623:x1874218681371264:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787398137.589543:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80623:x1874218681371264:12345-192.168.204.60@tcp:35:rm.0 Request processed in 291us (657us total) trans 128849018894 rc 0/0 00000100:00100000:0.0:1787398137.589552:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 12 00000100:00100000:2.0:1787398137.593028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.593253:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681371520 00000100:00100000:1.0:1787398137.593265:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681371520 00000100:00100000:1.0:1787398137.593507:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:1.0:1787398137.593545:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+15:80623:x1874218681371520:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787398137.593619:0:107263:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787398137.593651:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aae00/0x274786fe0d1944ab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8913 expref: 15 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593673:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fea00/0x274786fe0d19448f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8905 expref: 14 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593705:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:1.0:1787398137.593717:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aa800/0x274786fe0d19453e lrc: 0/0,0 mode: --/PR res: [0x20000dec1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d894b expref: 13 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593725:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a702453400) 00010000:00010000:1.0:1787398137.593735:0:107263:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398137.593762:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,1 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593773:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593782:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593793:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: --/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593799:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593806:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593895:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593906:0:107263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593927:0:107263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 4/0,1 mode: --/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593967:0:107263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.593981:0:107263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.593998:0:107263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:107263:1874218701343616:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787398137.594288:0:107263:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba780 going to sleep for 11 seconds 00010000:00010000:2.0:1787398137.598089:0:107263:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.60@tcp) returned -22 from blocking AST (req@00000000eeed7046 x1874218701343616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598121:0:107263:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598151:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a835e63e00/0x274786fe0d194059 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88b8 expref: 12 pid: 107348 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398137.598169:0:107263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70350b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:107263:1874218701343616:192.168.204.60@tcp:104: 00010000:00010000:2.0:1787398137.598193:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:2.0:1787398137.598199:0:107263:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598210:0:107263:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598242:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 4/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598267:0:107263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598277:0:107263:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598283:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787398137.598685:0:107263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1787398137.598703:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598712:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598720:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598727:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fee00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.598732:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598740:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598751:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x37:0x0].0x0 (ffff89a81a867c00) 00010000:00010000:2.0:1787398137.598754:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787398137.598765:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598772:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fee00/0x274786fe0d194576 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598796:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,1 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598803:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 2/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598810:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598815:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:2.0:1787398137.598819:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 3/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598825:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 4/0,0 mode: CW/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598833:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a81a964e00) 00010000:00010000:2.0:1787398137.598836:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787398137.598839:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 2/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.598845:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345ffa00/0x274786fe0d194568 lrc: 0/0,0 mode: --/CW res: [0x20000dec1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398137.598857:0:107263:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020b1d67c reply state 0000000073401b8f transno 128849018895 ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: PW/PW res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.599860:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.600063:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a81a964200) 00010000:00010000:2.0:1787398137.600066:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787398137.600070:0:107263:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787398137.600341:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80623:x1874218681371520:12345-192.168.204.60@tcp:36:rm.0 Request processed in 6819us (7320us total) trans 128849018895 rc 0/0 00000100:00100000:2.0:1787398137.600350:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 44 00000100:00100000:2.0:1787398137.607371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.607488:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681371648 00000100:00100000:3.0:1787398137.607500:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681371648 00000100:00100000:3.0:1787398137.607602:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:3.0:1787398137.607613:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681371648:12345-192.168.204.60@tcp:37:rm.0 00000100:00100000:0.0:1787398137.613172:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681371648:12345-192.168.204.60@tcp:37:rm.0 Request processed in 5547us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.613188:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 13 00000100:00100000:1.0:1787398137.618696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.619001:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681371904 00000100:00100000:0.0:1787398137.619011:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681371904 00000100:00100000:0.0:1787398137.619128:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:0.0:1787398137.619139:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8365d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681371904:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787398137.619410:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8365d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:80623:x1874218681371904:12345-192.168.204.60@tcp:35:rm.0 Request processed in 265us (714us total) trans 90194313223 rc 0/0 00000100:00100000:0.0:1787398137.619418:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 14 00000100:00100000:3.0:1787398137.624489:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.624819:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681372160 00000100:00100000:1.0:1787398137.624832:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681372160 00000100:00100000:1.0:1787398137.624917:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:1.0:1787398137.624929:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+20:80623:x1874218681372160:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787398137.624996:0:107265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787398137.625024:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aaa00/0x274786fe0d1944ea lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8928 expref: 20 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625056:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aa400/0x274786fe0d1944ce lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d891a expref: 19 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625068:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:1.0:1787398137.625078:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fe800/0x274786fe0d194530 lrc: 0/0,0 mode: --/PR res: [0x240009870:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8944 expref: 18 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625109:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81a964f00) 00010000:00010000:1.0:1787398137.625120:0:107265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398137.625146:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,1 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625159:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625170:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625182:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: --/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625189:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625196:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625287:0:107265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625299:0:107265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625307:0:107265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 4/0,1 mode: --/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625341:0:107265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.625363:0:107265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.625380:0:107265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:107265:1874218701343744:192.168.204.60@tcp:104: 00000100:00100000:1.0:1787398137.625498:0:107265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00010000:00010000:1.0:1787398137.635593:0:107265:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.60@tcp) returned -22 from blocking AST (req@0000000069d88ab7 x1874218701343744) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635621:0:107265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635646:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a828a74600/0x274786fe0d194235 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88bf expref: 17 pid: 107307 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.635663:0:107265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703509f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:107265:1874218701343744:192.168.204.60@tcp:104: 00010000:00010000:1.0:1787398137.635685:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:1.0:1787398137.635691:0:107265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635700:0:107265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635708:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635729:0:107265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635748:0:107265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.635754:0:107265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787398137.636069:0:107265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1787398137.636087:0:107265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636095:0:107265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636102:0:107265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636109:0:107265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fea00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.636115:0:107265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636121:0:107265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636131:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xd:0x0].0x0 (ffff89a818432f00) 00010000:00010000:1.0:1787398137.636134:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787398137.636137:0:107265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636143:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fea00/0x274786fe0d19458b lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636178:0:107265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,1 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636184:0:107265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 2/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636190:0:107265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636195:0:107265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffa00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.636198:0:107265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 3/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636204:0:107265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 4/0,0 mode: CW/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636211:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81a964800) 00010000:00010000:1.0:1787398137.636214:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398137.636217:0:107265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 2/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636222:0:107265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffa00/0x274786fe0d19457d lrc: 0/0,0 mode: --/CW res: [0x240009870:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787398137.636236:0:107265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc479d93 reply state 00000000bf33d6b3 transno 90194313224 ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: PW/PW res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636246:0:107265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.636252:0:107265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a81a964400) 00010000:00010000:1.0:1787398137.636261:0:107265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787398137.636265:0:107265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787398137.636352:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:80623:x1874218681372160:12345-192.168.204.60@tcp:36:rm.0 Request processed in 11424us (11870us total) trans 90194313224 rc 0/0 00000100:00100000:1.0:1787398137.636361:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 45 00000100:00100000:2.0:1787398137.654797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.654844:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681372288 00000100:00100000:3.0:1787398137.654859:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681372288 00000100:00100000:3.0:1787398137.654926:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 735 00000100:00100000:3.0:1787398137.654935:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:2405:x1874218681372288:12345-192.168.204.60@tcp:103:rm.0 00010000:00010000:3.0:1787398137.654951:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398137.654978:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050ab000/0x274786fe0d194465 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f7 expref: 13 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.654996:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453f00) 00010000:00010000:3.0:1787398137.655007:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398137.655129:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2405:x1874218681372288:12345-192.168.204.60@tcp:103:rm.0 Request processed in 194us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.655154:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 735 00000100:00100000:1.0:1787398137.664175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398137.664459:0:107266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681372544 00000100:00100000:2.0:1787398137.664469:0:107266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681372544 00000100:00100000:2.0:1787398137.664722:0:107266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:2.0:1787398137.664736:0:107266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+18:80623:x1874218681372544:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:2.0:1787398137.664985:0:107266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681372544:12345-192.168.204.60@tcp:35:rm.0 Request processed in 252us (820us total) trans 90194313225 rc 0/0 00000100:00100000:2.0:1787398137.664992:0:107266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 15 00000100:00100000:3.0:1787398137.667825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398137.667952:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681372800 00000100:00100000:1.0:1787398137.667963:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681372800 00000100:00100000:1.0:1787398137.668031:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 46 00000100:00100000:1.0:1787398137.668050:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+19:80623:x1874218681372800:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:1.0:1787398137.668128:0:108265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787398137.668167:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d19455a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8959 expref: 19 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.668212:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff400/0x274786fe0d194522 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d893d expref: 18 pid: 107265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.668228:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a7050aba00/0x274786fe0d194473 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88fe expref: 17 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.668240:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a702453700) 00010000:00010000:1.0:1787398137.668253:0:108265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787398137.668315:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.668324:0:108265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.668333:0:108265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.669301:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701343872:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787398137.669388:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.669426:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00000100:00100000:0.0:1787398137.670295:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701343872 00000100:00100000:0.0:1787398137.670305:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701343872 00000100:00100000:0.0:1787398137.670378:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787398137.670387:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:108265:x1874218701343872:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787398137.670411:0:99650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.670442:0:99650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d194592 expref: -99 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.670480:0:99650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 11 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.670490:0:99650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.670801:0:99650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 11 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.670818:0:99650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 11 pid: 107263 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398137.670832:0:99650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:99650:1874218701344000:192.168.204.60@tcp:104: 00000100:00100000:0.0:1787398137.670926:0:99650:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8357773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398137.674012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.674096:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681372928 00000100:00100000:3.0:1787398137.674108:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681372928 00010000:00010000:3.0:1787398137.674148:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 5/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 12 pid: 107263 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398137.674199:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2673 00000100:00100000:3.0:1787398137.674209:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2405:x1874218681372928:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787398137.674225:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398137.674232:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 5/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 12 pid: 107263 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674246:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 12 pid: 107263 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674267:0:19660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:3.0:1787398137.674273:0:19660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674285:0:19660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674295:0:19660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674330:0:19660:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398137.674371:0:19660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:19660:1874218701344128:0@lo:105: 00000100:00100000:3.0:1787398137.674418:0:19660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398137.674476:0:19660:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a801254780 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.674495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344128 00000100:00100000:3.0:1787398137.674499:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344128 00000100:00100000:3.0:1787398137.674560:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1787398137.674568:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19660:x1874218701344128:12345-0@lo:105: 00010000:00010000:3.0:1787398137.674579:0:6505:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674589:0:6505:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674597:0:6505:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674604:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674611:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674622:0:6505:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.674636:0:6505:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff89a8345fea00) 00000100:00100000:3.0:1787398137.674679:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19660:x1874218701344128:12345-0@lo:105: Request processed in 112us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.674687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1787398137.674731:0:19660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000_UUID:19660:1874218701344128:0@lo:105: 00010000:00010000:3.0:1787398137.674745:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398137.674780:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2405:x1874218681372928:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 572us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.674786:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2673 00010000:00010000:0.0:1787398137.676254:0:99650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d194449 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88f0 expref: 11 pid: 107263 timeout: 4116 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398137.676277:0:99650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:99650:1874218701344000:192.168.204.60@tcp:104: 00010000:00010000:0.0:1787398137.676302:0:99650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 8 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.676312:0:99650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:0.0:1787398137.676315:0:99650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398137.676318:0:99650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74600, rc 0) 00000100:00100000:0.0:1787398137.676419:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:108265:x1874218701343872:12345-0@lo:101:mdt00_003.0 Request processed in 6033us (7031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.676435:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787398137.676849:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a703508700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701343872:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787398137.676869:0:108265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787398137.676891:0:108265:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:1.0:1787398137.676934:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.676943:0:108265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.676951:0:108265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.676969:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344256:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787398137.677007:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.677132:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00000100:00100000:0.0:1787398137.677169:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344256 00000100:00100000:0.0:1787398137.677176:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344256 00000100:00100000:0.0:1787398137.677500:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787398137.677510:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:108265:x1874218701344256:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787398137.677568:0:99649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398137.677587:0:99649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1945a7 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d1945a0 expref: -99 pid: 99649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.677611:0:99649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1945a7 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1945a0 expref: 9 pid: 99649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.677624:0:99649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1945a7 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1945a0 expref: 9 pid: 99649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.677631:0:99649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a81a867b00) 00010000:00010000:0.0:1787398137.677634:0:99649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398137.677636:0:99649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74e00, rc 0) 00000100:00100000:0.0:1787398137.677674:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344256:12345-0@lo:101:mdt00_003.0 Request processed in 166us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398137.677681:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787398137.677762:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344256:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787398137.677774:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.677787:0:108265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787398137.677812:0:108265:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00000100:00100000:1.0:1787398137.677849:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344384:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.677893:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.678059:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.678169:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344384 00000100:00100000:2.0:1787398137.678176:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344384 00000100:00100000:2.0:1787398137.678213:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787398137.678230:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787398137.678314:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344384:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.678321:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787398137.678452:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344384:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.678513:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344512:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.678588:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.678607:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.679282:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344512 00000100:00100000:2.0:1787398137.679299:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344512 00000100:00100000:2.0:1787398137.679324:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787398137.679331:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787398137.679503:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344512:12345-0@lo:1000:mdt00_003.0 Request processed in 171us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.679511:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787398137.679699:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344512:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.679752:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344640:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.679780:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.679804:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.680631:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344640 00000100:00100000:2.0:1787398137.680639:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344640 00000100:00100000:2.0:1787398137.680675:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787398137.680683:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787398137.680826:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344640:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (1044us total) trans 0 rc 1/1 00000100:00100000:2.0:1787398137.680834:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787398137.681080:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344640:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787398137.681167:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.681179:0:108265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.681200:0:108265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.681218:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344768:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787398137.681252:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.681279:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.681604:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344768 00000100:00100000:2.0:1787398137.681610:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344768 00000100:00100000:2.0:1787398137.681641:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787398137.681647:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:108265:x1874218701344768:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787398137.681659:0:107321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787398137.681676:0:107321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1945b5 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d1945ae expref: -99 pid: 107321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.681701:0:107321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1945b5 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1945ae expref: 10 pid: 107321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.681713:0:107321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1945b5 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1945ae expref: 10 pid: 107321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.681721:0:107321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a70c7dc500) 00010000:00010000:2.0:1787398137.681730:0:107321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787398137.681734:0:107321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a7050aba00, rc 0) 00000100:00100000:2.0:1787398137.681778:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:108265:x1874218701344768:12345-0@lo:101:mdt00_003.0 Request processed in 130us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.681785:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787398137.682007:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344768:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787398137.682021:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682031:0:108265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682070:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682078:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682086:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682104:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,1 mode: --/EX res: [0x240009870:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682111:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,1 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682116:0:108265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,1 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682139:0:108265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,1 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 108265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682146:0:108265:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,1 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.682153:0:108265:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,1 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.682174:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344896:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787398137.682200:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.682261:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.684195:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701344896 00000100:00100000:3.0:1787398137.684210:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701344896 00000100:00100000:3.0:1787398137.684334:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787398137.684354:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:108265:x1874218701344896:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787398137.684375:0:99650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398137.684400:0:99650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d1945d1 lrc: 2/0,0 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x274786fe0d1945ca expref: -99 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.684435:0:99650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d1945d1 lrc: 3/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1945ca expref: 11 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.684451:0:99650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d1945d1 lrc: 3/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1945ca expref: 11 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.684459:0:99650:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a70242d400) 00010000:00010000:3.0:1787398137.684462:0:99650:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787398137.684464:0:99650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583200, rc 0) 00000100:00100000:3.0:1787398137.684565:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:108265:x1874218701344896:12345-0@lo:101:mdt00_003.0 Request processed in 213us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.684572:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787398137.684968:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701344896:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787398137.684987:0:108265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 4/0,1 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.684999:0:108265:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 4/0,1 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.685763:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701345024:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1787398137.685826:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.687962:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba900 going to sleep for 11 seconds 00000100:00100000:2.0:1787398137.688268:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345024 00000100:00100000:2.0:1787398137.688278:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345024 00000100:00100000:2.0:1787398137.688331:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787398137.688353:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:108265:x1874218701345024:12345-0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787398137.691705:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:108265:x1874218701345024:12345-0@lo:403:mdt00_003.0 Request processed in 3356us (5868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.691720:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787398137.691808:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701345024:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1787398137.693209:0:108265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x24000a040:0x1:0x0].2, 936 off34048 00000100:00100000:1.0:1787398137.693639:0:108265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701345152:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787398137.693705:0:108265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398137.693824:0:108265:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366bacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398137.693864:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345152 00000100:00100000:3.0:1787398137.693872:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345152 00000100:00100000:3.0:1787398137.694182:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787398137.694192:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:108265:x1874218701345152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787398137.694287:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:108265:x1874218701345152:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.694295:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787398137.694364:0:108265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:108265:1874218701345152:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1787398137.694398:0:108265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].2, 1016 off34208 00000004:00080000:1.0:1787398137.694405:0:108265:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a8366ba900 with version 8 00000004:00080000:2.0:1787398137.694667:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 8 rpc_version 8 00000020:00100000:2.0:1787398137.694692:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787398137.694701:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a835b59f80 x1874218701345408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398137.694718:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701345408:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398137.694753:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398137.694937:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8345fd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787398137.694974:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345408 00000100:00100000:0.0:1787398137.694979:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345408 00000100:00100000:1.0:1787398137.695020:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787398137.695029:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107290:x1874218701345408:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398137.695457:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:107290:x1874218701345408:12345-0@lo:1000:osp_up0-1.0 Request processed in 428us (701us total) trans 128849018896 rc 0/0 00000100:00100000:1.0:1787398137.695477:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787398137.695727:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701345408:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1787398137.695809:0:108265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1787398137.695831:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,1 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695840:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 2/0,0 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695848:0:108265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,0 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695854:0:108265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff800 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.695859:0:108265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 3/0,0 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695867:0:108265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 4/0,0 mode: EX/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695884:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0x0 (ffff89a81a964500) 00010000:00010000:1.0:1787398137.695887:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787398137.695892:0:108265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 2/0,0 mode: --/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695897:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ff800/0x274786fe0d1945c3 lrc: 0/0,0 mode: --/EX res: [0x240009870:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695919:0:108265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 4/0,1 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695928:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 4/0,1 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695946:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695972:0:108265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787398137.695981:0:108265:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000dec1:0x3:0x0] 00010000:00010000:1.0:1787398137.695989:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.695995:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696001:0:108265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696005:0:108265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffe00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398137.696009:0:108265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696014:0:108265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696023:0:108265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a81a964100) 00010000:00010000:1.0:1787398137.696025:0:108265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398137.696028:0:108265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696034:0:108265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345ffe00/0x274786fe0d1945bc lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 108265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696102:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398137.696108:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 2/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696114:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe000 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:2.0:1787398137.696119:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398137.696138:0:56852:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 3/0,0 mode: EX/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696170:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 2/0,0 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696177:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398137.696201:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 1/0,0 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696208:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe000/0x274786fe0d1945ca lrc: 0/0,0 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945d1 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696225:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398137.696226:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398137.696228:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398137.696241:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701345536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398137.696277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398137.696324:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345536 00000100:00100000:2.0:1787398137.696330:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345536 00000100:00100000:2.0:1787398137.696377:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1787398137.696385:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3651:x1874218701345536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398137.696397:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398137.696412:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583200/0x274786fe0d1945d1 lrc: 0/0,0 mode: --/EX res: [0x20000dec1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1945ca expref: 12 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.696425:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0x0 (ffff89a70242d400) 00010000:00010000:2.0:1787398137.696449:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398137.696479:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3651:x1874218701345536:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.696487:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1787398137.696519:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701345536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787398137.696668:0:108265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696683:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 4/0,1 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696690:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696713:0:108265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787398137.696725:0:108265:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:1.0:1787398137.696731:0:108265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696739:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696747:0:108265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696765:0:108265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1787398137.696769:0:108265:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x34:0x0] 00010000:00010000:1.0:1787398137.696774:0:108265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398137.696781:0:108265:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398137.696854:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:80623:x1874218681372800:12345-192.168.204.60@tcp:36:rm.0 Request processed in 28812us (29037us total) trans 90194313226 rc 0/0 00000100:00100000:1.0:1787398137.696879:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 46 00010000:00010000:2.0:1787398137.703178:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398137.703211:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703224:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff400 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:2.0:1787398137.703234:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398137.703243:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703298:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703306:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398137.703334:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 1/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703355:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345ff400/0x274786fe0d1945ae lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945b5 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703379:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398137.703384:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703410:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fea00 already unused, calling callback (ffffffffc1a83eb0) 00010000:00010000:2.0:1787398137.703415:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398137.703422:0:6510:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703449:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703456:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398137.703462:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703469:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fea00/0x274786fe0d194592 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d194599 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703483:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398137.703485:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398137.703487:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398137.703506:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701345664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398137.703590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398137.703638:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398137.703645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701345792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398137.703670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398137.703726:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345664 00000100:00100000:2.0:1787398137.703736:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345664 00000100:00100000:2.0:1787398137.703797:0:19659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345792 00000100:00100000:2.0:1787398137.703801:0:19659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345792 00000100:00100000:2.0:1787398137.703828:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1787398137.703837:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3648:x1874218701345664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398137.703852:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398137.703873:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aba00/0x274786fe0d1945b5 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1945ae expref: 12 pid: 107321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703887:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0xc:0x0].0x0 (ffff89a70c7dc500) 00010000:00010000:2.0:1787398137.703896:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398137.703931:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3648:x1874218701345664:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.703938:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1787398137.703957:0:19659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1787398137.703963:0:19659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3648:x1874218701345792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398137.703970:0:19659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398137.703980:0:19659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74600/0x274786fe0d194599 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d194592 expref: 10 pid: 99650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398137.703990:0:19659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:2.0:1787398137.703993:0:19659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398137.704015:0:19659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3648:x1874218701345792:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398137.704022:0:19659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1787398137.704080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701345792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787398137.704090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701345664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398137.705607:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398137.706084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.707179:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373056 00000100:00100000:3.0:1787398137.707207:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373056 00000100:00100000:3.0:1787398137.707286:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:3.0:1787398137.707297:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+11:80623:x1874218681373056:12345-192.168.204.60@tcp:101:rm.0 00010000:00010000:3.0:1787398137.707327:0:107264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398137.708155:0:107264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d1945d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8960 expref: -99 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708419:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708444:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708456:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708473:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708480:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708507:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708660:0:107264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708669:0:107264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708677:0:107264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787398137.708724:0:107264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00000004:00200000:3.0:1787398137.708728:0:107264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787398137.708750:0:107264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708761:0:107264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708767:0:107264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708774:0:107264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708780:0:107264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836582c00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398137.708784:0:107264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708792:0:107264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708810:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453b00) 00010000:00010000:3.0:1787398137.708813:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398137.708818:0:107264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708824:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836582c00/0x274786fe0d1945df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708839:0:107264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708846:0:107264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708852:0:107264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708857:0:107264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:3.0:1787398137.708860:0:107264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708866:0:107264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708872:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a70242d000) 00010000:00010000:3.0:1787398137.708875:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787398137.708877:0:107264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708882:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583e00/0x274786fe0d1945e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708926:0:107264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583000/0x274786fe0d1945d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8960 expref: 13 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708940:0:107264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8960 expref: 12 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398137.708947:0:107264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:3.0:1787398137.708949:0:107264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787398137.708952:0:107264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583800, rc 0) 00010000:00010000:2.0:1787398137.712024:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398137.712961:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80623:x1874218681373056:12345-192.168.204.60@tcp:101:rm.0 Request processed in 1746us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398137.712984:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:1.0:1787398137.713727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398137.713828:0:107267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373312 00000100:00100000:0.0:1787398137.713840:0:107267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373312 00000100:00100000:0.0:1787398137.713898:0:107267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:0.0:1787398137.714069:0:107267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80623:x1874218681373312:12345-192.168.204.60@tcp:35:rm.0 00000100:00100000:0.0:1787398137.714891:0:107267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80623:x1874218681373312:12345-192.168.204.60@tcp:35:rm.0 Request processed in 981us (1165us total) trans 128849018897 rc 0/0 00000100:00100000:0.0:1787398137.715052:0:107267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 16 00000100:00100000:1.0:1787398137.718207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398137.718276:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373568 00000100:00100000:3.0:1787398137.718287:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373568 00000100:00100000:3.0:1787398137.718358:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:0.0:1787398137.718407:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+13:80623:x1874218681373568:12345-192.168.204.60@tcp:36:rm.0 00010000:00010000:0.0:1787398137.718499:0:107263:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787398137.718558:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a836583800/0x274786fe0d1945ed lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8960 expref: 13 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718584:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74000/0x274786fe0d19450d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8936 expref: 12 pid: 107263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718596:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a807d24400) 00010000:00010000:0.0:1787398137.718614:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a7050aac00/0x274786fe0d19442d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88e9 expref: 11 pid: 107264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718623:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a702453b00) 00010000:00010000:0.0:1787398137.718630:0:107263:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787398137.718662:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718676:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718687:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718700:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718706:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718712:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718829:0:107263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718838:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.718846:0:107263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787398137.720804:0:107263:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1787398137.720835:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.720846:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.720854:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.720860:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75e00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398137.720865:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.720873:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.720889:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0x0 (ffff89a81a867d00) 00010000:00010000:0.0:1787398137.720891:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787398137.720896:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721097:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75e00/0x274786fe0d194602 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721130:0:107263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721136:0:107263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721142:0:107263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721148:0:107263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a74a00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398137.721151:0:107263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721157:0:107263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721165:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89a81a867900) 00010000:00010000:0.0:1787398137.721168:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398137.721171:0:107263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721178:0:107263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74a00/0x274786fe0d1945f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787398137.721191:0:107263:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bd0adb1 reply state 000000006d9069ce transno 128849018898 ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721203:0:107263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398137.721218:0:107263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a81a867a00) 00010000:00010000:0.0:1787398137.721220:0:107263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787398137.721224:0:107263:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787398137.721333:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:80623:x1874218681373568:12345-192.168.204.60@tcp:36:rm.0 Request processed in 2961us (3133us total) trans 128849018898 rc 0/0 00000100:00100000:0.0:1787398137.721343:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:1.0:1787398138.629010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398138.629074:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398138.629125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398138.629151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398138.629328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398138.629366:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374080 00000100:00100000:2.0:1787398138.629381:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374080 00000100:00100000:2.0:1787398138.629449:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374208 00000100:00100000:2.0:1787398138.629452:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374208 00000100:00100000:2.0:1787398138.629482:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:2.0:1787398138.629493:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374080:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398138.629599:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374080:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 107us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398138.629609:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 162 00000100:00100000:2.0:1787398138.629628:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 163 00000100:00100000:2.0:1787398138.629634:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374208:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398138.629660:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374208:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398138.629667:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 163 00000100:00100000:2.0:1787398138.629720:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373696 00000100:00100000:2.0:1787398138.629724:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373696 00000100:00100000:2.0:1787398138.629750:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:2.0:1787398138.629756:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681373696:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398138.629780:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681373696:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 24us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398138.629786:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 93 00000100:00100000:0.0:1787398138.633931:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373824 00000100:00100000:0.0:1787398138.633954:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373824 00000100:00100000:0.0:1787398138.636238:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681373952 00000100:00100000:0.0:1787398138.636256:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681373952 00000100:00100000:0.0:1787398138.636338:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:0.0:1787398138.636351:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2403:x1874218681373824:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398138.636506:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+12:2403:x1874218681373824:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 157us (7514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398138.636516:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 23 00000100:00100000:0.0:1787398138.636553:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 24 00000100:00100000:0.0:1787398138.636561:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2403:x1874218681373952:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398138.636607:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+17:2403:x1874218681373952:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 47us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398138.636614:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 24 00010000:00010000:1.0:1787398138.725157:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398138.852942:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701345920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398138.853052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398138.853168:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701345920 00000100:00100000:1.0:1787398138.853179:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701345920 00000100:00100000:1.0:1787398138.855354:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787398138.855384:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701345920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787398138.855447:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398138.855586:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701345920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 215us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398138.855596:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787398138.855637:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398138.855689:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701346048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398138.855735:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398138.855791:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346048 00000100:00100000:1.0:1787398138.855800:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346048 00000100:00100000:1.0:1787398138.855846:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787398138.855852:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701346048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398138.855883:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445498880 avail 1299259392 00000100:00100000:1.0:1787398138.855944:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701346048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398138.855951:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787398138.856009:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701346048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398138.857418:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701345920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398138.860693:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701346176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398138.860892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398138.860974:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346176 00000100:00100000:2.0:1787398138.860990:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346176 00000100:00100000:2.0:1787398138.861228:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787398138.861245:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701346176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398138.861307:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398138.861402:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701346176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398138.861420:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787398138.862353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701346176:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787398138.871326:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398139.369840:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701346688:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.369876:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701346304:0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.371028:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701346432:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.379151:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398139.379220:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346304 00000100:00100000:3.0:1787398139.379231:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346304 00000100:00100000:3.0:1787398139.379309:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787398139.379322:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701346304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.379516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398139.379580:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347200:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.379627:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398139.379857:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3649:x1874218701346304:12345-0@lo:400:kworker.0 Request processed in 537us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398139.379877:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787398139.379977:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701346304:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.379988:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701346816:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.380344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398139.380433:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701346560:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.380481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398139.380515:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701347072:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.380556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701347328:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.380568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398139.380597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398139.380618:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346688 00000100:00100000:0.0:1787398139.380625:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346688 00000100:00100000:3.0:1787398139.380720:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347200 00000100:00100000:3.0:1787398139.380724:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347200 00000100:00100000:3.0:1787398139.380763:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347328 00000100:00100000:3.0:1787398139.380766:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347328 00000100:00100000:3.0:1787398139.380794:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787398139.380803:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.380853:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346816 00000100:00100000:0.0:1787398139.380858:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346816 00000100:00100000:3.0:1787398139.380879:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347200:12345-0@lo:400:kworker.0 Request processed in 75us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.380880:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346560 00000100:00100000:0.0:1787398139.380885:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346560 00000100:00100000:3.0:1787398139.380891:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787398139.380906:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347072 00000100:00100000:0.0:1787398139.380909:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347072 00000100:00100000:0.0:1787398139.380924:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787398139.380931:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701346688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.380969:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701346688:12345-0@lo:400:kworker.0 Request processed in 39us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.380975:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787398139.380990:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787398139.380997:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701346816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.381027:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874218701346816:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.381034:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787398139.381045:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787398139.381051:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701346560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.381098:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874218701346560:12345-0@lo:400:kworker.0 Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.381104:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787398139.381117:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787398139.381123:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701347072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.381152:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701347072:12345-0@lo:400:kworker.0 Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.381158:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787398139.381182:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787398139.381190:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701347328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.381220:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701347328:12345-0@lo:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398139.381226:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1787398139.381251:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787398139.381257:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398139.381259:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398139.381262:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398139.381295:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1874218701346560:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.381488:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701347328:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.381519:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701347072:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.381542:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1874218701346816:0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.382132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398139.382172:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701346944:0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.382219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398139.382255:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346944 00000100:00100000:1.0:1787398139.382262:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346944 00000100:00100000:1.0:1787398139.382518:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787398139.382564:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701346944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.382632:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701346944:12345-0@lo:400:kworker.0 Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398139.382640:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787398139.382710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701346944:0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.382719:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701347456:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.382950:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701346688:0@lo:400:kworker.0 00000100:00100000:0.0:1787398139.382968:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347200:0@lo:400:kworker.0 00000100:00100000:1.0:1787398139.383076:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398139.383215:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701346432 00000100:00100000:3.0:1787398139.383222:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701346432 00000100:00100000:3.0:1787398139.383282:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347456 00000100:00100000:3.0:1787398139.383285:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347456 00000100:00100000:3.0:1787398139.383406:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787398139.383416:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701346432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.383584:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701346432:12345-0@lo:400:kworker.0 Request processed in 169us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398139.383611:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787398139.383634:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787398139.383641:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701347456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.383676:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701347456:12345-0@lo:400:kworker.0 Request processed in 36us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398139.383681:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787398139.383896:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398139.384677:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701346432:0@lo:400:kworker.0 00000100:00100000:3.0:1787398139.384718:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701347456:0@lo:400:kworker.0 00010000:00010000:0.0:1787398139.749587:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398140.774760:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398140.901927:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398140.903620:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398140.903729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398140.903833:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347712 00000100:00100000:0.0:1787398140.903843:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347712 00000100:00100000:0.0:1787398140.903913:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787398140.903924:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398140.903965:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398140.904019:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398140.904027:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787398140.904100:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398140.904181:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398140.904188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398140.904217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398140.904245:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347840 00000100:00100000:0.0:1787398140.904250:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347840 00000100:00100000:0.0:1787398140.904275:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787398140.904281:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787398140.904301:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398140.905503:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701347840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1212us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398140.905518:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787398140.905627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701347840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398140.913293:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701347584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787398140.913428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398140.913571:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347584 00000100:00100000:1.0:1787398140.913583:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347584 00000100:00100000:1.0:1787398140.913660:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787398140.913670:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701347584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398140.913720:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1787398140.913962:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701347584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 292us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398140.913982:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787398140.916958:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701347584:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787398141.796825:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398142.442652:0:107244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787398142.442674:0:107244:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398142.442727:0:107244:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398142.442735:0:107244:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398142.442761:0:107244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff89a8345fe600/0x274786fe0d1945a0 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x274786fe0d1945a7 expref: -99 pid: 108265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787398142.442784:0:107244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 90194313226 is committed 00000100:00100000:0.0:1787398142.442872:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701347968:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1787398142.442964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787398142.443249:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,1 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443259:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 2/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443266:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443272:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fee00 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:1.0:1787398142.443277:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 3/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443284:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 4/0,0 mode: TXN/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443297:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240009870:0x3:0x0].0xf0209d98 (ffff89a81a964400) 00010000:00010000:1.0:1787398142.443300:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787398142.443304:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 2/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398142.443310:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff89a8345fee00/0x274786fe0d194584 lrc: 0/0,0 mode: --/TXN res: [0x240009870:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107265 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398142.443615:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701347968 00000100:00100000:2.0:1787398142.443623:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701347968 00000100:00100000:2.0:1787398142.444444:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1787398142.444460:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3650:x1874218701347968:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787398142.444479:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398142.444603:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a74e00/0x274786fe0d1945a7 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d1945a0 expref: 9 pid: 99649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398142.444642:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x34:0x0].0xd1d4b922 (ffff89a81a867b00) 00010000:00010000:2.0:1787398142.444652:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398142.444731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701347968:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 276us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398142.444739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1787398142.444838:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701347968:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1787398142.821556:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787398143.465117:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018898 is committed 00000001:00080000:2.0:1787398143.465144:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018896 is committed 00010000:00010000:0.0:1787398143.465453:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,1 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465468:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 2/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465475:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465481:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe400 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398143.465486:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 3/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465495:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 4/0,0 mode: TXN/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465513:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000dec1:0x3:0x0].0xcd52553e (ffff89a81a964200) 00010000:00010000:0.0:1787398143.465517:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398143.465578:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 2/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465585:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a8345fe400/0x274786fe0d19456f lrc: 0/0,0 mode: --/TXN res: [0x20000dec1:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465617:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465624:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465629:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465649:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a828a75000 already unused, calling callback (ffffffffc1a774f0) 00010000:00010000:0.0:1787398143.465653:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465659:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465668:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff89a81a867a00) 00010000:00010000:0.0:1787398143.465671:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787398143.465674:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398143.465680:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89a828a75000/0x274786fe0d1945fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107263 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398143.762474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398143.762550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398143.762585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398143.762648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398143.762691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398143.762722:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374592 00000100:00100000:1.0:1787398143.762733:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374592 00000100:00100000:1.0:1787398143.762806:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374464 00000100:00100000:1.0:1787398143.762809:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374464 00000100:00100000:1.0:1787398143.762835:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:1.0:1787398143.762846:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681374592:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398143.762922:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681374592:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398143.762930:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 31 00000100:00100000:1.0:1787398143.762961:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00100000:1.0:1787398143.762967:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681374464:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398143.763001:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681374464:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398143.763007:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 32 00000100:00080000:1.0:1787398143.763025:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398143.763029:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398143.763112:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374848 00000100:00100000:0.0:1787398143.763116:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374848 00000100:00100000:0.0:1787398143.763161:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374720 00000100:00100000:0.0:1787398143.763164:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374720 00000100:00100000:0.0:1787398143.763187:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 166 00000100:00100000:0.0:1787398143.763195:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374848:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398143.763225:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374848:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398143.763231:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 166 00000100:00100000:0.0:1787398143.763244:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00100000:0.0:1787398143.763265:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374720:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398143.763287:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681374720:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398143.763301:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 167 00000100:00080000:1.0:1787398143.763860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398143.763866:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398143.764586:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374336 00000100:00100000:2.0:1787398143.764596:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374336 00000100:00100000:2.0:1787398143.764662:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 95 00000100:00100000:2.0:1787398143.764671:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681374336:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398143.764724:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681374336:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 54us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398143.764731:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 95 00010000:00010000:1.0:1787398143.845614:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398143.973141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398143.973181:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701348224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398143.973271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398143.973348:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348224 00000100:00100000:3.0:1787398143.973361:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348224 00000100:00100000:3.0:1787398143.973540:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787398143.973553:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701348224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787398143.973595:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398143.973602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701348096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398143.973702:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701348352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398143.975406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398143.976419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398143.976458:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348096 00000100:00100000:1.0:1787398143.976472:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348096 00000100:00100000:1.0:1787398143.976582:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787398143.977300:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701348096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398143.977380:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445502976 avail 1299263488 00000100:00100000:1.0:1787398143.977487:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701348096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398143.977581:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701348224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4029us (4307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398143.977605:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787398143.977694:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701348224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398143.983369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398143.983563:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701348096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398143.983749:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348352 00000100:00100000:3.0:1787398143.983769:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348352 00000100:00080000:0.0:1787398143.985563:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398143.985706:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787398143.985719:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701348352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398143.985767:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398143.985913:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701348352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398143.985936:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787398143.985999:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701348352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398143.987389:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787398144.485126:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701348736:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398144.485265:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701349248:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398144.485327:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787398144.485333:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701348864:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398144.485371:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349376:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398144.485421:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348736 00000100:00100000:1.0:1787398144.485430:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348736 00000100:00100000:1.0:1787398144.485488:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349248 00000100:00100000:1.0:1787398144.485491:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349248 00000100:00100000:1.0:1787398144.485504:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348864 00000100:00100000:1.0:1787398144.485506:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348864 00000100:00100000:1.0:1787398144.485542:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787398144.485550:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701348736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485600:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701348736:12345-0@lo:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398144.485606:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787398144.485622:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787398144.485627:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701349248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485670:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701349248:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398144.485676:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787398144.485685:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787398144.485690:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701348864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485707:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701348864:12345-0@lo:400:kworker.0 Request processed in 17us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398144.485712:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787398144.485725:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787398144.485742:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787398144.485772:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701348864:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485781:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701348736:0@lo:400:kworker.0 00000100:00100000:1.0:1787398144.485788:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701349248:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486151:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701348480:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486207:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486245:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701348992:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486266:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486287:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701349504:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486322:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486345:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787398144.486351:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701348608:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486379:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486395:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701349120:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486416:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486433:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701349632:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398144.486475:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348992 00000100:00100000:3.0:1787398144.486479:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348992 00000100:00100000:3.0:1787398144.486513:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348608 00000100:00100000:3.0:1787398144.486515:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348608 00000100:00100000:3.0:1787398144.486559:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349632 00000100:00100000:3.0:1787398144.486562:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349632 00000100:00100000:3.0:1787398144.486574:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787398144.486580:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701348992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486618:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874218701348992:12345-0@lo:400:kworker.0 Request processed in 38us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398144.486637:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787398144.486651:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787398144.486657:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701348608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486682:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701348608:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398144.486688:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787398144.486697:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787398144.486703:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701349632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.486725:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701349632:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398144.486920:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701348480 00000100:00100000:2.0:1787398144.486926:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701348480 00000100:00100000:2.0:1787398144.486955:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787398144.486962:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701348480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.486999:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701348480:12345-0@lo:400:kworker.0 Request processed in 38us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398144.487006:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787398144.487051:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349376 00000100:00100000:2.0:1787398144.487061:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349376 00000100:00100000:2.0:1787398144.487088:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349504 00000100:00100000:2.0:1787398144.487090:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349504 00000100:00100000:2.0:1787398144.487109:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787398144.487115:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487150:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349376:12345-0@lo:400:kworker.0 Request processed in 35us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398144.487156:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787398144.487166:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787398144.487172:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487195:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701349504:12345-0@lo:400:kworker.0 Request processed in 23us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398144.487213:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787398144.487275:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349376:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487316:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349120 00000100:00100000:2.0:1787398144.487320:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349120 00000100:00100000:2.0:1787398144.487346:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787398144.487353:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701349120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487387:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701349120:12345-0@lo:400:kworker.0 Request processed in 35us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398144.487393:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787398144.487411:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398144.487414:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398144.487416:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787398144.487417:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787398144.487443:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701348608:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487452:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018896 gen 2 00000004:00080000:2.0:1787398144.487464:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018893 committed transno 128849018896 00000020:00080000:2.0:1787398144.487469:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a82e4deb40 refcount 2 committed 0 result 0 batchid 85899345937 00000020:00080000:2.0:1787398144.487474:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a705225400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a82e4ded80 00000020:00080000:2.0:1787398144.487476:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].1 00000020:00080000:2.0:1787398144.487479:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a705225700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a705abf400 00000020:00080000:2.0:1787398144.487481:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x24000a040:0x1:0x0].1 00000004:00080000:2.0:1787398144.487543:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018896 committed transno 128849018896 00000020:00080000:2.0:1787398144.487547:0:3650:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff89a8366baf00 refcount 2 committed 0 result 0 batchid 85899345938 00000020:00080000:2.0:1787398144.487550:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a838353300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff89a8366ba900 00000020:00080000:2.0:1787398144.487553:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].2 00000020:00080000:2.0:1787398144.487555:0:3650:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89a838353100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89a83654b800 00000020:00080000:2.0:1787398144.487558:0:3650:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x24000a040:0x1:0x0].2 00000100:00100000:2.0:1787398144.487571:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701349120:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487586:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701349632:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487594:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701348480:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487603:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1874218701348992:0@lo:400:kworker.0 00000100:00100000:2.0:1787398144.487613:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701349504:0@lo:400:kworker.0 00000100:00100000:3.0:1787398144.487983:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00080000:0.0:1787398144.488171:0:107304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 85899345938 committed batchid 81604378797 00000020:00080000:0.0:1787398144.488281:0:107304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378797 00010000:00010000:2.0:1787398144.872621:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787398144.980017:0:108525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 200: Dropping one OBD_PING should not cause disconnect ========================================================== 07:29:02 (1787398142) 00010000:00010000:2.0:1787398145.893807:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398146.020952:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398146.021027:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398146.021077:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398146.021083:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398146.021107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398146.021145:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349760 00000100:00100000:3.0:1787398146.021153:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349760 00000100:00100000:3.0:1787398146.021203:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701349888 00000100:00100000:3.0:1787398146.021206:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701349888 00000100:00100000:3.0:1787398146.021224:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787398146.021232:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398146.021258:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398146.021315:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398146.021339:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787398146.021359:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787398146.021365:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787398146.021382:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787398146.021409:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701349888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398146.021415:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787398146.021462:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398146.021474:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701349760:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787398146.021716:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398146.021721:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398146.022614:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398146.022684:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398146.023090:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350016 00000100:00100000:1.0:1787398146.023097:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350016 00000100:00100000:1.0:1787398146.023144:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787398146.023152:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701350016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398146.023182:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1787398146.023237:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701350016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398146.023244:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787398146.023425:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701350016:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787398146.896325:0:108574:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_200 Need remote client 00010000:00010000:0.0:1787398146.920965:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398147.940747:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787398148.463079:0:108622:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 201: MDT umount cascading disconnects timeouts ========================================================== 07:29:06 (1787398146) 00000100:00100000:0.0:1787398148.874270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398148.874316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398148.874355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398148.874386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398148.874416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398148.874447:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375104 00000100:00100000:0.0:1787398148.874458:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375104 00000100:00100000:0.0:1787398148.874559:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375232 00000100:00100000:0.0:1787398148.874563:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375232 00000100:00100000:0.0:1787398148.874588:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787398148.874599:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681375104:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398148.874679:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681375104:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 82us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398148.874686:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 39 00000100:00100000:0.0:1787398148.874704:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:0.0:1787398148.874710:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681375232:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398148.874752:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681375232:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 42us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398148.874760:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 40 00000100:00100000:0.0:1787398148.874780:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375360 00000100:00100000:0.0:1787398148.874784:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375360 00000100:00100000:0.0:1787398148.874806:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375488 00000100:00100000:0.0:1787398148.874809:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375488 00000100:00100000:1.0:1787398148.874985:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681374976 00000100:00100000:1.0:1787398148.874989:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681374976 00000100:00100000:1.0:1787398148.875027:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00100000:1.0:1787398148.875034:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681374976:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398148.875063:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681374976:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398148.875070:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 97 00000100:00080000:1.0:1787398148.875134:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398148.875138:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398148.875141:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398148.875143:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398148.875641:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:0.0:1787398148.875651:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681375360:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398148.875687:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681375360:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 39us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398148.875694:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 170 00000100:00100000:0.0:1787398148.875707:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 171 00000100:00100000:0.0:1787398148.875713:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681375488:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398148.875734:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2405:x1874218681375488:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 22us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398148.875740:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 171 00010000:00010000:1.0:1787398148.968582:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398149.093649:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701350144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398149.093721:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398149.093776:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350144 00000100:00100000:3.0:1787398149.093784:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350144 00000100:00100000:3.0:1787398149.093836:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787398149.093845:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701350144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398149.093873:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398149.093914:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874218701350144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398149.093922:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787398149.093968:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701350144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398149.094413:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398149.094425:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701350272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398149.094463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398149.094499:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350272 00000100:00100000:1.0:1787398149.094504:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350272 00000100:00100000:1.0:1787398149.094569:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787398149.094577:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701350272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787398149.094597:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398149.094632:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701350272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398149.094639:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1787398149.094656:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398149.094660:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398149.094681:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701350272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398149.099087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398149.106617:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701350400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398149.106698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398149.106810:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350400 00000100:00100000:1.0:1787398149.106826:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350400 00000100:00100000:1.0:1787398149.106881:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787398149.106890:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701350400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787398149.106931:0:107321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445502976 avail 1299263488 00000100:00100000:1.0:1787398149.106976:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701350400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398149.106983:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787398149.107137:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701350400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398149.604764:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701350656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.604841:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.604879:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701351168:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.604906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.604924:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701351680:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.604945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.604967:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787398149.604973:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701350528:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605027:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701351040:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605047:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605065:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701351552:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605113:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701350784:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605136:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605152:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701351296:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787398149.605189:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701350912:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605225:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605237:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701351424:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605257:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398149.605286:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351168 00000100:00100000:2.0:1787398149.605294:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351168 00000100:00100000:2.0:1787398149.605342:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787398149.605360:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701351168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605416:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70350a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874218701351168:12345-0@lo:400:kworker.0 Request processed in 56us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605424:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787398149.605449:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350528 00000100:00100000:2.0:1787398149.605465:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350528 00000100:00100000:2.0:1787398149.605489:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787398149.605495:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701350528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605554:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701350528:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605561:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787398149.605588:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350656 00000100:00100000:2.0:1787398149.605592:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350656 00000100:00100000:2.0:1787398149.605619:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351680 00000100:00100000:2.0:1787398149.605622:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351680 00000100:00100000:2.0:1787398149.605635:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351040 00000100:00100000:2.0:1787398149.605638:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351040 00000100:00100000:2.0:1787398149.605650:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350784 00000100:00100000:2.0:1787398149.605652:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350784 00000100:00100000:2.0:1787398149.605664:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351296 00000100:00100000:2.0:1787398149.605667:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351296 00000100:00100000:2.0:1787398149.605676:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701350912 00000100:00100000:2.0:1787398149.605679:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701350912 00000100:00100000:2.0:1787398149.605692:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787398149.605697:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701350656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605729:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701350656:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605735:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787398149.605746:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787398149.605758:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701351680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605787:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701351680:12345-0@lo:400:kworker.0 Request processed in 29us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605793:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787398149.605804:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787398149.605810:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701351040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605836:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701351040:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605842:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787398149.605852:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787398149.605857:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701350784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605886:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701350784:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605892:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787398149.605903:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787398149.605908:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701351296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605933:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874218701351296:12345-0@lo:400:kworker.0 Request processed in 25us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605939:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787398149.605949:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787398149.605955:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701350912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.605978:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701350912:12345-0@lo:400:kworker.0 Request processed in 24us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.605984:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787398149.606000:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351552 00000100:00100000:2.0:1787398149.606010:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351552 00000100:00100000:2.0:1787398149.606039:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351424 00000100:00100000:2.0:1787398149.606042:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351424 00000100:00100000:2.0:1787398149.606060:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787398149.606066:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606097:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701351552:12345-0@lo:400:kworker.0 Request processed in 31us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.606103:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787398149.606112:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787398149.606118:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701351424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606141:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701351424:12345-0@lo:400:kworker.0 Request processed in 23us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398149.606146:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787398149.606209:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701350912:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606223:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701351424:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606233:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701350784:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606242:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874218701351296:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606279:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701350528:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606289:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701351040:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606298:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701351552:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606307:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701350656:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606316:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701351168:0@lo:400:kworker.0 00000100:00100000:2.0:1787398149.606337:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701351680:0@lo:400:kworker.0 00000100:00080000:1.0:1787398149.606740:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398149.606745:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398149.606747:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398149.606750:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787398149.990824:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787398150.633735:0:107244:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 85899345938 batchid updated 00000020:00080000:0.0:1787398150.633802:0:107304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 85899345938 00000004:00080000:0.0:1787398150.633869:0:107304:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a835777240 with version 9 00000020:00080000:0.0:1787398150.633887:0:107304:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 85899345937 cancel update log [0x20000e691:0x1:0x0].1: rc = 0 00000020:00080000:0.0:1787398150.633972:0:107304:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 85899345937 cancel update log [0x24000a040:0x1:0x0].1: rc = 0 00000004:00080000:2.0:1787398150.633975:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 9 rpc_version 9 00000004:00080000:0.0:1787398150.634008:0:107304:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a835777d80 with version 10 00000020:00100000:2.0:1787398150.634011:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1787398150.634012:0:107304:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 85899345938 cancel update log [0x20000e691:0x1:0x0].2: rc = 0 00000100:00100000:2.0:1787398150.634022:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a83876f100 x1874218701351936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1787398150.634033:0:107304:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 85899345938 cancel update log [0x24000a040:0x1:0x0].2: rc = 0 00000100:00100000:2.0:1787398150.634046:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701351936:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1787398150.634052:0:107304:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 85899345938 00000100:00100000:2.0:1787398150.634122:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398150.634161:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8366ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787398150.634346:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701351936 00000100:00100000:3.0:1787398150.634354:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701351936 00000100:00100000:3.0:1787398150.634412:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787398150.634422:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107290:x1874218701351936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787398150.634603:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107290:x1874218701351936:12345-0@lo:1000:osp_up0-1.0 Request processed in 182us (481us total) trans 128849018899 rc 0/0 00000100:00100000:3.0:1787398150.634611:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787398150.634709:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701351936:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787398150.634721:0:107290:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a830f90300 version 10 rpc_version 10 00000020:00100000:0.0:1787398150.634734:0:107290:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398150.634740:0:107290:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a81816d500 x1874218701352192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398150.634752:0:107290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701352192:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398150.634792:0:107290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398150.634817:0:107290:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a835777b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787398150.634950:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352192 00000100:00100000:2.0:1787398150.634955:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352192 00000100:00100000:2.0:1787398150.634989:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787398150.634996:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82f608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107290:x1874218701352192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398150.635105:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82f608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107290:x1874218701352192:12345-0@lo:1000:osp_up0-1.0 Request processed in 108us (311us total) trans 128849018900 rc 0/0 00000100:00100000:2.0:1787398150.635112:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787398150.635217:0:107290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107290:1874218701352192:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787398151.014044:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398151.142398:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701352320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398151.142479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398151.142550:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787398151.142557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701352448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398151.142581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398151.142617:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352320 00000100:00100000:2.0:1787398151.142625:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352320 00000100:00100000:2.0:1787398151.142678:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352448 00000100:00100000:2.0:1787398151.142681:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352448 00000100:00100000:2.0:1787398151.142709:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787398151.142718:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701352320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787398151.142746:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398151.142788:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701352320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398151.142795:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787398151.142812:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787398151.142818:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701352448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398151.142833:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398151.142857:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701352448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398151.142863:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1787398151.142881:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398151.142884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398151.142920:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701352448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398151.142949:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701352320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398151.144200:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701352576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398151.144262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398151.145211:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352576 00000100:00100000:0.0:1787398151.145223:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352576 00000100:00100000:0.0:1787398151.145281:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787398151.145291:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701352576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787398151.145335:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:0.0:1787398151.146152:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701352576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 857us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398151.146174:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787398151.151334:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701352576:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787398152.039139:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398153.060763:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787398153.110716:0:108816:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787398153.110768:0:108816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398153.110783:0:108816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398153.110792:0:108816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398153.110799:0:108816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398153.110821:0:108816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787398153.110827:0:108816:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787398153.110837:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398153.110846:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787398153.110853:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787398153.110855:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc1466c20) 00000100:00100000:1.0:1787398153.110858:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 10000000:00010000:0.0:1787398153.110861:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787398153.110865:0:108816:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787398153.110890:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787398153.110893:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787398153.110903:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398153.110909:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787398153.110911:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787398153.110914:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787398153.110940:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398153.110947:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787398153.110965:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398153.110972:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e62800/0x274786fe0d193e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e22 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398153.110982:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398153.110984:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398153.110986:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398153.111004:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398153.111022:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701352832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787398153.111104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398153.111208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701352704:0@lo:39:umount.0 00000100:00100000:2.0:1787398153.111242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398153.111313:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352832 00000100:00100000:2.0:1787398153.111320:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352832 00000100:00100000:2.0:1787398153.111364:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1787398153.111374:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701352832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398153.111376:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352704 00000100:00100000:1.0:1787398153.111391:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352704 00010000:00010000:2.0:1787398153.111397:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398153.111415:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a7050aa200/0x274786fe0d193e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193e1b expref: 24 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398153.111430:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787398153.111431:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787398153.111439:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701352704:12345-0@lo:39:umount.0 00000001:00020000:1.0:1787398153.111456:0:107264:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:2.0:1787398153.111471:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701352832:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398153.111481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1787398153.111559:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701352832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398153.992298:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398153.992357:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398153.992396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398153.992431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398153.992486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398153.992511:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375744 00000100:00100000:1.0:1787398153.992516:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375872 00000100:00100000:1.0:1787398153.992545:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375872 00000100:00100000:0.0:1787398153.992548:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375744 00000100:00100000:0.0:1787398153.992613:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:3.0:1787398153.992620:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681375616 00000100:00100000:0.0:1787398153.992626:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681375744:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398153.992627:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681375616 00000100:00100000:3.0:1787398153.992664:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00100000:3.0:1787398153.992673:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681375616:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398153.992719:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681375744:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398153.992729:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 47 00000100:00100000:2.0:1787398153.992788:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376000 00000100:00100000:2.0:1787398153.992792:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376000 00000100:00100000:1.0:1787398153.993015:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:1.0:1787398153.993023:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681375872:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398153.993758:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376128 00000100:00100000:2.0:1787398153.993765:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376128 00000100:00100000:2.0:1787398153.993796:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 174 00000100:00100000:2.0:1787398153.993806:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681376000:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398153.994015:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681375616:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 1341us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398153.994025:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 99 00000100:00080000:3.0:1787398153.994078:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398153.994083:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398153.994086:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787398153.994089:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398153.994100:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 175 00000100:00100000:3.0:1787398153.994121:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681376128:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398153.994150:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681376128:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 43us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398153.994169:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 175 00000100:00100000:1.0:1787398154.005292:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681375872:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 12255us (12845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.005309:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 48 00000100:00100000:2.0:1787398154.008067:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2403:x1874218681376000:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 14249us (15694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398154.008085:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 174 00010000:00010000:2.0:1787398154.086309:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398154.212772:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701352960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398154.212848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.216176:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701353088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398154.216429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.216494:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701352960 00000100:00100000:0.0:1787398154.216502:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701352960 00000100:00100000:2.0:1787398154.216538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398154.216551:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701353216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398154.216581:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353088 00000100:00100000:0.0:1787398154.216586:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353088 00000100:00100000:2.0:1787398154.216591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.216612:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787398154.216625:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701352960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787398154.216656:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398154.216702:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701352960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (3854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398154.216710:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787398154.216727:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787398154.216734:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701353088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787398154.216750:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1787398154.216783:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701353088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398154.216789:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1787398154.216804:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398154.216808:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398154.216842:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701353088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787398154.216892:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701352960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787398154.217829:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353216 00000100:00100000:3.0:1787398154.217837:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353216 00000100:00100000:3.0:1787398154.217894:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787398154.219734:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701353216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787398154.219774:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445502976 avail 1299263488 00000100:00100000:3.0:1787398154.219864:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701353216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (3273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398154.219961:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701353216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398154.220357:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787398154.725133:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701353344:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.725164:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.725258:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701353600:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.725329:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701353728:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.728388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398154.728461:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701353984:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.728675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398154.728700:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701354496:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.728728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398154.728773:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354496 00000100:00100000:1.0:1787398154.728781:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354496 00000100:00100000:1.0:1787398154.728848:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787398154.728859:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701354496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.729238:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701354496:12345-0@lo:400:kworker.0 Request processed in 379us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.729247:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1787398154.729270:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787398154.729309:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701354496:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.729434:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353984 00000100:00100000:1.0:1787398154.729438:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353984 00000100:00100000:1.0:1787398154.729481:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398154.729488:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701353984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.729701:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3648:x1874218701353984:12345-0@lo:400:kworker.0 Request processed in 212us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.729708:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398154.729736:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701353984:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.729775:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353472 00000100:00100000:1.0:1787398154.729780:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353472 00000100:00100000:1.0:1787398154.729810:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787398154.729817:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701353472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.729854:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874218701353472:12345-0@lo:400:kworker.0 Request processed in 37us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.729860:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787398154.729875:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398154.729891:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1874218701353472:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398154.731184:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701354112:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398154.731251:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354112 00000100:00100000:3.0:1787398154.731257:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354112 00000100:00100000:3.0:1787398154.731298:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787398154.731305:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701354112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731348:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701354112:12345-0@lo:400:kworker.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398154.731355:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787398154.731394:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701354112:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731400:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701354624:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398154.731459:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354624 00000100:00100000:3.0:1787398154.731474:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354624 00000100:00100000:3.0:1787398154.731509:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787398154.731515:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701354624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.731567:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701354624:12345-0@lo:400:kworker.0 Request processed in 52us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398154.731574:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1787398154.731588:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398154.731610:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701354624:0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.731720:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353600 00000100:00100000:1.0:1787398154.731724:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353600 00000100:00100000:1.0:1787398154.731765:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787398154.731772:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701353600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.731815:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874218701353600:12345-0@lo:400:kworker.0 Request processed in 44us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.731822:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787398154.733757:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787398154.733817:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701353600:0@lo:400:kworker.0 00000100:00100000:0.0:1787398154.735227:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.735358:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701353856:0@lo:400:kworker.0 00000100:00100000:0.0:1787398154.735422:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.735456:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701354368:0@lo:400:kworker.0 00000100:00100000:0.0:1787398154.735481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.735508:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354368 00000100:00100000:0.0:1787398154.735516:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354368 00000100:00100000:0.0:1787398154.735579:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787398154.735588:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398154.735652:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701354368:12345-0@lo:400:kworker.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398154.735660:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787398154.735701:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701354368:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.736770:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353856 00000100:00100000:3.0:1787398154.736780:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353856 00000100:00100000:3.0:1787398154.736841:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787398154.736850:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701353856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.736922:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701353856:12345-0@lo:400:kworker.0 Request processed in 72us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398154.736929:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787398154.736953:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787398154.737784:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398154.737833:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701354240:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.737865:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398154.737912:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701353856:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.737914:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354240 00000100:00100000:2.0:1787398154.737918:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354240 00000100:00100000:2.0:1787398154.737953:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787398154.737960:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701354240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.737999:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701354240:12345-0@lo:400:kworker.0 Request processed in 40us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398154.738005:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787398154.738045:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701354240:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.738052:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701354752:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.738077:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398154.738247:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353728 00000100:00100000:3.0:1787398154.738252:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353728 00000100:00100000:3.0:1787398154.738297:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354752 00000100:00100000:3.0:1787398154.738301:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354752 00000100:00100000:3.0:1787398154.738317:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787398154.738352:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398154.738375:0:107263:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787398154.738384:0:107263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787398154.738510:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701353728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.738589:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701353728:12345-0@lo:400:kworker.0 Request processed in 265us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.739799:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701353344 00000100:00100000:1.0:1787398154.739809:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701353344 00000100:00100000:1.0:1787398154.740021:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787398154.740035:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701353344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398154.740122:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:3651:x1874218701353344:12345-0@lo:400:kworker.0 Request processed in 88us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398154.740130:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787398154.742572:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787398154.742724:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701354752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398154.742899:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701354752:12345-0@lo:400:kworker.0 Request processed in 313us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398154.742908:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787398154.743174:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701353344:0@lo:400:kworker.0 00000100:00100000:3.0:1787398154.744828:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787398154.744831:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701353728:0@lo:400:kworker.0 00000100:00100000:2.0:1787398154.744851:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701354752:0@lo:400:kworker.0 00010000:00010000:2.0:1787398155.109592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398156.132821:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398156.262104:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398156.262129:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398156.262202:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398156.262275:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701354880 00000100:00100000:2.0:1787398156.262283:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701354880 00000100:00100000:2.0:1787398156.262328:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787398156.262336:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701354880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787398156.262366:0:107321:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1787398156.262412:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3650:x1874218701354880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398156.262435:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787398156.262482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398156.263628:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701355136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398156.263678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398156.263704:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398156.263710:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701355008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398156.263739:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398156.263816:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355136 00000100:00100000:1.0:1787398156.263822:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355136 00000100:00100000:1.0:1787398156.263869:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355008 00000100:00100000:1.0:1787398156.263871:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355008 00000100:00100000:1.0:1787398156.263887:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787398156.263894:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701355136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398156.263917:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398156.263954:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701355136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398156.263961:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787398156.263989:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787398156.263995:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701355008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398156.264011:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398156.264036:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701355008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398156.264041:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1787398156.264390:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398156.264395:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398156.264425:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701355008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398156.264437:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701355136:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787398156.774032:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018900 is committed 00010000:00010000:2.0:1787398157.156746:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398158.181220:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398159.111764:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398159.111806:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398159.111857:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398159.111907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398159.111996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398159.112052:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376256 00000100:00100000:1.0:1787398159.112063:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376256 00000100:00100000:0.0:1787398159.112073:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376384 00000100:00100000:0.0:1787398159.112080:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376384 00000100:00100000:1.0:1787398159.112126:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:0.0:1787398159.112135:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376512 00000100:00100000:1.0:1787398159.112139:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681376256:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398159.112140:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376512 00000100:00100000:0.0:1787398159.112166:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00100000:0.0:1787398159.112177:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681376384:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398159.112426:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681376256:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398159.112436:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00080000:1.0:1787398159.112491:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787398159.112496:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398159.112559:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376640 00000100:00100000:3.0:1787398159.112564:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376640 00000100:00100000:3.0:1787398159.112603:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376768 00000100:00100000:3.0:1787398159.112607:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376768 00000100:00100000:3.0:1787398159.112628:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 101 00000100:00100000:3.0:1787398159.112635:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681376640:12345-192.168.204.60@tcp:9:kworker.0 00000001:00020000:3.0:1787398159.112645:0:101069:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:2.0:1787398159.115980:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 102 00000100:00100000:2.0:1787398159.116028:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+5:2401:x1874218681376768:12345-192.168.204.60@tcp:9:kworker.0 00000001:00020000:2.0:1787398159.116050:0:99640:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:2.0:1787398159.116074:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 55 00000100:00100000:2.0:1787398159.116083:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681376512:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398159.118270:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681376384:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 6081us (6398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.118287:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 54 00000100:00080000:0.0:1787398159.118415:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398159.118420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398159.119600:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681376512:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 3506us (7590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398159.119617:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 55 00010000:00010000:2.0:1787398159.205969:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398159.332902:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701355264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398159.332986:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.333152:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355264 00000100:00100000:0.0:1787398159.333161:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355264 00000100:00100000:0.0:1787398159.333228:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787398159.333239:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701355264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787398159.333276:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445502976 avail 1299263488 00000100:00100000:0.0:1787398159.333326:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874218701355264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.333333:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787398159.335147:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701355264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398159.335173:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398159.335183:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701355392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398159.335247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.335506:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355392 00000100:00100000:3.0:1787398159.335514:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355392 00000100:00100000:1.0:1787398159.335725:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787398159.335734:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701355520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398159.335767:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398159.335794:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355520 00000100:00100000:1.0:1787398159.335797:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355520 00000100:00100000:3.0:1787398159.338340:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787398159.338360:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701355392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398159.338395:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398159.338490:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701355392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398159.338497:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787398159.339120:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82ebd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701355392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787398159.340694:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398159.340703:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787398159.345241:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787398159.345258:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701355520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787398159.345293:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398159.345372:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701355520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (9603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398159.345380:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787398159.345447:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701355520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787398159.844977:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701355776:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845140:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701356288:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845199:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701356800:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845225:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845255:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787398159.845261:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701355904:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845301:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701356416:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845335:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701356928:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398159.845386:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356800 00000100:00100000:0.0:1787398159.845394:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356800 00000100:00100000:0.0:1787398159.845457:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356416 00000100:00100000:0.0:1787398159.845461:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356416 00000100:00100000:0.0:1787398159.845475:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356928 00000100:00100000:0.0:1787398159.845478:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356928 00000100:00100000:0.0:1787398159.845497:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787398159.845505:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701356800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845588:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701356800:12345-0@lo:400:kworker.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.845596:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787398159.845613:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787398159.845619:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701356416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845646:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874218701356416:12345-0@lo:400:kworker.0 Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.845652:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787398159.845663:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787398159.845669:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701356928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845706:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701356928:12345-0@lo:400:kworker.0 Request processed in 36us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.845712:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787398159.845735:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398159.845739:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787398159.845749:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356288 00000100:00100000:0.0:1787398159.845753:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356288 00000100:00100000:0.0:1787398159.845778:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787398159.845784:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701356288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845817:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701356288:12345-0@lo:400:kworker.0 Request processed in 33us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.845823:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787398159.845863:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701356416:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845874:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701356928:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845883:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018900 gen 2 00000004:00080000:0.0:1787398159.845888:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018899 committed transno 128849018900 00000004:00080000:0.0:1787398159.845906:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018900 committed transno 128849018900 00000100:00100000:0.0:1787398159.845916:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701356288:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845927:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701356800:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.845954:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355776 00000100:00100000:0.0:1787398159.845957:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355776 00000100:00080000:0.0:1787398159.845973:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398159.846005:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355904 00000100:00100000:0.0:1787398159.846008:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355904 00000100:00080000:0.0:1787398159.846022:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787398159.846041:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787398159.846054:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701355776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.846090:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701355776:12345-0@lo:400:kworker.0 Request processed in 37us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.846096:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787398159.846122:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701355776:0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.846139:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787398159.846145:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701355904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398159.846177:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874218701355904:12345-0@lo:400:kworker.0 Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398159.846183:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787398159.846204:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1874218701355904:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846569:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701356032:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846641:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701356544:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846663:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846687:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701357056:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787398159.846733:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701355648:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846782:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701356160:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846819:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701356672:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.846839:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398159.846864:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356672 00000100:00100000:3.0:1787398159.846868:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356672 00000100:00100000:3.0:1787398159.846897:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787398159.846904:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701356672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847006:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701356672:12345-0@lo:400:kworker.0 Request processed in 101us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398159.847013:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787398159.847034:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356032 00000100:00100000:3.0:1787398159.847038:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356032 00000100:00100000:3.0:1787398159.847064:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357056 00000100:00100000:3.0:1787398159.847067:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357056 00000100:00100000:3.0:1787398159.847077:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356160 00000100:00100000:3.0:1787398159.847079:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356160 00000100:00100000:3.0:1787398159.847092:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787398159.847097:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701356032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847126:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701356032:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398159.847139:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787398159.847152:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787398159.847157:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701357056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847185:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701357056:12345-0@lo:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398159.847190:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787398159.847200:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787398159.847206:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701356160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847229:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874218701356160:12345-0@lo:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398159.847234:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787398159.847246:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787398159.847249:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398159.847271:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1874218701356160:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847281:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701356672:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847289:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701356032:0@lo:400:kworker.0 00000100:00100000:3.0:1787398159.847297:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701357056:0@lo:400:kworker.0 00000100:00100000:2.0:1787398159.847384:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701356544 00000100:00100000:2.0:1787398159.847389:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701356544 00000100:00100000:2.0:1787398159.847425:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787398159.847432:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701356544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398159.847504:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701356544:12345-0@lo:400:kworker.0 Request processed in 72us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398159.847510:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787398159.847561:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701356544:0@lo:400:kworker.0 00000100:00100000:1.0:1787398159.847846:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701355648 00000100:00100000:1.0:1787398159.847857:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701355648 00000100:00100000:1.0:1787398159.847895:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787398159.847902:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82880f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701355648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398159.847958:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82880f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701355648:12345-0@lo:400:kworker.0 Request processed in 57us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398159.847965:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787398159.848363:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701355648:0@lo:400:kworker.0 00010000:00010000:2.0:1787398160.229025:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1787398161.124655:0:107264:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:1.0:1787398161.134888:0:107264:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193ff0 00000100:00080000:1.0:1787398161.134917:0:107264:0:(import.c:65:import_set_state_nolock()) ffff89a70374c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787398161.135099:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+1:3647:x1874218701352704:12345-0@lo:39:umount.0 Request processed in 8023656us (8023851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398161.135112:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000020:00000080:1.0:1787398161.135127:0:107264:0:(genops.c:906:class_export_put()) final put ffff89a70374c000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1787398161.135282:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787398161.135320:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a83879d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1787398161.135333:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70374c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1787398161.135344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701352704:0@lo:39:umount.0 00000020:00000080:2.0:1787398161.135389:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70374c800 for lustre-MDT0000 00000100:00080000:1.0:1787398161.135828:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398161.135833:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787398161.135838:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787398161.137118:0:108816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137135:0:108816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137142:0:108816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137155:0:108816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137177:0:108816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398161.137196:0:108816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137203:0:108816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137208:0:108816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137214:0:108816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137230:0:108816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398161.137236:0:108816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137242:0:108816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137248:0:108816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137253:0:108816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137263:0:108816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787398161.137267:0:108816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137273:0:108816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.137284:0:108816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137490:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787398161.137498:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137505:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398161.137509:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137518:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398161.137545:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398161.137550:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787398161.137553:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1787398161.137596:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137604:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787398161.137635:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137641:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63600/0x274786fe0d193d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d65 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137655:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398161.137658:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137664:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398161.137666:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137673:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398161.137691:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398161.137697:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787398161.137699:0:56852:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787398161.137701:0:56852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787398161.137702:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398161.137708:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137715:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137722:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398161.137724:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787398161.137727:0:56853:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398161.137734:0:56853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787398161.137740:0:56853:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.137741:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398161.137746:0:56853:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787398161.137748:0:56853:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787398161.137748:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63800/0x274786fe0d193f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193f6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398161.137750:0:56853:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787398161.137765:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398161.137767:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398161.137768:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398161.137770:0:56853:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398161.137775:0:56853:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398161.137781:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398161.137786:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701357184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398161.137787:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa000/0x274786fe0d193e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193e14 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398161.137795:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398161.137797:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398161.137798:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398161.137852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398161.137916:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357184 00000100:00100000:2.0:1787398161.137923:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357184 00000100:00100000:2.0:1787398161.137987:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1787398161.137996:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83453ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+23:3649:x1874218701357184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398161.138008:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398161.138021:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe75600/0x274786fe0d193d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193d57 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.138033:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398161.138068:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83453ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3649:x1874218701357184:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398161.138075:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1787398161.138076:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701357440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398161.138102:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398161.138128:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398161.138144:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701357312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398161.138166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398161.138488:0:19662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357440 00000100:00100000:2.0:1787398161.138493:0:19662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357440 00000100:00100000:2.0:1787398161.138549:0:19662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1787398161.138556:0:19662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701357440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398161.138563:0:19662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398161.138573:0:19662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62200/0x274786fe0d193e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193e0d expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.138595:0:19662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398161.138630:0:19662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:99b57a74-e5dc-42df-b087-b10fad741506+21:3651:x1874218701357440:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398161.138636:0:19662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1787398161.138674:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701357184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398161.138801:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398161.138922:0:108816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398161.141369:0:108816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787398161.141382:0:108816:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1787398161.141390:0:108816:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1787398161.141822:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398161.141831:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.141841:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:2.0:1787398161.141845:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.141854:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787398161.141861:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398161.141867:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787398161.141869:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787398161.141872:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787398161.141913:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.141920:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1787398161.142515:0:108816:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787398161.142531:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1787398161.142539:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1787398161.142545:0:108816:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:2.0:1787398161.142648:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.143010:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a835e63400/0x274786fe0d193d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x274786fe0d193d50 expref: -99 pid: 107234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398161.143048:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398161.143061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398161.143064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398161.143080:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398161.143106:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701357568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398161.144761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398161.144799:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357312 00000100:00100000:2.0:1787398161.144808:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357312 00000100:00100000:3.0:1787398161.144819:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357568 00000100:00100000:3.0:1787398161.144822:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357568 00000100:00100000:2.0:1787398161.144867:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1787398161.144876:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+22:3651:x1874218701357312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398161.144892:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787398161.144912:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a835e62600/0x274786fe0d193f6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193f64 expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398161.145010:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1787398161.145018:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+21:3649:x1874218701357568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398161.145027:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398161.145036:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75200/0x274786fe0d193d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x274786fe0d193d49 expref: 21 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398161.145046:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398161.145092:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99b57a74-e5dc-42df-b087-b10fad741506+20:3649:x1874218701357568:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398161.145099:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1787398161.145141:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701357568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398161.145171:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701357440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787398161.145498:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787398161.145563:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701357312:12345-0@lo:103:ldlm_bl.0 Request processed in 687us (7395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398161.145570:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000004:00000080:1.0:1787398161.147702:0:108816:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:3.0:1787398161.148259:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701357312:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1787398161.149187:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1787398161.149204:0:108816:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a828a5a800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398161.149211:0:108816:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a838260000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398161.149219:0:108816:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a706d31800 784819ec-79bc-4534-8fa6-902d7a92d2f8 192.168.204.60@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 90194313226 stale:0 00000020:00080000:1.0:1787398161.149224:0:108816:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff89a706d32000 lustre-MDT0000-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398161.151368:0:108816:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff89a829b94d40) has exports, disconnecting them 00000020:00080000:1.0:1787398161.151381:0:108816:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a828a5a800), last request at 1787398159 00000020:00000080:1.0:1787398161.151390:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19441f 00000100:00080000:1.0:1787398161.151409:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787398161.151477:0:108816:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a828a5a800): rc 0 00000020:00000080:1.0:1787398161.151480:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a828a5a800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1787398161.151500:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787398161.151500:0:108816:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a838260000), last request at 1787398159 00000020:00000080:1.0:1787398161.151519:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d194418 00000100:00080000:1.0:1787398161.151549:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a838267000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787398161.151567:0:108816:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a838260000): rc 0 00000020:00000080:1.0:1787398161.151569:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a838260000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787398161.151576:0:108816:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.204.60@tcp (ffff89a706d31800), last request at 1787398159 00010000:00010000:2.0:1787398161.151655:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787398161.151668:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787398161.151728:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838260000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787398161.151751:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5c800 for lustre-MDT0001 00000020:00000080:3.0:1787398161.151758:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a838267000 for lustre-MDT0001 00000020:00000080:1.0:1787398161.152015:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193dab 00000100:00080000:1.0:1787398161.152028:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a838264800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787398161.152068:0:108816:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.60@tcp (ffff89a706d31800): rc 0 00000020:00000080:1.0:1787398161.152070:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a706d31800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00080000:1.0:1787398161.152086:0:108816:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89a706d32000), last request at 1787398114 00000020:00000080:1.0:1787398161.152090:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193da4 00000100:00080000:1.0:1787398161.152095:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a70374d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787398161.152105:0:108816:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a706d32000): rc 0 00000020:00000080:1.0:1787398161.152107:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a706d32000/lustre-MDT0000-mdtlov_UUID 00000004:00000080:1.0:1787398161.152113:0:108816:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadfe41547ae0 00000100:00080000:1.0:1787398161.152132:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398161.152135:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018900 gen 3 00010000:00010000:2.0:1787398161.152146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787398161.152153:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d31800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-MDT0001 00000020:00000080:2.0:1787398161.152187:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a706d32000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787398161.152200:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a838264800 for lustre-MDT0001 00000020:00000080:2.0:1787398161.152203:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70374d000 for lustre-MDT0001 00010000:00010000:3.0:1787398161.153300:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787398161.158279:0:108816:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787398161.158315:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787398161.158803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357696:0@lo:39:umount.0 00000100:00100000:0.0:1787398161.159006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398161.159097:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398161.159101:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 3 00000004:00080000:1.0:1787398161.159121:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787398161.159187:0:108816:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787398161.159201:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a7054c6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787398161.159218:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398161.159221:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 3 00000004:00080000:1.0:1787398161.159229:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787398161.159289:0:108816:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787398161.159315:0:108816:0:(import.c:65:import_set_state_nolock()) ffff89a70a903000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787398161.159368:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a829b94d40) has no exports 00000100:00100000:2.0:1787398161.159398:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357696 00000100:00100000:2.0:1787398161.159407:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357696 00000100:00100000:0.0:1787398161.159423:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357824:0@lo:9:umount.0 00000100:00100000:0.0:1787398161.159454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398161.159470:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787398161.159471:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357952:0@lo:9:umount.0 00000100:00100000:2.0:1787398161.159486:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701357696:12345-0@lo:39:umount.0 00000100:00100000:0.0:1787398161.159491:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00020000:2.0:1787398161.159503:0:99649:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:3.0:1787398161.159810:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357824 00000100:00100000:3.0:1787398161.159816:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357824 00000100:00100000:3.0:1787398161.159928:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701357952 00000100:00100000:3.0:1787398161.159932:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701357952 00000100:00100000:3.0:1787398161.159959:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787398161.159977:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701357824:12345-0@lo:9:umount.0 00000001:00020000:3.0:1787398161.159987:0:99641:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00080000:3.0:1787398161.160000:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398161.160004:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787398161.160633:0:108816:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 30, last_idx 32 00000040:00080000:1.0:1787398161.161116:0:108816:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 31, last_idx 32 00000020:00080000:1.0:1787398161.161348:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89a829b94d40) has no exports 00000020:01000000:3.0:1787398161.253833:0:108816:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a7026cb600 - data ffff89a827e0b6c0/ffff89a831086000 00000020:01000000:3.0:1787398161.254120:0:108816:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89a81100ee40 - data ffff89a83fd06bd0/ffff89a8067fbc00 00010000:00010000:2.0:1787398161.254830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398161.380802:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701358080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398161.380876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398161.380932:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398161.380943:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1874218701358208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398161.380945:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358080 00000100:00100000:1.0:1787398161.380956:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358080 00000100:00080000:3.0:1787398161.381011:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398161.381058:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787398161.381068:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701358080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398161.381095:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398161.381139:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701358080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398161.381146:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787398161.382804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787398161.382825:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701358336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398161.382856:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701358080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398161.382886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398161.382921:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358336 00000100:00100000:1.0:1787398161.382927:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358336 00000100:00100000:1.0:1787398161.383009:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787398161.383018:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701358336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398161.383045:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398161.383089:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701358336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398161.383097:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:2.0:1787398161.383103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398161.383134:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701358336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787398162.276828:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398163.303173:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398164.231784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398164.231836:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398164.231881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:2.0:1787398164.231973:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377024 00000100:00100000:2.0:1787398164.231985:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377024 00000100:00100000:2.0:1787398164.232053:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377152 00000100:00100000:2.0:1787398164.232056:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377152 00000100:00100000:2.0:1787398164.232075:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787398164.232085:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681377024:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398164.232160:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681377024:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 77us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398164.232168:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 61 00000100:00100000:2.0:1787398164.232186:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00100000:2.0:1787398164.232191:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874218681377152:12345-192.168.204.60@tcp:400:kworker.0 00000020:00080000:2.0:1787398164.232202:0:107265:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.60@tcp 00000100:00100000:2.0:1787398164.232225:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1874218681377152:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 32us (343us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787398164.232231:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 50 00000100:00080000:1.0:1787398164.232298:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398164.233398:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681376896 00000100:00100000:0.0:1787398164.233408:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681376896 00000100:00100000:0.0:1787398164.233463:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:0.0:1787398164.233471:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681376896:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398164.234334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398164.234399:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377280 00000100:00100000:3.0:1787398164.234406:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377280 00000100:00100000:3.0:1787398164.234436:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 51 00000100:00100000:3.0:1787398164.234443:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681377280:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787398164.234461:0:108817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:0.0:1787398164.238032:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681376896:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 4548us (6182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398164.238069:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 103 00000100:00100000:3.0:1787398164.241148:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2401:x1874218681377280:12345-192.168.204.60@tcp:38:ptlrpcd_00_01.0 Request processed in 6694us (6807us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398164.241180:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 51 00010000:00010000:2.0:1787398164.325277:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398164.453183:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1874218701358464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398164.453324:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398164.453336:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701358592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787398164.453405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398164.453492:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358592 00000100:00100000:0.0:1787398164.453500:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358592 00000100:00100000:0.0:1787398164.453566:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787398164.453574:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1874218701358592:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1787398164.453582:0:99650:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787398164.453624:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3648:x1874218701358592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (218us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787398164.453631:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:02020000:1.0:1787398164.453711:0:3648:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787398164.453715:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787398164.453720:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787398164.453738:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787398164.458439:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787398164.458468:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a82e4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1874218701358720:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787398164.476102:0:3648:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398164.476118:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 3999 00000100:00080000:1.0:1787398164.476131:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398164.476182:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bd7b80 x1874218701358848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398164.476319:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701358848:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787398164.476401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398164.476500:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358848 00000100:00100000:1.0:1787398164.476508:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358848 00000100:00100000:1.0:1787398164.477207:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787398164.477216:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701358848:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787398164.477236:0:99650:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787398164.477359:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701358848:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 141us (957us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398164.477367:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787398164.477611:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398164.477630:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398164.477634:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701358848:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787398164.965905:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398164.965912:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398164.965916:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398164.965926:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4043 00000100:00080000:0.0:1787398164.965933:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787398164.965940:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398164.965964:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835e50380 x1874218701359616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398164.966070:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701358976:0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398164.966197:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701359488:0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966225:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398164.966248:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787398164.966253:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701359360:0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398164.966286:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701360000:0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398164.966357:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359488 00000100:00100000:3.0:1787398164.966365:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359488 00000100:00100000:3.0:1787398164.966396:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359360 00000100:00100000:3.0:1787398164.966398:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359360 00000100:00100000:3.0:1787398164.966424:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360000 00000100:00100000:3.0:1787398164.966426:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360000 00000100:00100000:3.0:1787398164.966439:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787398164.966446:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701359360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966491:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701359360:12345-0@lo:400:kworker.0 Request processed in 45us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398164.966498:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787398164.966555:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787398164.966561:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701360000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966587:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701360000:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398164.966593:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787398164.966603:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787398164.966607:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1874218701359488:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787398164.966613:0:108265:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787398164.966630:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1874218701359488:12345-0@lo:400:kworker.0 Request processed in 22us (405us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787398164.966636:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787398164.966669:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701359360:0@lo:400:kworker.0 00000100:00100000:3.0:1787398164.966679:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701360000:0@lo:400:kworker.0 00000100:00080000:3.0:1787398164.966688:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787398164.966694:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787398164.966698:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787398164.966704:0:3651:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398164.966707:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4003 00000100:00080000:3.0:1787398164.966711:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398164.966727:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d2300 x1874218701360128/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398164.966738:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701359488:0@lo:400:kworker.0 00000100:00100000:2.0:1787398164.966938:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701359616:0@lo:38:kworker.0 00000100:00100000:2.0:1787398164.966972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398164.967012:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701360128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787398164.967033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398164.967063:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360128 00000100:00100000:2.0:1787398164.967068:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360128 00000100:00100000:2.0:1787398164.967088:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787398164.967093:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701360128:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787398164.967109:0:107263:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787398164.967141:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701360128:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (107us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398164.967146:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787398164.967178:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398164.967183:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398164.967187:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701360128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787398164.967299:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359616 00000100:00100000:3.0:1787398164.967304:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359616 00000100:00100000:3.0:1787398164.967345:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787398164.967349:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701359616:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787398164.967358:0:107321:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787398164.967387:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701359616:12345-0@lo:38:kworker.0 Request processed in 37us (414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398164.967392:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787398164.968087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701359232:0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398164.968163:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701359872:0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398164.968212:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787398164.968219:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701359104:0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968239:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398164.968256:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701359744:0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968276:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787398164.968301:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398164.968316:0:99639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1787398164.968335:0:99639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:1.0:1787398164.968425:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359232 00000100:00100000:1.0:1787398164.968430:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359232 00000100:00100000:1.0:1787398164.968454:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359104 00000100:00100000:1.0:1787398164.968457:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359104 00000100:00100000:1.0:1787398164.968486:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398164.968493:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701359104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968562:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701359104:12345-0@lo:400:kworker.0 Request processed in 68us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398164.968568:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787398164.968584:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787398164.968587:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218701359232:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787398164.968592:0:107264:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787398164.968617:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1874218701359232:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787398164.968622:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787398164.968636:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398164.968659:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701359104:0@lo:400:kworker.0 00000100:00080000:1.0:1787398164.968669:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787398164.968672:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787398164.968676:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787398164.968680:0:3649:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787398164.968683:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4003 00000100:00080000:1.0:1787398164.968688:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398164.968724:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835bd4700 x1874218701360256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398164.968751:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1874218701359232:0@lo:400:kworker.0 00000100:00100000:1.0:1787398164.968795:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359872 00000100:00100000:1.0:1787398164.968799:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359872 00000100:00100000:1.0:1787398164.968821:0:99639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1787398164.968827:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701359744 00000100:00100000:1.0:1787398164.968829:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701359744 00000100:00100000:1.0:1787398164.968842:0:99639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1787398164.968848:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787398164.968854:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701359872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398164.969038:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358976 00000100:00100000:0.0:1787398164.969043:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358976 00000100:00100000:0.0:1787398164.969078:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787398164.969085:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701358976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398164.969346:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701360256:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787398164.973790:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398164.973801:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398164.973926:0:108819:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:3.0:1787398164.973938:0:108819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00000100:00100000:3.0:1787398164.973973:0:100418:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:3.0:1787398164.973990:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787398164.974005:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398164.977215:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3651:x1874218701358976:12345-0@lo:400:kworker.0 Request processed in 8120us (11056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398164.977240:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787398164.977309:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701358976:0@lo:400:kworker.0 00000100:00100000:0.0:1787398164.977653:0:108820:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:0.0:1787398164.978493:0:108820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_007' 00000100:00100000:0.0:1787398164.978684:0:108820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787398164.978712:0:108820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1874218701357952:12345-0@lo:9:umount.0 00000001:00020000:0.0:1787398164.978731:0:108820:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:1.0:1787398164.981607:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701359872:12345-0@lo:400:kworker.0 Request processed in 12742us (13407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398164.981623:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787398164.983161:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701359872:0@lo:400:kworker.0 00000100:00080000:1.0:1787398164.983413:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398164.985488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398164.985605:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398164.985612:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398164.985647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701359616:0@lo:38:kworker.0 00000100:00100000:1.0:1787398164.986358:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360256 00000100:00100000:1.0:1787398164.986368:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360256 00000100:00100000:1.0:1787398164.986410:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787398164.986418:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701360256:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787398164.986439:0:108817:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787398164.986504:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701360256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 85us (1023us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398164.986512:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787398164.986638:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787398164.986644:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787398164.986647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701360256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787398164.987160:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701359744:12345-0@lo:400:kworker.0 Request processed in 13156us (18879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398164.987172:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787398164.987339:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701359744:0@lo:400:kworker.0 00010000:00010000:3.0:1787398165.348706:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398166.378049:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398166.500730:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398166.500749:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701360384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787398166.500831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398166.500927:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360384 00000100:00100000:3.0:1787398166.500936:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360384 00000100:00080000:1.0:1787398166.500983:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398166.501010:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787398166.501177:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701360384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398166.501215:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398166.501277:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701360384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398166.501386:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701360384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398166.501467:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701360512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398166.501499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398166.501547:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360512 00000100:00100000:0.0:1787398166.501550:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360512 00000100:00080000:1.0:1787398166.512088:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398166.512293:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787398166.520121:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787398166.520151:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701360512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398166.520192:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398166.520583:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701360512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 448us (19083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398166.520591:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787398166.520674:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701360512:0@lo:13:osp-pre-0-0.0 00000001:00020000:1.0:1787398167.148597:0:99640:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:1.0:1787398167.154999:0:99640:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d194411 00000100:00080000:1.0:1787398167.155020:0:99640:0:(import.c:65:import_set_state_nolock()) ffff89a828a5c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787398167.155144:0:99640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934596 00000100:00100000:1.0:1787398167.155448:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681376768:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 8039450us (8043635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398167.155459:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 102 00010000:00010000:2.0:1787398167.155804:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1787398167.156865:0:101069:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:3.0:1787398167.156891:0:101069:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d19440a 00000100:00080000:3.0:1787398167.156903:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a828a58000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787398167.156958:0:101069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901913 00010000:00010000:2.0:1787398167.157201:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398167.157370:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+2:2401:x1874218681376640:12345-192.168.204.60@tcp:9:kworker.0 Request processed in 8044730us (8045611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398167.157381:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 101 00010000:00010000:2.0:1787398167.398139:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398168.421392:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1787398169.173354:0:99641:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:0.0:1787398169.199128:0:99641:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193dea 00000001:00020000:1.0:1787398169.199145:0:99649:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000100:00080000:0.0:1787398169.199155:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a705573800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787398169.199163:0:99649:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193e8b 00000100:00080000:1.0:1787398169.199176:0:99649:0:(import.c:65:import_set_state_nolock()) ffff89a70374b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787398169.199198:0:99649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 128849018900 00000001:00000004:0.0:1787398169.199224:0:99641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901913 00010000:00010000:3.0:1787398169.199400:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398169.199431:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398169.213586:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701357824:12345-0@lo:9:umount.0 Request processed in 8053603us (8054113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398169.213607:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1787398169.213769:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787398169.213785:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398169.213787:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398169.213791:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357824:0@lo:9:umount.0 00000100:00100000:1.0:1787398169.218429:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+3:3647:x1874218701357696:12345-0@lo:39:umount.0 Request processed in 8058926us (8059404us total) trans 128849018901 rc 0/0 00000100:00100000:1.0:1787398169.218451:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787398169.218854:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a836713800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787398169.218884:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8047cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357696:0@lo:39:umount.0 00000100:00080000:1.0:1787398169.219001:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398169.219005:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018900 gen 4 00000100:00100000:1.0:1787398169.219013:0:108816:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89a8047cb480 x1874218701357696/t128849018901(128849018901) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1787398202 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398169.219033:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787398169.223385:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787398169.223393:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 4 00000004:00080000:2.0:1787398169.223451:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787398169.223454:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787398169.234079:0:107292:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787398169.234096:0:107292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x54:0x0] index 1 count 1 00000040:00080000:1.0:1787398169.234109:0:107292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 21 count 2 00000100:00100000:3.0:1787398169.349437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398169.354447:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377664 00000100:00100000:0.0:1787398169.354617:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377664 00000100:00100000:1.0:1787398169.354900:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:1.0:1787398169.354909:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681377664:12345-192.168.204.60@tcp:38:kworker.0 00010000:02000000:1.0:1787398169.354931:0:107263:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 192.168.204.60@tcp (stopping) 00000100:00100000:1.0:1787398169.355011:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874218681377664:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 100us (5584us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398169.355031:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 56 00000100:00100000:1.0:1787398169.358047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398169.358156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398169.358370:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377536 00000100:00100000:3.0:1787398169.358384:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377536 00000100:00100000:3.0:1787398169.358475:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00100000:3.0:1787398169.358490:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681377536:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398169.358629:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2403:x1874218681377536:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 142us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398169.358636:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 65 00000100:00080000:1.0:1787398169.360639:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787398169.360794:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377408 00000100:00100000:2.0:1787398169.360875:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377408 00000100:00100000:2.0:1787398169.360998:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 105 00000100:00100000:2.0:1787398169.361009:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681377408:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398169.361108:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2403:x1874218681377408:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 100us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398169.361116:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 105 00010000:00010000:2.0:1787398169.448673:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787398170.085004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398170.085012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398170.085016:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398170.085026:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4044 00000100:00080000:3.0:1787398170.085032:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787398170.085040:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398170.085063:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d3480 x1874218701360896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398170.085111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398170.085114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398170.085116:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398170.085120:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4044 00000100:00080000:3.0:1787398170.085123:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787398170.085126:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398170.085137:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d0a80 x1874218701361152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398170.085145:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398170.085148:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398170.085150:0:8:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398170.085153:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4044 00000100:00080000:3.0:1787398170.085155:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787398170.085158:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398170.085171:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d0e00 x1874218701361280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398170.085219:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701361024:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085292:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085330:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787398170.085336:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701360768:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085390:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701361664:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085456:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361024 00000100:00100000:3.0:1787398170.085463:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361024 00000100:00100000:3.0:1787398170.085512:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360768 00000100:00100000:3.0:1787398170.085515:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360768 00000100:00100000:3.0:1787398170.085568:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361664 00000100:00100000:3.0:1787398170.085571:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361664 00000100:00100000:3.0:1787398170.085588:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787398170.085596:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701361024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085652:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701361024:12345-0@lo:400:kworker.0 Request processed in 56us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398170.085659:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787398170.085676:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787398170.085681:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701360768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085708:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701360768:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398170.085713:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787398170.085724:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787398170.085730:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701361664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085757:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701361664:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398170.085763:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787398170.085810:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701360768:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085822:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701361664:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085831:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701361024:0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.085860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701360896:0@lo:38:kworker.0 00000100:00100000:3.0:1787398170.085897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085915:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701361152:0@lo:38:kworker.0 00000100:00100000:3.0:1787398170.085934:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085945:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701361280:0@lo:38:kworker.0 00000100:00100000:3.0:1787398170.085967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398170.085994:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360896 00000100:00100000:3.0:1787398170.085998:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360896 00000100:00100000:3.0:1787398170.086011:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361152 00000100:00100000:3.0:1787398170.086013:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361152 00000100:00100000:3.0:1787398170.086022:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787398170.086026:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701360896:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787398170.086042:0:107265:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787398170.086078:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701360896:12345-0@lo:38:kworker.0 Request processed in 50us (180us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398170.086084:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787398170.086096:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787398170.086100:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701361152:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787398170.086107:0:107265:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787398170.086130:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1874218701361152:12345-0@lo:38:kworker.0 Request processed in 29us (196us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398170.086136:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787398170.086163:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398170.086167:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398170.086170:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701360896:0@lo:38:kworker.0 00000100:00080000:3.0:1787398170.086177:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398170.086180:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787398170.086191:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701361152:0@lo:38:kworker.0 00000100:00080000:1.0:1787398170.086305:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787398170.086372:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701360640:0@lo:400:kworker.0 00000100:00100000:0.0:1787398170.086417:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398170.086453:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701361536:0@lo:400:kworker.0 00000100:00100000:0.0:1787398170.086480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398170.086509:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787398170.086516:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701361408:0@lo:400:kworker.0 00000100:00100000:0.0:1787398170.086565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398170.086640:0:108821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361536 00000100:00100000:1.0:1787398170.086645:0:108821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361536 00000100:00100000:1.0:1787398170.086690:0:108821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361408 00000100:00100000:1.0:1787398170.086693:0:108821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361408 00000100:00100000:1.0:1787398170.086716:0:108821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787398170.086723:0:108821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701361536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398170.086769:0:108821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701361536:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398170.086775:0:108821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787398170.086814:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701361536:0@lo:400:kworker.0 00000100:00100000:1.0:1787398170.086836:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787398170.086843:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701361408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398170.086878:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701361408:12345-0@lo:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398170.086885:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787398170.086908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701361408:0@lo:400:kworker.0 00000100:00080000:0.0:1787398170.086972:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787398170.086975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787398170.087053:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361280 00000100:00100000:2.0:1787398170.087058:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361280 00000100:00100000:2.0:1787398170.087086:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787398170.087091:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701361280:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1787398170.087101:0:99650:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787398170.087152:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701361280:12345-0@lo:38:kworker.0 Request processed in 59us (1184us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787398170.087158:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787398170.087230:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787398170.087235:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787398170.087238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701361280:0@lo:38:kworker.0 00000100:00100000:3.0:1787398170.090682:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701360640 00000100:00100000:3.0:1787398170.090699:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701360640 00000100:00100000:3.0:1787398170.090774:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787398170.090785:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398170.091070:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701360640:12345-0@lo:400:kworker.0 Request processed in 285us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398170.091079:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787398170.091198:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701360640:0@lo:400:kworker.0 00010000:00010000:2.0:1787398170.468890:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398171.496144:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787398171.620937:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787398171.621027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398171.621146:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361792 00000100:00100000:3.0:1787398171.621155:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361792 00000100:00100000:3.0:1787398171.621219:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787398171.621229:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701361792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398171.621260:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398171.621314:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398171.621322:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787398171.621543:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398171.621773:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701361920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398171.621807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398171.621891:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701361920 00000100:00100000:0.0:1787398171.621897:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701361920 00000100:00100000:0.0:1787398171.621935:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787398171.621945:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701361920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787398171.621964:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787398171.622002:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701361920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398171.622009:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787398171.622040:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701361920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787398172.517072:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787398172.647029:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:0.0:1787398172.647040:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a828a5b800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:2.0:1787398172.647117:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a5b800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0001 00000020:00000080:2.0:1787398172.647174:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a5c000 for lustre-OST0001 00000001:00100000:1.0:1787398172.651171:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398172.651181:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a705572800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787398172.651216:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:1.0:1787398172.651234:0:99635:0:(genops.c:906:class_export_put()) final put ffff89a828a59800/784819ec-79bc-4534-8fa6-902d7a92d2f8 00000020:00000080:3.0:1787398172.651346:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a705572800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787398172.651411:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828a59800/784819ec-79bc-4534-8fa6-902d7a92d2f8 for lustre-OST0000 00000020:00000080:3.0:1787398172.651426:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a705573800 for lustre-OST0000 00000020:00000080:3.0:1787398172.651431:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a828a58000 for lustre-OST0000 00000001:00020000:2.0:1787398173.004673:0:108820:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:2.0:1787398173.030882:0:108820:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193e06 00000100:00080000:2.0:1787398173.030905:0:108820:0:(import.c:65:import_set_state_nolock()) ffff89a836493000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787398173.030970:0:108820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934596 00010000:00010000:3.0:1787398173.031040:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787398173.031281:0:108820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+2:3647:x1874218701357952:12345-0@lo:9:umount.0 Request processed in 8052581us (11871782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398173.031292:0:108820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787398173.031414:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a70a903000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787398173.031432:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787398173.031448:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787398173.031456:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701357952:0@lo:9:umount.0 00000100:00080000:1.0:1787398173.031951:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398173.031957:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 4 00000004:00080000:1.0:1787398173.031962:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398173.031964:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787398173.034086:0:107294:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787398173.034093:0:107294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x56:0x0] index 1 count 1 00000040:00080000:3.0:1787398173.034114:0:107294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 21 count 2 00000020:00000080:1.0:1787398173.036728:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193d7a 00000020:00000080:1.0:1787398173.036773:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835596000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787398173.037091:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835596000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787398173.038004:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193d8f 00000020:00000080:1.0:1787398173.038018:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835594800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398173.038325:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787398173.038571:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.038582:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787398173.038586:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff89a829b90000) has no exports 00000004:01000000:1.0:1787398173.038762:0:108816:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787398173.038772:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193df1 00000020:00000080:1.0:1787398173.038778:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a836494000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398173.041090:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787398173.041107:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.041118:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398173.041672:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff89a70247b380) has no exports 00000020:00000080:1.0:1787398173.041683:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193de3 00000020:00000080:1.0:1787398173.041692:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a70a904000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787398173.041998:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835594800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00010000:01000000:1.0:1787398173.042113:0:108816:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787398173.042119:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787398173.042124:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 5 00000004:00080000:1.0:1787398173.042129:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398173.042132:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787398173.042311:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836494000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787398173.042319:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70a904000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787398173.042809:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398173.042819:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398173.042826:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193dd5 00000020:00000080:1.0:1787398173.042833:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a7054c6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398173.042838:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787398173.042855:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.042859:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398173.042862:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff89a70247cd40) has no exports 00000020:00000080:1.0:1787398173.042867:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193dce 00000020:00000080:1.0:1787398173.042872:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a7054c2800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398173.043028:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70a903000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787398173.043035:0:8:0:(genops.c:906:class_export_put()) final put ffff89a7054c3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398173.043037:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787398173.043043:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787398173.043236:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787398173.043241:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787398173.043994:0:108816:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787398173.043999:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787398173.044002:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 5 00000004:00080000:1.0:1787398173.044008:0:108816:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787398173.044009:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398173.044051:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398173.044058:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787398173.044072:0:108816:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787398173.044078:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193dc0 00000020:00000080:1.0:1787398173.044084:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a7054c0800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787398173.044088:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:1.0:1787398173.044092:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.044095:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787398173.044098:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff89a829b93380) has no exports 00000020:00000080:1.0:1787398173.044103:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193db9 00000020:00000080:1.0:1787398173.044106:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835593000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787398173.044641:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a7054c6000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787398173.044649:0:8:0:(genops.c:906:class_export_put()) final put ffff89a7054c7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787398173.044652:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787398173.044657:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787398173.044714:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a7054c0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787398173.044719:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835593000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787398173.048060:0:108816:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787398173.048070:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398173.048075:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018900 gen 5 00000100:00100000:1.0:1787398173.048086:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787398173.048135:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787398173.048139:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836713800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787398173.048147:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398173.048152:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835592000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398173.048156:0:108816:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835592000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787398173.048163:0:108816:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398173.048508:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398173.049090:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398173.049094:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a828780800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398173.049097:0:108816:0:(genops.c:865:class_export_destroy()) destroying export ffff89a828780800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787398173.049103:0:108816:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398173.049170:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193d96 00000020:00000080:1.0:1787398173.049177:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835591800/lustre-MDD0001_UUID 00000020:01000000:1.0:1787398173.049194:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787398173.049198:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.049268:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787398173.049273:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff89a829b919c0) has no exports 00000020:00000080:1.0:1787398173.049295:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398173.049299:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787398173.049303:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193d9d 00000020:00000080:1.0:1787398173.049306:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835595800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787398173.049313:0:108816:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a827b3e000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787398173.049318:0:108816:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a827b3e000 2 00000020:01000004:1.0:1787398173.049320:0:108816:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89a827b3e000 from lustre-MDT0001 00000020:00000080:1.0:1787398173.049344:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787398173.049348:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787398173.049350:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a835596800/lustre-MDT0001_UUID 00000020:00000080:1.0:1787398173.049352:0:108816:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835596800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787398173.049360:0:108816:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:3.0:1787398173.049372:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835591800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787398173.049377:0:8:0:(genops.c:906:class_export_put()) final put ffff89a835590800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787398173.049378:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835590800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787398173.049382:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787398173.049442:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a835595800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:1.0:1787398173.049448:0:108816:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1787398173.049453:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787398173.049456:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787398173.049460:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787398173.049467:0:108816:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff89a838799800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787398173.049472:0:108816:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff89a702478000) has exports, disconnecting them 00000020:00080000:1.0:1787398173.049476:0:108816:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff89a838799800), last request at 1787398114 00000020:00000080:1.0:1787398173.049480:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193e30 00000020:00080000:1.0:1787398173.049487:0:108816:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89a838799800): rc 0 00000020:00000080:1.0:1787398173.049499:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a838799800/lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787398173.050361:0:108816:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787398173.050366:0:108816:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787398173.050370:0:108816:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787398173.050375:0:108816:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787398173.050469:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a838799800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787398173.054150:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a83879d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787398173.054170:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398173.054184:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1787398173.054190:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a70a907000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1787398173.054193:0:108816:0:(genops.c:865:class_export_destroy()) destroying export ffff89a70a907000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1787398173.054215:0:108816:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1787398173.054294:0:108816:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a827b3e000 1 00000020:00000080:0.0:1787398173.054300:0:108816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x274786fe0d193d11 00000020:00000080:0.0:1787398173.054307:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a836710000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1787398173.054321:0:108816:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1787398173.054325:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787398173.054329:0:108816:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787398173.054332:0:108816:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff89a82e4fcd40) has no exports 00000020:00000080:3.0:1787398173.054628:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836710000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787398173.090441:0:108816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787398173.090454:0:108816:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787398173.090459:0:108816:0:(genops.c:906:class_export_put()) final put ffff89a827b3f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787398173.090464:0:108816:0:(genops.c:865:class_export_destroy()) destroying export ffff89a827b3f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787398173.090476:0:108816:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787398173.090619:0:108816:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89a827b3d800 00000020:02000400:0.0:1787398173.090687:0:108816:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787398173.552497:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398174.469152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398174.469200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398174.469262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398174.469571:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377920 00000100:00100000:3.0:1787398174.469582:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377920 00000100:00100000:3.0:1787398174.469637:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378048 00000100:00100000:3.0:1787398174.469640:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378048 00000100:00100000:3.0:1787398174.469659:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787398174.469669:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681377920:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398174.469756:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681377920:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 88us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398174.469764:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 69 00000100:00100000:3.0:1787398174.469781:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:3.0:1787398174.469786:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681378048:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:3.0:1787398174.469806:0:107265:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787398174.469830:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681378048:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 43us (568us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787398174.469838:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 59 00000100:00100000:2.0:1787398174.470139:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681377792 00000100:00100000:2.0:1787398174.470144:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681377792 00000100:00100000:2.0:1787398174.470178:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00100000:2.0:1787398174.470186:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681377792:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398174.470222:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681377792:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 37us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398174.470304:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 107 00000100:00080000:1.0:1787398174.470760:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787398174.573940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787398174.694073:0:107260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1787398174.694089:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018901 is committed 00000020:00000080:2.0:1787398174.694094:0:107260:0:(genops.c:906:class_export_put()) final put ffff89a836496800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787398174.694148:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836496800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787398174.694211:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a70374b800 for lustre-MDT0000 00000100:00100000:2.0:1787398175.204733:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701362048:0@lo:400:kworker.0 00000100:00100000:2.0:1787398175.204813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398175.204907:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362048 00000100:00100000:0.0:1787398175.204918:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362048 00000100:00100000:0.0:1787398175.204986:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787398175.204997:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701362048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787398175.205823:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398175.205830:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398175.205833:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398175.205839:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4049 00000100:00080000:3.0:1787398175.205844:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787398175.205850:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398175.205872:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d0a80 x1874218701362304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398175.205914:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398175.205917:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398175.205919:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398175.205922:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4049 00000100:00080000:3.0:1787398175.205925:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787398175.205928:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398175.205938:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d0e00 x1874218701362560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787398175.205945:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787398175.205948:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787398175.205950:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787398175.205953:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4049 00000100:00080000:3.0:1787398175.205955:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787398175.205958:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:3.0:1787398175.205969:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a8067d0700 x1874218701362688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398175.206035:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701362176:0@lo:400:kworker.0 00000100:00100000:1.0:1787398175.206081:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398175.206114:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398175.206120:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701362432:0@lo:400:kworker.0 00000100:00100000:1.0:1787398175.206142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398175.206669:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701362304:0@lo:38:kworker.0 00000100:00100000:1.0:1787398175.206709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398175.206728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701362560:0@lo:38:kworker.0 00000100:00100000:1.0:1787398175.206750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398175.206766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701362688:0@lo:38:kworker.0 00000100:00100000:1.0:1787398175.206815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398175.206854:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362176 00000100:00100000:1.0:1787398175.206860:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362176 00000100:00100000:1.0:1787398175.206904:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362432 00000100:00100000:1.0:1787398175.206908:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362432 00000100:00100000:1.0:1787398175.206923:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362304 00000100:00100000:1.0:1787398175.206926:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362304 00000100:00100000:1.0:1787398175.206947:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362560 00000100:00100000:1.0:1787398175.206949:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362560 00000100:00100000:1.0:1787398175.206959:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787398175.206966:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701362176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398175.207012:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874218701362176:12345-0@lo:400:kworker.0 Request processed in 46us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398175.207020:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787398175.207037:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787398175.207043:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701362432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398175.207070:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701362432:12345-0@lo:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398175.207076:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787398175.207087:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787398175.207091:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701362304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398175.207110:0:107263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398175.207140:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701362304:12345-0@lo:38:kworker.0 Request processed in 47us (431us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398175.207146:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787398175.207156:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787398175.207160:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701362560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398175.207169:0:107263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398175.207197:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701362560:12345-0@lo:38:kworker.0 Request processed in 35us (447us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398175.207203:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787398175.207225:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362688 00000100:00100000:1.0:1787398175.207229:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362688 00000100:00100000:1.0:1787398175.207256:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787398175.207261:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701362688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398175.207272:0:99649:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398175.207312:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701362688:12345-0@lo:38:kworker.0 Request processed in 50us (496us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398175.207318:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787398175.207333:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398175.207375:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701362432:0@lo:400:kworker.0 00000100:00100000:1.0:1787398175.207387:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1874218701362176:0@lo:400:kworker.0 00000100:00080000:1.0:1787398175.207417:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398175.207422:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398175.207425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701362304:0@lo:38:kworker.0 00000100:00080000:1.0:1787398175.207433:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398175.207436:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398175.207438:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701362560:0@lo:38:kworker.0 00000100:00080000:1.0:1787398175.207445:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398175.207448:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398175.207450:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701362688:0@lo:38:kworker.0 00000100:00100000:0.0:1787398175.208347:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3649:x1874218701362048:12345-0@lo:400:kworker.0 Request processed in 3346us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398175.208359:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787398175.209001:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99b57a74-e5dc-42df-b087-b10fad741506:3649:1874218701362048:0@lo:400:kworker.0 00000100:00100000:2.0:1787398175.209034:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398175.209044:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701362816:0@lo:400:kworker.0 00000100:00100000:2.0:1787398175.209090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398175.209481:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787398175.209491:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701362944:0@lo:400:kworker.0 00000100:00100000:3.0:1787398175.209535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398175.209561:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701363072:0@lo:400:kworker.0 00000100:00100000:3.0:1787398175.209585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398175.209739:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363072 00000100:00100000:3.0:1787398175.209745:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363072 00000100:00100000:3.0:1787398175.209973:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787398175.209992:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701363072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398175.210010:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362816 00000100:00100000:0.0:1787398175.210016:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362816 00000100:00100000:3.0:1787398175.210043:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701363072:12345-0@lo:400:kworker.0 Request processed in 52us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398175.210051:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787398175.210061:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701362944 00000100:00100000:0.0:1787398175.210065:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701362944 00000100:00100000:0.0:1787398175.210114:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787398175.210131:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701362816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398175.210139:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701363072:0@lo:400:kworker.0 00000100:00100000:0.0:1787398175.210183:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701362816:12345-0@lo:400:kworker.0 Request processed in 54us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398175.210191:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787398175.210206:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787398175.210213:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701362944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398175.210452:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701362816:0@lo:400:kworker.0 00000100:00100000:0.0:1787398175.210970:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701362944:12345-0@lo:400:kworker.0 Request processed in 754us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398175.210979:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1787398175.211011:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787398175.211015:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787398175.211088:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701362944:0@lo:400:kworker.0 00010000:00010000:1.0:1787398175.591565:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398176.612638:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398176.744425:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701363200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787398176.744510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398176.744594:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363200 00000100:00100000:1.0:1787398176.744602:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363200 00000100:00100000:1.0:1787398176.744650:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787398176.744688:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701363200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787398176.744721:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787398176.744766:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701363200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398176.744774:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787398176.744927:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701363200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398176.747679:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701363328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398176.747754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398176.748962:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363328 00000100:00100000:1.0:1787398176.748977:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363328 00000100:00100000:1.0:1787398176.749037:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787398176.749049:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701363328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398176.749086:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398176.749160:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701363328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398176.749168:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787398176.749627:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701363328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787398177.638138:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398178.660662:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787398178.807950:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787398178.807960:0:100452:0:(genops.c:906:class_export_put()) final put ffff89a836496000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787398178.807986:0:65702:0:(genops.c:865:class_export_destroy()) destroying export ffff89a836496000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787398178.808028:0:65702:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89a836493000 for lustre-OST0001 00000100:00100000:1.0:1787398179.597982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398179.598019:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398179.598061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398179.598099:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378304 00000100:00100000:1.0:1787398179.598107:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378304 00000100:00100000:1.0:1787398179.598160:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378432 00000100:00100000:1.0:1787398179.598164:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378432 00000100:00100000:1.0:1787398179.598184:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:1.0:1787398179.598194:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681378304:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398179.598271:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2405:x1874218681378304:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398179.598279:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 73 00000100:00100000:1.0:1787398179.598306:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00100000:1.0:1787398179.598311:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681378432:12345-192.168.204.60@tcp:38:kworker.0 00010000:00020000:1.0:1787398179.598332:0:107264:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.204.60@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398179.598362:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874218681378432:12345-192.168.204.60@tcp:38:kworker.0 Request processed in 49us (300us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398179.598369:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 62 00000100:00080000:1.0:1787398179.598385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398179.598744:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378176 00000100:00100000:3.0:1787398179.598749:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378176 00000100:00100000:3.0:1787398179.598774:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 109 00000100:00100000:3.0:1787398179.598780:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681378176:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398179.598807:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681378176:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398179.598813:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 109 00010000:00010000:0.0:1787398179.686152:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787398180.326618:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398180.326625:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398180.326629:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398180.326638:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4054 00000100:00080000:2.0:1787398180.326645:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398180.326653:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398180.326678:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70aa92300 x1874218701363712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398180.326700:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398180.326704:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398180.326706:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398180.326709:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4054 00000100:00080000:2.0:1787398180.326712:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787398180.326715:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398180.326725:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015dc000 x1874218701363968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398180.326733:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787398180.326737:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787398180.326763:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787398180.326767:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4054 00000100:00080000:2.0:1787398180.326770:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787398180.326774:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398180.326789:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015df800 x1874218701364096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398180.326934:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364224:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.327010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398180.327056:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787398180.327062:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701363456:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.327107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398180.327114:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701363840:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.327144:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364352:0@lo:400:kworker.0 00000100:00100000:0.0:1787398180.327145:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398180.327165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398180.327166:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787398180.327170:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701363584:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.327189:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70aa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701363712:0@lo:38:kworker.0 00000100:00100000:0.0:1787398180.327191:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398180.327207:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701364480:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.327221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398180.327239:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701363968:0@lo:38:kworker.0 00000100:00100000:0.0:1787398180.327239:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363840 00000100:00100000:0.0:1787398180.327247:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363840 00000100:00100000:1.0:1787398180.327258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398180.327273:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701364096:0@lo:38:kworker.0 00000100:00100000:1.0:1787398180.327294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398180.327300:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363584 00000100:00100000:0.0:1787398180.327303:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363584 00000100:00100000:0.0:1787398180.327318:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363712 00000100:00100000:1.0:1787398180.327320:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363456 00000100:00100000:1.0:1787398180.327324:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363456 00000100:00100000:0.0:1787398180.327327:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363712 00000100:00100000:0.0:1787398180.327337:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701363968 00000100:00100000:0.0:1787398180.327339:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701363968 00000100:00100000:1.0:1787398180.327351:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787398180.327364:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787398180.327461:0:108821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364224 00000100:00100000:2.0:1787398180.327465:0:108821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364224 00000100:00100000:2.0:1787398180.327497:0:108821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364352 00000100:00100000:2.0:1787398180.327500:0:108821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364352 00000100:00100000:1.0:1787398180.328630:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701363456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.328721:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+19:3648:x1874218701363456:12345-0@lo:400:kworker.0 Request processed in 1362us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398180.328741:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787398180.331421:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7016fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701363840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398180.331550:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7016fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874218701363840:12345-0@lo:400:kworker.0 Request processed in 4178us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398180.331560:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787398180.331607:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787398180.331620:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701363584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398180.331650:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701363584:12345-0@lo:400:kworker.0 Request processed in 35us (4458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398180.331657:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787398180.331670:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787398180.331675:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701363712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787398180.331697:0:107263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787398180.331739:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701363712:12345-0@lo:38:kworker.0 Request processed in 62us (4516us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398180.331745:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787398180.331755:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787398180.331760:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701363968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787398180.331768:0:107263:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787398180.331791:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1874218701363968:12345-0@lo:38:kworker.0 Request processed in 30us (4531us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787398180.331797:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787398180.332784:0:108821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787398180.332805:0:108821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398180.332882:0:108821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364224:12345-0@lo:400:kworker.0 Request processed in 84us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398180.336884:0:108819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1787398180.336929:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787398180.336934:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787398180.336937:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787398180.336954:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364096 00000100:00100000:1.0:1787398180.336962:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364096 00000100:00100000:1.0:1787398180.337005:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787398180.337011:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701364096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787398180.337035:0:107321:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787398180.337125:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701364096:12345-0@lo:38:kworker.0 Request processed in 113us (9829us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787398180.337365:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787398180.337399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398180.337462:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1874218701363840:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.337486:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701363584:0@lo:400:kworker.0 00000100:00080000:1.0:1787398180.337537:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398180.337542:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398180.337546:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701363712:0@lo:38:kworker.0 00000100:00080000:1.0:1787398180.337555:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398180.337559:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398180.337562:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701363968:0@lo:38:kworker.0 00000100:00080000:1.0:1787398180.337570:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787398180.337572:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787398180.337601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701364096:0@lo:38:kworker.0 00000100:00100000:1.0:1787398180.337660:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70aa90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701363456:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.337673:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364224:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.337700:0:108819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398180.338534:0:107263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364480 00000100:00100000:0.0:1787398180.338551:0:107263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364480 00000100:00100000:0.0:1787398180.338606:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787398180.338615:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701364480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398180.338669:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701364480:12345-0@lo:400:kworker.0 Request processed in 55us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398180.338676:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787398180.338713:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701364480:0@lo:400:kworker.0 00000100:00100000:1.0:1787398180.338947:0:108819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364352:12345-0@lo:400:kworker.0 Request processed in 847us (10577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398180.338956:0:108819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787398180.338989:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364352:0@lo:400:kworker.0 00000100:00100000:2.0:1787398180.343605:0:108821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00010000:1.0:1787398180.715219:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398181.733136:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787398181.800027:0:109272:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787398181.800032:0:109272:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787398181.800033:0:109272:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787398181.800282:0:109272:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89a7025d6800 00000020:01000004:1.0:1787398181.800298:0:109272:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787398181.800313:0:109272:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787398181.800667:0:109272:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff89a702478000) 00000020:00000080:1.0:1787398181.800688:0:109272:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787398181.850099:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787398181.851550:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.855289:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.855493:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.855722:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.855892:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.856054:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.856417:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.856671:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.856840:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.857007:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.857213:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.857377:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.857555:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.857735:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.857898:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.858057:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.858236:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.858386:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.858627:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.858871:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.859092:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.859316:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.859550:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.859744:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787398181.859937:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787398181.860126:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00000100:00100000:0.0:1787398181.860856:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701364608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398181.860939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.861092:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364608 00000100:00100000:2.0:1787398181.861100:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364608 00000100:00100000:2.0:1787398181.861152:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787398181.861162:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701364608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398181.861201:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00100000:10000000:1.0:1787398181.861284:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00000100:00100000:3.0:1787398181.861626:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398181.861661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.861763:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364736 00000100:00100000:1.0:1787398181.861768:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364736 00000100:00100000:1.0:1787398181.861802:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787398181.861809:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787398181.861827:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1787398181.861862:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874218701364736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.861869:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787398181.861967:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701364736:0@lo:13:osp-pre-1-0.0 00100000:10000000:1.0:1787398181.862248:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787398181.862697:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787398181.862938:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787398181.863188:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787398181.863452:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787398181.863717:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787398181.864128:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787398181.864348:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787398181.864916:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00000100:00100000:2.0:1787398181.865159:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701364608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3993us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.865182:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00100000:10000000:1.0:1787398181.865306:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787398181.865499:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787398181.865720:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787398181.865908:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:3.0:1787398181.866266:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701364608:0@lo:13:osp-pre-0-0.0 00100000:10000000:1.0:1787398181.866340:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787398181.866595:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787398181.866782:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787398181.866968:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787398181.867157:0:109272:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1787398181.870865:0:109272:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787398181.871087:0:109272:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787398181.871097:0:109272:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787398181.871108:0:109272:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d194610 00000020:01000004:1.0:1787398181.871115:0:109272:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787398181.871142:0:109272:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787398181.871145:0:109272:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787398181.871150:0:109272:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787398181.871189:0:109272:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787398181.871193:0:109272:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.160@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787398181.874716:0:109272:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787398181.874760:0:109272:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.160@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787398181.874765:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787398181.874767:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787398181.874768:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398181.874770:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398181.874771:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398181.874773:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398181.874774:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398181.874775:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398181.874776:0:109272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398181.874780:0:109272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787398181.874782:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787398181.874783:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787398181.874785:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398181.874786:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398181.874787:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398181.874788:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398181.874789:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398181.874790:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398181.874791:0:109272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787398181.874817:0:109272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787398181.874839:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701364864:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787398181.874908:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.874953:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be180 going to sleep for 11 seconds 00000100:00100000:2.0:1787398181.875078:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364864 00000100:00100000:2.0:1787398181.875086:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364864 00000100:00100000:2.0:1787398181.875134:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787398181.875142:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:109272:x1874218701364864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787398181.875172:0:107281:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787398181.875190:0:107281:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787398181.875200:0:107281:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787398181.875639:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+19:109272:x1874218701364864:12345-0@lo:253:mount.lustre.0 Request processed in 496us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.875648:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787398181.875717:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701364864:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787398181.875727:0:109272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787398181.875729:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787398181.875731:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787398181.875732:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787398181.875733:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787398181.875734:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787398181.875736:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787398181.875737:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787398181.875738:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787398181.875739:0:109272:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787398181.875796:0:109272:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89a7025d6800 from lustre-MDT0001 10000000:01000000:1.0:1787398181.875823:0:109272:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787398181.875826:0:109272:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787398181.875835:0:109272:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89a828c1b380 local copy 00010000:00010000:1.0:1787398181.875845:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398181.875924:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701364992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398181.875954:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.876031:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a7025be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787398181.876066:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701364992 00000100:00100000:3.0:1787398181.876071:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701364992 00000100:00100000:3.0:1787398181.876142:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787398181.876151:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:109272:x1874218701364992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398181.876277:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:109272:x1874218701364992:12345-0@lo:501:mount.lustre.0 Request processed in 127us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787398181.876285:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787398181.876415:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701364992:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787398181.876428:0:109272:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787398181.876448:0:109272:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787398181.876455:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.876464:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a835e63000/0x274786fe0d193fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d193fdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398181.876490:0:109272:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89a7025d6800 10000000:01000000:2.0:1787398181.876495:0:109272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787398181.876501:0:109272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89a7025d6800 10000000:01000000:2.0:1787398181.876503:0:109272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787398181.876506:0:109272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89a7025d6800 from 1 10000000:01000000:2.0:1787398181.876510:0:109272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787398181.878681:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.878703:0:109272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.878716:0:109272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398181.878749:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398181.878852:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.879017:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398181.879131:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365120 00000100:00100000:3.0:1787398181.879139:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365120 00000100:00100000:3.0:1787398181.879267:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787398181.879277:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+19:109272:x1874218701365120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398181.879294:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398181.879308:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583a00/0x274786fe0d19461e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d194617 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879334:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583a00/0x274786fe0d19461e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d194617 expref: 20 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879346:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583a00/0x274786fe0d19461e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d194617 expref: 20 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879355:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583a00, rc 0) 00000100:00100000:3.0:1787398181.879406:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:109272:x1874218701365120:12345-0@lo:101:mount.lustre.0 Request processed in 130us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.879413:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787398181.879506:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398181.879542:0:109272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19461e expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.879551:0:109272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19461e expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398181.879579:0:109272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787398181.879594:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19461e expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.879603:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aae00/0x274786fe0d194617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19461e expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398181.879611:0:109272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787398181.879616:0:109272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787398181.879622:0:109272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89a7025d6800 10000000:01000000:2.0:1787398181.879625:0:109272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787398181.879629:0:109272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787398181.879632:0:109272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787398181.879651:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.879660:0:109272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.879667:0:109272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398181.879688:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398181.879715:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.879728:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787398181.879788:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365248 00000100:00100000:3.0:1787398181.879793:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365248 00000100:00100000:3.0:1787398181.879811:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787398181.879816:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+20:109272:x1874218701365248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398181.879823:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398181.879837:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583800/0x274786fe0d19462c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d194625 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879851:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583800/0x274786fe0d19462c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d194625 expref: 21 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879860:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583800/0x274786fe0d19462c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d194625 expref: 21 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398181.879866:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583800, rc 0) 00000100:00100000:3.0:1787398181.879899:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365248:12345-0@lo:101:mount.lustre.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.879905:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787398181.880017:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398181.880028:0:109272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19462c expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.880036:0:109272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d19462c expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787398181.881827:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7a:0x0] index 59 count 58 00000040:00080000:3.0:1787398181.882489:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787398181.886478:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].1, 224 off8416 00000040:00080000:3.0:1787398181.886756:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].2, 136 off8552 00000040:00080000:3.0:1787398181.886778:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].3, 176 off8728 00000040:00080000:3.0:1787398181.886792:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].4, 224 off8952 00000040:00080000:3.0:1787398181.886804:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].5, 224 off9176 00000040:00080000:3.0:1787398181.886816:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].6, 120 off9296 00000040:00080000:3.0:1787398181.886828:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].7, 112 off9408 00000040:00080000:3.0:1787398181.886841:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].8, 160 off9568 00000040:00080000:3.0:1787398181.886852:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].9, 224 off9792 00000040:00080000:3.0:1787398181.886865:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].10, 224 off10016 00000040:00080000:3.0:1787398181.886877:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].11, 88 off10104 00000040:00080000:3.0:1787398181.886891:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].12, 144 off10248 00000040:00080000:3.0:1787398181.886907:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].13, 152 off10400 00000040:00080000:3.0:1787398181.886921:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].14, 168 off10568 00000040:00080000:3.0:1787398181.886935:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].15, 224 off10792 00000040:00080000:3.0:1787398181.886949:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].16, 224 off11016 00000040:00080000:3.0:1787398181.886972:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].17, 80 off11096 00000040:00080000:3.0:1787398181.886983:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].18, 224 off11320 00000040:00080000:3.0:1787398181.886995:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].19, 224 off11544 00000040:00080000:3.0:1787398181.887006:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].20, 160 off11704 00000040:00080000:3.0:1787398181.887018:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].21, 224 off11928 00000040:00080000:3.0:1787398181.887030:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].22, 224 off12152 00000040:00080000:3.0:1787398181.887043:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].23, 80 off12232 00000040:00080000:3.0:1787398181.887058:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].24, 224 off12456 00000040:00080000:3.0:1787398181.887074:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].25, 224 off12680 00000040:00080000:3.0:1787398181.887088:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].26, 88 off12768 00000040:00080000:3.0:1787398181.887099:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].27, 144 off12912 00000040:00080000:3.0:1787398181.887111:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].28, 152 off13064 00000040:00080000:3.0:1787398181.887124:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].29, 136 off13200 00000040:00080000:3.0:1787398181.887136:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].30, 224 off13424 00000040:00080000:3.0:1787398181.887149:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].31, 224 off13648 00000040:00080000:3.0:1787398181.887161:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].32, 80 off13728 00000040:00080000:3.0:1787398181.887236:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].33, 224 off13952 00000040:00080000:3.0:1787398181.887257:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].34, 224 off14176 00000040:00080000:3.0:1787398181.887269:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].35, 88 off14264 00000040:00080000:3.0:1787398181.887280:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].36, 144 off14408 00000040:00080000:3.0:1787398181.887293:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].37, 152 off14560 00000040:00080000:3.0:1787398181.887305:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].38, 136 off14696 00000040:00080000:3.0:1787398181.887316:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].39, 224 off14920 00000040:00080000:3.0:1787398181.887328:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].40, 224 off15144 00000040:00080000:3.0:1787398181.887341:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].41, 80 off15224 00000040:00080000:3.0:1787398181.887352:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].42, 224 off15448 00000040:00080000:3.0:1787398181.887363:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].43, 224 off15672 00000040:00080000:3.0:1787398181.887375:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].44, 120 off15792 00000040:00080000:3.0:1787398181.887388:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].45, 224 off16016 00000040:00080000:3.0:1787398181.887402:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].46, 224 off16240 00000040:00080000:3.0:1787398181.887418:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].47, 120 off16360 00000040:00080000:3.0:1787398181.887430:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].48, 24 off16384 00000040:00080000:3.0:1787398181.887654:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].49, 224 off16608 00000040:00080000:3.0:1787398181.887681:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].50, 224 off16832 00000040:00080000:3.0:1787398181.887695:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].51, 144 off16976 00000040:00080000:3.0:1787398181.887708:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].52, 224 off17200 00000040:00080000:3.0:1787398181.887720:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].53, 224 off17424 00000040:00080000:3.0:1787398181.887734:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].54, 144 off17568 00000040:00080000:3.0:1787398181.887746:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].55, 224 off17792 00000040:00080000:3.0:1787398181.887759:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].56, 224 off18016 00000040:00080000:3.0:1787398181.887770:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].57, 120 off18136 00000040:00080000:3.0:1787398181.887784:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7f:0x0].58, 224 off18360 00000040:00080000:3.0:1787398181.887789:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7a:0x0] index 58 count 58 00000100:00100000:3.0:1787398181.887892:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398181.887956:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.888050:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787398181.888089:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365376 00000100:00100000:0.0:1787398181.888095:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365376 00000100:00100000:0.0:1787398181.888166:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787398181.888183:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398181.888301:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365376:12345-0@lo:501:mount.lustre.0 Request processed in 127us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398181.888309:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787398181.888371:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787398181.888402:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787398181.888436:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.888611:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701b2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398181.888698:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365504 00000100:00100000:1.0:1787398181.888702:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365504 00000100:00100000:1.0:1787398181.888724:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787398181.888731:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787398181.888842:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365504:12345-0@lo:503:mount.lustre.0 Request processed in 111us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.888849:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787398181.888968:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787398181.889401:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787398181.889470:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398181.889516:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.889703:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701b2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398181.889766:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365632 00000100:00100000:1.0:1787398181.889772:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365632 00000100:00100000:1.0:1787398181.889837:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787398181.889844:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398181.889931:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365632:12345-0@lo:502:mount.lustre.0 Request processed in 86us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.889937:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787398181.889996:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787398181.890146:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].1, 224 off8416 00000040:00080000:3.0:1787398181.890170:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].2, 136 off8552 00000040:00080000:3.0:1787398181.890199:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].3, 176 off8728 00000040:00080000:3.0:1787398181.890214:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].4, 224 off8952 00000040:00080000:3.0:1787398181.890240:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].5, 224 off9176 00000040:00080000:3.0:1787398181.890252:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].6, 120 off9296 00000040:00080000:3.0:1787398181.890263:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].7, 112 off9408 00000040:00080000:3.0:1787398181.890276:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].8, 160 off9568 00000040:00080000:3.0:1787398181.890287:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].9, 224 off9792 00000040:00080000:3.0:1787398181.890299:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].10, 224 off10016 00000040:00080000:3.0:1787398181.890312:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].11, 88 off10104 00000040:00080000:3.0:1787398181.890324:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].12, 144 off10248 00000040:00080000:3.0:1787398181.890337:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].13, 152 off10400 00000040:00080000:3.0:1787398181.890351:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].14, 168 off10568 00000040:00080000:3.0:1787398181.890364:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].15, 224 off10792 00000040:00080000:3.0:1787398181.890377:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].16, 224 off11016 00000040:00080000:3.0:1787398181.890389:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].17, 80 off11096 00000040:00080000:3.0:1787398181.890402:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].18, 224 off11320 00000040:00080000:3.0:1787398181.890415:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].19, 224 off11544 00000040:00080000:3.0:1787398181.890427:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].20, 160 off11704 00000040:00080000:3.0:1787398181.890439:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].21, 224 off11928 00000040:00080000:3.0:1787398181.890452:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].22, 224 off12152 00000040:00080000:3.0:1787398181.890465:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].23, 80 off12232 00000040:00080000:3.0:1787398181.890478:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].24, 224 off12456 00000040:00080000:3.0:1787398181.890492:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].25, 224 off12680 00000040:00080000:3.0:1787398181.890505:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].26, 88 off12768 00000040:00080000:3.0:1787398181.890517:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].27, 144 off12912 00000040:00080000:3.0:1787398181.890580:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].28, 152 off13064 00000040:00080000:3.0:1787398181.890595:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].29, 136 off13200 00000040:00080000:3.0:1787398181.890608:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].30, 224 off13424 00000040:00080000:3.0:1787398181.890622:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].31, 224 off13648 00000040:00080000:3.0:1787398181.890635:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].32, 80 off13728 00000040:00080000:3.0:1787398181.890648:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].33, 224 off13952 00000040:00080000:3.0:1787398181.890662:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].34, 224 off14176 00000040:00080000:3.0:1787398181.890675:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].35, 88 off14264 00000040:00080000:3.0:1787398181.890687:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].36, 144 off14408 00000040:00080000:3.0:1787398181.890698:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].37, 152 off14560 00000040:00080000:3.0:1787398181.890725:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].38, 136 off14696 00000040:00080000:3.0:1787398181.890739:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].39, 224 off14920 00000040:00080000:3.0:1787398181.890750:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].40, 224 off15144 00000040:00080000:3.0:1787398181.890761:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].41, 80 off15224 00000040:00080000:3.0:1787398181.890772:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].42, 224 off15448 00000040:00080000:3.0:1787398181.890783:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].43, 224 off15672 00000040:00080000:3.0:1787398181.890794:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].44, 120 off15792 00000040:00080000:3.0:1787398181.890806:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].45, 224 off16016 00000040:00080000:3.0:1787398181.890819:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].46, 224 off16240 00000040:00080000:3.0:1787398181.890831:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].47, 120 off16360 00000040:00080000:3.0:1787398181.890842:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].48, 24 off16384 00000100:00100000:3.0:1787398181.890878:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398181.890925:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.891186:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787398181.891304:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365760 00000100:00100000:0.0:1787398181.891311:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365760 00000100:00100000:0.0:1787398181.891344:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787398181.891352:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398181.891453:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365760:12345-0@lo:502:mount.lustre.0 Request processed in 101us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398181.891461:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787398181.891608:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787398181.891749:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].49, 224 off16608 00000040:00080000:3.0:1787398181.891772:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].50, 224 off16832 00000040:00080000:3.0:1787398181.891788:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].51, 144 off16976 00000040:00080000:3.0:1787398181.891800:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].52, 224 off17200 00000040:00080000:3.0:1787398181.891811:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].53, 224 off17424 00000040:00080000:3.0:1787398181.891824:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].54, 144 off17568 00000040:00080000:3.0:1787398181.891838:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].55, 224 off17792 00000040:00080000:3.0:1787398181.891851:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].56, 224 off18016 00000040:00080000:3.0:1787398181.891863:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].57, 120 off18136 00000100:00100000:3.0:1787398181.891884:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398181.891918:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.891935:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a701b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787398181.891987:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701365888 00000100:00100000:0.0:1787398181.891997:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701365888 00000100:00100000:0.0:1787398181.892016:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787398181.892021:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398181.892096:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701365888:12345-0@lo:502:mount.lustre.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398181.892102:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787398181.892168:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8067d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701365888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787398181.892213:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x80:0x0].58, 224 off18360 00000040:00080000:3.0:1787398181.892227:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:0.0:1787398181.892973:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398181.892984:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.892986:0:109276:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787398181.892991:0:109276:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787398181.892994:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398181.893008:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff89a706920000) 00000020:00000080:0.0:1787398181.893037:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1787398181.893044:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787398181.893122:0:109276:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787398181.893130:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d19463a 00000020:00000080:0.0:1787398181.893371:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787398181.893376:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398181.893379:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.893381:0:109276:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787398181.893384:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398181.893387:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.893388:0:109276:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787398181.893392:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398181.893399:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff89a706924d40) 00000020:00000080:0.0:1787398181.893411:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1787398181.893415:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787398181.893417:0:109276:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787398181.893421:0:109276:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787398181.893426:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787398181.893473:0:109276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a7025d6800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787398181.893483:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff89a706923380) 00000020:00000080:0.0:1787398181.893503:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:0.0:1787398181.893599:0:109276:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787398181.893604:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d19464f 00000020:00000080:0.0:1787398181.893693:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787398181.893699:0:109276:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787398181.893703:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x274786fe0d194656 00080000:01000000:0.0:1787398181.893707:0:109276:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787398181.893711:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d19465d 00010000:00010000:1.0:1787398181.953818:0:109276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:1.0:1787398181.954303:0:109276:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 90194313216 lx: 0 gen 28 00000001:00080000:1.0:1787398181.954348:0:109276:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 784819ec-79bc-4534-8fa6-902d7a92d2f8 idx: 2 lr: 85899345937 srv lr: 90194313216 lx: 0 gen 25 00000001:00000004:1.0:1787398181.954382:0:109276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 22, last_transno is 90194313216 00000001:00080000:1.0:1787398181.954752:0:109276:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1787398181.954810:0:109276:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a704d4fa80: xid 1874218681372800, transno 90194313226, client gen 25, slot idx 0 00000001:00080000:1.0:1787398181.954821:0:109276:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff89a80537a9c0: xid 1874218681372544, transno 90194313225, client gen 25, slot idx 1 00000020:00000080:1.0:1787398181.957729:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787398181.957744:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398181.957752:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398181.957754:0:109276:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787398181.957758:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787398181.957764:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398181.957766:0:109276:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787398181.957770:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398181.957775:0:109276:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:00000080:1.0:1787398181.957807:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398181.957823:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff89a70247cd40) 00000020:00000080:1.0:1787398181.957848:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787398181.957854:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398181.957931:0:109276:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787398181.957937:0:109276:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787398181.957942:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d194679 00010000:00080000:1.0:1787398181.957978:0:109276:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a806937800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:3.0:1787398181.964961:0:109276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:0.0:1787398181.966147:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787398181.966162:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787398181.966264:0:109276:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787398181.966285:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d194680 00000100:00080000:0.0:1787398181.966296:0:109276:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787398181.966302:0:109276:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89a806937800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398181.966339:0:109276:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a835d84000 x1874218701366016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398181.966399:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701366016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787398181.966474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.966593:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366016 00000100:00100000:3.0:1787398181.966604:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366016 00000100:00100000:3.0:1787398181.966642:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787398181.966650:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701366016:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787398181.966676:0:99650:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:3.0:1787398181.966710:0:99650:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d194687 00000004:00100000:3.0:1787398181.966724:0:99650:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787398181.966826:0:99650:0:(import.c:65:import_set_state_nolock()) ffff89a836491800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787398181.966911:0:109276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787398181.966967:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398181.966973:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398181.966975:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398181.966980:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4059 00000100:00080000:0.0:1787398181.966983:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787398181.966987:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398181.967001:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a81816e680 x1874218701366272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787398181.967109:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701366272:0@lo:38:kworker.0 00000100:00100000:2.0:1787398181.967144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.967306:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701366016:12345-0@lo:38:llog_process_th.0 Request processed in 654us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.967315:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787398181.967341:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701366144:0@lo:400:kworker.0 00000100:00100000:3.0:1787398181.967367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.967422:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787398181.967431:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 30 00000100:00080000:2.0:1787398181.967438:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787398181.967444:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787398181.967446:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806937800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787398181.967452:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701366016:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787398181.968077:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398181.968082:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398181.968084:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398181.968098:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4059 00000100:00080000:0.0:1787398181.968102:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787398181.968106:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398181.968121:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a81816d500 x1874218701366528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398181.968131:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398181.968134:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398181.968136:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398181.968139:0:65702:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4059 00000100:00080000:0.0:1787398181.968141:0:65702:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787398181.968144:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398181.968154:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a83876e300 x1874218701366656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787398181.968262:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701366400:0@lo:400:kworker.0 00000100:00100000:3.0:1787398181.968297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787398181.968420:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398181.968425:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968428:0:109276:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787398181.968431:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398181.968434:0:109276:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787398181.968435:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398181.968437:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398181.968438:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398181.968440:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968442:0:109276:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398181.968444:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398181.968448:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968449:0:109276:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787398181.968453:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787398181.968495:0:109276:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787398181.968508:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398181.968532:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968534:0:109276:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787398181.968538:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787398181.968540:0:109276:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787398181.968541:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398181.968543:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787398181.968544:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787398181.968547:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968548:0:109276:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787398181.968551:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787398181.968554:0:109276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787398181.968567:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.968569:0:109276:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787398181.968572:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787398181.968576:0:109276:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:0.0:1787398181.968594:0:109276:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787398181.968597:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787398181.968611:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89a82e4fcd40) 00000020:00000080:0.0:1787398181.968629:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787398181.968635:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787398181.968698:0:109276:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787398181.968704:0:109276:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787398181.968710:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d194695 00010000:00080000:0.0:1787398181.968738:0:109276:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a827b3b800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:0.0:1787398181.968941:0:109276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000040:01000000:0.0:1787398181.969684:0:109276:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787398181.969995:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366272 00000100:00100000:1.0:1787398181.970006:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366272 00000100:00100000:1.0:1787398181.970040:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366144 00000100:00100000:1.0:1787398181.970043:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366144 00000100:00100000:1.0:1787398181.970075:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787398181.970084:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701366144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398181.970147:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701366144:12345-0@lo:400:kworker.0 Request processed in 64us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.970163:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787398181.970192:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787398181.970197:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701366272:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787398181.970233:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701366272:12345-0@lo:38:kworker.0 Request processed in 36us (3089us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787398181.970239:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:01000000:1.0:1787398181.970380:0:109276:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787398181.971605:0:109276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787398181.971819:0:109276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].22, 64 off9600 00000040:00080000:0.0:1787398181.971961:0:109276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].1, 64 off8256 00000040:00080000:0.0:1787398181.972275:0:109281:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 22 synced_idx: 22 lgh_last_idx: 22 00000040:00080000:0.0:1787398181.972280:0:109281:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787398181.972624:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701366784:0@lo:400:kworker.0 00000100:00100000:3.0:1787398181.972683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.972796:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701366912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398181.972833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.972876:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366912 00000100:00100000:1.0:1787398181.972884:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366912 00000100:00100000:1.0:1787398181.972927:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787398181.972935:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701366912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787398181.972970:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1787398181.973015:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701366912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.973022:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787398181.973069:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701366912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787398181.973106:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701366144:0@lo:400:kworker.0 00000100:00100000:1.0:1787398181.973127:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701366528:0@lo:38:kworker.0 00000020:00000080:1.0:1787398181.973468:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787398181.973483:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787398181.973541:0:109276:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787398181.973579:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d19469c 00000100:00080000:1.0:1787398181.973586:0:109276:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787398181.973597:0:109276:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89a827b3b800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:1.0:1787398181.973627:0:109276:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a827a8df80 x1874218701367040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787398181.973647:0:109276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787398181.973698:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787398181.973702:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398181.973704:0:109276:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787398181.973707:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787398181.973710:0:109276:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787398181.973712:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398181.973713:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787398181.973715:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787398181.973717:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398181.973719:0:109276:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787398181.973721:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787398181.973725:0:109276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787398181.973728:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787398181.973730:0:109276:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787398181.973733:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787398181.973736:0:109276:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.160@tcp to nid 0x20000c0a8cca0 (192.168.204.160@tcp) 00000020:01000000:1.0:1787398181.973758:0:109276:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787398181.973761:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787398181.973772:0:109276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89a70247b380) 00000020:00000080:1.0:1787398181.973788:0:109276:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787398181.973793:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787398181.973848:0:109276:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787398181.973854:0:109276:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787398181.973859:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x274786fe0d1946aa 00010000:00080000:1.0:1787398181.973889:0:109276:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a7054c7800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:1.0:1787398181.974074:0:109276:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787398181.974138:0:109276:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398181.974160:0:109276:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787398181.975985:0:109276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787398181.976302:0:109276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].22, 64 off9600 00000040:00080000:1.0:1787398181.976463:0:109276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5a:0x0].1, 64 off8256 00000100:00100000:3.0:1787398181.976706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.976784:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366400 00000100:00100000:2.0:1787398181.976795:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366400 00000100:00100000:2.0:1787398181.976845:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366784 00000100:00100000:2.0:1787398181.976849:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366784 00000100:00100000:2.0:1787398181.976872:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787398181.976888:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701366400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398181.976975:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701366400:12345-0@lo:400:kworker.0 Request processed in 89us (8676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.976983:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787398181.977001:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787398181.977007:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701366784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398181.977041:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874218701366784:12345-0@lo:400:kworker.0 Request processed in 34us (4357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.977046:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787398181.977342:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701366656:0@lo:38:kworker.0 00000100:00100000:3.0:1787398181.977383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787398181.977431:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398181.977436:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787398181.977440:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701366272:0@lo:38:kworker.0 00000100:00100000:3.0:1787398181.977462:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701367040:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787398181.977503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398181.977596:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874218701366784:0@lo:400:kworker.0 00000100:00100000:3.0:1787398181.977617:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367040 00000100:00100000:3.0:1787398181.977621:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367040 00000100:00100000:3.0:1787398181.977644:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787398181.977649:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3647:x1874218701367040:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1787398181.977675:0:101069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:3.0:1787398181.977703:0:101069:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1946b1 00002000:00100000:3.0:1787398181.977717:0:101069:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89a836496000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787398181.977722:0:101069:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787398181.977725:0:101069:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787398181.977789:0:101069:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787398181.977813:0:101069:0:(import.c:65:import_set_state_nolock()) ffff89a838799800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787398181.977851:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701367040:12345-0@lo:8:llog_process_th.0 Request processed in 200us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.977858:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787398181.977895:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787398181.977903:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:3.0:1787398181.977911:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787398181.977917:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787398181.977919:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a827b3b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787398181.977932:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787398181.977936:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701367040:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787398181.977965:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701366400:0@lo:400:kworker.0 00000100:00100000:2.0:1787398181.978267:0:108265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366528 00000100:00100000:2.0:1787398181.978272:0:108265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366528 00000100:00100000:2.0:1787398181.978292:0:108265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787398181.978297:0:108265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701366528:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787398181.978350:0:108265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874218701366528:12345-0@lo:38:kworker.0 Request processed in 51us (1645us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787398181.978357:0:108265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787398181.978467:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398181.978479:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787398181.978483:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701366528:0@lo:38:kworker.0 00000100:00100000:0.0:1787398181.978567:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701366656 00000100:00100000:0.0:1787398181.978580:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701366656 00000100:00100000:0.0:1787398181.978608:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787398181.978613:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8067d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701366656:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787398181.978653:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8067d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701366656:12345-0@lo:38:kworker.0 Request processed in 38us (1268us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787398181.978659:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:0.0:1787398181.978680:0:109281:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787398181.978738:0:109281:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 4061269214701ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787398181.978744:0:109281:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1787398181.979992:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787398181.980001:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787398181.980006:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701366656:0@lo:38:kworker.0 00000100:00100000:0.0:1787398181.980166:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701367168:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787398181.981048:0:109273:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787398181.981362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.981439:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367168 00000100:00100000:2.0:1787398181.981446:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367168 00000100:00100000:2.0:1787398181.981571:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787398181.981582:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701367168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398181.981609:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398181.981656:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a01ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701367168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.981662:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787398181.981740:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701367168:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787398181.981971:0:109283:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 22 synced_idx: 22 lgh_last_idx: 22 00000040:00080000:2.0:1787398181.981976:0:109283:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787398181.982706:0:109276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787398181.982722:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787398181.982767:0:109276:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787398181.982790:0:109276:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1946b8 00000100:00080000:2.0:1787398181.982798:0:109276:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787398181.982804:0:109276:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89a7054c7800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398181.982839:0:109276:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015df800 x1874218701367296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787398181.982864:0:109276:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787398181.982907:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.982911:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982913:0:109276:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787398181.982916:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398181.982919:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982921:0:109276:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787398181.982924:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787398181.982925:0:109276:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787398181.982927:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.982930:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982931:0:109276:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787398181.982933:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398181.982936:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982937:0:109276:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787398181.982940:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787398181.982946:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.982948:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982950:0:109276:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1787398181.982952:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787398181.982955:0:109276:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #42 00000020:01000000:2.0:1787398181.982956:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398181.982958:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398181.982974:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787398181.982984:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982985:0:109276:0:(obd_config.c:1561:class_process_config()) marker 42 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:2.0:1787398181.982989:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787398181.982991:0:109276:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #45 00000020:01000000:2.0:1787398181.982992:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398181.982993:0:109276:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787398181.982995:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787398181.982997:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.982998:0:109276:0:(obd_config.c:1561:class_process_config()) marker 45 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1787398181.983000:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398181.983003:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.983005:0:109276:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1787398181.983008:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:2.0:1787398181.983014:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.983016:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.983018:0:109276:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1787398181.983020:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787398181.983023:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.983024:0:109276:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:2.0:1787398181.983027:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000020:01000000:2.0:1787398181.983037:0:109276:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.983039:0:109276:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.983041:0:109276:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1787398181.983044:0:109276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x80:0x0] index 59 count 58 00000100:00100000:0.0:1787398181.983321:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701367296:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787398181.983386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398181.983474:0:99641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367296 00000100:00100000:1.0:1787398181.983481:0:99641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367296 00000100:00100000:1.0:1787398181.983519:0:99641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787398181.983569:0:99641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1874218701367296:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1787398181.983603:0:99641:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:1.0:1787398181.983632:0:99641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x274786fe0d1946bf 00002000:00100000:1.0:1787398181.983648:0:99641:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89a7054c0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787398181.983653:0:99641:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787398181.983656:0:99641:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787398181.983734:0:99641:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787398181.983756:0:99641:0:(import.c:65:import_set_state_nolock()) ffff89a7054c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398181.983806:0:99641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a01bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1874218701367296:12345-0@lo:8:llog_process_th.0 Request processed in 237us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.983816:0:99641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787398181.983855:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787398181.983865:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787398181.983875:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787398181.983881:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787398181.983883:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a7054c7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787398181.983897:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787398181.983903:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1874218701367296:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1787398181.983953:0:109283:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787398181.984008:0:109283:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 4061274484961ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787398181.984014:0:109283:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787398181.984680:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701367424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398181.984725:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787398181.984769:0:109272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 10000000:01000000:2.0:1787398181.984806:0:109272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787398181.984971:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19462c expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.984983:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050ab800/0x274786fe0d194625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d19462c expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398181.984997:0:109272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a7025d6800 from 1 10000000:01000000:2.0:1787398181.985000:0:109272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787398181.985028:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.985036:0:109272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.985045:0:109272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398181.985060:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398181.985089:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.985121:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398181.985138:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367424 00000100:00100000:2.0:1787398181.985142:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367424 00000100:00100000:1.0:1787398181.985193:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367552 00000100:00100000:1.0:1787398181.985197:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367552 00000100:00100000:1.0:1787398181.985229:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787398181.985236:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+21:109272:x1874218701367552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787398181.985248:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398181.985261:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1946c6 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398181.985284:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398181.985295:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 22 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398181.985304:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345fe400, rc 0) 00000100:00100000:1.0:1787398181.985336:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:109272:x1874218701367552:12345-0@lo:101:mount.lustre.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.985344:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787398181.985533:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398181.985539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787398181.986085:0:109273:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787398181.986383:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787398181.986393:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701367424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787398181.986414:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398181.986478:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1874218701367424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.986485:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787398181.986580:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1874218701367424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787398181.986987:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398181.987008:0:109272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.987018:0:109272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398181.987754:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367680:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787398181.987804:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.987880:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787398181.987971:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367680 00000100:00100000:1.0:1787398181.987977:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367680 00000100:00100000:1.0:1787398181.988046:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787398181.988054:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:109272:x1874218701367680:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787398181.988071:0:107281:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787398181.988089:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787398181.988093:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787398181.988096:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787398181.988099:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787398181.988101:0:107281:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 137 00000100:00100000:1.0:1787398181.988188:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+22:109272:x1874218701367680:12345-0@lo:256:mount.lustre.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398181.988196:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787398181.988251:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367680:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787398181.988867:0:109272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787398181.988981:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.988992:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787398181.989001:0:109272:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89a7025d6800 from 1 10000000:01000000:2.0:1787398181.989003:0:109272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787398181.989030:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.989037:0:109272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.989046:0:109272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787398181.989061:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787398181.989093:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.989354:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787398181.989418:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367808 00000100:00100000:0.0:1787398181.989424:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367808 00000100:00100000:0.0:1787398181.989453:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787398181.989459:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+22:109272:x1874218701367808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398181.989469:0:107283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398181.989481:0:107283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a75000/0x274786fe0d1946db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1946d4 expref: -99 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398181.989501:0:107283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a75000/0x274786fe0d1946db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1946d4 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398181.989512:0:107283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a75000/0x274786fe0d1946db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1946d4 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398181.989551:0:107283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a75000, rc 0) 00000100:00100000:0.0:1787398181.989594:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701367808:12345-0@lo:101:mount.lustre.0 Request processed in 134us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398181.989601:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787398181.989715:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787398181.989734:0:109272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946db expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398181.989743:0:109272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1946db expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787398181.990699:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7c:0x0] index 7 count 7 00000040:00080000:2.0:1787398181.991008:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398181.991275:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].1, 224 off8416 00000040:00080000:2.0:1787398181.991302:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].2, 112 off8528 00000040:00080000:2.0:1787398181.991317:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].3, 224 off8752 00000040:00080000:2.0:1787398181.991331:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].4, 224 off8976 00000040:00080000:2.0:1787398181.991345:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].5, 112 off9088 00000040:00080000:2.0:1787398181.991363:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x81:0x0].6, 224 off9312 00000040:00080000:2.0:1787398181.991368:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7c:0x0] index 6 count 7 00000100:00100000:2.0:1787398181.991432:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398181.991482:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.991551:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787398181.991624:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701367936 00000100:00100000:1.0:1787398181.991630:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701367936 00000100:00100000:2.0:1787398181.991728:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787398181.991736:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701367936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398181.991846:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701367936:12345-0@lo:501:mount.lustre.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.991853:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787398181.991896:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701367936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398181.991924:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398181.991964:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.991980:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1787398181.991998:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368064 00000100:00100000:2.0:1787398181.992001:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368064 00000100:00100000:2.0:1787398181.992018:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787398181.992023:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787398181.992093:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368064:12345-0@lo:503:mount.lustre.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398181.992099:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787398181.992136:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787398181.992681:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787398181.992747:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398181.992784:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.992810:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787398181.992811:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368192 00000100:00100000:3.0:1787398181.992816:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368192 00000100:00100000:3.0:1787398181.992850:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787398181.992857:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7059be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398181.992953:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7059be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368192:12345-0@lo:502:mount.lustre.0 Request processed in 96us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.992964:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787398181.993272:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398181.993443:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].1, 224 off8416 00000040:00080000:2.0:1787398181.993469:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].2, 112 off8528 00000040:00080000:2.0:1787398181.993483:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].3, 224 off8752 00000040:00080000:2.0:1787398181.993497:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].4, 224 off8976 00000040:00080000:2.0:1787398181.993511:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].5, 112 off9088 00000100:00100000:2.0:1787398181.993800:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787398181.993841:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398181.993882:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787398181.993942:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368320 00000100:00100000:3.0:1787398181.993947:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368320 00000100:00100000:3.0:1787398181.994028:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787398181.994036:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787398181.994124:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368320:12345-0@lo:502:mount.lustre.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398181.994131:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787398181.994204:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398181.994248:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x82:0x0].6, 224 off9312 00000040:00080000:2.0:1787398181.994256:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1787398181.996690:0:109285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398181.996706:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.996708:0:109285:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787398181.996716:0:109285:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a7025d6800 00000020:00000080:0.0:1787398181.996719:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787398181.996726:0:109285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787398181.996728:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.996730:0:109285:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787398181.996732:0:109285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787398181.996734:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787398181.996735:0:109285:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787398181.996738:0:109285:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89a7025d6800 00000020:00000080:0.0:1787398181.996740:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787398181.998624:0:109285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787398181.998635:0:109285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787398181.998643:0:109285:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787398181.998649:0:109285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x82:0x0] index 7 count 7 00000020:01000000:0.0:1787398181.999842:0:109272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1787398181.999884:0:109272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787398181.999904:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946db expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398181.999931:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a7050aaa00/0x274786fe0d1946d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946db expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787398182.000029:0:109272:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787398182.000032:0:109272:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89a7025d6800 10000000:01000000:0.0:1787398182.000035:0:109272:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89a7025d6800 10000000:01000000:0.0:1787398182.000039:0:109272:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787398182.000052:0:109272:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89a7025d6800 from 1 10000000:01000000:0.0:1787398182.000055:0:109272:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787398182.000092:0:109272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398182.000101:0:109272:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398182.000112:0:109272:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398182.000136:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787398182.000580:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.000756:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787398182.006589:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368448 00000100:00100000:3.0:1787398182.007369:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368448 00000100:00100000:3.0:1787398182.007449:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787398182.007460:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82e4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:109272:x1874218701368448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787398182.007481:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787398182.007507:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a836583400/0x274786fe0d1946e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d1946e2 expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.007836:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583400/0x274786fe0d1946e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d1946e2 expref: 24 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.007850:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a836583400/0x274786fe0d1946e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1946e2 expref: 24 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.007859:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a836583400, rc 0) 00000100:00100000:3.0:1787398182.007955:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82e4f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368448:12345-0@lo:101:mount.lustre.0 Request processed in 496us (7375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398182.007962:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787398182.008065:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787398182.008084:0:109272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946e9 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398182.008094:0:109272:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d1946e9 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787398182.016270:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7e:0x0] index 64 count 63 00000040:00080000:2.0:1787398182.017408:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787398182.018420:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].1, 224 off8416 00000040:00080000:2.0:1787398182.018459:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].2, 120 off8536 00000040:00080000:2.0:1787398182.018476:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].3, 168 off8704 00000040:00080000:2.0:1787398182.018492:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].4, 224 off8928 00000040:00080000:2.0:1787398182.018506:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].5, 224 off9152 00000040:00080000:2.0:1787398182.018676:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].6, 120 off9272 00000040:00080000:2.0:1787398182.018699:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].7, 168 off9440 00000040:00080000:2.0:1787398182.018716:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].8, 224 off9664 00000040:00080000:2.0:1787398182.018731:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].9, 224 off9888 00000040:00080000:2.0:1787398182.018748:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].10, 120 off10008 00000040:00080000:2.0:1787398182.018764:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].11, 224 off10232 00000040:00080000:2.0:1787398182.018779:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].12, 224 off10456 00000040:00080000:2.0:1787398182.018794:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].13, 88 off10544 00000040:00080000:2.0:1787398182.018809:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].14, 128 off10672 00000040:00080000:2.0:1787398182.018823:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].15, 144 off10816 00000040:00080000:2.0:1787398182.018839:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].16, 160 off10976 00000040:00080000:2.0:1787398182.018854:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].17, 224 off11200 00000040:00080000:2.0:1787398182.018867:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].18, 224 off11424 00000040:00080000:2.0:1787398182.018881:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].19, 80 off11504 00000040:00080000:2.0:1787398182.018896:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].20, 224 off11728 00000040:00080000:2.0:1787398182.018910:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].21, 224 off11952 00000040:00080000:2.0:1787398182.018925:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].22, 88 off12040 00000040:00080000:2.0:1787398182.018940:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].23, 128 off12168 00000040:00080000:2.0:1787398182.018955:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].24, 144 off12312 00000040:00080000:2.0:1787398182.018970:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].25, 160 off12472 00000040:00080000:2.0:1787398182.018986:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].26, 224 off12696 00000040:00080000:2.0:1787398182.019002:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].27, 224 off12920 00000040:00080000:2.0:1787398182.019017:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].28, 80 off13000 00000040:00080000:2.0:1787398182.019032:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].29, 224 off13224 00000040:00080000:2.0:1787398182.019059:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].30, 224 off13448 00000040:00080000:2.0:1787398182.019075:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].31, 88 off13536 00000040:00080000:2.0:1787398182.019089:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].32, 128 off13664 00000040:00080000:2.0:1787398182.019103:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].33, 144 off13808 00000040:00080000:2.0:1787398182.019118:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].34, 128 off13936 00000040:00080000:2.0:1787398182.019133:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].35, 224 off14160 00000040:00080000:2.0:1787398182.019147:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].36, 224 off14384 00000040:00080000:2.0:1787398182.019162:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].37, 80 off14464 00000040:00080000:2.0:1787398182.019337:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].38, 224 off14688 00000040:00080000:2.0:1787398182.019357:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].39, 224 off14912 00000040:00080000:2.0:1787398182.019371:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].40, 88 off15000 00000040:00080000:2.0:1787398182.019387:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].41, 128 off15128 00000040:00080000:2.0:1787398182.019405:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].42, 144 off15272 00000040:00080000:2.0:1787398182.019420:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].43, 128 off15400 00000040:00080000:2.0:1787398182.019434:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].44, 224 off15624 00000040:00080000:2.0:1787398182.019449:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].45, 224 off15848 00000040:00080000:2.0:1787398182.019463:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].46, 80 off15928 00000040:00080000:2.0:1787398182.019480:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].47, 224 off16152 00000040:00080000:2.0:1787398182.019494:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].48, 232 off16384 00000040:00080000:2.0:1787398182.019678:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].49, 224 off16608 00000040:00080000:2.0:1787398182.019698:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].50, 120 off16728 00000040:00080000:2.0:1787398182.019711:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].51, 224 off16952 00000040:00080000:2.0:1787398182.019725:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].52, 224 off17176 00000040:00080000:2.0:1787398182.019742:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].53, 112 off17288 00000040:00080000:2.0:1787398182.019756:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].54, 224 off17512 00000040:00080000:2.0:1787398182.019770:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].55, 224 off17736 00000040:00080000:2.0:1787398182.019786:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].56, 136 off17872 00000040:00080000:2.0:1787398182.019802:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].57, 224 off18096 00000040:00080000:2.0:1787398182.019817:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].58, 224 off18320 00000040:00080000:2.0:1787398182.019831:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].59, 136 off18456 00000040:00080000:2.0:1787398182.019845:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].60, 224 off18680 00000040:00080000:2.0:1787398182.019858:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].61, 224 off18904 00000040:00080000:2.0:1787398182.019872:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].62, 112 off19016 00000040:00080000:2.0:1787398182.019903:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x83:0x0].63, 224 off19240 00000040:00080000:2.0:1787398182.019909:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7e:0x0] index 63 count 63 00000100:00100000:2.0:1787398182.020056:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787398182.020133:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398182.020199:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787398182.021349:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368576 00000100:00100000:1.0:1787398182.021362:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368576 00000100:00100000:1.0:1787398182.021419:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787398182.021429:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787398182.021624:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368576:12345-0@lo:501:mount.lustre.0 Request processed in 195us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.021632:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787398182.022025:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787398182.022078:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787398182.022124:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.022166:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787398182.022288:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368704 00000100:00100000:1.0:1787398182.022293:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368704 00000100:00100000:1.0:1787398182.022328:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787398182.022335:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787398182.022429:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368704:12345-0@lo:503:mount.lustre.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.022436:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787398182.023351:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787398182.023929:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398182.024027:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398182.024100:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.024139:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398182.024232:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368832 00000100:00100000:1.0:1787398182.024238:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368832 00000100:00100000:1.0:1787398182.024289:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787398182.024298:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398182.024417:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368832:12345-0@lo:502:mount.lustre.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.024425:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787398182.025290:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398182.025490:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].1, 224 off8416 00000040:00080000:0.0:1787398182.026257:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].2, 120 off8536 00000040:00080000:0.0:1787398182.026297:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].3, 168 off8704 00000040:00080000:0.0:1787398182.026311:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].4, 224 off8928 00000040:00080000:0.0:1787398182.026322:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].5, 224 off9152 00000040:00080000:0.0:1787398182.026332:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].6, 120 off9272 00000040:00080000:0.0:1787398182.026343:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].7, 168 off9440 00000040:00080000:0.0:1787398182.026353:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].8, 224 off9664 00000040:00080000:0.0:1787398182.026364:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].9, 224 off9888 00000040:00080000:0.0:1787398182.026374:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].10, 120 off10008 00000040:00080000:0.0:1787398182.026386:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].11, 224 off10232 00000040:00080000:0.0:1787398182.026397:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].12, 224 off10456 00000040:00080000:0.0:1787398182.026410:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].13, 88 off10544 00000040:00080000:0.0:1787398182.026422:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].14, 128 off10672 00000040:00080000:0.0:1787398182.026434:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].15, 144 off10816 00000040:00080000:0.0:1787398182.026446:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].16, 160 off10976 00000040:00080000:0.0:1787398182.026459:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].17, 224 off11200 00000040:00080000:0.0:1787398182.026473:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].18, 224 off11424 00000040:00080000:0.0:1787398182.026487:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].19, 80 off11504 00000040:00080000:0.0:1787398182.026500:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].20, 224 off11728 00000040:00080000:0.0:1787398182.026511:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].21, 224 off11952 00000040:00080000:0.0:1787398182.026549:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].22, 88 off12040 00000040:00080000:0.0:1787398182.026577:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].23, 128 off12168 00000040:00080000:0.0:1787398182.026592:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].24, 144 off12312 00000040:00080000:0.0:1787398182.026609:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].25, 160 off12472 00000040:00080000:0.0:1787398182.026623:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].26, 224 off12696 00000040:00080000:0.0:1787398182.026636:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].27, 224 off12920 00000040:00080000:0.0:1787398182.026659:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].28, 80 off13000 00000040:00080000:0.0:1787398182.026673:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].29, 224 off13224 00000040:00080000:0.0:1787398182.026685:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].30, 224 off13448 00000040:00080000:0.0:1787398182.026697:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].31, 88 off13536 00000040:00080000:0.0:1787398182.026711:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].32, 128 off13664 00000040:00080000:0.0:1787398182.026725:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].33, 144 off13808 00000040:00080000:0.0:1787398182.026740:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].34, 128 off13936 00000040:00080000:0.0:1787398182.026751:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].35, 224 off14160 00000040:00080000:0.0:1787398182.026764:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].36, 224 off14384 00000040:00080000:0.0:1787398182.026776:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].37, 80 off14464 00000040:00080000:0.0:1787398182.026790:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].38, 224 off14688 00000040:00080000:0.0:1787398182.026803:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].39, 224 off14912 00000040:00080000:0.0:1787398182.026816:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].40, 88 off15000 00000040:00080000:0.0:1787398182.026828:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].41, 128 off15128 00000040:00080000:0.0:1787398182.026839:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].42, 144 off15272 00000040:00080000:0.0:1787398182.026851:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].43, 128 off15400 00000040:00080000:0.0:1787398182.026862:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].44, 224 off15624 00000040:00080000:0.0:1787398182.026873:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].45, 224 off15848 00000040:00080000:0.0:1787398182.026884:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].46, 80 off15928 00000040:00080000:0.0:1787398182.026894:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].47, 224 off16152 00000040:00080000:0.0:1787398182.026904:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].48, 232 off16384 00000100:00100000:0.0:1787398182.026953:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398182.027018:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.027846:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398182.031210:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701368960 00000100:00100000:1.0:1787398182.031238:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701368960 00000100:00100000:1.0:1787398182.031299:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787398182.031309:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398182.031495:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a831050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701368960:12345-0@lo:502:mount.lustre.0 Request processed in 186us (4475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.031503:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787398182.031799:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701368960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787398182.032030:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].49, 224 off16608 00000040:00080000:0.0:1787398182.032059:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].50, 120 off16728 00000040:00080000:0.0:1787398182.032073:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].51, 224 off16952 00000040:00080000:0.0:1787398182.032084:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].52, 224 off17176 00000040:00080000:0.0:1787398182.032096:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].53, 112 off17288 00000040:00080000:0.0:1787398182.032110:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].54, 224 off17512 00000040:00080000:0.0:1787398182.032132:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].55, 224 off17736 00000040:00080000:0.0:1787398182.032144:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].56, 136 off17872 00000040:00080000:0.0:1787398182.032156:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].57, 224 off18096 00000040:00080000:0.0:1787398182.032178:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].58, 224 off18320 00000040:00080000:0.0:1787398182.032194:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].59, 136 off18456 00000040:00080000:0.0:1787398182.032206:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].60, 224 off18680 00000040:00080000:0.0:1787398182.032217:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].61, 224 off18904 00000040:00080000:0.0:1787398182.032229:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].62, 112 off19016 00000100:00100000:0.0:1787398182.032261:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701369088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787398182.032307:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.032345:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787398182.032446:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369088 00000100:00100000:1.0:1787398182.032452:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369088 00000100:00100000:1.0:1787398182.032493:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787398182.032501:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701369088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787398182.032744:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a80488e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701369088:12345-0@lo:502:mount.lustre.0 Request processed in 243us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.032752:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787398182.032837:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701369088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787398182.032894:0:109272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x84:0x0].63, 224 off19240 00000040:00080000:2.0:1787398182.032905:0:109272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:2.0:1787398182.033979:0:109288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787398182.033995:0:109288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff89a703c8cd40) 00000020:00000080:2.0:1787398182.034023:0:109288:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787398182.034247:0:109288:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89a7025d6800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787398182.034252:0:109288:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89a7025d6800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787398182.034254:0:109288:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89a7025d6800 3 00010000:00080000:2.0:1787398182.034283:0:109288:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89a702184000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.160@tcp at head 00010000:00010000:2.0:1787398182.041026:0:109288:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:2.0:1787398182.041142:0:109288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787398182.042297:0:109288:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787398182.042316:0:109288:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x274786fe0d1946f7 00000100:00080000:2.0:1787398182.042328:0:109288:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787398182.042334:0:109288:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89a702184000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:2.0:1787398182.042371:0:109288:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a7015dca80 x1874218701369216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398182.042438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701369216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787398182.042511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787398182.042614:0:109288:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787398182.043550:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369216 00000100:00100000:0.0:1787398182.043571:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369216 00000100:00100000:0.0:1787398182.043614:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787398182.043623:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1874218701369216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787398182.043657:0:108817:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:0.0:1787398182.043695:0:108817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x274786fe0d1946fe 00000004:00100000:0.0:1787398182.043711:0:108817:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787398182.043741:0:108817:0:(import.c:65:import_set_state_nolock()) ffff89a83544a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398182.046947:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874218701369216:12345-0@lo:38:llog_process_th.0 Request processed in 3315us (4428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.046962:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000040:00080000:2.0:1787398182.047126:0:109288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x84:0x0] index 64 count 63 00000100:00100000:1.0:1787398182.049605:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787398182.049619:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 30 00000100:00080000:1.0:1787398182.049629:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787398182.049634:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787398182.049638:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a702184000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787398182.049649:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874218701369216:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787398182.049913:0:109272:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1787398182.049969:0:109272:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787398182.050025:0:109272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946e9 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398182.050037:0:109272:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75e00/0x274786fe0d1946e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d1946e9 expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787398182.050097:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787398182.050099:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787398182.050101:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787398182.050102:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787398182.050103:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787398182.050104:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787398182.050105:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787398182.050107:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787398182.050109:0:109272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787398182.050113:0:109272:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1787398182.050116:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787398182.050117:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787398182.050118:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787398182.050119:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787398182.050121:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787398182.050122:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787398182.050123:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787398182.050124:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787398182.050125:0:109272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787398182.050148:0:109272:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787398182.050167:0:109272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701369344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787398182.050249:0:109272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.050289:0:109272:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a82f464600 going to sleep for 11 seconds 00000100:00100000:2.0:1787398182.050395:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369344 00000100:00100000:2.0:1787398182.050403:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369344 00000100:00100000:2.0:1787398182.050454:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787398182.050471:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701369344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787398182.050509:0:107283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787398182.050768:0:107283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787398182.052371:0:107260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787398182.052445:0:107283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787398182.052463:0:107283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787398182.052760:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:109272:x1874218701369344:12345-0@lo:253:mount.lustre.0 Request processed in 2285us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.052772:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787398182.052854:0:109272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99b57a74-e5dc-42df-b087-b10fad741506:109272:1874218701369344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787398182.052867:0:109272:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787398182.052870:0:109272:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787398182.052872:0:109272:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787398182.052886:0:109272:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787398182.052887:0:109272:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787398182.052888:0:109272:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787398182.052890:0:109272:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787398182.052891:0:109272:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787398182.052893:0:109272:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787398182.052894:0:109272:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787398182.052912:0:109272:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787398182.053711:0:107285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787398182.053716:0:107285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787398182.053738:0:107285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053756:0:107285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 9 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053765:0:107285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d193f56 expref: 23 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053771:0:107285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053778:0:107285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053822:0:107285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053836:0:107285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.053849:0:107285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369472:0@lo:104: 00000100:00100000:3.0:1787398182.053893:0:107285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787398182.053948:0:107285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 23 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.053956:0:107285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 23 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.053965:0:107285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369600:0@lo:104: 00000100:00100000:3.0:1787398182.053986:0:107285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787398182.054010:0:107285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 9 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.054019:0:107285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 9 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.054029:0:107285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369728:192.168.204.60@tcp:104: 00000100:00100000:3.0:1787398182.054078:0:107285:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836685240 going to sleep for 11 seconds 00000100:00100000:3.0:1787398182.054102:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369472 00000100:00100000:3.0:1787398182.054110:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369472 00000100:00100000:3.0:1787398182.054151:0:93049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369600 00000100:00100000:3.0:1787398182.054154:0:93049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369600 00000100:00100000:3.0:1787398182.054180:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1787398182.054187:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:107285:x1874218701369472:12345-0@lo:104: 00010000:00010000:3.0:1787398182.054200:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.054243:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787398182.054248:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+4:107285:x1874218701369472:12345-0@lo:104: Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398182.054255:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1787398182.054269:0:93049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787398182.054274:0:93049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701369600:12345-0@lo:104: 00010000:00010000:3.0:1787398182.054281:0:93049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.054306:0:93049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787398182.054310:0:93049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:99b57a74-e5dc-42df-b087-b10fad741506+3:107285:x1874218701369600:12345-0@lo:104: Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398182.054315:0:93049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1787398182.054462:0:107285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a83876e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369472:0@lo:104: 00000100:00100000:3.0:1787398182.054471:0:107285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369600:0@lo:104: 00010000:00010000:3.0:1787398182.054483:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398182.054488:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.054495:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:3.0:1787398182.054499:0:15258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.054518:0:15258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787398182.054550:0:15258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398182.054571:0:15258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398182.054942:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398182.054949:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.054956:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc1466c20) 10000000:00010000:1.0:1787398182.054965:0:56852:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.054972:0:56852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787398182.054979:0:56852:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787398182.054984:0:56852:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787398182.055010:0:56852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.055016:0:56852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787398182.055034:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.055040:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a80fe74600/0x274786fe0d193f56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d193f5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.055051:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398182.055053:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398182.055054:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398182.055066:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787398182.055076:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701369856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787398182.055109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787398182.058566:0:15258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058582:0:15258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787398182.058605:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058614:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.160@tcp lock: ffff89a7050aa800/0x274786fe0d1946c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x274786fe0d1946cd expref: -99 pid: 109272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058633:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398182.058635:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398182.058637:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398182.058655:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369856 00000100:00100000:3.0:1787398182.058662:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369856 00010000:00010000:3.0:1787398182.058693:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 24 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.058728:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:3.0:1787398182.058738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+24:3650:x1874218701369856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398182.058751:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398182.058757:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 24 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058775:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 24 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058789:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a828a75a00/0x274786fe0d193f5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d193f56 expref: 24 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.058803:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398182.058875:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99b57a74-e5dc-42df-b087-b10fad741506+23:3650:x1874218701369856:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398182.058883:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:3.0:1787398182.058954:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701369984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398182.058990:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398182.059050:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99b57a74-e5dc-42df-b087-b10fad741506:3650:1874218701369856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787398182.059083:0:107285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107285:1874218701369728:192.168.204.60@tcp:104: 00010000:00010000:3.0:1787398182.059103:0:107285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.059121:0:19660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701369984 00000100:00100000:3.0:1787398182.059124:0:19660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701369984 00010000:00010000:3.0:1787398182.059137:0:19660:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398182.059156:0:19660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1787398182.059162:0:19660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+23:3648:x1874218701369984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787398182.059182:0:19660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787398182.059187:0:19660:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.059203:0:19660:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.059214:0:19660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a8345fe400/0x274786fe0d1946cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x274786fe0d1946c6 expref: 23 pid: 107283 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398182.059223:0:19660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787398182.059251:0:19660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:99b57a74-e5dc-42df-b087-b10fad741506+22:3648:x1874218701369984:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398182.059257:0:19660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1787398182.059286:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701369984:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787398182.059371:0:109272:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 85899345938 00000040:01000000:1.0:1787398182.059724:0:109272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787398182.059870:0:109293:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 85899345938 00000020:00080000:3.0:1787398182.059874:0:109293:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 85899345938 00000040:01000000:3.0:1787398182.060991:0:109294:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787398182.061183:0:109272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787398182.061734:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398182.061797:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398182.061884:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092eca80 going to sleep for 50 seconds 00000040:01000000:3.0:1787398182.062034:0:109272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787398182.062075:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398182.062235:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370112 00000100:00100000:0.0:1787398182.062244:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370112 00000100:00100000:0.0:1787398182.062293:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787398182.062302:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370112:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1787398182.062857:0:109272:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:3.0:1787398182.062954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398182.063007:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378560 00000100:00100000:1.0:1787398182.063012:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378560 00010000:00010000:1.0:1787398182.063044:0:8451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 10 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787398182.063072:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 2676 00000100:00100000:1.0:1787398182.063079:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2405:x1874218681378560:12345-192.168.204.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787398182.063091:0:8451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787398182.063097:0:8451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 10 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063345:0:8451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 10 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063366:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a80fe74200/0x274786fe0d193f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d88c6 expref: 10 pid: 107280 timeout: 4161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063382:0:8451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063390:0:8451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787398182.063408:0:8451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009691258s 00010000:00010000:1.0:1787398182.063413:0:8451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063419:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063426:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063443:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063450:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a836583e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398182.063455:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063463:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063480:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.063491:0:8451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:01000000:3.0:1787398182.063614:0:109272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787398182.063694:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787398182.063943:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a7015df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1640us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.063954:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787398182.064110:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370112:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787398182.064150:0:109295:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787398182.064288:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787398182.064344:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398182.064414:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092eca80 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.064448:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370240 00000100:00100000:0.0:1787398182.064453:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370240 00000100:00100000:0.0:1787398182.064759:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787398182.064769:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370240:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.064893:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370240:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.064901:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787398182.064998:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.065063:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:109295:1874218701370368:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.065095:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.065151:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787398182.065259:0:107275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370368 00000100:00100000:2.0:1787398182.065264:0:107275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370368 00000100:00100000:2.0:1787398182.065330:0:107275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787398182.065338:0:107275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:109295:x1874218701370368:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787398182.065378:0:107275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:109295:x1874218701370368:12345-0@lo:900:lod0001_rec0000.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398182.065385:0:107275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787398182.065428:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:109295:1874218701370368:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.065470:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.065536:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.065565:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370496 00000100:00100000:0.0:1787398182.065569:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370496 00000100:00100000:0.0:1787398182.065593:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398182.065599:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.065645:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.067055:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398182.067100:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf180 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.067133:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.067261:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.067347:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.067386:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370624 00000100:00100000:0.0:1787398182.067393:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370624 00000100:00100000:0.0:1787398182.067426:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787398182.067434:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.067651:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8047c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:2405:x1874218681378560:12345-192.168.204.60@tcp:103:ldlm_bl.0 Request processed in 4568us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.067662:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 2676 00010000:00010000:1.0:1787398182.067701:0:107285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.067715:0:107285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398182.067722:0:107285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89a836583e00/0x274786fe0d194705 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398182.067794:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 359us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.067800:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787398182.067817:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf000 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.067832:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370624:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398182.067868:0:109295:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 30, last_idx 32 00000100:00100000:0.0:1787398182.067974:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.068020:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.068041:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370752 00000100:00100000:0.0:1787398182.068051:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370752 00000100:00100000:0.0:1787398182.068075:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398182.068081:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.068179:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.068185:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398182.068200:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf000 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.068211:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398182.068238:0:109295:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 32 synced_idx: 0 lgh_last_idx: 32 00000040:00080000:0.0:1787398182.068242:0:109295:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x20000e691:0x1:0x0] at index 31 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:0.0:1787398182.068287:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.068309:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.068332:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf180 going to sleep for 50 seconds 00000100:00100000:1.0:1787398182.068666:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701370880 00000100:00100000:1.0:1787398182.068671:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701370880 00000100:00100000:1.0:1787398182.068696:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787398182.068702:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370880:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.068769:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701370880:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 66us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.068775:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787398182.068804:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701370880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.068870:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.068918:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398182.068937:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371008 00000100:00100000:1.0:1787398182.068940:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371008 00000100:00100000:1.0:1787398182.068959:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787398182.068965:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701371008:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.069112:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701371008:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 146us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.069118:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787398182.069135:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fe40 going to sleep for 50 seconds 00000100:00100000:1.0:1787398182.069147:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371008:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.069212:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371136:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.069235:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398182.069252:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371136 00000100:00100000:1.0:1787398182.069255:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371136 00000100:00100000:1.0:1787398182.069333:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787398182.069340:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701371136:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.069405:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109295:x1874218701371136:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.069411:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000040:00080000:3.0:1787398182.069670:0:109272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787398182.069798:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4f900 going to sleep for 50 seconds 00000100:00100000:1.0:1787398182.069813:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371136:0@lo:1000:lod0001_rec0000.0 00000004:00080000:1.0:1787398182.069848:0:109295:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a802b7f540 with version 1 00000040:00080000:1.0:1787398182.069864:0:109295:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x200000bd3:0x1:0x0] first idx 31, last_idx 32 00000004:00080000:1.0:1787398182.069875:0:109295:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a704d4f900 with version 2 00000040:00080000:1.0:1787398182.069878:0:109295:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x20000e691:0x1:0x0] at index 31 of catalog [0x200000bd3:0x1:0x0] 00000004:00080000:0.0:1787398182.069937:0:109279:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a701b2be40 version 1 rpc_version 1 00000020:00100000:0.0:1787398182.069954:0:109279:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787398182.069961:0:109279:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a70a018000 x1874218701371392/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398182.069976:0:109279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a018000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701371392:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398182.070004:0:109279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.070022:0:109279:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edf0c0 going to sleep for 50 seconds 00000100:00100000:1.0:1787398182.070060:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371392 00000100:00100000:1.0:1787398182.070064:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371392 00000100:00100000:1.0:1787398182.070118:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787398182.070125:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:109279:x1874218701371392:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1787398182.070186:0:109272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787398182.070221:0:109272:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:1.0:1787398182.070318:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a01b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:109279:x1874218701371392:12345-0@lo:1000:osp_up0-1.0 Request processed in 193us (312us total) trans 128849018902 rc 0/0 00000040:00080000:3.0:1787398182.070322:0:109272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787398182.070325:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787398182.070476:0:109279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a018000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701371392:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398182.070961:0:109279:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a701b2be40 version 2 rpc_version 2 00000020:00100000:1.0:1787398182.070978:0:109279:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398182.070985:0:109279:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a827a8ea00 x1874218701371648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398182.071001:0:109279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701371648:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398182.071037:0:109279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398182.071055:0:109279:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704d4fe40 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.071087:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371648 00000100:00100000:0.0:1787398182.071093:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371648 00000100:00100000:0.0:1787398182.071126:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787398182.071135:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:109279:x1874218701371648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398182.071275:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109279:x1874218701371648:12345-0@lo:1000:osp_up0-1.0 Request processed in 139us (235us total) trans 128849018903 rc 0/0 00000100:00100000:0.0:1787398182.071292:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787398182.071392:0:109279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701371648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398182.071503:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.071586:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.071599:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edfd80 going to sleep for 50 seconds 00000100:00100000:1.0:1787398182.071857:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371776 00000100:00100000:1.0:1787398182.071862:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371776 00000100:00100000:1.0:1787398182.071895:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787398182.071901:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109295:x1874218701371776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787398182.072039:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109295:x1874218701371776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 137us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398182.072045:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00080000:10000000:3.0:1787398182.072187:0:109272:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x43:0x0] (8/32) registered 00000100:00100000:0.0:1787398182.072311:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398182.072356:0:109295:0:(llog.c:805:llog_process_thread()) index: 32, lh_last_idx: 32 synced_idx: 32 lgh_last_idx: 32 00000040:00080000:0.0:1787398182.072361:0:109295:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x20000e691:0x2:0x0] at index 32 of catalog [0x200000bd3:0x1:0x0] 00000100:00100000:0.0:1787398182.072403:0:109295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371904:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.072433:0:109295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398182.072454:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701371904 00000100:00100000:0.0:1787398182.072457:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701371904 00000100:00100000:0.0:1787398182.072484:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787398182.072490:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70a01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109295:x1874218701371904:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787398182.072804:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70a01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109295:x1874218701371904:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 312us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398182.072810:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787398182.072839:0:109295:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a704edfb40 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.072852:0:109295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:109295:1874218701371904:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787398182.072894:0:109295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787398182.072936:0:109295:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a704edfe40 with version 3 00000004:00080000:0.0:1787398182.072978:0:109295:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff89a704edfd80 with version 4 00000040:00080000:0.0:1787398182.072983:0:109295:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x20000e691:0x2:0x0] at index 32 of catalog [0x200000bd3:0x1:0x0] 00000040:00080000:0.0:1787398182.072998:0:109295:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd3:0x1:0x0] index 32 count 1 00000004:00080000:0.0:1787398182.073051:0:109295:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787398182.073115:0:109279:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a701b2be40 version 3 rpc_version 3 00000020:00100000:1.0:1787398182.073132:0:109279:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398182.073139:0:109279:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a827a8df80 x1874218701372160/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398182.073154:0:109279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701372160:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398182.073182:0:109279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398182.073204:0:109279:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802b7fe40 going to sleep for 50 seconds 00000100:00100000:0.0:1787398182.073244:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372160 00000100:00100000:0.0:1787398182.073254:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372160 00000100:00100000:0.0:1787398182.073277:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787398182.073283:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:109279:x1874218701372160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787398182.073462:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:109279:x1874218701372160:12345-0@lo:1000:osp_up0-1.0 Request processed in 178us (278us total) trans 128849018904 rc 0/0 00000100:00100000:0.0:1787398182.073469:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787398182.073579:0:109279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701372160:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787398182.073589:0:109279:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff89a701b2be40 version 4 rpc_version 4 00000020:00100000:1.0:1787398182.073600:0:109279:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787398182.073605:0:109279:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff89a827a8ca80 x1874218701372416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787398182.073618:0:109279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a827a8ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701372416:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787398182.073640:0:109279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398182.073659:0:109279:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a802bee240 going to sleep for 50 seconds 00000100:00100000:2.0:1787398182.073759:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372416 00000100:00100000:2.0:1787398182.073763:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372416 00000100:00100000:2.0:1787398182.073791:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787398182.073798:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a827a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:109279:x1874218701372416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787398182.073899:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a827a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:109279:x1874218701372416:12345-0@lo:1000:osp_up0-1.0 Request processed in 102us (258us total) trans 128849018905 rc 0/0 00000100:00100000:2.0:1787398182.073906:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787398182.074774:0:109279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a827a8ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:109279:1874218701372416:0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1787398182.075282:0:109272:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 90194313226 00000040:00080000:0.0:1787398182.075890:0:109294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240002340:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787398182.075947:0:109294:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787398182.075952:0:109294:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00080000:3.0:1787398182.076400:0:109296:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 109296 00010000:02000000:3.0:1787398182.076444:0:109296:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1787398182.076454:0:109296:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1787398182.076468:0:109296:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1787398182.076894:0:109272:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787398182.076922:0:109272:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787398182.076945:0:109272:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787398182.076969:0:109272:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787398182.077789:0:109272:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787398182.078035:0:109272:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787398182.766401:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787398183.143673:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787398183.143683:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a7025d6800 from 138 10000000:01000000:0.0:1787398183.143690:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787398183.143743:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.143755:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.143768:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398183.143800:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787398183.143869:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398183.143919:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787398183.144415:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372544 00000100:00100000:1.0:1787398183.144425:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372544 00000100:00100000:1.0:1787398183.144482:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787398183.144492:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+22:6519:x1874218701372544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787398183.144507:0:107280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787398183.144555:0:107280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a8345ff400/0x274786fe0d194713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19470c expref: -99 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398183.144588:0:107280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a8345ff400/0x274786fe0d194713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19470c expref: 23 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398183.144600:0:107280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a8345ff400/0x274786fe0d194713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19470c expref: 23 pid: 107280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398183.144610:0:107280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a8345ff400, rc 0) 00000100:00100000:1.0:1787398183.144670:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701372544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398183.144678:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787398183.144772:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787398183.144787:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398183.144796:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d194713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398183.144854:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787398183.144889:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398183.144923:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a808723000 going to sleep for 11 seconds 00000100:00100000:1.0:1787398183.145084:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372672 00000100:00100000:1.0:1787398183.145089:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372672 00000100:00100000:1.0:1787398183.145122:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787398183.145130:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701372672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787398183.145144:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787398183.145160:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787398183.145163:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 138 00000100:00100000:1.0:1787398183.145252:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701372672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398183.145261:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787398183.145398:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787398183.145450:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787398183.145458:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398183.145467:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a828a75200/0x274786fe0d19470c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194713 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787398183.145476:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787398183.145479:0:6519:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89a829b29000 from 138 10000000:01000000:3.0:1787398183.145482:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787398183.145500:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398183.145507:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398183.145560:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398183.145575:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787398183.145604:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398183.145620:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a836546540 going to sleep for 11 seconds 00000100:00100000:0.0:1787398183.145630:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372800 00000100:00100000:0.0:1787398183.145634:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372800 00000100:00100000:0.0:1787398183.145668:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787398183.145676:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+23:6519:x1874218701372800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398183.145683:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398183.145693:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74e00/0x274786fe0d194721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x274786fe0d19471a expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.145708:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74e00/0x274786fe0d194721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x274786fe0d19471a expref: 24 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.145717:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74e00/0x274786fe0d194721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x274786fe0d19471a expref: 24 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.145724:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74e00, rc 0) 00000100:00100000:0.0:1787398183.145757:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701372800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398183.145763:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787398183.145792:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835b6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398183.145804:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194721 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.145811:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x274786fe0d194721 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787398183.145848:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787398183.145874:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398183.145887:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a70267ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787398183.145904:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701372928 00000100:00100000:0.0:1787398183.145907:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701372928 00000100:00100000:0.0:1787398183.145934:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787398183.145940:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701372928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787398183.145950:0:107281:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787398183.145962:0:107281:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787398183.145965:0:107281:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 138 00000100:00100000:0.0:1787398183.146032:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:6519:x1874218701372928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398183.146038:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787398183.146065:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99b57a74-e5dc-42df-b087-b10fad741506:6519:1874218701372928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787398183.146096:0:6519:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787398183.146101:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194721 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.146109:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.160@tcp lock: ffff89a836583600/0x274786fe0d19471a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x274786fe0d194721 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.781690:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398183.826918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398183.827055:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378688 00000100:00100000:0.0:1787398183.827067:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378688 00000100:00100000:0.0:1787398183.827645:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:0.0:1787398183.827662:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+9:70888:x1874218681378688:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787398183.827687:0:107281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787398183.827715:0:107281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89a828a74c00/0x274786fe0d194728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x52f5daecf11d8967 expref: -99 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.827755:0:107281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89a828a74c00/0x274786fe0d194728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8967 expref: 10 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.827785:0:107281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89a828a74c00/0x274786fe0d194728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.60@tcp remote: 0x52f5daecf11d8967 expref: 10 pid: 107281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398183.827797:0:107281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89a828a74c00, rc 0) 00000100:00100000:0.0:1787398183.827908:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a703131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681378688:12345-192.168.204.60@tcp:101:ll_cfg_requeue.0 Request processed in 249us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398183.827915:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 138 00000100:00100000:3.0:1787398183.835400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398183.835491:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378816 00000100:00100000:0.0:1787398183.835505:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378816 00000100:00100000:0.0:1787398183.835604:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:0.0:1787398183.835617:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681378816:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787398183.835658:0:107283:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1787398183.835704:0:107283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787398183.835708:0:107283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 138 00000100:00100000:0.0:1787398183.839321:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:70888:x1874218681378816:12345-192.168.204.60@tcp:256:ll_cfg_requeue.0 Request processed in 3686us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398183.839340:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 139 00000100:00100000:1.0:1787398183.843169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398183.843267:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681378944 00000100:00100000:0.0:1787398183.843283:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681378944 00000100:00100000:0.0:1787398183.843341:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:0.0:1787398183.843353:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874218681378944:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1787398183.843395:0:107265:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '784819ec-79bc-4534-8fa6-902d7a92d2f8' at ffff89a835596800, cookie 0x274786fe0d19466b 00010000:00080000:0.0:1787398183.843402:0:107265:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp recovering/t85899345937 exp ffff89a835596800 cur 4063 last 1787398181 00010000:02000400:0.0:1787398183.843414:0:107265:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1787398183.843440:0:107265:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1787398183.843487:0:107265:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787398183.843714:0:107265:0:(import.c:65:import_set_state_nolock()) ffff89a706ff7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787398183.843821:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681378944:12345-192.168.204.60@tcp:38:ll_cfg_requeue.0 Request processed in 468us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398183.843830:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 68 00000100:00100000:2.0:1787398183.855683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398183.855917:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379072 00000100:00100000:1.0:1787398183.855931:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379072 00000100:00100000:1.0:1787398183.856005:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 80 00000100:00100000:1.0:1787398183.856016:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681379072:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1787398183.856074:0:107264:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a835d84000 x1874218681379072/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:663/0 lens 224/0 e 0 to 0 dl 1787398233 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787398183.856114:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2401:x1874218681379072:12345-192.168.204.60@tcp:400:ldlm_lock_repla.0 Request processed in 100us (447us total) trans 0 rc 0/-999 00000100:00100000:1.0:1787398183.856124:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 80 00010000:00080000:0.0:1787398183.856464:0:109296:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1787398184.710785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:3.0:1787398184.710850:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:0.0:1787398184.711309:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379200 00000100:00100000:0.0:1787398184.711324:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379200 00000100:00100000:0.0:1787398184.711399:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:0.0:1787398184.711426:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681379200:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:0.0:1787398184.711576:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2404:x1874218681379200:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 153us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398184.711585:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 140 00000100:00100000:2.0:1787398184.711844:0:108817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379328 00000100:00100000:2.0:1787398184.711851:0:108817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379328 00000100:00100000:2.0:1787398184.711919:0:108817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00100000:2.0:1787398184.711940:0:108817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681379328:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:2.0:1787398184.711997:0:108817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2404:x1874218681379328:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 60us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398184.712005:0:108817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 81 00000100:00080000:0.0:1787398184.712826:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787398184.806262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398185.831725:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398186.853644:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398186.981440:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701373056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398186.981560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398186.981631:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373056 00000100:00100000:3.0:1787398186.981639:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373056 00000100:00100000:3.0:1787398186.981706:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787398186.981717:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701373056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787398186.981751:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398186.981800:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874218701373056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398186.981808:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:3.0:1787398186.981832:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398186.981892:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1874218701373056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787398186.983438:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787398186.983455:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701373184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787398186.983542:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398186.983592:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373184 00000100:00100000:2.0:1787398186.983598:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373184 00000100:00100000:2.0:1787398186.983652:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787398186.983661:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701373184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398186.983691:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398186.983733:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701373184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398186.983740:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787398186.983783:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701373184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787398186.983804:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787398186.988897:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701373312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398186.988986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398186.992070:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373312 00000100:00100000:3.0:1787398186.992086:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373312 00000100:00100000:3.0:1787398186.992146:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787398186.992164:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701373312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398186.992205:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445126144 avail 1298886656 00000100:00100000:3.0:1787398187.000430:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3651:x1874218701373312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8257us (11432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398187.000444:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787398187.002514:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701373312:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787398187.227793:0:109537:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg460-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:1.0:1787398187.494797:0:107260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018905 is committed 00000001:00100000:0.0:1787398187.495506:0:100452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00080000:0.0:1787398187.499708:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398187.499715:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398187.499719:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398187.499732:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89a8364ea800 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398187.499754:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a01a680 x1874218701373696/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398187.499790:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398187.499794:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398187.499796:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398187.499893:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89a80570d000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398187.499908:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a019880 x1874218701373952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787398187.499917:0:65702:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787398187.499920:0:65702:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787398187.499921:0:65702:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787398187.499926:0:65702:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89a806931000 using connection 192.168.204.160@tcp/0@lo 00000100:00100000:0.0:1787398187.499938:0:65702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89a70a01b480 x1874218701374080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787398187.500014:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701373824:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500080:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398187.500113:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701374592:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398187.500156:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398187.500162:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701374208:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500184:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398187.500215:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373824 00000100:00100000:0.0:1787398187.500223:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373824 00000100:00100000:0.0:1787398187.500271:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374592 00000100:00100000:0.0:1787398187.500274:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374592 00000100:00100000:0.0:1787398187.500293:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374208 00000100:00100000:0.0:1787398187.500296:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374208 00000100:00100000:0.0:1787398187.500312:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398187.500320:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701373824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500373:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874218701373824:12345-0@lo:400:kworker.0 Request processed in 53us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398187.500389:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787398187.500409:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787398187.500415:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701374592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500458:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874218701374592:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398187.500466:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787398187.500473:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701373568:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500491:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398187.500501:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701374208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398187.500510:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398187.500557:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874218701374208:12345-0@lo:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398187.500563:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787398187.500574:0:107265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373568 00000100:00100000:0.0:1787398187.500577:0:107265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373568 00000100:00100000:0.0:1787398187.500595:0:107265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787398187.500600:0:107265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500633:0:107265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a81816e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874218701373568:12345-0@lo:400:kworker.0 Request processed in 32us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398187.500639:0:107265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787398187.500690:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874218701374208:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500704:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1874218701373824:0@lo:400:kworker.0 00000100:00100000:0.0:1787398187.500717:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874218701374592:0@lo:400:kworker.0 00000100:00100000:3.0:1787398187.500815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1874218701373568:0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.501052:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701373440:0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.501089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.501118:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701374336:0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.501148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.501178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701373696:0@lo:38:kworker.0 00000100:00100000:1.0:1787398187.501202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.501219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701373952:0@lo:38:kworker.0 00000100:00100000:1.0:1787398187.501242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.501251:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701374080:0@lo:38:kworker.0 00000100:00100000:1.0:1787398187.501284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.501316:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373696 00000100:00100000:1.0:1787398187.501320:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373696 00000100:00100000:1.0:1787398187.501336:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373952 00000100:00100000:1.0:1787398187.501338:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373952 00000100:00100000:1.0:1787398187.501349:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787398187.501354:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701373696:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398187.501378:0:107264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4066 last 0 00000020:00000080:1.0:1787398187.501414:0:107264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x274786fe0d19472f 00000004:00100000:1.0:1787398187.501437:0:107264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398187.502018:0:107264:0:(import.c:65:import_set_state_nolock()) ffff89a835706000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398187.502083:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874218701373696:12345-0@lo:38:kworker.0 Request processed in 727us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.502090:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787398187.502111:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787398187.502115:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1874218701373952:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787398187.502129:0:107264:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4066 last 0 00000020:00000080:1.0:1787398187.502153:0:107264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x274786fe0d194736 00000004:00100000:1.0:1787398187.502160:0:107264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398187.502177:0:107264:0:(import.c:65:import_set_state_nolock()) ffff89a835701000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398187.502201:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874218701373952:12345-0@lo:38:kworker.0 Request processed in 84us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.502207:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787398187.502228:0:107283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701373440 00000100:00100000:1.0:1787398187.502232:0:107283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701373440 00000100:00100000:1.0:1787398187.502262:0:107283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787398187.502268:0:107283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.502299:0:107283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99b57a74-e5dc-42df-b087-b10fad741506+24:3648:x1874218701373440:12345-0@lo:400:kworker.0 Request processed in 31us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.502306:0:107283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787398187.502333:0:108819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374336 00000100:00100000:1.0:1787398187.502336:0:108819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374336 00000100:00100000:1.0:1787398187.502365:0:108819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787398187.502371:0:108819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701374336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.502399:0:108819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70aa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701374336:12345-0@lo:400:kworker.0 Request processed in 28us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.502413:0:108819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787398187.502431:0:107321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374080 00000100:00100000:1.0:1787398187.502435:0:107321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374080 00000100:00100000:1.0:1787398187.502465:0:107321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787398187.502470:0:107321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3647:x1874218701374080:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787398187.502732:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701374464:0@lo:400:kworker.0 00000100:00100000:3.0:1787398187.502773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787398187.503796:0:107321:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff89a828780800, cookie 0x274786fe0d194664 00010000:00080000:1.0:1787398187.503864:0:107321:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff89a828780800 cur 4066 last 1787398181 00000004:00100000:1.0:1787398187.503950:0:107321:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787398187.503986:0:107321:0:(import.c:65:import_set_state_nolock()) ffff89a835702800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787398187.504054:0:107321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701374080:12345-0@lo:38:kworker.0 Request processed in 1581us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.504063:0:107321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787398187.504103:0:100418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374464 00000100:00100000:1.0:1787398187.504109:0:100418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374464 00000100:00100000:1.0:1787398187.504150:0:100418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787398187.504157:0:100418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701374464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.504208:0:100418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a83876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701374464:12345-0@lo:400:kworker.0 Request processed in 40us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.504215:0:100418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:1.0:1787398187.504239:0:109296:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1787398187.504244:0:109296:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 90194313227 00000020:00080000:1.0:1787398187.504248:0:109296:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787398187.504251:0:109296:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313227 00000020:00080000:1.0:1787398187.504254:0:109296:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787398187.504256:0:109296:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313227 00010000:00080000:0.0:1787398187.504297:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70a01a680 x1874218701373696/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.504312:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 22 00000100:00100000:1.0:1787398187.504406:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99b57a74-e5dc-42df-b087-b10fad741506:3648:1874218701373440:0@lo:400:kworker.0 00000100:00100000:1.0:1787398187.504446:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7015dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701374336:0@lo:400:kworker.0 00000100:00080000:2.0:1787398187.504465:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787398187.504477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787398187.504481:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787398187.506694:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701374464:0@lo:400:kworker.0 00000100:00080000:0.0:1787398187.506957:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff89a70a01a680 x1874218701373696/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398212 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.506969:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787398187.506975:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a8364ea800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787398187.506980:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787398187.506985:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1874218701373696:0@lo:38:kworker.0 00000001:00100000:0.0:1787398187.507270:0:99635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:0.0:1787398187.507307:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a70a019880 x1874218701373952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.507321:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 22 00000100:00080000:0.0:1787398187.509812:0:3647:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff89a70a019880 x1874218701373952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787398212 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.509834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1787398187.509840:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a80570d000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787398187.509844:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1787398187.509850:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1874218701373952:0@lo:38:kworker.0 00000100:00080000:0.0:1787398187.509895:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 22 00000100:00080000:0.0:1787398187.509909:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1787398187.509912:0:3647:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:0.0:1787398187.509915:0:3647:0:(recover.c:53:ptlrpc_replay_next()) import ffff89a806931000 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:0.0:1787398187.509918:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1787398187.513288:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a70a01b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701374080:0@lo:38:kworker.0 00010000:00080000:0.0:1787398187.513337:0:109555:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:0.0:1787398187.513341:0:109555:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:0.0:1787398187.513354:0:109555:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1787398187.513840:0:109555:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1787398187.513894:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701374720:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787398187.513965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.514942:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374720 00000100:00100000:3.0:1787398187.514952:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374720 00000100:00100000:3.0:1787398187.515002:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787398187.515012:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701374720:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1787398187.515033:0:99650:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff89a803436d80 x1874218701374720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:667/0 lens 224/0 e 0 to 0 dl 1787398237 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398187.515050:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874218701374720:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (1087us total) trans 0 rc 0/-999 00000100:00100000:3.0:1787398187.515057:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000020:00080000:1.0:1787398187.515328:0:109296:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787398187.515333:0:109296:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 90194313227 00010000:00080000:1.0:1787398187.515337:0:109296:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1787398187.515340:0:109296:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1787398187.515347:0:109296:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1787398187.515349:0:109296:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1787398187.516177:0:109296:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 22, last_transno is 94489280512 00000001:00100000:1.0:1787398187.526606:0:109273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787398187.526616:0:109273:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 784819ec-79bc-4534-8fa6-902d7a92d2f8 00000001:00080000:1.0:1787398187.526655:0:109296:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1787398187.526702:0:109296:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:1.0:1787398187.526723:0:109296:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.60@tcp: req@ffff89a835d84000 x1874218681379072/t0(0) o400->784819ec-79bc-4534-8fa6-902d7a92d2f8@192.168.204.60@tcp:663/0 lens 224/0 e 0 to 0 dl 1787398233 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787398187.526840:0:109296:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff89a803436d80 x1874218701374720/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:667/0 lens 224/0 e 0 to 0 dl 1787398237 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1787398187.526911:0:109296:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1787398187.532079:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1787398187.532099:0:3647:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff89a803436680 x1874218701374720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398242 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.532111:0:3647:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff89a803436680 x1874218701374720/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398242 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787398187.532118:0:3647:0:(import.c:65:import_set_state_nolock()) ffff89a806931000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1787398187.532133:0:3647:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1787398187.532139:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000681333b8): req@ffff89a835e50e00 x1874218701358592/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787398180 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787398187.532154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1874218701374720:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1787398187.532235:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787398187.532247:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701374848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787398187.532311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398187.536738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.537153:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374848 00000100:00100000:3.0:1787398187.537162:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374848 00000100:00100000:3.0:1787398187.537206:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701358592 00000100:00100000:3.0:1787398187.537209:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701358592 00000100:00100000:3.0:1787398187.537238:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787398187.537247:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701374848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787398187.537284:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445552128 avail 1299312640 00000100:00100000:3.0:1787398187.537342:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874218701374848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398187.537349:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787398187.537366:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787398187.537372:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701358592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787398187.537381:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445552128 avail 1299312640 00000100:00100000:3.0:1787398187.537410:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701358592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398187.537415:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787398187.537467:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701374848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398187.538951:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701358592:0@lo:41:osp-pre-1-0.0 00000004:00000080:1.0:1787398187.578574:0:109296:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadfe45807e10 00100000:10000000:1.0:1787398187.578591:0:109296:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:1.0:1787398187.579678:0:109284:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x243:0x0] 00000100:00100000:1.0:1787398187.579727:0:109284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a836530a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:109284:1874218701374976:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787398187.579799:0:109284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787398187.579833:0:109284:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a804ce09c0 going to sleep for 50 seconds 00000100:00100000:1.0:1787398187.579855:0:101069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701374976 00000100:00100000:1.0:1787398187.579862:0:101069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701374976 00000100:00100000:1.0:1787398187.579907:0:101069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787398187.579924:0:101069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:109284:x1874218701374976:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787398187.579953:0:101069:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -94 00002000:02000040:1.0:1787398187.579957:0:101069:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:580 to 0x2c0000400:673) 00000004:00080000:2.0:1787398187.580575:0:109282:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x242:0x0] 00000100:00100000:2.0:1787398187.580604:0:109282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:109282:1874218701375104:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787398187.580647:0:109282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398187.580672:0:109282:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8092eca80 going to sleep for 50 seconds 00000100:00100000:2.0:1787398187.580834:0:99639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375104 00000100:00100000:2.0:1787398187.580838:0:99639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375104 00000100:00100000:2.0:1787398187.580868:0:99639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787398187.580876:0:99639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a70230fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:109282:x1874218701375104:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787398187.580893:0:99639:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -95 00002000:02000040:2.0:1787398187.580896:0:99639:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:579 to 0x280000400:673) 00002000:00010000:1.0:1787398187.586007:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.586020:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586039:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2a1:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.586044:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.586051:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586070:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586081:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586088:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586116:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398187.586231:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.586237:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586244:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2a0:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.586262:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.586266:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586275:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586283:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586291:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586310:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.586326:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.586331:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586340:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffe00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.586346:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586355:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586371:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586391:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b1558f/0x274786fe0d19473d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586413:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.586418:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586424:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.586430:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586438:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586460:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586467:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a67b54b/0x274786fe0d194744 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586478:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.586481:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.586482:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.586773:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.586779:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586798:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29f:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.586801:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.586808:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586816:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586824:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586832:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586850:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.586861:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.586866:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586873:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.586877:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586885:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586909:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586916:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7454aa7/0x274786fe0d19474b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586930:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.586931:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.586933:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.586985:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.586991:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.586999:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29e:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.587002:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.587006:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587016:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587022:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587028:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587052:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398187.587100:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.587107:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587116:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29d:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.587119:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.587123:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587132:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587140:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587148:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587164:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.587173:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.587178:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587186:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.587198:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587207:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587217:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587223:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea5c6bd/0x274786fe0d194752 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587237:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.587240:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587247:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.587250:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587257:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587267:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587274:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006def9e58/0x274786fe0d194759 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587294:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587296:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587298:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.587355:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.587361:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587368:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29c:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.587372:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.587376:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587386:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587395:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587402:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587417:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.587423:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.587427:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587444:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fea00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.587465:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587475:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587488:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587495:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc5ddede/0x274786fe0d194760 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587510:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587513:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587516:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.587587:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.587593:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587601:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29b:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.587604:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.587608:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587617:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587634:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587641:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587655:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.587663:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.587667:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587674:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.587678:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587687:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587700:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587708:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafe6bc2/0x274786fe0d194767 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587726:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587737:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.587792:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.587798:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587807:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29a:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.587810:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x29a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.587814:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587823:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587832:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587840:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587855:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.587862:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.587866:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587873:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fec00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.587877:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587896:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587910:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587917:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009df208d0/0x274786fe0d19476e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.587934:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587937:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.587940:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.587995:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.588001:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.588009:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x299:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.588012:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.588017:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590459:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590484:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590503:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590548:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.590563:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.590569:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590576:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.590581:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590590:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590609:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590617:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f65cb32/0x274786fe0d194775 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590645:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.590647:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.590649:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.590773:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.590788:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590798:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x298:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.590802:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x298:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.590809:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590821:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590828:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590834:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590846:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.590854:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.590858:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590864:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.590867:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590875:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590893:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590900:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5cbf38e/0x274786fe0d19477c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590916:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.590918:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.590920:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.590964:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.590970:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590978:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x297:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.590981:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x297:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.590985:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.590994:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591001:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591007:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591037:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398187.591303:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.591310:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591318:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x296:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.591321:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.591325:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591335:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591344:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591351:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591366:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.591373:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.591377:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591383:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ff000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.591393:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591401:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591413:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591420:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3010b2d/0x274786fe0d194783 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591434:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.591438:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591445:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.591460:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591468:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591479:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591486:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d62ce1fc/0x274786fe0d19478a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591506:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.591508:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.591510:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.591581:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.591587:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591595:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x295:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.591598:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x295:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.591603:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591612:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591620:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591627:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591640:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.591647:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.591652:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591670:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345fe600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.591674:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591681:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591693:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591700:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3e05aa/0x274786fe0d194791 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591793:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.591795:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.591798:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.591846:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.591852:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591860:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x294:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.591863:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.591867:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591877:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591891:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591898:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591911:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.591919:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.591923:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591930:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8345ffa00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.591934:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591942:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.591954:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592166:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd3bdca6/0x274786fe0d194798 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592182:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592192:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592194:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.592250:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.592257:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592265:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x293:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.592269:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.592274:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592283:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592291:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592299:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592310:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.592315:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.592319:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592326:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.592329:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592347:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592359:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592367:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae1b050/0x274786fe0d19479f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592386:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592388:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592390:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.592439:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.592444:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592460:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x292:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.592463:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x292:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.592467:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592476:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592483:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.592486:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592495:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592507:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.592513:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.592516:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592538:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.592541:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592548:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592559:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592565:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e13f40e/0x274786fe0d1947a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592578:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592580:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.592581:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.592621:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.592631:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592639:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x291:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.592641:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x291:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.592645:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592654:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592661:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592668:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592679:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.592684:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.592687:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592694:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.592698:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.592706:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593184:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593192:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca5c2869/0x274786fe0d1947ad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.593208:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.593210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.593267:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.593273:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593281:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x290:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.593284:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x290:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.593289:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593298:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593306:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593315:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593342:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398187.593384:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.593389:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593396:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28f:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.593399:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.593403:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593411:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593418:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593424:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593438:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.593806:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.593814:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593823:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.593832:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593842:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593855:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593862:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadbe998/0x274786fe0d1947b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593876:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.593879:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593885:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.593888:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593896:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593904:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593912:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001227d3b5/0x274786fe0d1947bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.593928:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.593929:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.593931:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.594404:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.594412:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594422:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28e:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.594426:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.594431:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594441:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594462:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594470:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594489:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.594499:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.594503:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594542:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.594545:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594554:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594566:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594574:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098f90fbb/0x274786fe0d1947c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594591:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.594593:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.594595:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.594646:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.594652:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594661:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28d:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.594664:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.594668:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594677:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594691:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594699:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594793:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.594802:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.594806:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594813:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.594817:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594825:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594836:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594844:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e23f5c5/0x274786fe0d1947c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594857:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.594864:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.594866:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.594911:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.594917:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594925:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28c:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.594928:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.594932:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594942:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594950:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.594958:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.595142:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595220:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.595228:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.595232:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595238:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.595241:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595258:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595269:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595275:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b54cab/0x274786fe0d1947d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595288:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595290:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595292:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.595339:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.595345:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595353:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28b:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.595356:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.595359:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595369:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595376:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595390:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595403:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.595409:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.595412:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595419:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.595422:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595430:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595441:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595461:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9acae8/0x274786fe0d1947d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595474:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595476:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595477:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.595535:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.595548:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595555:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28a:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.595558:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x28a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.595561:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595570:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595576:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595582:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595601:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787398187.595640:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.595645:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595653:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x289:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.595656:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.595659:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595679:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595686:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595693:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595704:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.595796:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.595801:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595808:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.595811:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595819:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595830:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595837:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187843ae/0x274786fe0d1947de lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595858:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.595861:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595867:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.595870:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595877:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595886:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595893:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edc452e5/0x274786fe0d1947e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.595904:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595906:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.595908:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.595951:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.595956:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596324:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x288:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.596333:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.596338:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596348:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596357:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596364:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596380:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.596388:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.596392:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596399:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.596402:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596409:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596419:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596436:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b517cd33/0x274786fe0d1947ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596460:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596462:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596463:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.596514:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.596541:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596549:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x287:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.596552:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.596556:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596563:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596570:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596577:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596588:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.596600:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.596604:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596625:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.596629:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596637:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596649:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596657:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bab821e1/0x274786fe0d1947f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596671:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596673:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596675:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.596800:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.596806:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596813:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x286:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.596816:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.596820:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596840:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596847:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596855:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596869:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.596877:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.596880:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596887:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e2c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.596892:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596899:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596910:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596918:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6e0e16/0x274786fe0d1947fa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.596939:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596940:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.596942:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.597192:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.597199:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597207:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x285:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.597211:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.597215:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597226:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597234:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597241:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597254:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.597260:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.597264:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597284:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.597288:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597297:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597309:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597316:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb08010/0x274786fe0d194801 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597332:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597334:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597336:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.597379:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.597384:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597392:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x284:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.597395:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.597399:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597409:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597424:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597431:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597454:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.597462:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.597467:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597474:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8099e3400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.597478:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597485:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597497:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597504:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef2bd5d/0x274786fe0d194808 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597555:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597563:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597564:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.597620:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.597622:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.597627:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597634:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x283:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.597637:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.597640:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597648:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597655:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597662:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597672:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.597680:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.597684:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597691:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83af21c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.597694:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597791:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597806:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597812:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f85b1a/0x274786fe0d19480f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597826:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597827:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.597829:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787398187.597872:0:101069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787398187.597878:0:101069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597887:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x282:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:1.0:1787398187.597890:0:101069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787398187.597895:0:101069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597904:0:101069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597911:0:101069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597924:0:101069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597938:0:101069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787398187.597945:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.597949:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.597956:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a83af20200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.599827:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.599848:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.599870:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.599879:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcbff3af/0x274786fe0d194816 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.599911:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.599913:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.599916:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398187.599982:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787398187.600656:0:101069:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:579 00000100:00100000:1.0:1787398187.601369:0:101069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:109284:x1874218701374976:12345-0@lo:5:osp-pre-1-1.0 Request processed in 21441us (21565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.601381:0:101069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787398187.601929:0:109284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a836530a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:109284:1874218701374976:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787398187.601945:0:109284:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x2a1:0x0] from OST, last_created [0x2c0000400:0x2a1:0x0]last_used is [0x2c0000400:0x243:0x0] 00000100:00100000:1.0:1787398187.602037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701375232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787398187.602083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.602157:0:109284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:109284:1874218701375360:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787398187.602186:0:109284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.602205:0:109284:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365466c0 going to sleep for 50 seconds 00000100:00100000:3.0:1787398187.602226:0:99642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375232 00000100:00100000:3.0:1787398187.602231:0:99642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375232 00000100:00100000:3.0:1787398187.602278:0:99642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787398187.602287:0:99642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701375232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787398187.602321:0:99642:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398187.605792:0:99642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874218701375232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3492us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398187.605807:0:99642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787398187.605950:0:108819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375360 00000100:00100000:3.0:1787398187.605958:0:108819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375360 00000100:00100000:3.0:1787398187.606001:0:108819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787398187.606009:0:108819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:109284:x1874218701375360:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787398187.606055:0:108819:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 674 00000100:00100000:1.0:1787398187.606923:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701375232:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787398187.607343:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.607388:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.607409:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607428:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a1:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.607432:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.607438:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607465:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607476:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607496:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607601:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.607876:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.607883:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607892:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a0:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.607895:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.607899:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.607909:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608115:0:15258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.608122:0:15258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608132:0:15258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.608137:0:15258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608147:0:15258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608165:0:15258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608172:0:15258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b0908c/0x274786fe0d19481d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.608191:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.608194:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.608196:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.608817:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608826:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608850:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.608922:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.608929:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608943:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29f:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.608946:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.608951:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608962:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608970:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.608978:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609073:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.609081:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609090:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aba00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.609101:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609109:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609121:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609129:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056711f6c/0x274786fe0d194824 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609146:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.609149:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.609151:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.609227:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.609281:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.609288:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.609297:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29e:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.609300:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.609305:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.609315:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.609335:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.609343:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609406:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787398187.609412:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609421:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050ab000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.609425:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609434:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609457:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609473:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cba1b0e8/0x274786fe0d19482b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609488:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.609491:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609498:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050abc00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.609502:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609510:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609548:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.609557:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.609559:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.609561:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.610838:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398187.610849:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8fc23bf/0x274786fe0d194832 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.610963:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.610971:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.610992:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29d:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.610996:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.611001:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611012:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611021:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611043:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611115:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.611122:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611130:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.611141:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611152:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611166:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611177:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611181:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611184:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.611250:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398187.611255:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e6eaf0/0x274786fe0d194839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.611311:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.611317:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611325:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29c:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.611328:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.611331:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611340:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611348:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611356:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611393:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.611399:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611406:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.611409:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611417:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611428:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611437:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611455:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611458:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.611516:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787398187.611537:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52855bf/0x274786fe0d194840 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.611592:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.611597:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611604:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.611607:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.611610:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611618:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611624:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611630:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611692:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398187.611694:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.611699:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611708:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aa000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.611712:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611720:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611732:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611739:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe575da/0x274786fe0d194847 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611759:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.611761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.611807:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.611813:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611827:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29a:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.611831:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.611835:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611846:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611854:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611862:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611882:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.611934:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.611940:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611948:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x299:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.611951:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.611955:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.611964:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.611993:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.611999:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612007:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a7050aac00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.612010:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612024:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612037:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612045:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001c0edb/0x274786fe0d19484e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612052:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612060:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612077:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398187.612087:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.612092:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612099:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.612104:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612112:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612125:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc85fe4c/0x274786fe0d194855 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612153:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612160:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.612219:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.612225:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612233:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x298:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.612236:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x298:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.612241:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612251:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612259:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612266:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612266:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.612269:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.612271:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612282:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398187.612289:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.612293:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612302:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.612306:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612324:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612337:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612344:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aeadb6b/0x274786fe0d19485c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612360:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612363:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612366:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.612424:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.612431:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612439:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x297:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.612442:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x297:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.612458:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612468:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612476:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612490:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612507:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398187.612552:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.612557:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.612574:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398187.612576:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe74400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.612579:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612580:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612588:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x296:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:0.0:1787398187.612589:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612592:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.612597:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612603:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612605:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612620:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612620:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a78001/0x274786fe0d194863 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612628:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612637:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.612640:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787398187.612640:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612647:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.612647:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a80fe75600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.612651:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612659:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612671:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612678:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047ecf766/0x274786fe0d19486a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.612691:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.612694:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.612695:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1787398187.612696:0:108819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:109284:x1874218701375360:12345-0@lo:5:osp-pre-1-1.0 Request processed in 6681us (10502us total) trans 8589934597 rc 0/0 00010000:00010000:0.0:1787398187.612697:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.612707:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612786:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x295:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.612789:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x295:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.612793:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612802:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612809:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612816:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612834:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.612875:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.612880:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612888:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.612890:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.612895:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612903:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612917:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612925:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612937:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398187.612945:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398187.612948:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612955:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.612958:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612965:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.612976:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613058:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e39819/0x274786fe0d194871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613071:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.613081:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613088:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.613091:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613098:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613109:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613117:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d05b121/0x274786fe0d194878 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613129:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613131:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613133:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.613177:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.613182:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613190:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x293:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.613193:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.613197:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613217:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613224:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613230:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613242:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398187.613249:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.613251:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613252:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613259:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62200 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.613262:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613270:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613279:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613286:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad953d5a/0x274786fe0d19487f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613305:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613307:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613308:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.613474:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.613480:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613487:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x292:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.613490:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x292:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.613494:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613503:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613510:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613517:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613551:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787398187.613560:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.613569:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613577:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.613580:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.613586:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398187.613588:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613590:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613600:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613608:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x291:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:0.0:1787398187.613608:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbf4257/0x274786fe0d194886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613611:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x291:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.613615:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613621:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.613622:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613624:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613624:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613632:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613639:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613656:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.613697:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398187.613701:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.613703:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613705:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613712:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63600 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.613716:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613735:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613745:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613752:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001feced3f/0x274786fe0d19488d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.613765:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.613767:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.613768:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.613791:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x290:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.613795:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x290:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.613799:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613809:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613828:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613835:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613852:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.613898:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.613903:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.613911:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.613913:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398187.614046:0:56853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.614048:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614051:0:56853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614058:0:56853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.614060:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614067:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614075:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614099:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398187.614107:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.614111:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614118:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e63e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.614122:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614130:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614141:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614147:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189a3be6/0x274786fe0d19489b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614160:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.614162:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.614164:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.614186:0:56853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614195:0:56853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.614203:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787398187.614206:0:56853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614207:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614215:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.614222:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787398187.614224:0:56853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f3930a/0x274786fe0d194894 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614226:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614236:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614238:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.614240:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.614242:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.614244:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614251:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614266:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.614305:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.614309:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614317:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28d:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.614319:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.614324:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614335:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.614340:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614346:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.614350:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614675:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614688:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614694:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaabe1a0/0x274786fe0d1948a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.614706:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.614708:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.614716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.614812:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614820:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614833:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614853:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.614897:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.614903:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614911:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28c:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.614913:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.614918:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614927:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614935:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614941:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614954:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398187.614962:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398187.614965:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.614978:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.615066:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.615072:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.615079:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:0.0:1787398187.615083:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.615090:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.615100:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.615107:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440e12e1/0x274786fe0d1948b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.615122:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.615124:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787398187.615126:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.615151:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615162:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615173:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615181:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b44d7d3/0x274786fe0d1948a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.615196:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.615198:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.615240:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.615246:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615253:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.615256:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.615260:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615269:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615283:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615297:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615408:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787398187.615458:0:108819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00010000:2.0:1787398187.615466:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.615473:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615481:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28a:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.615483:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.615486:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615495:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615502:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615509:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615583:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398187.615590:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398187.615594:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615601:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a835e62c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.615605:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615612:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615623:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615631:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c10fab/0x274786fe0d1948b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615646:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.615649:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615654:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1e00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.615657:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615678:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615690:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615698:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001bf63ea/0x274786fe0d1948be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615732:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.615734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.615736:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787398187.615798:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.615804:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615811:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x289:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.615814:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.615818:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615826:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615833:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615846:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615862:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.615905:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.615911:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615919:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.615923:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.615927:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615943:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615951:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615957:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.615971:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787398187.615978:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787398187.616056:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616072:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.616077:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616084:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616096:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616105:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b6f799/0x274786fe0d1948c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616122:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787398187.616125:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616128:0:109284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:109284:1874218701375360:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1787398187.616139:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0000 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.616144:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787398187.616150:0:109284:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x2a1:0x0]-[0x2c0000400:0x2c1:0x0] 00010000:00010000:2.0:1787398187.616152:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616166:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616179:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f455cb8b/0x274786fe0d1948cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616191:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.616194:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.616196:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398187.616199:0:109284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:109284:1874218701375488:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1787398187.616239:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.616245:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616252:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x287:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.616255:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.616259:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616269:0:109284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787398187.616273:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616282:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616289:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616302:0:109284:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365466c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787398187.616302:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787398187.616318:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787398187.616321:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.616323:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616327:0:107274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375488 00010000:00010000:2.0:1787398187.616344:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:2.0:1787398187.616348:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616350:0:107274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375488 00010000:00010000:2.0:1787398187.616359:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616371:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616378:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005ac48ff/0x274786fe0d1948d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616396:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398187.616398:0:107274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787398187.616400:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.616404:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398187.616411:0:107274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:109284:x1874218701375488:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1787398187.616461:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.616467:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616476:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x286:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.616481:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.616485:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616504:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787398187.616512:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.616513:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.616608:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787398187.616932:0:107274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:109284:x1874218701375488:12345-0@lo:900:osp-pre-1-1.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398187.616942:0:107274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787398187.616974:0:109284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:109284:1874218701375488:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787398187.619136:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.619173:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.619295:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.619304:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619320:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x285:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.619324:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.619341:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619355:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619365:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619385:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619465:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787398187.619516:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.619552:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619562:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x284:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.619565:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.619568:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619577:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619584:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.619592:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619659:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787398187.619668:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619676:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0400 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398187.619680:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619689:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000417cc572/0x274786fe0d1948da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619739:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787398187.619743:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619751:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1800 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398187.619755:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619763:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619788:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619796:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c08adaa/0x274786fe0d1948e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619811:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787398187.619815:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619821:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:3.0:1787398187.619824:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619831:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619839:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787398187.619845:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398187.619847:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398187.619849:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.620054:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787398187.620069:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398187.620101:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787398187.620138:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c02bfcf/0x274786fe0d1948e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787398187.620237:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.620243:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620251:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x283:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.620254:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.620258:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620272:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620280:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620286:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620310:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787398187.620346:0:99639:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787398187.620351:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620359:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x282:0x0].0x0 since=4066s v=(0 0) 00010000:00010000:2.0:1787398187.620362:0:99639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787398187.620373:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620381:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620389:0:99639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620396:0:99639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787398187.620425:0:99639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787398187.621108:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787398187.621115:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621124:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a1a00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.621128:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621135:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621150:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621158:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c667a0bb/0x274786fe0d1948ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621174:0:56852:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787398187.621177:0:56852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621183:0:56852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89a8016a0c00 already unused, calling callback (ffffffffc0e6de90) 00010000:00010000:1.0:1787398187.621186:0:56852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621203:0:56852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621213:0:56852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621219:0:56852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a931c0d/0x274786fe0d1948f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787398187.621230:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.621232:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398187.621233:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787398187.621417:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787398187.622270:0:99639:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:578 00000100:00100000:2.0:1787398187.622386:0:99639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a70230fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:109282:x1874218701375104:12345-0@lo:5:osp-pre-0-1.0 Request processed in 41506us (41734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398187.622397:0:99639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787398187.622794:0:109282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:109282:1874218701375104:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787398187.622819:0:109282:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x2a1:0x0] from OST, last_created [0x280000400:0x2a1:0x0]last_used is [0x280000400:0x242:0x0] 00000100:00100000:3.0:1787398187.622885:0:109282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:109282:1874218701375744:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787398187.622921:0:109282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.622945:0:109282:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365466c0 going to sleep for 50 seconds 00000100:00100000:1.0:1787398187.623181:0:108820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375744 00000100:00100000:1.0:1787398187.623189:0:108820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375744 00000100:00100000:1.0:1787398187.623247:0:108820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787398187.623256:0:108820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:109282:x1874218701375744:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787398187.623295:0:108820:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 674 00000100:00100000:2.0:1787398187.624102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701375616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787398187.624160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398187.624212:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375616 00000100:00100000:2.0:1787398187.624217:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375616 00000100:00100000:2.0:1787398187.624252:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787398187.624259:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701375616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398187.624276:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 896 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398187.624316:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701375616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398187.624323:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787398187.624371:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701375616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398187.625512:0:108820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:109282:x1874218701375744:12345-0@lo:5:osp-pre-0-1.0 Request processed in 2254us (2587us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787398187.625546:0:108820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787398187.625778:0:109282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:109282:1874218701375744:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787398187.625793:0:109282:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x2a1:0x0]-[0x280000400:0x2c1:0x0] 00000100:00100000:3.0:1787398187.625829:0:109282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:109282:1874218701375872:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787398187.625869:0:109282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398187.625899:0:109282:0:(client.c:2702:ptlrpc_set_wait()) set ffff89a8365466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787398187.625957:0:107275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701375872 00000100:00100000:1.0:1787398187.625975:0:107275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701375872 00000100:00100000:1.0:1787398187.626072:0:107275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787398187.626080:0:107275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:109282:x1874218701375872:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787398187.626133:0:107275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:109282:x1874218701375872:12345-0@lo:900:osp-pre-0-1.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398187.626151:0:107275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787398187.626218:0:109282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:109282:1874218701375872:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787398187.878225:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787398188.227997:0:109592:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787398188.228233:0:109592:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787398188.758731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398188.758791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398188.758827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.60@tcp (source: 12345-192.168.204.60@tcp) 00000100:00100000:1.0:1787398188.759122:0:107280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379456 00000100:00100000:1.0:1787398188.759135:0:107280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379456 00000100:00100000:1.0:1787398188.759212:0:107280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 142 00000100:00100000:1.0:1787398188.759225:0:107280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681379456:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:1.0:1787398188.759317:0:107280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5696550-1ffc-466d-b13d-359d59b5fc5f+10:2402:x1874218681379456:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 94us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787398188.759326:0:107280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 142 00000100:00100000:3.0:1787398188.769920:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379584 00000100:00100000:3.0:1787398188.769944:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379584 00000100:00100000:3.0:1787398188.770065:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218681379712 00000100:00100000:3.0:1787398188.770069:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218681379712 00000100:00100000:3.0:1787398188.770107:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787398188.770120:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681379584:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398188.770252:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681379584:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 134us (11534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398188.770262:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 86 00000100:00100000:3.0:1787398188.770284:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00100000:3.0:1787398188.770292:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681379712:12345-192.168.204.60@tcp:400:kworker.0 00000100:00100000:3.0:1787398188.770323:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:784819ec-79bc-4534-8fa6-902d7a92d2f8+6:2402:x1874218681379712:12345-192.168.204.60@tcp:400:kworker.0 Request processed in 31us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398188.770331:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.60@tcp, seq: 87 00000100:00080000:3.0:1787398188.770376:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787398188.902904:0:56853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787398189.349913:0:109642:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787398189.350153:0:109642:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787398189.926729:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787398190.950397:0:56852:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787398191.913056:0:109690:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_201: @@@@@@ FAIL: Cascading timeouts on disconnect 00010000:00010000:1.0:1787398191.977163:0:15258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787398192.104009:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701376000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787398192.104109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398192.104783:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787398192.104798:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701376256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787398192.104850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398192.104887:0:99650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376256 00000100:00100000:3.0:1787398192.104896:0:99650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376256 00000100:00100000:3.0:1787398192.105075:0:99650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787398192.105086:0:99650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701376256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787398192.105132:0:99650:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445126144 avail 1298886656 00000100:00100000:3.0:1787398192.105184:0:99650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874218701376256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.105191:0:99650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787398192.105223:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701376128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787398192.105252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398192.105300:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018905 gen 2 00000004:00080000:3.0:1787398192.105307:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018902 committed transno 128849018905 00000004:00080000:3.0:1787398192.105331:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018903 committed transno 128849018905 00000004:00080000:3.0:1787398192.105344:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018904 committed transno 128849018905 00000004:00080000:3.0:1787398192.105356:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018905 committed transno 128849018905 00000100:00100000:3.0:1787398192.105386:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701376256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787398192.105487:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376000 00000100:00100000:2.0:1787398192.105492:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376000 00000100:00100000:2.0:1787398192.105571:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376128 00000100:00100000:2.0:1787398192.105575:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376128 00000100:00100000:2.0:1787398192.105595:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787398192.105605:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701376000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787398192.105630:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1787398192.105684:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874218701376000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398192.105691:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787398192.105704:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787398192.105711:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701376128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787398192.105729:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398192.105759:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874218701376128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398192.105765:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787398192.105801:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1874218701376000:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787398192.105933:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398192.105938:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787398192.106037:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701376128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787398192.612787:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787398192.612825:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701376768:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.612931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.612973:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a803435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701376384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398192.612992:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701376640:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398192.613042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613173:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701377280:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613223:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787398192.613229:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701376896:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613273:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701377408:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613338:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376384 00000100:00100000:0.0:1787398192.613356:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376384 00000100:00100000:3.0:1787398192.613390:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701377152:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613419:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787398192.613432:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613435:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701376384:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787398192.613455:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701377664:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.613483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1787398192.613486:0:99649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445552128 avail 1299312640 00000100:00100000:3.0:1787398192.613507:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787398192.613514:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701376512:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613575:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874218701376384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.613581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613590:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787398192.613615:0:99649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377152 00000100:00100000:0.0:1787398192.613619:0:99649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377152 00000100:00100000:3.0:1787398192.613620:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701377024:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613643:0:99649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787398192.613654:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613655:0:99649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701377152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.613672:0:3651:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701377536:0@lo:400:kworker.0 00000100:00100000:0.0:1787398192.613700:0:99649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3651:x1874218701377152:12345-0@lo:400:kworker.0 Request processed in 49us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.613708:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787398192.613712:0:99649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787398192.613757:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1874218701377152:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.613789:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376768 00000100:00100000:3.0:1787398192.613793:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376768 00000100:00100000:3.0:1787398192.613828:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376640 00000100:00100000:3.0:1787398192.613831:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376640 00000100:00100000:3.0:1787398192.613843:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377280 00000100:00100000:3.0:1787398192.613845:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377280 00000100:00100000:3.0:1787398192.613855:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376896 00000100:00100000:3.0:1787398192.613857:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376896 00000100:00100000:3.0:1787398192.613874:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377664 00000100:00100000:3.0:1787398192.613877:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377664 00000100:00100000:3.0:1787398192.613887:0:107264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377024 00000100:00100000:3.0:1787398192.613889:0:107264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377024 00000100:00100000:3.0:1787398192.613914:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787398192.613922:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701376768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.613958:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874218701376768:12345-0@lo:400:kworker.0 Request processed in 38us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.613966:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787398192.613977:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787398192.613985:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787398192.613993:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701376640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.613997:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701377280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614043:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874218701377280:12345-0@lo:400:kworker.0 Request processed in 51us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.614050:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787398192.614063:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a835b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874218701376640:12345-0@lo:400:kworker.0 Request processed in 75us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.614066:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787398192.614078:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701376896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614079:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787398192.614102:0:107263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787398192.614117:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874218701376896:12345-0@lo:400:kworker.0 Request processed in 41us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398192.614122:0:107263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701377664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614129:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787398192.614145:0:107264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787398192.614152:0:107264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701377024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614181:0:107263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874218701377664:12345-0@lo:400:kworker.0 Request processed in 63us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398192.614190:0:107263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787398192.614196:0:107264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1874218701377024:12345-0@lo:400:kworker.0 Request processed in 43us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.614203:0:107264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787398192.614236:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377408 00000100:00100000:3.0:1787398192.614242:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377408 00000100:00100000:2.0:1787398192.614263:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787398192.614274:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701377792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398192.614278:0:99640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377536 00000100:00100000:3.0:1787398192.614283:0:99640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377536 00000100:00100000:2.0:1787398192.614314:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787398192.614326:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787398192.614336:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a803435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701377408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614362:0:99643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377792 00000100:00100000:2.0:1787398192.614367:0:99643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377792 00000100:00100000:3.0:1787398192.614397:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a803435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701377408:12345-0@lo:400:kworker.0 Request processed in 62us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.614405:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787398192.614409:0:99643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787398192.614420:0:99643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874218701377792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398192.614426:0:99640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787398192.614436:0:99640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701377536:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787398192.614444:0:99643:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1787398192.614468:0:99640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a82ebd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3651:x1874218701377536:12345-0@lo:400:kworker.0 Request processed in 34us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787398192.614475:0:99640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787398192.614493:0:99643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a8178dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874218701377792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398192.614501:0:99643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1787398192.614517:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787398192.614546:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787398192.614549:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787398192.614552:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787398192.614594:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835e53100 x1874218701377024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787398247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398192.614609:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1874218701377024:0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614610:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1874218701377792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787398192.614630:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1874218701377536:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614645:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1874218701376640:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614660:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874218701377664:0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614672:0:107281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701376512 00000100:00100000:2.0:1787398192.614677:0:107281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701376512 00000100:00100000:3.0:1787398192.614729:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1874218701376896:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614744:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a81816ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701377408:0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.614750:0:107281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787398192.614760:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a7016f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874218701377280:0@lo:400:kworker.0 00010000:00080000:3.0:1787398192.614773:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89a835e50a80 x1874218701376768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787398247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787398192.614794:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1874218701376768:0@lo:400:kworker.0 00000100:00100000:3.0:1787398192.614811:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a803435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1874218701376384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787398192.614987:0:107281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701376512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.615041:0:107281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a828827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99b57a74-e5dc-42df-b087-b10fad741506+24:3651:x1874218701376512:12345-0@lo:400:kworker.0 Request processed in 72us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787398192.615281:0:3651:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a835e51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99b57a74-e5dc-42df-b087-b10fad741506:3651:1874218701376512:0@lo:400:kworker.0 00000100:00100000:2.0:1787398192.618464:0:107281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:3.0:1787398193.000246:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787398193.124805:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787398193.124829:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701377920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787398193.124900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787398193.124984:0:102958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874218701377920 00000100:00100000:2.0:1787398193.124992:0:102958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874218701377920 00000100:00100000:2.0:1787398193.125049:0:102958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787398193.125059:0:102958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89a836530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701377920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787398193.125092:0:102958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787398193.125145:0:102958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89a836530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874218701377920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787398193.125153:0:102958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787398193.125413:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89a8178de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1874218701377920:0@lo:13:osp-pre-0-1.0 Debug log: 118713 lines, 118713 kept, 0 dropped, 0 bad.